Commit Graph

274 Commits

Author SHA1 Message Date
HaraldSchafer 08846b5c0e Torch model (#2452)
* refactor draw model

* rebase master

* correct valid_len

* rename function

* rename variables

* white space

* rebase to master

* e16c13ac-927d-455e-ae0a-81b482a2c787

* start rewriting

* save proress

* compiles!

* oops

* many fixes

* seems to work

* fix desires

* finally cleaned

* wrong std for ll

* dont pulse none

* compiles!

* ready to test

* WIP does not compile

* compiles

* various fixes

* does something!

* full 3d

* not needed

* draw up to 100m

* fix segfault

* wrong sign

* fix flicker

* add road edges

* finish v2 packet

* Added pytorch supercombo

* fix rebase

* no more keras

* Hacky solution to the NCHW/NHWC incompatibility between SNPE and our frame data

* dont break dmonitoringd, final model 229e3ce1-7259-412b-85e6-cc646d70f1d8/430

* fix hack

* Revert "fix hack"

This reverts commit 5550fc01a7881d065a5eddbbb42dac55ef7ec36c.

* Removed axis permutation hack

* Folded padding layers into conv layers

* Removed the last pad layer from the dlc

* Revert "Removed the last pad layer from the dlc"

This reverts commit b85f24b9e1d04abf64e85901a7ff49e00d82020a.

* Revert "Folded padding layers into conv layers"

This reverts commit b8d1773e4e76dea481acebbfad6a6235fbb58463.

* vision model: 5034ac8b-5703-4a49-948b-11c064d10880/780  temporal model: 229e3ce1-7259-412b-85e6-cc646d70f1d8/430  with permute + pool opt

* fix ui drawing with clips

* ./compile_torch.py 5034ac8b-5703-4a49-948b-11c064d10880/780 dfcd2375-81d8-49df-95bf-1d2d6ad86010/450 with variable history length

* std::clamp

* not sure how this compiled before

* 2895ace6-a296-47ac-86e6-17ea800a74e5/550

* db090195-8810-42de-ab38-bb835d775d87/601

* 5m is very little

* onnx runner

* add onnxruntime to pipfile

* run in real time without using the whole CPU

* bump cereal;

* add stds

* set road edge opacity based on stddev

* don't access the model packet in paint

* convert mat.h to a c++ header file (#2499)

* update tests

* safety first

Co-authored-by: deanlee <deanlee3@gmail.com>
Co-authored-by: mitchell <mitchell@comma.ai>
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: George Hotz <george@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2020-11-11 20:31:46 -08:00
ZwX1616 faf8b1fd82 continued: Update DM awareness times (#2527)
* Gets us 6 seconds before making sound (up from 2s; 9s originally)

* Average last two awareness times

* This alert shows up every ~20 seconds, distracting

* Revert "Average last two awareness times"

This reverts commit 2fd7e7a44c708039e1692dcc14ee913ef88bb37e.

* update ref

* update test

* update ref

Co-authored-by: Shane Smiskol <shane@smiskol.com>
2020-11-11 14:24:32 -08:00
HaraldSchafer f7d1ace883 Fix lane width (#2520)
* use prob modifiers in lane width calc

* update ref

* update ref
2020-11-10 21:12:36 -08:00
HaraldSchafer 26583b1b85 No uncertain ll (#2495)
* initial, needs tune

* support metrics

* a little more

* wrong type

* fixup

* update refs
2020-11-06 21:01:16 -08:00
HaraldSchafer e6668625fa set y too (#2448)
* set y too

* new ref
2020-11-04 19:52:05 -08:00
Adeeb Shihadeh 89d02dcf97 check for safety mode mismatch (#2443) 2020-11-04 11:12:15 -08:00
Adeeb Shihadeh 47c21f10f5 grey panda is unsupported (#2458) 2020-11-03 19:56:25 -08:00
Adeeb Shihadeh 3795920750 update process replay test routes (#2482)
* update bosch route

* update rfs

* bump refs
2020-11-03 18:44:35 -08:00
Adeeb Shihadeh 4d0745504b Car Port: Lexus NX300 (#2481)
* Adding 2018 Lexus NX 300

* adding test model

* Update README.md

adding lexus nx 300 to readme

* update route

* add nx dbc to release files

* fix readme

* add to release notes

Co-authored-by: matt12eagles <matt12eagles@gmail.com>
2020-11-03 15:43:52 -08:00
Adeeb Shihadeh 719c5e3598 ubuntu 16.04 -> 20.04 (#2378) 2020-10-29 16:51:09 -07:00
NiCK.n17 a0b40984af Car Port: 2020 Kia Niro EV (#2416) 2020-10-28 16:13:31 -07:00
Adeeb Shihadeh bdfb0488a8 fix cpu test thresholds after downclock 2020-10-26 15:22:45 -07:00
Adeeb Shihadeh 88b956528e camera malfunction alert (#2391)
* camera malfunction alert

* bump cereal

* fix process replay

* ugh, needs refactor
2020-10-22 16:28:54 -07:00
Kumar 2a6765580c Car Port: Prius 2021 TSS2 (#2163) 2020-10-22 13:39:44 -07:00
ZwX1616 53bd3050ee infinite sound (#2372)
* make sound infinite loopable

* Update selfdrive/ui/android/sl_sound.cc

* fix loop

* fix test threshold

* more fix

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
2020-10-20 17:42:19 -07:00
Adeeb Shihadeh 32496626b2 numpy tolerance for INDI 2020-10-19 23:29:22 -07:00
Adeeb Shihadeh 516da927f9 add cars with LQR and INDI lat control to process replay (#2363)
* add cars that use LQR and INDI lat control to process replay

* bump ref commit
2020-10-19 21:18:50 -07:00
Chris Souers dc8b5538e8 Add 2020 Acura RDX (#1557)
Update CAN Fingerprint

Update files_common

Update test_car_models.py
2020-10-18 19:03:04 -07:00
ZwX1616 6b020241c9 Clean up and test camerad refactor (#2310)
* refactor

add function get_camerabuf_by_type

remove cl_free

use camera_id

move front stuff into frontview_thread

bigger refactor

more

typo

rename camerabuf *c to *b

cleanup header files

remove wideview_thread

camera_qcom.c to c++

fix SConscript

camera_process_buf

space

sendrgb same with before

do autoexposure in processing_thread

correct sendrgb

add camera_common.cc

move yuv_transform to CameraBuf

* use C to keep consitent

* rebase master

* rebase master

* continue refactor

* refactor all camera related data&function out of main

 done

* cleanup

* -use buf.rgb_width&height

* remoe ,

* rebase master

* remove unused std::vector

* add func common_camera_process_front

* fix max

* fix sendrgb

* less crap being logged

* fix indents

* add back thumbnails

* thumbnail fixed on tici

* junk junk junk

* unify api

* fix ptr ref

* lol!

* cleanup

* more simplified

* typos

* remove terminate

* use standard polling

* ops_thread refactor, too much code!

* fix build

* ok

* assert

* listen

* incl more

* wq!

* fix more build

* macos

* fix exp targets

* front is different

* const

* bye

* remath

* remove irrelevant

* do ops in a thread

* fix init

* return null

* QCOM2 ops

* qcom2 build

* missing comma

Co-authored-by: deanlee <deanlee3@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
2020-10-16 21:58:05 -07:00
Adeeb Shihadeh 725e3b78ea HKG fixups (#2342)
* fix hyundai blinker state

* consistency with update_speed

* update refs

* make hyundai resume reliable

* update refs

* 20 works

* don't need that

Co-authored-by: Greg Hogan <gregjhogan@gmail.com>
2020-10-14 18:27:27 -07:00
Adeeb Shihadeh ae4b4bd125 Alert cleanup (#2274)
* no more focus recover active

* consistency

* more permanent

* dm alerts

* sanity check test

* no please

* clean that up

* update refs

* one more

* bump cereal
2020-10-14 15:56:18 -07:00
Adeeb Shihadeh 1c6905cac1 clear irrelevant alerts on state transition (#2318)
* cleanup

* clear warnings

* more types

* needs refactor

* update refs

* update refs
2020-10-14 14:08:15 -07:00
Willem Melching 2e182e5c57 Params refactor, simplified (#2300)
* always c++

* Create C++ params class

* get works

* tests hang now

* passes tests

* cleanup string formatting

* handle interrupt in blocking read

* fix memory leak

* remove unused constructor

* Use delete_db_value directly

* Rename put -> write_db_value

* filename cleanup

* no semicolons in cython

* Update common/SConscript

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* add std::string version of delete_db_value

* This is handled

* cleanup encoding

* Add clear method to clear all

* add persistent params

* fix android build

* Should be called clear_all

* only import params when needed

* set params path on manager import

* recusrively create directories

* Fix function order

* cleanup mkdirp

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
2020-10-13 16:23:23 +02:00
grekiki fc1d01be81 add caching to CI tests (#2269)
* first caching attempt

* caching attempt

* caching attempt

* caching attempt

* caching attempt

* caching attempt

* dump logs

* does this work?

* Create cache folder

* Print folder contents

* Fix volume mount

* Update test.yaml

* add removed tests

* reduce diff

* reduce diff

* reduce diff

* reduce diff

* reduce diff

* readd coverage upload

* Update test.yaml

* add more caching

* Use hash of test file to compute cache key

* add cache to valgrind tests

* Update .github/workflows/test.yaml

Co-authored-by: Willem Melching <willem.melching@gmail.com>

* Update .github/workflows/test.yaml

Co-authored-by: Willem Melching <willem.melching@gmail.com>

* Also hash workflow yaml

Co-authored-by: Willem Melching <willem.melching@gmail.com>
2020-10-13 15:38:13 +02:00
grekiki 870644b59e Process replay for C++ daemons (#2288)
* more like a stash

* mem

* comment cpp

* remove some tests

* WORKSpython test_processes.py python test_processes.py

* all tests work, time to clean up

* initialize cleanup

* fix spaces

* refactor

* Update selfdrive/test/process_replay/process_replay.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* revert debug change

* mini refactor

* remove submaster

* update README

* add delay

* check for missaligned start

* Update compare_logs.py

* should finally work now, I hope...

* update comment

* real fix

* real fix now

* fix styling

* fix styling

* Update process_replay.py

* fix code review

* speed up tests

* Update selfdrive/test/process_replay/process_replay.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Update selfdrive/test/process_replay/process_replay.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* fix reviews

* nicer code

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2020-10-12 11:18:53 +02:00
Adeeb Shihadeh d5796e07e2 more accurate profiling (#2287) 2020-10-10 15:17:02 -07:00
Adeeb Shihadeh cb85a19350 add timeout to modeld replay 2020-10-09 16:25:21 -07:00
Adeeb Shihadeh 024c33e724 add acura rdx test route 2020-10-09 13:57:58 -07:00
Adeeb Shihadeh f1c3662311 report git branch to testing closet 2020-10-06 21:00:19 -07:00
Willem Melching 079c878adf Update radard cpu usage 2020-10-06 12:16:12 +02:00
Adeeb Shihadeh 176c06499d write car params before profiling 2020-10-05 21:34:57 -07:00
Adeeb Shihadeh 6709106025 don't want to profile that 2020-10-05 20:48:23 -07:00
Adeeb Shihadeh 0d11acf34e paramsd profiling 2020-10-05 20:41:24 -07:00
Willem Melching 3f88df62c7 Fix calibration invalid alert on startup (#2270)
* change controlsd calibration initial value

* update refs

* update refs

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2020-10-05 19:16:52 -07:00
ZwX1616 21d4ac1eeb Reduced wheel touch time (#2259)
* decrease wheel touch time

* update refs

* fix unittest

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2020-10-05 14:39:24 -07:00
grekiki a09fd7c860 CI: Add valgrind (#2245)
* prepare a test for valgrind by fixing linter issues

* something went wrong

* Try update cereal

* Not working, fixing replay_learning.py

* Testing

* Testing

* Working now

* More logs, a bit of cleaning, still no idea how this works

* Ok got 10% cleaning done

* trying some stackOverflow code

* Lots of cleaning

* wip

* Delete valgrind_testing.py

* Delete replay_learning.py

* Add to CI, cannot fail though

* Add to CI, cannot fail though

* Now the unit test should fail

* Dump valgrind output in case of a failure

* fix subrepos

* fix subs

* hopefully fixes every issue that we have

* wait for message confirmation

* Revert "wait for message confirmation"

This reverts commit ad7ba280ec6536015ac1a442c9732bfe42fd5664.

* fix local issues

* Revert "fix local issues"

This reverts commit 4498df21df471fa6e9360d50407eaefdf24ae69f.

* attempt 3 to fix things

* untested function extraction

* refactor

* add valgrind task

* add delay and BASEDIR

* Make test not fail, it is not designed for that

* fix subrepositories

* fix tests

* Real fix now :)

* scons

* ... stupid CI

* fix valgrind CI

* Update test.yaml

* Update test.yaml

* Update test.yaml

* add valgrind logs as file

* remove delays

* kill process more reliably

* rename action

* small cleanup

* fix casting to int in case of large leaks

Co-authored-by: Willem Melching <willem.melching@gmail.com>
2020-10-05 16:09:32 +02:00
Adeeb Shihadeh a77548bff6 radard cleanup (#2266)
* some cleanup

* more realistic profiling

* Update selfdrive/controls/radard.py

Co-authored-by: Willem Melching <willem.melching@gmail.com>

Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
2020-10-05 11:37:39 +02:00
Adeeb Shihadeh df6a66c785 radard profiling (#2265) 2020-10-04 15:55:25 -07:00
Adeeb Shihadeh 427d4a5a9e run loggerd tests in CI (#2241)
* run loggerd tests in jenkins

* fast

* check segs on the fly

* missing import

* wait for dir

* no thread

* relax FILE_SIZE_TOLERANCE

* cleanup

* unused

* set ci flag

* wait longer for first seg

* fix race condition with setting RecordFront

Co-authored-by: ZwX1616 <zwx1616@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
2020-10-01 18:42:43 -07:00
Adeeb Shihadeh 67aec50b88 Increase HKG torque limit (#2249)
* increase hkg torque limit

* update refs

* bump panda
2020-10-01 13:16:51 -07:00
Willem Melching 1c6fb56769 simplify testing closet client 2020-10-01 16:01:34 +02:00
Comma Device 3f0491b7e5 update testing closet client 2020-10-01 06:52:59 -07:00
qadmus cba53957bd Fix grade force in test_long plant (#2225)
Co-authored-by: user <email@web.com>
2020-09-28 11:54:48 +02:00
Adeeb Shihadeh 0040ac987a add type hints to selfdrive/version.py 2020-09-19 14:55:27 -07:00
Adeeb Shihadeh ef21b83937 Improve realtime performance on NEOS (#2166)
* fix setting core affinity

* dmonitoringd doesn't need rt priority

* android only gets two cores

* model and planner get core 2

* log missed cycle count

* neos update

* prod image

* revert NEOS changes

* still need this
2020-09-16 15:33:12 -07:00
ZwX1616 a2adfdb155 Cut down unnecessary DM uncertain alerts (#2157)
* cut down high std alerts

* clean comments

* uncertain curve tune

* update test gt

* update refs

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2020-09-14 10:43:19 -07:00
Adeeb Shihadeh e0004d0981 Reduce paramsd and calibrationd CPU usage (#2119)
* reduce paramsd cpu

* reduce calibrationd cpu usage

* calibration_helpers was mostly unused

* more calibration cleanup

* update refs

* fix thresholds in CPU test
2020-09-10 12:16:29 -07:00
Jafar Al-Gharaibeh 6c292c3f0c Split car identities to CX5, CX9, and Mazda3 (#2097)
Add test routes for CX9 and Mazda3

CX9: "10b5a4b380434151|2020-08-26--17-11-45"

Mazda3: "74f1038827005090|2020-08-26--20-05-50"

Signed-off-by: Jafar Al-Gharaibeh <to.jafar@gmail.com>
2020-09-09 16:02:26 -07:00
Adeeb Shihadeh 9cd88526b5 hide camera view when in reverse (#2144)
* partially hide camera view when in reverse

* lowest priority

* update ref commit

* fix type

* update refs
2020-09-09 00:11:12 -07:00
Adeeb Shihadeh 5838a88a3f update refs after new alert 2020-09-04 14:09:26 -07:00