Commit Graph

329 Commits

Author SHA1 Message Date
HaraldSchafer 7c8ea30532 fix frame drop percentage (#2578)
* correct, I think

* add model execution time

* remove unused

* token is a file

* this is gonna change

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 7378bc42845a094bbb22fb76154cb40ecb098aaf
2020-11-19 21:05:29 -08:00
Adeeb Shihadeh 597759d16c model replay improvements (#2580)
old-commit-hash: 67382242824d7dafcd5e450f6279673cc28f0513
2020-11-19 16:47:14 -08:00
HaraldSchafer c4d50c0bf0 preinit locationd filter (#2569)
* preinit

* update ref commit
old-commit-hash: 9f5dfb74f97cc8cdd1e0d25055ebc98ca9f5ee79
2020-11-19 15:14:35 -08:00
HaraldSchafer faad598e29 Minor fixes 08 (#2565)
* correct indexes

* best metrics yet 30231f46-08af-477e-9d30-776593913c24/700

* sometimes x decreases

* update model refs

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 7b216e7cbb30f9a7b164cc17bb66b348d728b65e
2020-11-17 20:04:32 -08:00
Adeeb Shihadeh 8385349af7 update model refs
old-commit-hash: 448734dbfdf1a29f8d121e918e04417ed27bd7e8
2020-11-14 18:05:13 -08:00
Adeeb Shihadeh 252ebb6788 cpu usage test debug print
old-commit-hash: d0ebf09d561b60dd6602e932e6d0ab6b4cad1830
2020-11-14 14:05:54 -08:00
ZwX1616 3da8dc9b25 use enabled flag from controlsState instead of carState (#2518)
* use enabled from controls instead of carstate

* update process replay

* rm

* fix long test

* update reff

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: d8fea41b2af0de53d649612513535d9f9595c088
2020-11-12 17:30:33 -08:00
HaraldSchafer 008f37c749 Torch model (#2452)
* refactor draw model

* rebase master

* correct valid_len

* rename function

* rename variables

* white space

* rebase to master

* e16c13ac-927d-455e-ae0a-81b482a2c787

* start rewriting

* save proress

* compiles!

* oops

* many fixes

* seems to work

* fix desires

* finally cleaned

* wrong std for ll

* dont pulse none

* compiles!

* ready to test

* WIP does not compile

* compiles

* various fixes

* does something!

* full 3d

* not needed

* draw up to 100m

* fix segfault

* wrong sign

* fix flicker

* add road edges

* finish v2 packet

* Added pytorch supercombo

* fix rebase

* no more keras

* Hacky solution to the NCHW/NHWC incompatibility between SNPE and our frame data

* dont break dmonitoringd, final model 229e3ce1-7259-412b-85e6-cc646d70f1d8/430

* fix hack

* Revert "fix hack"

This reverts commit 5550fc01a7881d065a5eddbbb42dac55ef7ec36c.

* Removed axis permutation hack

* Folded padding layers into conv layers

* Removed the last pad layer from the dlc

* Revert "Removed the last pad layer from the dlc"

This reverts commit b85f24b9e1d04abf64e85901a7ff49e00d82020a.

* Revert "Folded padding layers into conv layers"

This reverts commit b8d1773e4e76dea481acebbfad6a6235fbb58463.

* vision model: 5034ac8b-5703-4a49-948b-11c064d10880/780  temporal model: 229e3ce1-7259-412b-85e6-cc646d70f1d8/430  with permute + pool opt

* fix ui drawing with clips

* ./compile_torch.py 5034ac8b-5703-4a49-948b-11c064d10880/780 dfcd2375-81d8-49df-95bf-1d2d6ad86010/450 with variable history length

* std::clamp

* not sure how this compiled before

* 2895ace6-a296-47ac-86e6-17ea800a74e5/550

* db090195-8810-42de-ab38-bb835d775d87/601

* 5m is very little

* onnx runner

* add onnxruntime to pipfile

* run in real time without using the whole CPU

* bump cereal;

* add stds

* set road edge opacity based on stddev

* don't access the model packet in paint

* convert mat.h to a c++ header file (#2499)

* update tests

* safety first

Co-authored-by: deanlee <deanlee3@gmail.com>
Co-authored-by: mitchell <mitchell@comma.ai>
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: George Hotz <george@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 08846b5c0ec3a5299c8cb73904da15a18d3aaccf
2020-11-11 20:31:46 -08:00
ZwX1616 b0bb9daf21 continued: Update DM awareness times (#2527)
* Gets us 6 seconds before making sound (up from 2s; 9s originally)

* Average last two awareness times

* This alert shows up every ~20 seconds, distracting

* Revert "Average last two awareness times"

This reverts commit 2fd7e7a44c708039e1692dcc14ee913ef88bb37e.

* update ref

* update test

* update ref

Co-authored-by: Shane Smiskol <shane@smiskol.com>
old-commit-hash: faf8b1fd826575c179e6442d5f4f1055eeecb11c
2020-11-11 14:24:32 -08:00
HaraldSchafer b7ae2e9e85 Fix lane width (#2520)
* use prob modifiers in lane width calc

* update ref

* update ref
old-commit-hash: f7d1ace8836e02689d344561586e966758e99d23
2020-11-10 21:12:36 -08:00
HaraldSchafer 4bd3ffa94b No uncertain ll (#2495)
* initial, needs tune

* support metrics

* a little more

* wrong type

* fixup

* update refs
old-commit-hash: 26583b1b85cfe496300ab61310c3489b542ecead
2020-11-06 21:01:16 -08:00
HaraldSchafer fcb995e19c set y too (#2448)
* set y too

* new ref
old-commit-hash: e6668625fa8c0dec0277a87ce3d5bfad4a1a55a6
2020-11-04 19:52:05 -08:00
Adeeb Shihadeh 6e078827b3 check for safety mode mismatch (#2443)
old-commit-hash: 89d02dcf97d60585f9c627f11fdd75387d632b83
2020-11-04 11:12:15 -08:00
Adeeb Shihadeh f25cec394e grey panda is unsupported (#2458)
old-commit-hash: 47c21f10f598639307994392e96f4d9293b295c7
2020-11-03 19:56:25 -08:00
Adeeb Shihadeh 68b4380545 update process replay test routes (#2482)
* update bosch route

* update rfs

* bump refs
old-commit-hash: 37959207502c366d783972243a0d02f6ba0a91df
2020-11-03 18:44:35 -08:00
Adeeb Shihadeh 09034a6147 Car Port: Lexus NX300 (#2481)
* Adding 2018 Lexus NX 300

* adding test model

* Update README.md

adding lexus nx 300 to readme

* update route

* add nx dbc to release files

* fix readme

* add to release notes

Co-authored-by: matt12eagles <matt12eagles@gmail.com>
old-commit-hash: 4d0745504b8ca0a49e5314d70b81c49e8ee8aea7
2020-11-03 15:43:52 -08:00
Adeeb Shihadeh 2e5247056a ubuntu 16.04 -> 20.04 (#2378)
old-commit-hash: 719c5e3598846a6f3fa08c85bb811d197e0c6d0a
2020-10-29 16:51:09 -07:00
NiCK.n17 8a133b39ef Car Port: 2020 Kia Niro EV (#2416)
old-commit-hash: a0b40984afe77b49d542e4c8edef1d908c701d8c
2020-10-28 16:13:31 -07:00
Adeeb Shihadeh 0cd95164b8 fix cpu test thresholds after downclock
old-commit-hash: bdfb0488a80460be41995b6ec8047e35eabb56aa
2020-10-26 15:22:45 -07:00
Adeeb Shihadeh b7c4c26012 camera malfunction alert (#2391)
* camera malfunction alert

* bump cereal

* fix process replay

* ugh, needs refactor
old-commit-hash: 88b956528e614dc7429d525d5d7e09b5431d7b38
2020-10-22 16:28:54 -07:00
Kumar a78b00647c Car Port: Prius 2021 TSS2 (#2163)
old-commit-hash: 2a6765580c7984e64a3b56da5f21bd99243942df
2020-10-22 13:39:44 -07:00
ZwX1616 e9d58939d2 infinite sound (#2372)
* make sound infinite loopable

* Update selfdrive/ui/android/sl_sound.cc

* fix loop

* fix test threshold

* more fix

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 53bd3050ee90ca18445ddc41b837f5f927cc0c6a
2020-10-20 17:42:19 -07:00
Adeeb Shihadeh 09095e07fd numpy tolerance for INDI
old-commit-hash: 32496626b260a3c95440052a7d262f5859e136f1
2020-10-19 23:29:22 -07:00
Adeeb Shihadeh e94809f5bd add cars with LQR and INDI lat control to process replay (#2363)
* add cars that use LQR and INDI lat control to process replay

* bump ref commit
old-commit-hash: 516da927f9a1f04be4cbc281bc1b3c73092a4a36
2020-10-19 21:18:50 -07:00
Chris Souers 747de9f80f Add 2020 Acura RDX (#1557)
Update CAN Fingerprint

Update files_common

Update test_car_models.py
old-commit-hash: dc8b5538e858d4435fa636705ca3bb592999dcde
2020-10-18 19:03:04 -07:00
ZwX1616 dae628002f Clean up and test camerad refactor (#2310)
* refactor

add function get_camerabuf_by_type

remove cl_free

use camera_id

move front stuff into frontview_thread

bigger refactor

more

typo

rename camerabuf *c to *b

cleanup header files

remove wideview_thread

camera_qcom.c to c++

fix SConscript

camera_process_buf

space

sendrgb same with before

do autoexposure in processing_thread

correct sendrgb

add camera_common.cc

move yuv_transform to CameraBuf

* use C to keep consitent

* rebase master

* rebase master

* continue refactor

* refactor all camera related data&function out of main

 done

* cleanup

* -use buf.rgb_width&height

* remoe ,

* rebase master

* remove unused std::vector

* add func common_camera_process_front

* fix max

* fix sendrgb

* less crap being logged

* fix indents

* add back thumbnails

* thumbnail fixed on tici

* junk junk junk

* unify api

* fix ptr ref

* lol!

* cleanup

* more simplified

* typos

* remove terminate

* use standard polling

* ops_thread refactor, too much code!

* fix build

* ok

* assert

* listen

* incl more

* wq!

* fix more build

* macos

* fix exp targets

* front is different

* const

* bye

* remath

* remove irrelevant

* do ops in a thread

* fix init

* return null

* QCOM2 ops

* qcom2 build

* missing comma

Co-authored-by: deanlee <deanlee3@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 6b020241c986f614e9a1f08b5b870ff225cf7b19
2020-10-16 21:58:05 -07:00
Adeeb Shihadeh 8531345bf9 HKG fixups (#2342)
* fix hyundai blinker state

* consistency with update_speed

* update refs

* make hyundai resume reliable

* update refs

* 20 works

* don't need that

Co-authored-by: Greg Hogan <gregjhogan@gmail.com>
old-commit-hash: 725e3b78ea1baaefa6795116c582a63c7a61686b
2020-10-14 18:27:27 -07:00
Adeeb Shihadeh aea2faaa98 Alert cleanup (#2274)
* no more focus recover active

* consistency

* more permanent

* dm alerts

* sanity check test

* no please

* clean that up

* update refs

* one more

* bump cereal
old-commit-hash: ae4b4bd1256c11153035e4236cd801738f135c51
2020-10-14 15:56:18 -07:00
Adeeb Shihadeh 5dc58abbbe clear irrelevant alerts on state transition (#2318)
* cleanup

* clear warnings

* more types

* needs refactor

* update refs

* update refs
old-commit-hash: 1c6905cac1c5b4528e60dac3279357959c2e2bc3
2020-10-14 14:08:15 -07:00
Willem Melching 498ecbdf3c Params refactor, simplified (#2300)
* always c++

* Create C++ params class

* get works

* tests hang now

* passes tests

* cleanup string formatting

* handle interrupt in blocking read

* fix memory leak

* remove unused constructor

* Use delete_db_value directly

* Rename put -> write_db_value

* filename cleanup

* no semicolons in cython

* Update common/SConscript

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* add std::string version of delete_db_value

* This is handled

* cleanup encoding

* Add clear method to clear all

* add persistent params

* fix android build

* Should be called clear_all

* only import params when needed

* set params path on manager import

* recusrively create directories

* Fix function order

* cleanup mkdirp

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 2e182e5c574ea1468678b5fd8d0597e34ed5898d
2020-10-13 16:23:23 +02:00
grekiki 469a7ee7ef add caching to CI tests (#2269)
* first caching attempt

* caching attempt

* caching attempt

* caching attempt

* caching attempt

* caching attempt

* dump logs

* does this work?

* Create cache folder

* Print folder contents

* Fix volume mount

* Update test.yaml

* add removed tests

* reduce diff

* reduce diff

* reduce diff

* reduce diff

* reduce diff

* readd coverage upload

* Update test.yaml

* add more caching

* Use hash of test file to compute cache key

* add cache to valgrind tests

* Update .github/workflows/test.yaml

Co-authored-by: Willem Melching <willem.melching@gmail.com>

* Update .github/workflows/test.yaml

Co-authored-by: Willem Melching <willem.melching@gmail.com>

* Also hash workflow yaml

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: fc1d01be81d4e0716d10f8bed9ea3feb6a22be5b
2020-10-13 15:38:13 +02:00
grekiki 83b7ec3ce1 Process replay for C++ daemons (#2288)
* more like a stash

* mem

* comment cpp

* remove some tests

* WORKSpython test_processes.py python test_processes.py

* all tests work, time to clean up

* initialize cleanup

* fix spaces

* refactor

* Update selfdrive/test/process_replay/process_replay.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* revert debug change

* mini refactor

* remove submaster

* update README

* add delay

* check for missaligned start

* Update compare_logs.py

* should finally work now, I hope...

* update comment

* real fix

* real fix now

* fix styling

* fix styling

* Update process_replay.py

* fix code review

* speed up tests

* Update selfdrive/test/process_replay/process_replay.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Update selfdrive/test/process_replay/process_replay.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* fix reviews

* nicer code

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 870644b59eb61953b3355a3938cc272927708dfa
2020-10-12 11:18:53 +02:00
Adeeb Shihadeh 17d4fbfa7c more accurate profiling (#2287)
old-commit-hash: d5796e07e2a08141bae97de2d76bfd20ce199aad
2020-10-10 15:17:02 -07:00
Adeeb Shihadeh 6bb8f56f8d add timeout to modeld replay
old-commit-hash: cb85a193509c21597986f3f9abaf1a29e061b26d
2020-10-09 16:25:21 -07:00
Adeeb Shihadeh b864a2e9dd add acura rdx test route
old-commit-hash: 024c33e7246418e921fab1e9616814a79d33b2c3
2020-10-09 13:57:58 -07:00
Adeeb Shihadeh baae562f8f report git branch to testing closet
old-commit-hash: f1c3662311ae3d4b69ddb2ddb268622d9a9c3339
2020-10-06 21:00:19 -07:00
Willem Melching 13769c0287 Update radard cpu usage
old-commit-hash: 079c878adf24f1374a687138d70f6802ed030a93
2020-10-06 12:16:12 +02:00
Adeeb Shihadeh daad4ce4d6 write car params before profiling
old-commit-hash: 176c06499de585cc2c96484d442ee79fd0df844e
2020-10-05 21:34:57 -07:00
Adeeb Shihadeh 2f754f6df4 don't want to profile that
old-commit-hash: 67091060253a94d921460ad2bb4d8c5f2685dc07
2020-10-05 20:48:23 -07:00
Adeeb Shihadeh 413d7a4243 paramsd profiling
old-commit-hash: 0d11acf34ea7cf23d00d206fcd284bdf8b9f5d54
2020-10-05 20:41:24 -07:00
Willem Melching 416bc987f5 Fix calibration invalid alert on startup (#2270)
* change controlsd calibration initial value

* update refs

* update refs

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 3f88df62c76ee91deda15063bb2803f391c3912e
2020-10-05 19:16:52 -07:00
ZwX1616 a9d6c98aa4 Reduced wheel touch time (#2259)
* decrease wheel touch time

* update refs

* fix unittest

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 21d4ac1eebba06769f03edf7220ce84bd6ae154d
2020-10-05 14:39:24 -07:00
grekiki 67b02775da CI: Add valgrind (#2245)
* prepare a test for valgrind by fixing linter issues

* something went wrong

* Try update cereal

* Not working, fixing replay_learning.py

* Testing

* Testing

* Working now

* More logs, a bit of cleaning, still no idea how this works

* Ok got 10% cleaning done

* trying some stackOverflow code

* Lots of cleaning

* wip

* Delete valgrind_testing.py

* Delete replay_learning.py

* Add to CI, cannot fail though

* Add to CI, cannot fail though

* Now the unit test should fail

* Dump valgrind output in case of a failure

* fix subrepos

* fix subs

* hopefully fixes every issue that we have

* wait for message confirmation

* Revert "wait for message confirmation"

This reverts commit ad7ba280ec6536015ac1a442c9732bfe42fd5664.

* fix local issues

* Revert "fix local issues"

This reverts commit 4498df21df471fa6e9360d50407eaefdf24ae69f.

* attempt 3 to fix things

* untested function extraction

* refactor

* add valgrind task

* add delay and BASEDIR

* Make test not fail, it is not designed for that

* fix subrepositories

* fix tests

* Real fix now :)

* scons

* ... stupid CI

* fix valgrind CI

* Update test.yaml

* Update test.yaml

* Update test.yaml

* add valgrind logs as file

* remove delays

* kill process more reliably

* rename action

* small cleanup

* fix casting to int in case of large leaks

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: a09fd7c860555c308e516bbcfbf4fff850a694e1
2020-10-05 16:09:32 +02:00
Adeeb Shihadeh af2ec63bea radard cleanup (#2266)
* some cleanup

* more realistic profiling

* Update selfdrive/controls/radard.py

Co-authored-by: Willem Melching <willem.melching@gmail.com>

Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: a77548bff606a20537ed7ff526d605bed1b7a721
2020-10-05 11:37:39 +02:00
Adeeb Shihadeh 349b5814bb radard profiling (#2265)
old-commit-hash: df6a66c785acaba43ba2699a35e3937c818aae8a
2020-10-04 15:55:25 -07:00
Adeeb Shihadeh 0184a43999 run loggerd tests in CI (#2241)
* run loggerd tests in jenkins

* fast

* check segs on the fly

* missing import

* wait for dir

* no thread

* relax FILE_SIZE_TOLERANCE

* cleanup

* unused

* set ci flag

* wait longer for first seg

* fix race condition with setting RecordFront

Co-authored-by: ZwX1616 <zwx1616@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 427d4a5a9eaf3a593db43ee78315dd38664dbb47
2020-10-01 18:42:43 -07:00
Adeeb Shihadeh 6c39de6c92 Increase HKG torque limit (#2249)
* increase hkg torque limit

* update refs

* bump panda
old-commit-hash: 67aec50b88cf1a65ae44940a4594d893a384bbc6
2020-10-01 13:16:51 -07:00
Willem Melching d34b18069c simplify testing closet client
old-commit-hash: 1c6fb567699714fa2aa39a147114fb277544c59f
2020-10-01 16:01:34 +02:00
Comma Device 493c95e363 update testing closet client
old-commit-hash: 3f0491b7e58d4d3a7fe6e2bd483d6fd267a9bdd4
2020-10-01 06:52:59 -07:00
qadmus 94b0fd629e Fix grade force in test_long plant (#2225)
Co-authored-by: user <email@web.com>
old-commit-hash: cba53957bd33379ff6ad9fc53dd5edc73cfdff4a
2020-09-28 11:54:48 +02:00