Commit Graph

929 Commits

Author SHA1 Message Date
Justin Newberry b86567d330 compare_logs: separate format_process_diff into a new function (#30284)
support separate
2023-10-18 15:12:43 -07:00
Yassine 52b5a33d35 Revert "update model replay ref commit"
This reverts commit 40817b6810.
2023-10-17 19:49:42 -07:00
Yassine 40817b6810 update model replay ref commit 2023-10-17 19:49:13 -07:00
Justin Newberry 1820b5f259 Proc Replay: cleanup iterable log typing (#30261)
* cleanup log typing

* use iterable

* fix those

* Cleanup

* cleanup

* missed that one
2023-10-17 12:58:28 -07:00
George Hotz 50d720fc2e Bump tinygrad to master (0.7) (#30254)
* bump tinygrad to master

* ops_cpu is required now

* and that one too

* tinygrad is getting out of hand with all the files

* bump tinygrad

* update ref commit

* tinygrad master

* Revert "update ref commit"

This reverts commit e7284152899d6dd8a986d9570e6021addfbc6b0f.

* bump tinygrad repo

* bump master

* update ref commit
2023-10-17 10:05:28 -07:00
Justin Newberry def2b93895 compare_logs: better names for short/long diffs (#30263)
* better names

* dont need that

* those too
2023-10-16 17:04:14 -07:00
Justin Newberry d23f5d2ec5 test_processes: assert that mazda is tested (#30258)
mazda left dashcam mode
2023-10-16 12:18:25 -07:00
Shane Smiskol 3cd0e392eb Toyota: combine similar TSS2 hybrid platforms (#30194)
* combine corolla

* corolla tss2: remove duplicates

* remove gas pedal hybrid signal

* combine RX TSS2

* we only split for static DSU msgs, or sng differences

* Combine NX TSS2

* remove nb

* Combine ES TSS2

* Combine RAV4 TSS2 (torque params for each EPS variant are similar enough, and eps and fwdcamera all are identical)

* Merge TSS-P Lexus NX

* TSS-P Lexus NX: remove duplicates

* TSS-P C-HR: merge

* TSS-P C-HR: remove duplicates

* fix routes

* re-did everything: no diff 🎉

* update test models seg list

* Update ref_commit
2023-10-07 01:26:49 -07:00
Kacper Rączy 3aa74c28fc CI: add regen job (#30157)
* Ability to whitelist/blacklist cars in regen_all

* Add CI job for regen, running on 2 segments

* Run regen_all, not regen

* Use coverage run

* Add test_regen

* Use test_regen in ci test

* Add test case names

* ONNXCPU = 1

* Add mazda segment

* Use RUN_CL

* build cl image before running

* unset PYTHONWARNINGS

* Create regen cache

* Replace daemons with processes

* Skip ford

* Skip mazda

* Add comment about commented segments

* Update selfdrive/test/process_replay/test_regen.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Remove unset pythonwarnings

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2023-10-05 13:59:00 -07:00
Shane Smiskol a1ca5dc484 scripts: format diff when comparing logs (#30174)
* move format diff to compare_logs to pretty print

* smaller
2023-10-04 22:59:03 -07:00
Kacper Rączy 18f41d1910 regen: skip fetching camera files when not needed (#30169)
* Fetch only camera files which are needed in current setup

* Refactor daemons to processes
2023-10-04 15:00:50 -07:00
Kacper Rączy 898acb13f2 process_replay: migrate panda/peripheral/manager states (#30141)
* Migrate pandaStates

* Fix import

* Make pandaStates migration optional, so process_replay still works on logs without carParams

* peripheralState migration if its not available

* Do nothing if log file has peripheralStates

* Add migrate_managerState

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
2023-10-04 13:41:50 -07:00
Kacper Rączy cf3549fe8a process_replay: migrate cameraState timestampSof if its missing (#30153)
Migrate timestampSof if its missing
2023-10-03 19:46:24 -07:00
Harald Schäfer 3c0a7d6986 Night Strike Model (#30148)
* baab2a46-f0c3-46eb-8756-00c55354945b/700

* Update model replay ref
2023-10-03 14:25:30 -07:00
Shane Smiskol 661edd7d8b regen: fix wide road camera msg name (#30147)
fixed
2023-10-02 21:21:49 -07:00
Kacper Rączy 9c5bbe1a91 process_replay: fix support for single cam segments (#30143)
* Fix assertion for vision_pubs

* Get camera states from meta

* Convert deviceType to string

* Use neo instead of eon for frame sizes dict

* update vision_pubs of process config when creating vipc
2023-10-02 19:36:47 -07:00
Adeeb Shihadeh a4aa801fbe simplify sensor alert (#29824)
* simplify

* update proc replay
2023-09-26 16:47:21 -07:00
Vivek Aithal 6d5f4f149d locationd: Replace allAliveAndValid with allValid (#30064)
* replace allaliveandvalid check with allvalid, all necessary time checks are already used

* update refs
2023-09-26 15:31:40 -07:00
Adeeb Shihadeh 5f318faf93 model replay: add cameraOdometry (#30007)
* model replay: add back cameraOdometry coverage

* update refs

* try again

* fix cmp log
2023-09-22 17:10:36 -07:00
Shane Smiskol 7f073483bb services: capitalize constant service list (#30005)
* rename

* bump

* Apply suggestions from code review
2023-09-21 18:25:15 -07:00
Harald Schäfer 3799fe46b3 Optimus Prime Model 🤖 (#29752)
* b449f295-7e40-4f97-96a6-d858815955e5/700

* make it compile b449f295-7e40-4f97-96a6-d858815955e5/700

* simpler - b449f295-7e40-4f97-96a6-d858815955e5/700

* feature_len changed

* 0a833ab4-9fc7-4e51-a686-9bce3eafcb91/700

* Revert "0a833ab4-9fc7-4e51-a686-9bce3eafcb91/700"

This reverts commit 41708b88447cfcf302b16f21f0caa69450bbd3df.

* 0a833ab4-9fc7-4e51-a686-9bce3eafcb91/700 again

* Update ref

* update ref

---------

Co-authored-by: Yassine <yassine.y10@gmail.com>
2023-09-21 13:51:12 -07:00
Vivek Aithal 00d1c682b0 Alerts: More understandable locationd, paramsd alerts (#29831)
* add locationd paramsd alerts

* remove more additions, just renames

* update refs

* Update selfdrive/controls/lib/events.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Update selfdrive/controls/lib/events.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* resolve comemnts

* update cereal

* update refs

* remove nosensor in new alerts

* bump cereal

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2023-09-11 16:28:42 -07:00
Lee Jong Mun 238f9d65db cleanup remnants of LQR and INDI tuning (#29860)
* not use 'indi' cleanup

* bump cereal

* rm more

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2023-09-10 16:30:13 -07:00
Kacper Rączy 0267e0500c radard: expose radarTrackId for radar leads (#29809)
* Add radarState track identifier for debugging purposes

* update process replay ref
2023-09-07 11:24:54 -07:00
Vivek Aithal dbada885ac locationd: Add camera-IMU cross-checks (#29727)
* camera-gyro cross checks, but one way

* increase factor to account for gyro noise (potholes, bad roads etc

* increase factor to reduce FP with device taps, bad roads, etc

* factor to 30

* add inputsok to sensoir data invalid alert

* bugfix

* move the sensors check

* add localizer catchall alert

* update refcommit

* remove permanent alert

* revert sensorDataInvalid alert change, split into new PR
2023-09-06 21:01:01 -07:00
Justin Newberry 338288df6e Subaru: don't copy eyesight counters, calculate manually (#29533)
* subaru manual counters

* update ref

* that isn't used

* review suggestions
2023-09-06 16:08:59 -07:00
Adeeb Shihadeh 7b6afbc162 pytest: use a clean environment for all tests (#29788)
* pytest: use a clean environment for all tests

* rm that

* fix pj

* put build back

* fix params

* fix that

* handle no key

* that was removed

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
2023-09-05 18:52:40 -07:00
Mitchell Goff 1eb60516cb Move update_calibration to modeld.py (#29688)
* Move update_calibration to modeld.py

* Updated ref commit
2023-08-30 14:12:52 -07:00
Kacper Rączy bb14ba4e5e process_replay: clean env vars after run (#29694)
Clean environ vars at the end of replay
2023-08-28 19:44:40 -07:00
Harald Schäfer 55b391509d Revert: Locationd: enable laikad (#29687)
* Revert: Locationd: enable laikad

* update ref
2023-08-28 16:27:11 -07:00
Adeeb Shihadeh 4d6bb32df2 process replay: parallel by default (#29633)
* process replay: parallel by default

* more is helpful
2023-08-25 14:41:43 -07:00
Harald Schäfer f1b8a86464 K1FD: generate kalman gain at init (#29610)
* K1FD: generate kalman gain at init

* Update interfaces.py

* Update interfaces.py

* Update interfaces.py

* Update ref_commit
2023-08-25 13:44:03 -07:00
Harald Schäfer 8205590624 Locationd: enable laikad (#29570)
* experiment

* llk back

* update refs

* update ref

* no internet

* Update ref
2023-08-24 16:51:45 -07:00
Harald Schäfer 8a7281d285 Laikad upgrades: prep for laikad lld (#29545)
* Laikad upgrades: prep for laikad lld

* Update ref commit
2023-08-23 00:13:10 -07:00
Harald Schäfer fda3106c28 Revert laikad llk (#29535)
* Revert "bump laika (#29522)"

This reverts commit 3523bef732.

* Revert "Locationd: switch to laikad (#29278)"

This reverts commit fd3b8a3d75.
2023-08-22 14:12:51 -07:00
Harald Schäfer fd3b8a3d75 Locationd: switch to laikad (#29278)
* use_laika

* Update test

* fix spacing

* fix proc replay

* small fix

* Try correct std

* cast correctly

* experimental

* simpler

* update reset thresholds

* improve

* Ready for live running

* outlier reject

* update laika

* add fine speeds

* more experiments

* fixes

* all in laika

* more small tweaks

* outlier rejection not needed

* fix conflict

* no more gpslocation

* update test

* refactor to laika

* runs again

* Update ref
2023-08-21 22:51:02 -07:00
Adeeb Shihadeh a9626f95b6 add openpilot prefix to imports (#29498)
* add openpilot prefix to imports

* more

* more

* fix docs

* fix linter

* bump submodules

* fix patched tests

* update dynamic imports

* debug

* Revert "debug"

This reverts commit db5e13b9911cc74438bee123bc3430da6c31b24b.

* fix pm test
2023-08-20 20:49:55 -07:00
Harald Schäfer 1dea20e574 Proc replay: field tolerance unused (#29479)
field tolerance unused
2023-08-20 13:05:18 -07:00
Shane Smiskol 1a08c2986e Revert "radard: tie radard frequency to modelV2 vol. 2 (#29240)" (#29474)
* Revert "static analysis fixes"

This reverts commit a1e85f3661.

* Revert "radard: tie radard frequency to modelV2 vol. 2 (#29240)"

This reverts commit 460f5c8e0b.

* update refs
2023-08-18 22:56:43 -07:00
Shane Smiskol e4ecb511c9 upadte process replay refs 2023-08-17 00:45:44 -07:00
Kacper Rączy f07e4fb49a process_replay: prevent creating orphaned processes if replay fails during setup (#29426)
Fix the ability to cleanup, if process container fails during start
2023-08-16 10:37:19 -07:00
Justin Newberry 7ec52da33a Subaru: calculate steering angle rate (#29409)
* calculate rate

* added adeeb's comment

* move to selfdrive/car

* that makes way more sense

* much simpler

* fix rate

* preglobal doesn't have a counter

* update ref

* merge

* update ref after merging
2023-08-15 15:28:46 -07:00
Jason Young 90c4bbe8e4 car interfaces: cleanup tire stiffness calculation (#28263)
* cleanup tire stiffness calculation

* bump cereal

* think these todos still apply

* gm: same default

* revert comments

* bump

* update refs

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
2023-08-15 14:17:08 -07:00
Kacper Rączy 460f5c8e0b radard: tie radard frequency to modelV2 vol. 2 (#29240)
* radard: tie radard frequency to modelV2

Accumulate parsed messages until state is updated (toyota)

Same for honda

Rename rr to something more descriptive

* Change _update method name, since signature has changed

* Update ref commit

* Some renames

* Check for number of cans
2023-08-11 18:07:06 -07:00
Justin Newberry e4ead4f183 Ruff: b905 (strict zip) (#29336)
* added mutable default args

* most of the Bs

* add comment about lrucache

* b905
2023-08-11 16:13:51 -07:00
Justin Newberry 8793cbff40 Ruff: enable flake8-builtins (#29315)
* enable flake8-builtins

* replace any with contains

* fix typo in pack

* fix type

* format is from the parent module, has to be enabled

* item_id

* fix item_id

* disable for id since that's what the remote server returns
2023-08-10 18:58:22 -07:00
Justin Newberry 4a9afd7554 Ruff: comprehensions conventions (#29317)
ignore c408
2023-08-10 16:40:30 -07:00
Mitchell Goff c04e5d12fc Non-Inflatable Model 🎈 (#29003)
* Added all maneuvers to navInstruction message

* Added nav instruction logic to modeld

* New model: fcee01c1-96bb-414f-b00d-e4a994a00922/700

* Fixed bug in navd

* Added sharp/slight modifiers

* Updated refs
2023-08-09 19:56:45 -07:00
Justin Newberry 7fdd9fc37c CI: Pylint to ruff (#29294)
* pylint to riff

* pylint to riff

* pylint to riff

* revert more

* undo exclude removal

* exclude tinygrad

* set line length

* pylint exclusions to ruff

* same excludes as old linter

* fix tools QA

* remove unrequired check

* revert linting third_party

* ignore e402
2023-08-09 13:26:54 -07:00
Justin Newberry cf64b27168 Linter: Fix >160 line length test (#29287)
* test

* fix line length

* fix line length

* fix file size

* revert poetry

* cleanup for PR
2023-08-08 17:13:35 -07:00