Commit Graph

1445 Commits

Author SHA1 Message Date
Justin Newberry e525f47141 model_replay: allow skipping modeld/dmodeld (#30365)
* skip model

* sa

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: c52f2ec19b9d0cfc98aaa66b459d02f0d87116cb
2023-11-02 18:10:11 -07:00
YassineYousfi 91751770a8 (New) Lemon Pie Model 🍋 (#30209)
* 6f6e3749-1b7c-42e8-a33b-03929b7fc476/700

* oops deleted too much

* 1b4308b7-a659-4ebd-b4c6-c81c1c3890f8/700

* 1be192f3-f407-4217-9757-78b9ad92750a/700

* remove some todos

* more cleanup in lat planner

* vego > min_speed

* regen and update process replay refs

* update model replay ref

* update model replay ref commit again

* Revert "update model replay ref commit again"

This reverts commit 922cb796b8dfe264b0cce7a18206bb898b18bcb3.

* update again

* bump cereal
old-commit-hash: 4c2bd853e4410db7f0d80e258291408e94c6c068
2023-11-02 14:01:00 -07:00
Justin Newberry 0785258458 test_onroad: assert the procs that use the GPU (#30359)
* test gpu

* keep it localiized

* has to be later

* reduce diff

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: ddbdaf3cf97f0db02f355110615789e09936220c
2023-11-01 17:31:54 -07:00
Kacper Rączy 82009093f5 regen: update refs with dummy dcamera (#30347)
Update refs
old-commit-hash: e5eea7276f82f0e8467c43e52545ca06701526fa
2023-10-30 15:33:17 -07:00
Kacper Rączy bacaff6eda regen: dummy dcamera support (#30323)
* DummyFrameReader

* dummy_dcam_if_missing flag

* Blank dcamera for all neo segments, as dmonitoringd does not support neo camera feeds

* Remove trailing whitespace

* zero_dcamera staticmethod

* enable dmonitoring in test_regen

* Simplify. User decides wether to use dummy or not

* Moving some stuff

* rename to dummy_driver_cam
old-commit-hash: 7a5d85232fee1b4792f1bfcfcea38a2f57c0b0ea
2023-10-30 15:17:32 -07:00
Adeeb Shihadeh 8855a694a3 fix up docker script
old-commit-hash: 91380f085b6fed2e70d66e792d7a3f3d136b8252
2023-10-29 07:05:13 -10:00
Kacper Rączy 1027a60851 process_replay: use frame dimensions from FrameReader (#30332)
Use dimensions from FrameReader to setup vipc server
old-commit-hash: 4094d584f3b7788d50eb90110b6f3d7651c96863
2023-10-25 15:46:16 -07:00
Kacper Rączy 5fc85a7fba process_replay: migrate cameraStates of segments without driverEncodeIdx (#30331)
Migrate camera states of segments without driverEncodeIdx
old-commit-hash: 21715d7f810aa67213d767829c41ae42541c6b2b
2023-10-25 15:42:06 -07:00
Harald Schäfer 7c4d29c3d1 Rm laikad (#30299)
* rm laika

* Rm laika

* Needed this

* More rm

* More rm
old-commit-hash: 56dea7b0b42e7624a39fef0986cd0db151bb9512
2023-10-23 00:15:39 -07:00
Adeeb Shihadeh 3d602a86dc delete clocksd (#30252)
old-commit-hash: 67f2321060321a87082e297151692ed9b36de2c0
2023-10-22 14:47:38 -07:00
YassineYousfi d18f185115 modeld: parsing and publishing in python (#30273)
* WIP try modeld all in python

* fix plan

* add lane lines stds

* fix lane lines prob

* add lead prob

* add meta

* simplify plan parsing

* add hard brake pred

* add confidence

* fix desire state and desire pred

* check this file for now

* rm prints

* rm debug

* add todos

* add plan_t_idxs

* same as cpp

* removed cython

* add wfd width - rm cpp code

* add new files rm old files

* get metadata at compile time

* forgot this file

* now uses more CPU

* not used

* update readme

* lint

* copy this too

* simplify disengage probs

* update model replay ref commit

* update again

* confidence: remove if statemens

* use publish_state.enqueue

* Revert "use publish_state.enqueue"

This reverts commit d8807c8348338a1f773a8de00fd796abb8181404.

* confidence: better shape defs

* use ModelConstants class

* fix confidence

* Parser

* slightly more power too

* no inline ifs :(

* confidence: just use if statements
old-commit-hash: cad17b125595c4654bfd8299b041b94ccb3faf73
2023-10-19 14:23:51 -07:00
Adeeb Shihadeh f89f1ce4ab Update test_onroad.py
old-commit-hash: 09c8866d17d4ed60efce7fadf2c1179a71f7cd47
2023-10-19 10:36:18 -07:00
Adeeb Shihadeh 87f77825db test_onroad: log sizes check (#30265)
* test_onroad: check log sizes

* fix

* check logs

* rb

* len

* pytest

* mb

* corolla log is small

* adjust qlog
old-commit-hash: 13d780a5f2b049731df2cbf617cc6dfdd648e622
2023-10-18 19:44:46 -07:00
Justin Newberry 414d4cd8d0 compare_logs: separate format_process_diff into a new function (#30284)
support separate
old-commit-hash: b86567d330a2f599aea10c1454623496815b559c
2023-10-18 15:12:43 -07:00
Yassine 8f4e2f63f0 Revert "update model replay ref commit"
This reverts commit f53aef968ff298912ad48983fd9c7bc626783aa6.

old-commit-hash: 52b5a33d35a3ce42862ca0fa6dffa7d6c6f19c76
2023-10-17 19:49:42 -07:00
Yassine 2a5f2826d3 update model replay ref commit
old-commit-hash: 40817b6810afa7848a02a1e34fc9f09f037e4ac3
2023-10-17 19:49:13 -07:00
Justin Newberry ef1acd4e6c Proc Replay: cleanup iterable log typing (#30261)
* cleanup log typing

* use iterable

* fix those

* Cleanup

* cleanup

* missed that one
old-commit-hash: 1820b5f25930ae68e760157d6ff026516e3811ed
2023-10-17 12:58:28 -07:00
George Hotz 2b5ad3fe86 Bump tinygrad to master (0.7) (#30254)
* bump tinygrad to master

* ops_cpu is required now

* and that one too

* tinygrad is getting out of hand with all the files

* bump tinygrad

* update ref commit

* tinygrad master

* Revert "update ref commit"

This reverts commit e7284152899d6dd8a986d9570e6021addfbc6b0f.

* bump tinygrad repo

* bump master

* update ref commit
old-commit-hash: 50d720fc2e0d7dc12f8f39f069261cd27221b059
2023-10-17 10:05:28 -07:00
Justin Newberry f2dcaf6f79 compare_logs: better names for short/long diffs (#30263)
* better names

* dont need that

* those too
old-commit-hash: def2b938950def9f4bd6e44d8f16a172983428a6
2023-10-16 17:04:14 -07:00
Justin Newberry f4365f014e test_processes: assert that mazda is tested (#30258)
mazda left dashcam mode
old-commit-hash: d23f5d2ec544f2bfec99586a897a7bf8bc766260
2023-10-16 12:18:25 -07:00
Adeeb Shihadeh 4866e8376b docs: move to gh pages (#30242)
* mv to pages

* cleanup

* push static

* mv that

* new name for the orphan

* only master

* build op
old-commit-hash: f8a7def5154acbff3d258b306c86a737ebf98f8c
2023-10-14 23:03:57 -07:00
Adeeb Shihadeh c3aa58b492 cleanup up old lib64 references (#30246)
* cleanup sensord

* rm rest

* fix that

* update that
old-commit-hash: f0aa63181804259c5cea20b9d608bdbe9db6b340
2023-10-14 20:39:15 -07:00
Shane Smiskol 34ad81a239 Toyota: combine similar TSS2 hybrid platforms (#30194)
* combine corolla

* corolla tss2: remove duplicates

* remove gas pedal hybrid signal

* combine RX TSS2

* we only split for static DSU msgs, or sng differences

* Combine NX TSS2

* remove nb

* Combine ES TSS2

* Combine RAV4 TSS2 (torque params for each EPS variant are similar enough, and eps and fwdcamera all are identical)

* Merge TSS-P Lexus NX

* TSS-P Lexus NX: remove duplicates

* TSS-P C-HR: merge

* TSS-P C-HR: remove duplicates

* fix routes

* re-did everything: no diff 🎉

* update test models seg list

* Update ref_commit
old-commit-hash: 3cd0e392eb69f36e23afeeb0af1ee87176bfa96c
2023-10-07 01:26:49 -07:00
Kacper Rączy 2878a3a876 CI: add regen job (#30157)
* Ability to whitelist/blacklist cars in regen_all

* Add CI job for regen, running on 2 segments

* Run regen_all, not regen

* Use coverage run

* Add test_regen

* Use test_regen in ci test

* Add test case names

* ONNXCPU = 1

* Add mazda segment

* Use RUN_CL

* build cl image before running

* unset PYTHONWARNINGS

* Create regen cache

* Replace daemons with processes

* Skip ford

* Skip mazda

* Add comment about commented segments

* Update selfdrive/test/process_replay/test_regen.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Remove unset pythonwarnings

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 3aa74c28fcd426f73da2201b2fdd7ac2be21ba71
2023-10-05 13:59:00 -07:00
Shane Smiskol 338987a5d2 scripts: format diff when comparing logs (#30174)
* move format diff to compare_logs to pretty print

* smaller
old-commit-hash: a1ca5dc484132122b8b9ba7e2ff73da7c86bf1a2
2023-10-04 22:59:03 -07:00
Kacper Rączy 4987ed88a4 regen: skip fetching camera files when not needed (#30169)
* Fetch only camera files which are needed in current setup

* Refactor daemons to processes
old-commit-hash: 18f41d191047c0ed9549ada7c0d5fa21a49a707b
2023-10-04 15:00:50 -07:00
Kacper Rączy c33f68047b process_replay: migrate panda/peripheral/manager states (#30141)
* Migrate pandaStates

* Fix import

* Make pandaStates migration optional, so process_replay still works on logs without carParams

* peripheralState migration if its not available

* Do nothing if log file has peripheralStates

* Add migrate_managerState

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
old-commit-hash: 898acb13f27d69291e8b7ecfa8a6ea577b330520
2023-10-04 13:41:50 -07:00
Kacper Rączy f1ac2e7216 process_replay: migrate cameraState timestampSof if its missing (#30153)
Migrate timestampSof if its missing
old-commit-hash: cf3549fe8a7190130b6e9064d4be0f8c47d41f0a
2023-10-03 19:46:24 -07:00
Harald Schäfer dd8a904c5b Night Strike Model (#30148)
* baab2a46-f0c3-46eb-8756-00c55354945b/700

* Update model replay ref
old-commit-hash: 3c0a7d69862c52a7060b928162bd67cf55cc9c73
2023-10-03 14:25:30 -07:00
Shane Smiskol f56bfdc7c9 regen: fix wide road camera msg name (#30147)
fixed
old-commit-hash: 661edd7d8b403fe21a124c5a08d2f0b0cc76e68c
2023-10-02 21:21:49 -07:00
Kacper Rączy 71ad6ce228 process_replay: fix support for single cam segments (#30143)
* Fix assertion for vision_pubs

* Get camera states from meta

* Convert deviceType to string

* Use neo instead of eon for frame sizes dict

* update vision_pubs of process config when creating vipc
old-commit-hash: 9c5bbe1a91cc56df71d6f71a37b801aee24d073b
2023-10-02 19:36:47 -07:00
Adeeb Shihadeh 9c8de3e08b simplify sensor alert (#29824)
* simplify

* update proc replay
old-commit-hash: a4aa801fbe924ace2ebd493eeac7eb0c596f81b5
2023-09-26 16:47:21 -07:00
Adeeb Shihadeh 0358e2c547 add extra debug info to onroad test (#30067)
old-commit-hash: fa06a691017f6f1b333bb2e6bcb99bf4361bcc33
2023-09-26 16:11:26 -07:00
Vivek Aithal 9d4767bd87 locationd: Replace allAliveAndValid with allValid (#30064)
* replace allaliveandvalid check with allvalid, all necessary time checks are already used

* update refs
old-commit-hash: 6d5f4f149d819eed6a56112e9fba277b62613ff1
2023-09-26 15:31:40 -07:00
Justin Newberry ef75f0ab12 CI: use "slow" marker for pytest (#30063)
* skip to mark

* fix quotes
old-commit-hash: 0251742079b206ce40a3b4d8ae9cec1381494d4a
2023-09-26 13:44:18 -07:00
Adeeb Shihadeh 7a0a5c604e model replay: add cameraOdometry (#30007)
* model replay: add back cameraOdometry coverage

* update refs

* try again

* fix cmp log
old-commit-hash: 5f318faf93d7a9acb31fa694633c3881e9e5283f
2023-09-22 17:10:36 -07:00
Shane Smiskol 13381ed446 services: capitalize constant service list (#30005)
* rename

* bump

* Apply suggestions from code review
old-commit-hash: 7f073483bb2586053d6c5508ef3f420947941d90
2023-09-21 18:25:15 -07:00
Harald Schäfer 3f1086c410 Optimus Prime Model 🤖 (#29752)
* b449f295-7e40-4f97-96a6-d858815955e5/700

* make it compile b449f295-7e40-4f97-96a6-d858815955e5/700

* simpler - b449f295-7e40-4f97-96a6-d858815955e5/700

* feature_len changed

* 0a833ab4-9fc7-4e51-a686-9bce3eafcb91/700

* Revert "0a833ab4-9fc7-4e51-a686-9bce3eafcb91/700"

This reverts commit 41708b88447cfcf302b16f21f0caa69450bbd3df.

* 0a833ab4-9fc7-4e51-a686-9bce3eafcb91/700 again

* Update ref

* update ref

---------

Co-authored-by: Yassine <yassine.y10@gmail.com>
old-commit-hash: 3799fe46b3a629e491d4b8498b8ae83e4c88c304
2023-09-21 13:51:12 -07:00
Justin Newberry 2e36724cd2 Tests: power_monitoring disable nonblocking writes (#29994)
* better error logging

* fix power monitoring test

* revert that

* properly patch it
old-commit-hash: f69a45faba2789a6bcca8eca62acd316ff79f7a6
2023-09-20 16:51:46 -07:00
Vivek Aithal 56f4c138cd Alerts: More understandable locationd, paramsd alerts (#29831)
* add locationd paramsd alerts

* remove more additions, just renames

* update refs

* Update selfdrive/controls/lib/events.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Update selfdrive/controls/lib/events.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* resolve comemnts

* update cereal

* update refs

* remove nosensor in new alerts

* bump cereal

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 00d1c682b0a6e62652dbfe4686c674539fe82d8f
2023-09-11 16:28:42 -07:00
Adeeb Shihadeh 52752a3131 jenkins speedup (#29869)
* jenkins speedup

* cleanup
old-commit-hash: d0361485504fe5af47a9e8ffaf0b64cfcdf03ac9
2023-09-10 16:47:07 -07:00
Lee Jong Mun 89e5ee45ca cleanup remnants of LQR and INDI tuning (#29860)
* not use 'indi' cleanup

* bump cereal

* rm more

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 238f9d65dbc17613c2a045b5741483c3f9a7659d
2023-09-10 16:30:13 -07:00
Kacper Rączy f8c6ebd3ad docker: multiarch images (amd64/aarch64) (#29691)
* arch specific tags

* merge multiarch script

* arm64 build and merge jobs

* update tag script

* casual ci test

* change image to 2204

* docker -v test

* arch specific naming

* Remove test_buildjet

* build -arch images only when CURRENT_ARCH_BUILD is set

* support new tags in tag_multiarch

* Toggle CURRENT_ARCH_BUILD on in ci

* Docker common

* Fix condition

* Fix path to docker_common

* Add more stuff to common

* Add build_arm job

* composite job for building

* Run checkout before build composite

* add shell arg

* move timeout to selfdrive_tests

* TARGET ARCHITECTURE var

* Support TARGET_ARCHITECTURE in workflow

* Rewrite to Single build job with matrix

* Remove shebang from docker_common

* Attempt for fix build matrix

* Remove setup arch

* build matrix for docker push

* Use 2vcpu for arm build

* 2vcpu for docker_push too

* temporarly unlock docker_push

* Remove requirement for target arch when pushing

* Unset target architecture in docker_push cl

* fix sha tags

* Rename action to compile-openpilot

* move push_image line to tag_multiarch step

* arch suffix for scons cache

* cache_key_prefix for setup-with-retry

* Re-disable docker_push on non-master

* Add newlines
old-commit-hash: 1344a93a356e4734fedb5f717778a8b1a273c74b
2023-09-08 14:46:39 -07:00
Mitchell Goff 5732002296 Rewrite dmonitoringmodeld in python (#29740)
* Added dmonitoringmodeld.py

* Removed dmonitoringmodeld.cc

* Use ModelRunner helpers from runners/__init__.py

* Fixed DriverStateResult field ordering

* Some bug fixes

* Set calib input

* Look ma, no loop!

* Bump dmonitoringmodeld cpu usage in test_onroad

* Fixed memory leak caused by np.ctypes.data_as

* Formatting fixes

* chmod +x

* remove USE_ONNX_MODEL

* Realtime priority 1, formatting fixes
old-commit-hash: 503fa121ee83469763e9386b9e5df7a733693e2c
2023-09-07 19:46:43 -07:00
Mitchell Goff f9daa1d1cc Rewrite navmodeld in python (#29579)
* Added navmodeld.py

* Deleted navmodeld.cc

* Write SConscript config flags to config.py

* Remove deleted files from release/files_common

* Some more bug fixes

* Added config.py to gitignore

* Get rid of config.py

* Use set_realtime_priority

* A tiny bit more cleanup

* set realtime priority 1

* Use ModelRunner helper class from runners/__init__.py

* Formatting fixes

* mama mia that's a SPICY memory leak
old-commit-hash: 0c0af682a13753a3db971b12c2852cfddf1e5b49
2023-09-07 14:39:37 -07:00
Justin Newberry dc6078a6c3 System: use paths for download folders too (#29818)
* use paths for download folders too

* trailing slash

* reset that
old-commit-hash: 73eda51a11955627f4d149fdf12c1c781983d52e
2023-09-07 12:49:03 -07:00
Justin Newberry c7029ea15a System: cleanup paths to use a common class (#29816)
* use OP prefix for logmessage

* cleanup paths too

* cleanup the paths too

* add hw.py to release

* fix those issues

* fix unittests

* fix unittests

* fix unittests

* do swaglog_ipc properly across all the files

* fix that

* fix swaglog in c++

* review suggestions
old-commit-hash: bfe990b112a83f245bb5244553c84202aec7d86c
2023-09-07 11:32:47 -07:00
Kacper Rączy f0c3036ad1 radard: expose radarTrackId for radar leads (#29809)
* Add radarState track identifier for debugging purposes

* update process replay ref
old-commit-hash: 0267e0500c49ccbd00c58a8911e2446c7b8c614f
2023-09-07 11:24:54 -07:00
Vivek Aithal 43ce3d16df locationd: Add camera-IMU cross-checks (#29727)
* camera-gyro cross checks, but one way

* increase factor to account for gyro noise (potholes, bad roads etc

* increase factor to reduce FP with device taps, bad roads, etc

* factor to 30

* add inputsok to sensoir data invalid alert

* bugfix

* move the sensors check

* add localizer catchall alert

* update refcommit

* remove permanent alert

* revert sensorDataInvalid alert change, split into new PR
old-commit-hash: dbada885acf6418edbf6d781dc79fb85dfa74117
2023-09-06 21:01:01 -07:00
Justin Newberry a1b0f02051 Subaru: don't copy eyesight counters, calculate manually (#29533)
* subaru manual counters

* update ref

* that isn't used

* review suggestions
old-commit-hash: 338288df6e0f872ddc6c1cd02ce130d6ce154e36
2023-09-06 16:08:59 -07:00