87a6e369aa
Framereader: minor cleanup ( #35577 )
...
* No wrapping
* unused test
* another list
* mypy
* cleaner
* Revert "cleaner"
This reverts commit ccc1446b9d649d64b20175e22a66e135c44b21e5.
* mypy
2025-06-19 09:49:51 -07:00
5f3d876aaa
model replay: framereader cache ( #35576 )
...
* Simpler cache version
* cachetools
* different LRU
* lint
* smaller
* just write LRU
* mypy
* same length
2025-06-18 16:29:22 -07:00
d9b6c16037
Cleanup framereader ( #35513 )
...
* squash
* misc cleanup
* no LLM garbage
* misc fixes
* typo
* fix CI
* fix hints
* LLM soo wordy
* improve
2025-06-09 22:39:35 -07:00
5505338ffb
model replay: less frames and less complexity ( #35427 )
...
* Revert "ci: faster model_replay (#34036 )"
This reverts commit 847a5ce1f3
2025-06-02 21:54:37 -07:00
997a99926c
ci: overwrite previous comment for model_replay ( #35209 )
...
* less
* test
* fix
* cleanup
2025-05-13 21:06:30 -07:00
b42ec33a63
Update modeld action logic ( #35032 )
...
* add action logic
* magic numbers
* unused
* plot accel
* more changes
2025-04-17 17:59:15 -07:00
3f9437e249
process_replay: support lane changes in model_replay ( #34777 )
...
* lane changes need to see these
* newline
* add lc probs
2025-03-04 20:24:17 -08:00
3e8e7e8e6d
update model_replay route ( #34774 )
...
* update route
* Update selfdrive/test/process_replay/model_replay.py
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com >
---------
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com >
2025-03-04 18:36:30 -08:00
c82af71e83
model_replay: raise max modelV2 exec time ( #34505 )
...
raise
2025-01-30 11:21:45 -08:00
2eb3585dae
Not Too Shabby Model ( #34484 )
...
* b25c27a8-263b-4f3f-b1f8-72ac49b4f9c7/700
* replay
* model_replay: support empty
2025-01-28 12:16:13 -08:00
52f935da74
model_replay: check modelExecutionTime ( #34457 )
...
* metric
* fix
* format
* table
* test failure
* cleanup
* 3
* 4
2025-01-23 16:14:02 -08:00
c8264cbf2c
Notre Dame model in tinygrad ( #34324 )
...
* release model: 6f23a03f-486b-4d3e-a314-19d149644c7c/700
* old style model in tinygrad
* fix desire
* tg hack
* 20Hz
* no gas probs
* No gas here
* better indexing
---------
Co-authored-by: Yassine Yousfi <yyousfi1@binghamton.edu >
2025-01-06 20:52:36 -08:00
847a5ce1f3
ci: faster model_replay ( #34036 )
...
* cache draft
* fix
* fix
* fix
* better
* zst
* more
* try
* pool
* fix
* fix
* revert :C
* better
* cleanup
* no cache
* this too
2024-11-16 15:34:21 -08:00
360bb68547
proposed should be orange
2024-11-14 23:24:07 -08:00
a4848ceee9
Add driverStateV2 plots to model replay ( #33967 )
2024-11-07 21:49:15 -08:00
e6afe355d4
model_replay: save plots for each commits ( #33886 )
...
* fix
* better
* cleanup
2024-10-29 13:56:16 -07:00
a8908b5c08
model_replay: skip report if no PR associated with the branch ( #33866 )
...
* no pr number
* better
* test
* cleanup
2024-10-23 21:22:03 -07:00
f11e5492f8
ci: keep old comment on model replay report ( #33759 )
...
keep old
2024-10-09 15:29:41 -07:00
596d8b13bb
ci: model_replay improvements ( #33753 )
...
* diff
* tr
* cleanup
* at the end
* fix
2024-10-08 17:39:13 -07:00
2e83e37984
jenkins: model replay report in PR ( #33723 )
...
* first
* first
* first
* token
* edit previous comment
* clean
* plots
* linter
* cleaner
* comment
* save ref
* fix
* remove refs
* add tokens
* fix branch
* table
* fix
* real data
* title
* github
* fix
* github api
* better
* clean
* errors
* create bucket
* true
* fix
2024-10-07 21:40:00 -07:00
3b08501db3
Game Boy Model V3 ( #33674 )
...
* f4afab38-2ee3-4a71-904a-f2e5d4ec119a/400
* Model replay
* fix onnx cast
* tol
2024-09-29 20:33:35 -07:00
04a266eaeb
Game Boy Model ( #33661 )
...
* 559069cd-40a6-4456-9052-08659f376ca3/370
* 028fb9bc-b33e-4c26-9cf7-e3c44a85276a/400
* Update ref
* Update tolerance
2024-09-27 22:48:32 -07:00
876f192112
exec DM model with gpu ( #33609 )
...
* half
old-commit-hash: 9f72eca003d4637ca7fe847ebaf925c694fc2e84
* optimed
old-commit-hash: 6e36e2a12e09275ec21d1590012a92b05ca52ff5
* thneed
old-commit-hash: 419a06c09c0c767d828bcd1e118bc575898c343a
* exec
old-commit-hash: 0059c27ec11b076a37f65d604ed135ea6541b1a6
* runner
old-commit-hash: 34232ada94450ce541eaef546197fa219810a891
* runs but
old-commit-hash: 3db37c00b6a64908293b4de8d8b56e80308cd8f2
* it is 01
old-commit-hash: a160d81eb1a7e77abbef959b44f602610f68f665
* np
old-commit-hash: c1caff6ba648cc2c0094c71b2ea074f01c3c2dc8
* module url
old-commit-hash: 6f4902c4d384263a53e2c1d14d93b5ff864b6a5f
* new
old-commit-hash: 779ae79b1bc3df6374fb6663ac8592e107a6e504
* ds fast
* is this work
* corcention
* real timing
* no reg
* interim gather
* 0e4a9c7b
* fa69be01, and halve
* list
* cleanup
* slighly faster
* setprotlt
* expected
* replay ref
* more powar
* reluctantly
* bump tg
* 8
* less
* less
* bump tg
* better than exp
* closer
* cc
* see diff
* commits
* was right
* to 32 cast
* remove dlc file
* support both
* dspExecutionTime -> gpuExecutionTime
* ignore
* time ref
* ref commit
* last
---------
Co-authored-by: Comma Device <device@comma.ai >
2024-09-26 16:40:44 -07:00
ba7039785c
More reasonable model replay tolerance ( #33652 )
2024-09-25 14:21:19 -07:00
48938098e0
Add modelExecutionTime to DrivingModelData ( #33606 )
...
* Add model execution time to DrivingModelData
* Update model replay ref commit
* Update ref commit again
* Ignore this field in model replay
* Back to original ref commit
* Bring back
---------
Co-authored-by: Comma Device <device@comma.ai >
2024-09-19 22:09:53 -07:00
786aff27da
azure_container: pass the filename explicitely when using get_url ( #33407 )
...
* Pass filename explicitely when using azure container
* Do not update segments in test_processes
* openpilotci_source_zst
* Fix static analysisc
old-commit-hash: b5958ebb600f503f585a1080236a0f26b4f5c6a0
2024-08-29 21:51:55 -07:00
539c828861
tools: keep re pattern file small ( #33084 )
...
remove bz2 from re file
old-commit-hash: e68bb26e14d4e85f61ab3f58ac9667ca9d6ea565
2024-07-25 22:05:10 -07:00
02a35949dc
drivingModelData: frameDropPerc ( #32871 )
...
* Smokes! lets go!
* Ignore it in model replay
old-commit-hash: 417f1e2139ba6037c9fd6494f68194e36e243540
2024-06-29 02:31:55 -07:00
102188c245
drivingModelData: new model packet for qlogs ( #32821 )
...
* Mini model v2 prototype
* Apply suggestions
* Add meta
* Support for new packet in model
* Support in process replay
* Meta
* Add it to services
* Update model replay
* Add drivingModelData in model_replay
* Update ref
* MAX_FRAMES*3
* No modelv2, but drivingModelData at 2hz
* Polypath
* Dont use keyword
* Update model ref commit
* xyz coeff
* Fix field name
* Update ref commit
* Min qlog size 0.6
---------
Co-authored-by: Comma Device <device@comma.ai >
old-commit-hash: 2059f986dff46254419c889eadcc82ecea1bce94
2024-06-28 19:27:58 -07:00
6745358478
remove mapbox references ( #32811 )
...
old-commit-hash: bccccde568c05a7a641110c90d4ed95047cdea4e
2024-06-22 18:01:47 -07:00
75a69e12b3
disable navigate on openpilot ( #32106 )
...
* 2eedcd90-b7db-46cb-86be-740f48ded7ab/700
* noop ciao
* here too
* mapsd too
* update translations
* disable mapsd test from test onroad
* disable mapRenderState test from timings
* lint
* fix exp mode toggle panel
* update tr
* french done
* dont build mapd
* only no nav
* just comment
* deprecate nav fields
* rm not comment
* dont deprecate too much
* remove from services
* merge cereal
old-commit-hash: 754dd45ffa82bf3d7f2d3413c4132eb65551ebd5
2024-04-09 10:40:38 -07:00
a5bc36ea9d
move git commands to common/git.py ( #31921 )
...
move git into common/git.py
old-commit-hash: 4fbc8a389662f82018eeabd03294cc761b87ce75
2024-03-19 12:39:09 -07:00
f60cbbb04b
modeld: prep for camera transform refactor ( #31820 )
...
* modeld: prep for camera transform refactor
* update refs
* add pub
* do setup
old-commit-hash: 7436aa8b053aeccfc9bacb06bfaf4a42b3ec5f78
2024-03-10 16:39:40 -07:00
66dbadb029
Delete lat planner ( #31089 )
...
* Initial commit
* Fixup
* typo
* ignore lateral plan
* Update cereal
* Remove lateralPlan
* Fix release build
* Fix release build
* give car params
* Add carParams to include_all_types
* Write car param in powerdraw test
* add demo mode
* Update model regf
* proc replay ref commit
* Try
* Move enum definition
* Update cereal
* typo
* Write car param for modeld test
* Update ref
* Update model ref again
---------
Co-authored-by: Kacper Rączy <gfw.kra@gmail.com >
old-commit-hash: e6c97c384671b448f307a7ed91416886f2186d80
2024-01-21 12:09:48 -08:00
4b7edec2b0
LogReader: move opci to tools/lib ( #31021 )
...
move opci
old-commit-hash: 7d400112df6692ef026245b03951345cc36dd83e
2024-01-16 10:58:51 -08:00
e525f47141
model_replay: allow skipping modeld/dmodeld ( #30365 )
...
* skip model
* sa
---------
Co-authored-by: Comma Device <device@comma.ai >
old-commit-hash: c52f2ec19b9d0cfc98aaa66b459d02f0d87116cb
2023-11-02 18:10:11 -07:00
f2dcaf6f79
compare_logs: better names for short/long diffs ( #30263 )
...
* better names
* dont need that
* those too
old-commit-hash: def2b938950def9f4bd6e44d8f16a172983428a6
2023-10-16 17:04:14 -07:00
338987a5d2
scripts: format diff when comparing logs ( #30174 )
...
* move format diff to compare_logs to pretty print
* smaller
old-commit-hash: a1ca5dc484132122b8b9ba7e2ff73da7c86bf1a2
2023-10-04 22:59:03 -07:00
7a0a5c604e
model replay: add cameraOdometry ( #30007 )
...
* model replay: add back cameraOdometry coverage
* update refs
* try again
* fix cmp log
old-commit-hash: 5f318faf93d7a9acb31fa694633c3881e9e5283f
2023-09-22 17:10:36 -07:00
16ec56398c
add openpilot prefix to imports ( #29498 )
...
* add openpilot prefix to imports
* more
* more
* fix docs
* fix linter
* bump submodules
* fix patched tests
* update dynamic imports
* debug
* Revert "debug"
This reverts commit db5e13b9911cc74438bee123bc3430da6c31b24b.
* fix pm test
old-commit-hash: a9626f95b69af19306143fc4def02fb5769405d2
2023-08-20 20:49:55 -07:00
0a6b589f23
dmonitoringmodeld: initialize model first ( #29080 )
...
* hacky fix
* even better
* ordering
* clean up
* fix model replay
* add comment
* catch sigint
old-commit-hash: 12ed894362dd22513a21de6689a31511b791e37b
2023-07-23 09:28:22 -07:00
1fa42d0b97
process_replay: modeld and dmonitoringmodeld support ( #28463 )
...
* vipc support. modeld and dmonitoringmodeld configs
* Update cereal
* Add vision meta
* Use vision meta in process replay
* Exclude modeld and dmonitoringmodeld from test_processes
* Refactor other pieces of code to use vision meta
* remove unnecessary imports
* Add MAX_FRAMES_PER_SEGMENT
* cameraState migration
* Move camera state migration to migration module
* model_replay refactor
* Fix lint issues
* Reduce number of vipc buffers to 2
* Update spinner message
* Update model replay ref
* Support the new log order
* Replace CameraFrameSizes with dict. Add encode_index field
* Migrate camera states based on encode indices
* Refactor process replay
* Refactor model replay
* Remove unnecessary print
* Update model replay ref
* Make camera state migration optional
* Remove unused import
* Add ignore_alive_pubs field
* Add assertion for carParams inside fingerprinting callback
* Remove WideCameraOnly param setup
* Refactor ModeldCameraSyncRcvCallback
* Update model replay ref commit
* Fix camera state migration
* Only migrate camera states when process has vision pubs
* Refactor model replay again
* Fix linter issues
* One more linter fix
* Update model replay ref commit
old-commit-hash: 2c617e0c7a082aeb3217b14e812e5d3c0c26cd4a
2023-06-22 17:36:25 -07:00
2edd65ad4e
process_replay: helpers ( #28367 )
...
* process_replay helper
* Refactor
* refactor check_enabled uses
* fix __init__
* noqa in __init__ imports
* Move compare_logs outside of process_replay
* Move save_logs to tools.lib.helpers
* Remove save_log from compare_logs
* fix lint issues
old-commit-hash: 64377a88f94527f56ba8e9cd7c01c97100681455
2023-06-06 10:31:13 -07:00
3dc3978a10
Test navmodel ( #28272 )
...
* Test navmodel
* removed comment
* Updated model_replay ref
* read tiles from azure bucket
* updated ref commit
old-commit-hash: 2d34083cd8a507ed06f0139f496930cfe4bde820
2023-05-30 20:33:01 -07:00
a4af0fca74
jenkins fixups
...
old-commit-hash: 5f66a9a6213f6c42161584979a2f760f9ad9df47
2023-01-10 16:20:27 -08:00
b3626c8ecd
model_replay: use last N frames of segment so navRoute is valid ( #26790 )
...
* model_replay: use last N frames of segment so navRoute is valid
* Use llk logMonoTime for MapRenderState.locationMonoTime
* Record mapRenderState
* update refs
Co-authored-by: Comma Device <device@comma.ai >
old-commit-hash: 5ab2fc16ab5b883f3fa151d0e7362bc73545ca32
2022-12-20 14:19:21 -08:00
44098cc024
navmodel: check images in replay test ( #26747 )
...
* move position
* log images
* enable test
* update refs
* ignore
Co-authored-by: Comma Device <device@comma.ai >
old-commit-hash: f3a711953afea1fcebb4c10b1e2462c4032ac147
2022-12-09 22:56:32 -08:00
01db07375c
nav model replay ( #26697 )
...
* nav model replay
* set token
* fix gh actions
* update refs
* fix pc
old-commit-hash: 1da6f6a6e213280979dcf64b4d3e90f291bda4a3
2022-12-07 19:36:30 -08:00
7dac75758d
model replay speedup ( #26181 )
...
* model replay speedup
* less frames too
Co-authored-by: Comma Device <device@comma.ai >
old-commit-hash: 188c2c1c5e1c06d68ae957ab16bcb77e29052f4b
2022-10-20 20:58:58 -07:00
a8ec6f4cfd
Rocket Launcher Model ( #25963 )
...
* 1456d261-d232-4654-8885-4d9fde883894/440 6b7d7cec-ead8-40f3-86cc-86d52c9b03fe/300
* compute only 9 tokens: 1456d261-d232-4654-8885-4d9fde883894/440 6b7d7cec-ead8-40f3-86cc-86d52c9b03fe/300
* tinygrad: cleanup gather
* 1456d261-d232-4654-8885-4d9fde883894/440 6b7d7cec-ead8-40f3-86cc-86d52c9b03fe/700
* empty commit for tests
* bump tinygrad
* dont use tinygrad matmul for now
* bump tinygrad
* 1456d261-d232-4654-8885-4d9fde883894/440 e63ab895-2222-4abd-a9a5-af86bb70e260/700
* float16 1456d261-d232-4654-8885-4d9fde883894/440 e63ab895-2222-4abd-a9a5-af86bb70e260/700
* increase steer rate cost
* Revert "increase steer rate cost"
This reverts commit 74ce9ab9be7ef17ecfec931f96851b12f37f2336.
* fork tinygrad
* empty commit for tests
* basics
* Kinda works
* new lat
* new tuning
* Move LATMPCN so scons compiles
* Update long weights
* Add tinygrad optim
* Update model ref
* update weights
* Update ref
* Try
* Error message for field ignore
* update model regf
* ref commit
* Fix onnx test
Co-authored-by: Yassine Yousfi <yyousfi1@binghamton.edu >
old-commit-hash: cb0b7375b728d1b6e92db68c9ba55f0f54c09a3f
2022-10-05 21:43:38 -07:00
Harald Schäfer