Commit Graph

1401 Commits

Author SHA1 Message Date
Mitchell Goff f9daa1d1cc Rewrite navmodeld in python (#29579)
* Added navmodeld.py

* Deleted navmodeld.cc

* Write SConscript config flags to config.py

* Remove deleted files from release/files_common

* Some more bug fixes

* Added config.py to gitignore

* Get rid of config.py

* Use set_realtime_priority

* A tiny bit more cleanup

* set realtime priority 1

* Use ModelRunner helper class from runners/__init__.py

* Formatting fixes

* mama mia that's a SPICY memory leak
old-commit-hash: 0c0af682a13753a3db971b12c2852cfddf1e5b49
2023-09-07 14:39:37 -07:00
Justin Newberry dc6078a6c3 System: use paths for download folders too (#29818)
* use paths for download folders too

* trailing slash

* reset that
old-commit-hash: 73eda51a11955627f4d149fdf12c1c781983d52e
2023-09-07 12:49:03 -07:00
Justin Newberry c7029ea15a System: cleanup paths to use a common class (#29816)
* use OP prefix for logmessage

* cleanup paths too

* cleanup the paths too

* add hw.py to release

* fix those issues

* fix unittests

* fix unittests

* fix unittests

* do swaglog_ipc properly across all the files

* fix that

* fix swaglog in c++

* review suggestions
old-commit-hash: bfe990b112a83f245bb5244553c84202aec7d86c
2023-09-07 11:32:47 -07:00
Kacper Rączy f0c3036ad1 radard: expose radarTrackId for radar leads (#29809)
* Add radarState track identifier for debugging purposes

* update process replay ref
old-commit-hash: 0267e0500c49ccbd00c58a8911e2446c7b8c614f
2023-09-07 11:24:54 -07:00
Vivek Aithal 43ce3d16df locationd: Add camera-IMU cross-checks (#29727)
* camera-gyro cross checks, but one way

* increase factor to account for gyro noise (potholes, bad roads etc

* increase factor to reduce FP with device taps, bad roads, etc

* factor to 30

* add inputsok to sensoir data invalid alert

* bugfix

* move the sensors check

* add localizer catchall alert

* update refcommit

* remove permanent alert

* revert sensorDataInvalid alert change, split into new PR
old-commit-hash: dbada885acf6418edbf6d781dc79fb85dfa74117
2023-09-06 21:01:01 -07:00
Justin Newberry a1b0f02051 Subaru: don't copy eyesight counters, calculate manually (#29533)
* subaru manual counters

* update ref

* that isn't used

* review suggestions
old-commit-hash: 338288df6e0f872ddc6c1cd02ce130d6ce154e36
2023-09-06 16:08:59 -07:00
Adeeb Shihadeh 53e0f5eb49 pytest: use a clean environment for all tests (#29788)
* pytest: use a clean environment for all tests

* rm that

* fix pj

* put build back

* fix params

* fix that

* handle no key

* that was removed

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
old-commit-hash: 7b6afbc1623b8c159a92f6a5a951fb4d688045ee
2023-09-05 18:52:40 -07:00
Justin Newberry 839e72de70 CI: use pytest for unittesting (#29709)
* switch to pytest

* static analysis

* fix the helpers

* static analysis

* remove that

* more parallel test

* cleanup

* static analysis

* durations min and tolerance

* reduce those iterations

* sleep time could be decreased too

* in case it's negative

* try using caching

* remove parallelization for first PR

* PR Cleanup

* reduce diff

* fix that

* bump panda
old-commit-hash: ca435d344714f08276f9f9da5039f730987f31fa
2023-09-04 11:54:35 -07:00
Justin Newberry 6537493450 Tests: disable laika tests in CI (#29742)
skip laika
old-commit-hash: 4c039ab02230c7fcf2439b56fe04ad79df911ad4
2023-08-31 17:17:07 -07:00
Justin Newberry 1cc555c37b Tests: expand temporary directory helpers for more directories (#29735)
* create helpers for testing

* document it

* fix other tests
old-commit-hash: 405d09714c15956a6d220ff963d07b89c8e790ca
2023-08-31 14:00:31 -07:00
Mitchell Goff 54988e457f Move update_calibration to modeld.py (#29688)
* Move update_calibration to modeld.py

* Updated ref commit
old-commit-hash: 1eb60516cbcfa014cfd728123b6b3a5b97fce2df
2023-08-30 14:12:52 -07:00
Justin Newberry da81738a85 Tests: remove sleep and prints from maneuver tests (#29711)
remove sleep and prints
old-commit-hash: f31b4ad25ef3aa2faf90116dcc9c44a459f2b676
2023-08-30 00:02:55 -07:00
Justin Newberry 279bd020dc Tests: logmessaged reduce global state (#29680)
* reduce global state

* use a decorator here too

* use that one

* use base imports

* ipchandler in setup

* move to common dir

* move to helpers

* wip

* fix the decorator
old-commit-hash: 5dc7028f91079dfa07347a4d24ff56b72c24bd20
2023-08-29 13:36:26 -07:00
Kacper Rączy a40c0c9b6e process_replay: clean env vars after run (#29694)
Clean environ vars at the end of replay
old-commit-hash: bb14ba4e5e5bd229bde42a14d1c9a7bbc02297b5
2023-08-28 19:44:40 -07:00
Harald Schäfer 3a28e97a95 Revert: Locationd: enable laikad (#29687)
* Revert: Locationd: enable laikad

* update ref
old-commit-hash: 55b391509d94c45000df6754f173ad446dc1b34c
2023-08-28 16:27:11 -07:00
Adeeb Shihadeh 68dd600872 CI: use buildjet for process replay (#29277)
* squash for pr

* backoff to 4vcpu

* review suggestions

* simplify

---------

Co-authored-by: Justin Newberry <jnewberry0502@gmail.com>
Co-authored-by: Justin Newberry <justin@comma.ai>
old-commit-hash: d35beffbcec1524ff4c4096079208b109fede3f0
2023-08-25 18:50:21 -07:00
Justin Newberry 643a13f27e CI: use local scons cache instead of building a separate image (#29634)
* use local

* added ci_sim

* revert scons

* dont need these anymore

* same for sim

* fix dockerfiles
old-commit-hash: c46965fc27ecfe76e02affca2aacbe410a55196a
2023-08-25 16:06:17 -07:00
Justin Newberry b4e9669bc2 CI: add comment about building locally (#29635)
add comment about build
old-commit-hash: 584239ceb586ab3336b33d667c6620e874455e51
2023-08-25 15:49:07 -07:00
Adeeb Shihadeh 0d4beff6a0 process replay: parallel by default (#29633)
* process replay: parallel by default

* more is helpful
old-commit-hash: 4d6bb32df250a65ef92ad82dce812b91a73896c4
2023-08-25 14:41:43 -07:00
Mitchell Goff a3fbbb26ac Rewrite modeld in python (#29230)
* Added modeld.py (WIP)

* No more VisionIpcBufExtra

* Started work on cython bindings for runmodel

* Got ONNXModel cython bindings mostly working, added ModelFrame bindings

* Got modeld main loop running without model eval

* Move everything into ModelState

* Doesn't crash!

* Moved ModelState into modeld.py

* Added driving_pyx

* Added cython bindings for message generation

* Moved CLContext definition to visionipc.pxd

* *facepalm*

* Move cl_pyx into commonmodel_pyx

* Split out ONNXModel into a subclass of RunModel

* Added snpemodel/thneedmodel bindings

* Removed modeld.cc

* Fixed scons for macOS

* Fixed sconscript

* Added flag for thneedmodel

* paths are now relative to openpilot root dir

* Set cl kernel paths in SConscript

* Set LD_PRELOAD=libthneed.so to fix ioctl interception

* Run from root dir

* A few more fixes

* A few more minor fixes

* Use C update_calibration for now to exactly match refs

* Add nav_instructions input

* Link driving_pyx.pyx with transformations

* Checked python FirstOrderFilter against C++ FirstOrderFilter

* Set process name to fix test_onroad

* Revert changes to onnxmodel.cc

* Fixed bad onnx_runner.py path in onnxmodel.cc

* Import all constants from driving.h

* logging -> cloudlog

* pylint import-error suppressions no longer needed?

* Loop in SConscript

* Added parens

* Bump modeld cpu usage in test_onroad

* Get rid of use_nav

* use config_realtime_process

* error message from ioctl sniffer was messing up pyenv

* cast distance_idx to int

* Removed cloudlog.infos in model.run

* Fixed rebase conflicts

* Clean up driving.pxd/pyx

* Fixed linter error
old-commit-hash: 72a3c987c0d9de6a0cd7a02bba032ccd5e1efe43
2023-08-25 14:36:26 -07:00
Adeeb Shihadeh 34edef6a60 update azure-storage-blob (#29411)
Co-authored-by: Cameron Clough <cameronjclough@gmail.com>

old-commit-hash: c9e227a9c062aa5e9569472e88d720d1160819de
2023-08-25 22:01:10 +01:00
Harald Schäfer 8960f76597 K1FD: generate kalman gain at init (#29610)
* K1FD: generate kalman gain at init

* Update interfaces.py

* Update interfaces.py

* Update interfaces.py

* Update ref_commit
old-commit-hash: f1b8a8646438008b35c0445812b818745ad01fc2
2023-08-25 13:44:03 -07:00
Justin Newberry 4063a92683 CI: use GITHUB_ENV for env variables (#29616)
export doesn't work across steps
old-commit-hash: 90cb417caa049261797449d7e75eea01093e073d
2023-08-24 17:03:25 -07:00
Harald Schäfer bc017ab936 Locationd: enable laikad (#29570)
* experiment

* llk back

* update refs

* update ref

* no internet

* Update ref
old-commit-hash: 8205590624913b927d7abb1d214ea25886d7c1ea
2023-08-24 16:51:45 -07:00
Justin Newberry c4f322ce2d Linter: remove pylint (#29611)
remove pylint
old-commit-hash: 1ee6ed4b16e2ade0dd887c0687243aee769043e5
2023-08-24 16:30:54 -07:00
Justin Newberry 6847f819d1 CI: use scripts for docker build (#29599)
* use scripts

* remove common

* do login in the workflow

* separate step

* cleanup

* one script is cleaner

* keep it consistent

* review suggestions

* move in ci too

* PR cleanup
old-commit-hash: 3d9f238bf9a1f27c5a9a44df1b0f116182829be0
2023-08-24 16:09:08 -07:00
Harald Schäfer 200a8eb8b5 Laikad upgrades: prep for laikad lld (#29545)
* Laikad upgrades: prep for laikad lld

* Update ref commit
old-commit-hash: 8a7281d2859f2fa8d49cb3b679c2eaf5ec8f1729
2023-08-23 00:13:10 -07:00
Adeeb Shihadeh b952317e9b soundd: update cpu usage
old-commit-hash: e0e139a233daf207833ecc3655ca4fd3a86a9f8e
2023-08-22 15:16:38 -07:00
Harald Schäfer a967592f8f Revert laikad llk (#29535)
* Revert "bump laika (#29522)"

This reverts commit 19ab859e302d52b4f1667f05543ac622ad259e57.

* Revert "Locationd: switch to laikad (#29278)"

This reverts commit 5dda7be8ac08ef6b51283eda74569517bba905f6.
old-commit-hash: fda3106c28af236e8b3dc78bfdca7a1365904d1e
2023-08-22 14:12:51 -07:00
Adeeb Shihadeh 783463db74 sensord: update cpu usage after removing light sensor
old-commit-hash: 6a5725bb38007d61602c7c495c275d234cd29fac
2023-08-22 14:03:15 -07:00
Harald Schäfer 0174c5f21c Locationd: switch to laikad (#29278)
* use_laika

* Update test

* fix spacing

* fix proc replay

* small fix

* Try correct std

* cast correctly

* experimental

* simpler

* update reset thresholds

* improve

* Ready for live running

* outlier reject

* update laika

* add fine speeds

* more experiments

* fixes

* all in laika

* more small tweaks

* outlier rejection not needed

* fix conflict

* no more gpslocation

* update test

* refactor to laika

* runs again

* Update ref
old-commit-hash: fd3b8a3d7511ad3d7c5aa0b82a1e2c28505e5a7f
2023-08-21 22:51:02 -07:00
Justin Newberry 7205b92bb6 CI: use scons cache mount for building simulator and docs (#29436)
* build docker image with scons cache

* use setup

* scons cache

* added the dockerfile

* add the shell

* docs use cache

* dont pull lfs for docs

* simulator too

* dont pull the cache image

* fix inputs

* inputs

* booleans aren't supported

* bool not supported

* bool isnt supported

* fix

* readonly cache

* fix sim cache too

* respect readonly

* gitignore and move to correct folder

* also copy old

* move to tools/ci

* move to selfdrive/test

* just make the cache writable, it's discarded anyway

* minimize diff in this pr
old-commit-hash: 197460e06136f66f60e10ccefece646cb472b872
2023-08-21 15:11:31 -07:00
Adeeb Shihadeh 16ec56398c add openpilot prefix to imports (#29498)
* add openpilot prefix to imports

* more

* more

* fix docs

* fix linter

* bump submodules

* fix patched tests

* update dynamic imports

* debug

* Revert "debug"

This reverts commit db5e13b9911cc74438bee123bc3430da6c31b24b.

* fix pm test
old-commit-hash: a9626f95b69af19306143fc4def02fb5769405d2
2023-08-20 20:49:55 -07:00
Harald Schäfer 92d1e3fabb Proc replay: field tolerance unused (#29479)
field tolerance unused
old-commit-hash: 1dea20e57485a79ff4e1515d892e589ed4a4c65e
2023-08-20 13:05:18 -07:00
Shane Smiskol 1a2818d775 Revert "radard: tie radard frequency to modelV2 vol. 2 (#29240)" (#29474)
* Revert "static analysis fixes"

This reverts commit 2271d0adf9a02aee1359717c47cb6280893a6b9b.

* Revert "radard: tie radard frequency to modelV2 vol. 2 (#29240)"

This reverts commit 6757e90415766e84ad1b6c921a2edb29ceb3bbbe.

* update refs
old-commit-hash: 1a08c2986e5600dd4e84bfeaed26c74e679085de
2023-08-18 22:56:43 -07:00
Shane Smiskol 52bc87c4f2 upadte process replay refs
old-commit-hash: e4ecb511c9d1342c9e42439004c388b9b15340a7
2023-08-17 00:45:44 -07:00
Kacper Rączy deb8257322 process_replay: prevent creating orphaned processes if replay fails during setup (#29426)
Fix the ability to cleanup, if process container fails during start
old-commit-hash: f07e4fb49a20b915e887f6a834ff3bc3636aa9cf
2023-08-16 10:37:19 -07:00
Justin Newberry 268fb070a8 Subaru: calculate steering angle rate (#29409)
* calculate rate

* added adeeb's comment

* move to selfdrive/car

* that makes way more sense

* much simpler

* fix rate

* preglobal doesn't have a counter

* update ref

* merge

* update ref after merging
old-commit-hash: 7ec52da33ade1b0926b38fb5dc1e2bc52e957bad
2023-08-15 15:28:46 -07:00
Jason Young b4614b3c28 car interfaces: cleanup tire stiffness calculation (#28263)
* cleanup tire stiffness calculation

* bump cereal

* think these todos still apply

* gm: same default

* revert comments

* bump

* update refs

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
old-commit-hash: 90c4bbe8e4ee11f3c1289a0dbb93262824fa430c
2023-08-15 14:17:08 -07:00
Adeeb Shihadeh 1ca3343d0c add small ui for jenkins runners (#29382)
old-commit-hash: 09ffce80737ec54ada27be5643e223ba1db12bd1
2023-08-13 18:01:51 -07:00
Adeeb Shihadeh 9a7e8e931a cleanup unused python packages (#29353)
* rm unused python packages

* lock
old-commit-hash: d6857996d3376aa757acdc697d33eb82088f523e
2023-08-11 21:34:47 -07:00
Kacper Rączy 4017b1707c radard: tie radard frequency to modelV2 vol. 2 (#29240)
* radard: tie radard frequency to modelV2

Accumulate parsed messages until state is updated (toyota)

Same for honda

Rename rr to something more descriptive

* Change _update method name, since signature has changed

* Update ref commit

* Some renames

* Check for number of cans
old-commit-hash: 460f5c8e0b2fd2c420e211b09b70d1d79834a929
2023-08-11 18:07:06 -07:00
Justin Newberry f33b4de80b Ruff: b905 (strict zip) (#29336)
* added mutable default args

* most of the Bs

* add comment about lrucache

* b905
old-commit-hash: e4ead4f1830618f5f61978491930cb0b8d36ab26
2023-08-11 16:13:51 -07:00
Justin Newberry d487c0501f Ruff: enable most of bugbear (#29320)
* added mutable default args

* most of the Bs

* add comment about lrucache
old-commit-hash: 62c1e6592439119f360dd64b854e7047f35222ba
2023-08-11 15:33:49 -07:00
Justin Newberry 715f028a0e Ruff: enable flake8-builtins (#29315)
* enable flake8-builtins

* replace any with contains

* fix typo in pack

* fix type

* format is from the parent module, has to be enabled

* item_id

* fix item_id

* disable for id since that's what the remote server returns
old-commit-hash: 8793cbff40662a92bff16d75b51479c80517305a
2023-08-10 18:58:22 -07:00
Justin Newberry a14f162bc7 Ruff: comprehensions conventions (#29317)
ignore c408
old-commit-hash: 4a9afd7554060ac5353e96f1d7feb06d3a3671e9
2023-08-10 16:40:30 -07:00
Adeeb Shihadeh b7f6b6dc95 pytest unit test running (#29261)
* setup config

* collect passes

* pytest system/ works
old-commit-hash: 670fa9af5f66278152acf477b19d19559733094f
2023-08-10 08:23:19 -07:00
Mitchell Goff e6e19f8d3e Non-Inflatable Model 🎈 (#29003)
* Added all maneuvers to navInstruction message

* Added nav instruction logic to modeld

* New model: fcee01c1-96bb-414f-b00d-e4a994a00922/700

* Fixed bug in navd

* Added sharp/slight modifiers

* Updated refs
old-commit-hash: c04e5d12fce1801cd555a4846768b68db7090b17
2023-08-09 19:56:45 -07:00
Adeeb Shihadeh 3821ca13eb jenkins: cleanup all orphaned git locks (#29296)
old-commit-hash: c53545621e865dbee2661442f03f00152c48b92c
2023-08-09 15:14:50 -07:00
Justin Newberry 3ee0786de3 CI: Pylint to ruff (#29294)
* pylint to riff

* pylint to riff

* pylint to riff

* revert more

* undo exclude removal

* exclude tinygrad

* set line length

* pylint exclusions to ruff

* same excludes as old linter

* fix tools QA

* remove unrequired check

* revert linting third_party

* ignore e402
old-commit-hash: 7fdd9fc37c1c5febf1cd3dc86441ebf0dec7f370
2023-08-09 13:26:54 -07:00