Commit Graph

37 Commits

Author SHA1 Message Date
Adeeb Shihadeh 9cfdd6200d Remove setproctitle (#32716)
* Custom setproctitle (#32667)

* add custom setproctitle

* add test

* Update poetry.lock

* fix lint

* support only Linux

* test only Linux

* final lint

* Update test_setproctitle.py

* Update setproctitle.py

* convert to threadnames

* delete proctitles

* Check str len and use PR_GET_NAME

* fix poetry.lock

* lint fix

* Update common/threadname.py

---------

Co-authored-by: reddyn12 <nikhilr.ssm@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* revert that for now

* use last 15

* fix

* use name

* update those

* and modeld

* rm

---------

Co-authored-by: schlimeszn <138847413+schlimeszn@users.noreply.github.com>
Co-authored-by: reddyn12 <nikhilr.ssm@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 83ac80c6c899dbf4b5b2d422947b02b57d83bccd
2024-06-11 21:57:32 -07:00
Adeeb Shihadeh e920e57530 Revert "Custom setproctitle (#32667)"
This reverts commit 1f45e163559baa2a6127d5a5e8deb7067e32f813.

old-commit-hash: 5b51f039675edbbdfbeac72cd9c518450a85bc04
2024-06-10 19:55:41 -07:00
schlimeszn afea57ae2a Custom setproctitle (#32667)
* add custom setproctitle

* add test

* Update poetry.lock

* fix lint

* support only Linux

* test only Linux

* final lint

* Update test_setproctitle.py

* Update setproctitle.py

* convert to threadnames

* delete proctitles

* Check str len and use PR_GET_NAME

* fix poetry.lock

* lint fix

* Update common/threadname.py

---------

Co-authored-by: reddyn12 <nikhilr.ssm@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 3365ed5effa48d34ffe0e2e9bbe9f6941336bed5
2024-06-10 18:59:01 -07:00
Harald Schäfer f870a968e9 Split cereal into cereal/msgq (#32631)
* squash

* fix doc

* compile device

* compile device

* Update ref

* add msgq to precommit exclusions

* No service ports

* fix compile

* address comments

* More comments

* Delete logger

* Update opendbc

* Linting

* bump msgq
old-commit-hash: e71ec4e8d7e39a56235f590227e7cb361cd8b79d
2024-06-06 14:31:56 -07:00
Adeeb Shihadeh 7a3e454d27 move sentry/stats to system/ (#32490)
* move sentry/stats to system/

* fix
old-commit-hash: da6fd751257bcd3aa087ac4114e9f1529f7d3d12
2024-05-20 22:39:25 -07:00
Adeeb Shihadeh 3358745103 ruff: enable UP
old-commit-hash: b2e4c64cf8fe3256d1e411e8715c29e2eb6f4f00
2024-05-20 17:43:54 -07:00
Adeeb Shihadeh cca041d5a2 modeld: less spammy with no cams
old-commit-hash: 34912b29c1aef1d2561592010978067bcb150459
2024-04-09 13:45:45 -07:00
YassineYousfi 9691393bde WD40 model (#32141)
* 2eedcd90-b7db-46cb-86be-740f48ded7ab/700

* cleanup some constants

* update model replay ref
old-commit-hash: 6c3a33a6d847c946e11f5a6414e270ae3ee5c03d
2024-04-09 11:19:43 -07:00
YassineYousfi 75a69e12b3 disable navigate on openpilot (#32106)
* 2eedcd90-b7db-46cb-86be-740f48ded7ab/700

* noop ciao

* here too

* mapsd too

* update translations

* disable mapsd test from test onroad

* disable mapRenderState test from timings

* lint

* fix exp mode toggle panel

* update tr

* french done

* dont build mapd

* only no nav

* just comment

* deprecate nav fields

* rm not comment

* dont deprecate too much

* remove from services

* merge cereal
old-commit-hash: 754dd45ffa82bf3d7f2d3413c4132eb65551ebd5
2024-04-09 10:40:38 -07:00
Adeeb Shihadeh da31ce154a refactor camera transformations (#31818)
* refactor camera transormations

* update users

* more stuff

* more fix

* swap

* tici

* lil shorter
old-commit-hash: e3589e4b5cc783001c95b52cce066647b4ae0c6c
2024-03-10 16:56:50 -07:00
Adeeb Shihadeh f60cbbb04b modeld: prep for camera transform refactor (#31820)
* modeld: prep for camera transform refactor

* update refs

* add pub

* do setup
old-commit-hash: 7436aa8b053aeccfc9bacb06bfaf4a42b3ec5f78
2024-03-10 16:39:40 -07:00
Cameron Clough 9bd90112d0 use pyupgrade to update to new typing syntax (#31580)
* add pyupgrade hook

* run pyupgrade (pre-commit run -a)

* ruff --fix

* Revert "add pyupgrade hook"

This reverts commit 56ec18bb6b8602a0b612f3803d96cdad14b52066.

* revert changes to third_party/

* manual type fixes

* explicit Optional wrapping capnp objects
old-commit-hash: 995250ae4967943ee33a3699a1d89a7a770d95e9
2024-02-24 16:41:23 -08:00
Adeeb Shihadeh 5b8eb7f9c7 modeld: add extra log for startup time debugging
old-commit-hash: 675eeb9d1605cb1eeca6e8752fa02b6c24512600
2024-02-19 22:33:30 -08:00
Harald Schäfer 48bd8c2aaa Modeld: cleanup unused variables (#31516)
Modeld: cleanup used variables
old-commit-hash: d371fb042c7a7c22f90ba99340ca1dd705f7e22d
2024-02-19 17:07:15 -08:00
Adeeb Shihadeh 1afe1fed8a more modeld logging (#31510)
old-commit-hash: 86184b76d5cf557e0b76efe64913e3dea85f4f4c
2024-02-19 10:46:04 -08:00
Adeeb Shihadeh 9ca2d61313 modeld: fix and cleanup getting carParams (#31488)
old-commit-hash: 5a441ec0c4bf39a5e066e307ee6c9a8b55f8d8b5
2024-02-15 22:20:00 -08:00
Harald Schäfer f9d5fc7dd9 Los Angeles Model 2 (#31135)
* 7045fb53-6739-4338-8426-20cbd4ad7832/600

* Update constants

* Update parse

* Typos

* Update ref

* 26057144-130f-48e1-8a98-00fae53ae7db/700

* Update ref
old-commit-hash: f55e6a3b81bf08bce9cb9d2357db5bbf529d1d39
2024-01-24 15:26:22 -08:00
Harald Schäfer 215b346dc0 Los Angeles Model (#31037)
* 1c888f5b-c213-4c1c-9eba-c587afd047fc/700

* Move to action

* Updates

* Add steer delay

* Update curvature grep

* clip speed

* No car params for now

* Add delay back

* Update

* fix lint

* fix lint

* update model regf
old-commit-hash: 0067cf3eb1fce18a4d9c548a0c136027c87d43aa
2024-01-22 00:58:06 -08:00
Bruce Wayne 4a03691a20 Revert "Refactor modeld (#31099)"
This reverts commit 7fc3acd8ac1c7139953bb96c827050120af6543b.

old-commit-hash: 3b01733900a531c7080f3b2b8d16d633cb18edb7
2024-01-21 17:29:32 -08:00
Harald Schäfer 34bdee83e0 Refactor modeld (#31099)
* First commit

* Allow

* Just camerastream helper
old-commit-hash: 599325718ebdecba993c3a93e4c416e47b72c343
2024-01-21 17:10:40 -08:00
Harald Schäfer 66dbadb029 Delete lat planner (#31089)
* Initial commit

* Fixup

* typo

* ignore lateral plan

* Update cereal

* Remove lateralPlan

* Fix release build

* Fix release build

* give car params

* Add carParams to include_all_types

* Write car param in powerdraw test

* add demo mode

* Update model regf

* proc replay ref commit

* Try

* Move enum definition

* Update cereal

* typo

* Write car param for modeld test

* Update ref

* Update model ref again

---------

Co-authored-by: Kacper Rączy <gfw.kra@gmail.com>
old-commit-hash: e6c97c384671b448f307a7ed91416886f2186d80
2024-01-21 12:09:48 -08:00
Adeeb Shihadeh 59eb2988de swaglog.py goes in common/ (#30631)
* swaglog.py goes in common/

* all of these go in release

* we'll even include the pyx
old-commit-hash: 35f819c8239b8ac3a000087a0f791b91ccea5e5e
2023-12-06 17:27:51 -08:00
YassineYousfi 91751770a8 (New) Lemon Pie Model 🍋 (#30209)
* 6f6e3749-1b7c-42e8-a33b-03929b7fc476/700

* oops deleted too much

* 1b4308b7-a659-4ebd-b4c6-c81c1c3890f8/700

* 1be192f3-f407-4217-9757-78b9ad92750a/700

* remove some todos

* more cleanup in lat planner

* vego > min_speed

* regen and update process replay refs

* update model replay ref

* update model replay ref commit again

* Revert "update model replay ref commit again"

This reverts commit 922cb796b8dfe264b0cce7a18206bb898b18bcb3.

* update again

* bump cereal
old-commit-hash: 4c2bd853e4410db7f0d80e258291408e94c6c068
2023-11-02 14:01:00 -07:00
mitchellgoffpc e911cab412 Added sentry hooks for modeld
old-commit-hash: eecdaf9950b150de723b5a5ec94cdbf7a063571a
2023-10-25 21:37:54 -07:00
YassineYousfi 8ea8f8710c modeld: send_raw_pred under a flag (#30298)
* modeld: SEND_RAW_PRED under a flag

* not twice
old-commit-hash: b7cc6983c31b158e2552192ee6f9fdf6116adc8e
2023-10-20 13:53:22 -07:00
YassineYousfi d18f185115 modeld: parsing and publishing in python (#30273)
* WIP try modeld all in python

* fix plan

* add lane lines stds

* fix lane lines prob

* add lead prob

* add meta

* simplify plan parsing

* add hard brake pred

* add confidence

* fix desire state and desire pred

* check this file for now

* rm prints

* rm debug

* add todos

* add plan_t_idxs

* same as cpp

* removed cython

* add wfd width - rm cpp code

* add new files rm old files

* get metadata at compile time

* forgot this file

* now uses more CPU

* not used

* update readme

* lint

* copy this too

* simplify disengage probs

* update model replay ref commit

* update again

* confidence: remove if statemens

* use publish_state.enqueue

* Revert "use publish_state.enqueue"

This reverts commit d8807c8348338a1f773a8de00fd796abb8181404.

* confidence: better shape defs

* use ModelConstants class

* fix confidence

* Parser

* slightly more power too

* no inline ifs :(

* confidence: just use if statements
old-commit-hash: cad17b125595c4654bfd8299b041b94ccb3faf73
2023-10-19 14:23:51 -07:00
Kacper Rączy 5d0e7e9373 modeld: don't attempt to connect extra vipc client if its not available (#30154)
Do not connect extra client if it's not available
old-commit-hash: 5cb9291de89d547354dde32453a1b19ae68812cd
2023-10-03 15:54:21 -07:00
Adeeb Shihadeh 03c4bdc0be Revert "modeld: remove extra cloudlog.bind, manager does this"
This reverts commit d99afd438be153166affb99ce366c537d977ba47.

old-commit-hash: 362c0bf2cadc3b54ad62472755a507fd6b3af825
2023-09-21 20:13:13 -07:00
Adeeb Shihadeh f0a8853060 modeld: remove extra cloudlog.bind, manager does this
old-commit-hash: 754af893e96039b1fa5cf39a0b739d05c9c48223
2023-09-21 20:06:46 -07:00
Mitchell Goff 65fc9f14b3 Update model input names to match onnx inputs (#29855)
Updated model input names to match onnx inputs
old-commit-hash: 2d69f3d63e5462e8b095fab097c4aff00bd1c83a
2023-09-08 16:06:16 -07:00
Mitchell Goff cd7d73eaf8 Added ModelRunner helpers in modeld/runners/__init__.py (#29737)
* Added ModelRunner helper class

* import Runtime in __init__.py
old-commit-hash: d5a55136a14537ec2b7b280aad4efdb61f38238c
2023-08-31 14:19:20 -07:00
mitchellgoffpc aca5580900 Move Runtime into runmodel_pyx
old-commit-hash: f91e955a86baaa6ff6ef686bb821177a668034e1
2023-08-31 13:51:50 -07:00
mitchellgoffpc e9c82290c0 Remove unnecessary hardware check in modeld
old-commit-hash: 857f747467f3dd1eb92cc39dafc2da4ea0a708c5
2023-08-31 13:51:49 -07:00
Mitchell Goff fa770f1ccc Combine update_calibration/get_warp_matrix (#29719)
old-commit-hash: 151ac4bf7631a60e05c7490515e58c3309de445b
2023-08-30 15:16:29 -07:00
Mitchell Goff 54988e457f Move update_calibration to modeld.py (#29688)
* Move update_calibration to modeld.py

* Updated ref commit
old-commit-hash: 1eb60516cbcfa014cfd728123b6b3a5b97fce2df
2023-08-30 14:12:52 -07:00
Mitchell Goff c4ae1fae5a Added USE_THNEED environment variable and removed build flag (#29645)
old-commit-hash: d998fd88a80e61e44692c50deefc91a7f94b59a2
2023-08-29 14:07:57 -07:00
Mitchell Goff a3fbbb26ac Rewrite modeld in python (#29230)
* Added modeld.py (WIP)

* No more VisionIpcBufExtra

* Started work on cython bindings for runmodel

* Got ONNXModel cython bindings mostly working, added ModelFrame bindings

* Got modeld main loop running without model eval

* Move everything into ModelState

* Doesn't crash!

* Moved ModelState into modeld.py

* Added driving_pyx

* Added cython bindings for message generation

* Moved CLContext definition to visionipc.pxd

* *facepalm*

* Move cl_pyx into commonmodel_pyx

* Split out ONNXModel into a subclass of RunModel

* Added snpemodel/thneedmodel bindings

* Removed modeld.cc

* Fixed scons for macOS

* Fixed sconscript

* Added flag for thneedmodel

* paths are now relative to openpilot root dir

* Set cl kernel paths in SConscript

* Set LD_PRELOAD=libthneed.so to fix ioctl interception

* Run from root dir

* A few more fixes

* A few more minor fixes

* Use C update_calibration for now to exactly match refs

* Add nav_instructions input

* Link driving_pyx.pyx with transformations

* Checked python FirstOrderFilter against C++ FirstOrderFilter

* Set process name to fix test_onroad

* Revert changes to onnxmodel.cc

* Fixed bad onnx_runner.py path in onnxmodel.cc

* Import all constants from driving.h

* logging -> cloudlog

* pylint import-error suppressions no longer needed?

* Loop in SConscript

* Added parens

* Bump modeld cpu usage in test_onroad

* Get rid of use_nav

* use config_realtime_process

* error message from ioctl sniffer was messing up pyenv

* cast distance_idx to int

* Removed cloudlog.infos in model.run

* Fixed rebase conflicts

* Clean up driving.pxd/pyx

* Fixed linter error
old-commit-hash: 72a3c987c0d9de6a0cd7a02bba032ccd5e1efe43
2023-08-25 14:36:26 -07:00