Commit Graph

199 Commits

Author SHA1 Message Date
Adeeb Shihadeh 8a84e369a0 bootlog doesn't block startup (#31061)
* bootlog doesn't block startup

* keep params

* fix

* cleanup
old-commit-hash: c4362bd958d1473b97ae336fd0e9bd7b50fe4fb9
2024-01-18 20:04:08 -08:00
Adeeb Shihadeh f5bf1a3389 manager: clean exit on ctrl-c
old-commit-hash: 3918039e293c1784cecc49cca41bc1907f23f146
2024-01-10 19:37:10 -08:00
Adeeb Shihadeh 59eb2988de swaglog.py goes in common/ (#30631)
* swaglog.py goes in common/

* all of these go in release

* we'll even include the pyx
old-commit-hash: 35f819c8239b8ac3a000087a0f791b91ccea5e5e
2023-12-06 17:27:51 -08:00
Justin Newberry 817161f3ac Soundd: move to python (#30567)
soundd python
old-commit-hash: abe39e50766c418818bf72d2567db78978dbd466
2023-12-05 18:10:01 -08:00
Adeeb Shihadeh f3dec8658c Revert "Simplify passive mode handling (#30593)"
old-commit-hash: 99d51bf02c5a13f3064b012da55634f8a319091e
2023-12-04 15:05:05 -08:00
Adeeb Shihadeh 4be789d40a Simplify passive mode handling (#30593)
* simplify passive handling

* makes more sense
old-commit-hash: 5ccff25d885365e4247665fdf8380c6b67c36b28
2023-12-03 13:59:59 -08:00
Adeeb Shihadeh 1cc4f1a634 new msgs default to invalid (#30587)
* new msgs default to invalid

* fix lm

* set more valid

* update rest

* update refs

* fix logMessage

* more valids

* cleanup

* fix llk test

* pigeond is also valid

* more valids
old-commit-hash: a1d36961cf9fa0c6a9c41fe92d6504de5d36cbaa
2023-12-03 10:50:17 -08:00
Adeeb Shihadeh 4394116e5b clear non-release params on startup (#30583)
old-commit-hash: 531e62fc033b06b54f11c702dcbde5982bfe41e6
2023-12-01 23:57:54 -08:00
Kacper Rączy d062a97a26 webrtcd: webrtc streaming server (audio/video/cereal) (#30186)
* WebRTCClient and WebRTCServer abstractions

* webrtc client implementation

* Interactive test scripts

* Send localDescriptions as offer/asnwer, as they are different

* Tracks need to be added after setting remote description for multi-cam streaming to work

* Remove WebRTCStreamingMetadata

* Wait for tracks

* Move stuff to separate files, rename some things

* Refactor everything, create WebRTCStreamBuilder for both offer and answers

* ta flight done time to grind

* wait for incoming tracks and channels

* Dummy track and frame reader track. Fix timing.

* dt based on camera type

* first trial of the new api

* Fix audio track

* methods for checking for incoming tracks

* Web migration part 2

* Fixes for stream api

* use rtc description for web.py

* experimental cereal proxy

* remove old code from bodyav

* fix is_started

* serialize session description

* fix audio

* messaging channel wrapper

* fix audiotrack

* h264 codec preference

* Add codec preference to tracks

* override sdp codecs

* add logging

* Move cli stuff to separate file

* slight cleanup

* Fix audio track

* create codec_mime inside force_codec function

* fix incoming media estimation

* move builders to __init__

* stream updates following builders

* Update example script

* web.py support for new builder

* web speaker fixes

* StreamingMediaInfo API

* Move things around

* should_add_data_channel rename

* is_connected_and_ready

* fix linter errors

* make cli executable

* remove dumb comments

* logging support

* fix parse_info_from_offer

* improve type annotations

* satisfy linters

* Support for waiting for disconnection

* Split device tracks into video/audio files. Move audio speaker to audio.py

* default dt for dummy video track

* Fix cli

* new speaker fixes

* Remove almost all functionality from web.py

* webrtcd

* continue refactoring web.py

* after handling joystick reset in controlsd with #30409, controls are not necessary anymore

* ping endpoint

* Update js files to at least support what worked previously

* Fixes after some tests on the body

* Streaming fixes

* Remove the use of WebRTCStreamBuilder. Subclass use is now required

* Add todo

* delete all streams on shutdown

* Replace lastPing with lastChannelMessageTime

* Update ping text only if rtc is still on

* That should affect the chart too

* Fix paths in web

* use protocol in SSLContext

* remove warnings since aiortc is not used directly anymore

* check if task is done in stop

* remove channel handler wrapper, since theres only one channel

* Move things around

* Moved webrtc abstractions to separate repository

* Moved webrtcd to tools/webrtc

* Update imports

* Add bodyrtc as dependency

* Add webrtcd to process_config

* Remove usage of DummyVideoStreamTrack

* Add main to webrtcd

* Move webrtcd to system

* Fix imports

* Move cereal proxy logic outside of runner

* Incoming proxy abstractions

* Add some tests

* Make it executable

* Fix process config

* Fix imports

* Additional tests. Add tests to pyproject.toml

* Update poetry lock

* New line

* Bump aiortc to 1.6.0

* Added teleoprtc_repo as submodule, and linked its source dir

* Add init file to webrtc module

* Handle aiortc warnings

* Ignore deprecation warnings

* Ignore resource warning too

* Ignore the warnings

* find free port for test_webrtcd

* Start process inside the test case

* random sleep test

* test 2

* Test endpoint function instead

* Update comment

* Add system/webrtc to release

* default arguments for body fields

* Add teleoprtc to release

* Bump teleoprtc

* Exclude teleoprtc from static analysis

* Use separate event loop for stream session tests
old-commit-hash: f058b5d64eed31878533a85f25eb53386ff9e330
2023-12-01 21:13:37 -08:00
Adeeb Shihadeh ca85e5b82a rename rawgpsd to qcomgpsd (#30493)
* rename rawgpsd to qcomgpsd

* fix more paths

* that moved

* forgot the d
old-commit-hash: 4cae08e6369c0f63229222c0b3815da983928787
2023-11-18 23:23:16 -08:00
Adeeb Shihadeh 8d3a5970d4 jenkins: use build.py to manage cache size (#30440)
* jenkins: use build.py to manage cache size

* label

* set pp

* double

* cleanup

* non mimimal build on PC

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
old-commit-hash: 5f7143df02b857201e2615240ccd1be06daa32fe
2023-11-10 16:55:25 -08:00
Justin Newberry 3027a428cb Pytest: tici mark for skipping on-device tests (#30412)
* mark tici

* not those ones

* missed that one

* add those

* add pypoetry

* oops
old-commit-hash: aec7cea30d48dc8915eea38c86de7d4effa0548d
2023-11-07 17:35:44 -08:00
Adeeb Shihadeh 331f95a2e2 remove mapsd exit code exception (#30398)
old-commit-hash: af86e305669b477d76a14485bd750f843aa0175d
2023-11-06 21:26:52 -08:00
Harald Schäfer 7c4d29c3d1 Rm laikad (#30299)
* rm laika

* Rm laika

* Needed this

* More rm

* More rm
old-commit-hash: 56dea7b0b42e7624a39fef0986cd0db151bb9512
2023-10-23 00:15:39 -07:00
Adeeb Shihadeh 3d602a86dc delete clocksd (#30252)
old-commit-hash: 67f2321060321a87082e297151692ed9b36de2c0
2023-10-22 14:47:38 -07:00
Mitchell Goff 5732002296 Rewrite dmonitoringmodeld in python (#29740)
* Added dmonitoringmodeld.py

* Removed dmonitoringmodeld.cc

* Use ModelRunner helpers from runners/__init__.py

* Fixed DriverStateResult field ordering

* Some bug fixes

* Set calib input

* Look ma, no loop!

* Bump dmonitoringmodeld cpu usage in test_onroad

* Fixed memory leak caused by np.ctypes.data_as

* Formatting fixes

* chmod +x

* remove USE_ONNX_MODEL

* Realtime priority 1, formatting fixes
old-commit-hash: 503fa121ee83469763e9386b9e5df7a733693e2c
2023-09-07 19:46:43 -07:00
Mitchell Goff f9daa1d1cc Rewrite navmodeld in python (#29579)
* Added navmodeld.py

* Deleted navmodeld.cc

* Write SConscript config flags to config.py

* Remove deleted files from release/files_common

* Some more bug fixes

* Added config.py to gitignore

* Get rid of config.py

* Use set_realtime_priority

* A tiny bit more cleanup

* set realtime priority 1

* Use ModelRunner helper class from runners/__init__.py

* Formatting fixes

* mama mia that's a SPICY memory leak
old-commit-hash: 0c0af682a13753a3db971b12c2852cfddf1e5b49
2023-09-07 14:39:37 -07:00
Justin Newberry c4f322ce2d Linter: remove pylint (#29611)
remove pylint
old-commit-hash: 1ee6ed4b16e2ade0dd887c0687243aee769043e5
2023-08-24 16:30:54 -07:00
Adeeb Shihadeh 61cf541322 Minimal build (#29600)
* add build flag for minimum build

* add minimal build

* update

* fix pj

* bump opendbc

* update subaru
old-commit-hash: 4917e22615adbfcc9b3c3ec89b00d240e0b48883
2023-08-24 14:58:30 -07:00
Adeeb Shihadeh 5bc6566e7c manager: refactor process starting logic (#29574)
* refactor into sane api

* always set

* cleanup

* cleanup

* and there too

* fix order

* fail

* and ensure we test

* pass test

pass test

* order

* only diff not related

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
old-commit-hash: d013f2174adf8ffbf2ba86e2656cf438930850a6
2023-08-24 06:00:55 -07:00
Shane Smiskol 8326f9f90c manager: test process exclusion (#29586)
* add test

* add comment

* Update selfdrive/manager/test/test_manager.py

* more accurate
old-commit-hash: 84b897cf44104d964834979d6fc34822baa999bf
2023-08-24 00:34:36 -07:00
Adeeb Shihadeh e9a497dc5b build.py: retry with less threads (#29543)
* build.py: retry with less threads

* cleanup

* fix no output

* cleanup
old-commit-hash: bb1b641812353e9723cad0aa6f844466c67d9c6b
2023-08-22 20:58:43 -07:00
Adeeb Shihadeh 16ec56398c add openpilot prefix to imports (#29498)
* add openpilot prefix to imports

* more

* more

* fix docs

* fix linter

* bump submodules

* fix patched tests

* update dynamic imports

* debug

* Revert "debug"

This reverts commit db5e13b9911cc74438bee123bc3430da6c31b24b.

* fix pm test
old-commit-hash: a9626f95b69af19306143fc4def02fb5769405d2
2023-08-20 20:49:55 -07:00
Adeeb Shihadeh 51634f52dc replace custom clock helpers with time module (#29499)
* replace custom clock stuff wtih time module

* fix double

* fix release

* bump cereal

* update type

* fix one more
old-commit-hash: d61f86d3398900ef01423d24cfdf897392a8efbb
2023-08-20 18:50:58 -07:00
Shane Smiskol 92ff85f4b4 Update TOTAL_SCONS_NODES
Should add a CI test for this
old-commit-hash: 3e2903a0c184a203718e2430aa33da6e3b62bf7f
2023-08-14 17:34:19 -07:00
Vivek Aithal 8d11558056 [commabody] setup and run live stream encoders (#29087)
* op changes needed for body

* remove logmessaged callback

* add newlines

* add stream arg

* add stream_encoder to config

* supersets, avoid two encoderd

* fix recursive exit error

* fix loggerd crash

* add stream_encoderd cpu usage to test

* Update system/loggerd/loggerd.h

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* resolve comments

* stream_encoderd onroad to false

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 81322a48059bfb77c1e5613dea35e24181c8bb14
2023-08-11 15:34:25 -07:00
Justin Newberry d487c0501f Ruff: enable most of bugbear (#29320)
* added mutable default args

* most of the Bs

* add comment about lrucache
old-commit-hash: 62c1e6592439119f360dd64b854e7047f35222ba
2023-08-11 15:33:49 -07:00
Vivek Aithal c1bcb53d4e [commabody] Add new body teleop ui (#29282)
* Revert "Revert "[commabody] Add new body teleop ui (#29119)" (#29249)"

This reverts commit 5dcfddbbfbddf00d16cb1f28c51f3dffc75d7cf6.

* add to release files

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: e7d307ca1b064c3789902bc077e93453dd96794b
2023-08-08 14:12:51 -07:00
Harald Schäfer c0fbbd4b36 Revert "[commabody] Add new body teleop ui (#29119)" (#29249)
This reverts commit 0df6353569b77869ce4ddc8ce43bab621bccd107.
old-commit-hash: 623351e4edb01b7c66612e43e5e8ebefd237276d
2023-08-05 07:15:35 -07:00
Vivek Aithal 082b1fd924 [commabody] Add new body teleop ui (#29119)
* add new ui

* move body tele op ui to new dir

* fix codespell errors

* resolve mediablackhole pylint error

* fix import error

* style fixes

* use logging, not print

* fix js styling

* resolve comments
old-commit-hash: a7304d059cb2f4e57e64fcbabb4f9079f1ea659d
2023-08-04 13:56:46 -07:00
Adeeb Shihadeh 6cdd601cfe manager: remove old unkillable process handling (#29209)
old-commit-hash: bc0aa1c59865645ea40f8b26fd2fc2cc58a7eb92
2023-08-01 22:18:58 -07:00
Kacper Rączy 67ac96c8b4 process_replay: capture process output (#29027)
* Add ProcessOutputProxy

* Move launcher to its own field

* Move ProcessOutputCapture to its own file

* Return itself from __enter__ of OpenpilotPrefix

* Integrate ProcessOutputCapture into process_replay

* Add note about capture_output_store to README

* ipykernel import is optional

* Disable type checking for link_with_current_proc

* Remove assertion

* Decode outputs to utf-8

* read(self): return empty buf if its none

* Fix type annotations

* Replace fifo with regular file, to avoid hitting fifo size limit
old-commit-hash: 547a033a3c32f05f2dd678280cee4d7378b60b83
2023-07-31 16:30:58 -07:00
Adeeb Shihadeh fcdc91aa35 mapsd exit needs some work
old-commit-hash: 571bf47b0a1438ef2e09437e4749f150969f57ec
2023-07-24 20:22:14 -07:00
Adeeb Shihadeh d76b76c090 test_manager: skip mapsd check for now
old-commit-hash: 2aa3000371e2c9242237e63a01722f28c4c4bd46
2023-07-18 19:15:47 -07:00
Adeeb Shihadeh ebae4d9579 manager: create params once (#28757)
old-commit-hash: 260e83d8e4b8902190f959696e7cd340c10dcd65
2023-06-30 10:03:45 -07:00
Adeeb Shihadeh 6baeca82c7 manager: write ublox param on change (#28748)
old-commit-hash: 9ca96cc4b10f49d8e5fc2779c9dbadb134533f41
2023-06-29 16:05:00 -07:00
Mitchell Goff 77b5e197aa Enable nav features in modeld (#28448)
* Enable nav features in modeld

* Enable mapsd/navmodeld

* Updated model_replay_ref_commit and added mapsd/navmodeld to test_onroad

* fixed process name

* always publish from mapsd
old-commit-hash: aadd9ae269e682b6893557a89a02a7ae357206ee
2023-06-16 21:27:35 -07:00
Mitchell Goff 300071a27c Rename map_renderer -> mapsd (#28580)
old-commit-hash: 6509cde41b0484131d4dcf41cb1f81769fe319d6
2023-06-16 20:12:50 -07:00
Adeeb Shihadeh ee363d69e3 fix a bunch of python warnings (#28576)
* fix a bunch of python warnings

* fix that
old-commit-hash: 111b4eee30d3a8f79d082b78e9158cbe262f1a14
2023-06-16 13:22:30 -07:00
Adeeb Shihadeh 2b9b5e3646 manager: watchdog restart UI with SIGKILL (#28523)
old-commit-hash: 58d32a70d7c6cd8285a0bc2ae03926b71a2d004e
2023-06-12 21:46:20 -07:00
Adeeb Shihadeh 2d3f8208f7 soundd: only run onroad (#28449)
old-commit-hash: 3e3c8b7ddf6b3d6f71182aea75db2fa642946175
2023-06-07 16:24:54 -07:00
Harald Schäfer 36aa81cdc3 Driving Personality setting (also changes follow distance) (#24742)
* Skeleton

* Adjustable follow parameter

* fix rebase

* long planner

* typo

* Add ui toggle

* Fix icon

* Improve text

* Better toggle position

* Im a UX engineer now

* add param reader

* CHange jerk to have same crash test performance

* Try reading param

* Unused comment

* translate ui text

* std stoi

* Parametrized buttons

* Empty strings are ints

* Move to generic

* Update translations

* Fix translation diffs

* Release notes

* update refs

* tweaks

* Misc fixes

* No param is standard
old-commit-hash: 205c900742a18ca4662f4535a1a4008624c05995
2023-06-05 22:17:41 -07:00
Shane Smiskol 72c64ed1bc manager: clear onroad/offroad transition params on start (#28199)
* clear onroad transition params

* all offroad params also have manager start
old-commit-hash: 75fc0291307e78ae6462e21a088e3229bca58305
2023-05-24 20:46:59 -07:00
Shane Smiskol f1c9f13c7f manager: initialize onroad params before starting processes (#28198)
* initialize to off on startup

* params

* better

* better

* move to helpers

* rm
old-commit-hash: 22ce4e17ba0d3bfcf37f8255a4dd1dc683fe0c38
2023-05-16 12:45:05 -07:00
Shane Smiskol a14463cbe3 onroad transition: clear params and start safety setter thread (#28151)
* rename from ignition to onroad/offroad

* forgot one

* clear in manager

* don't clear in boardd anymore

fix

* params isn't used here

* add comment

* Revert "add comment"

This reverts commit 54fb6660501679e5a989c3f06c0a438bdb04dc7e.

* write params in manager

* first part is self explanatory

* remove these from thermald now

* start safety setter thread with IsOnroad

* drivesss

* more

* less

* come back

* makes sense here
old-commit-hash: b8fa7f58ea8db77d2f7a9e70d139019b24a29da7
2023-05-09 21:25:23 -07:00
Cameron Clough 1e8bd0411f cloudlog: add git to ctx (#27996)
* cloudlog: add git to ctx

* use normalised origin, change names

* order
old-commit-hash: a33af9cb740b3db967ce926323d3b33486d236a1
2023-04-21 22:35:50 -07:00
Adeeb Shihadeh 388613c0c3 manager: log time with exit param (#27615)
* manager: log time with exit param

* fix double brackets
old-commit-hash: 455d76cdb6d06d85171bc252a06517d5432b6c68
2023-03-17 16:17:42 -07:00
Adeeb Shihadeh a1b574b737 only run rawgpsd without a ublox (#27577)
old-commit-hash: 39cf8c6694731e43a45462be8c645b732059f324
2023-03-14 13:31:49 -07:00
Adeeb Shihadeh de9a100719 ubloxd: move to system/ (#27536)
* ubloxd: move to system/

* more fixes

* add missing sconscript

* fix valgrind tests

* uncomment
old-commit-hash: c97911dbad15c3cc7dc577b305ab9aed775e021f
2023-03-08 16:11:18 -08:00
Adeeb Shihadeh 3a968c67e1 loggerd: move to system/ (#27534)
old-commit-hash: 94eb2159802d3dba99620db0b08731c68a7e4733
2023-03-08 11:20:49 -08:00