* check_most_messages_valid impl
* Add to both regen and test_processes
* Refactor
* Bring back carOutput
* Use Counter
* Use get(k, 0)
old-commit-hash: e0d20d2cf33a4398426e7ca4886bf6231d1220ad
* DummyFrameReader
* dummy_dcam_if_missing flag
* Blank dcamera for all neo segments, as dmonitoringd does not support neo camera feeds
* Remove trailing whitespace
* zero_dcamera staticmethod
* enable dmonitoring in test_regen
* Simplify. User decides wether to use dummy or not
* Moving some stuff
* rename to dummy_driver_cam
old-commit-hash: 7a5d85232fee1b4792f1bfcfcea38a2f57c0b0ea
* first working ProcessContainer and _replay_multi_process implementation
* Setup controlsd config_callback
* Add vision ipc support
* Remove old code
* add todo
* Update estimated processing times
* Use deepcopy when getting configs
* Rework the API to support passing multiple names or configs
* Add get_custom_params_from_lr
* Add more typing
* Enable simulation for controlsd
* Fix typing issues
* Regen refactor
* Fix linter issues
* Make wideRoadCameraState optional
* Move DummySocket to helpers
* Improve typing in regen
* Minor improvements
* Maintain sort order of internal_pub_queue using heapq
* Move ProcessContainer elsewhere
* Fix internal heap
* Change comment
* Remove subtest_name from ProcessConfig
* Update cereal
* Add newline
old-commit-hash: b2d0f74ec3cc48faa6b54c26267d53ac554e140f
* Move migration code to new file
* Migrate messages in process replay. Remove old code
* Fix old_logtime
* Keep old logtimes on migrated messages
* Update ref commit
old-commit-hash: 838346d8a3a139a160e3cc602ba38d6f3b09a00a
* replay_process_with_fake_sockets implementation
* add missing polled_pubs to configs
* drained_pubs field
* updated cereal
* Remove python/native variations of process replay. Replace with universal one using cereal fake sockets
* Replace old py FakeSocket with DummySocket
* Invalidate and deregister fake sockets after replay is done
* Remove unused import
* Set up new prefix for each replay
* Fixes for radard
* Refactor ReplayContext and ProcessConfig
* Minor fixes
* Reimplement controlsd fingerprinting callback
* time.sleep for sockets to safely reconnect
* Fix fingerprinting for controlsd
* Fixes for regen to work
* Fix replay loop to respect submaster frames
* Fix profiler to use new ProcessConfig fields
* Remove tqdm
* Refactor tests to use new ProcessConfig
* Add FrequencyBasedRcvCallback
* Make tolerance None by default
* Update cereal
* Add get_process_config utility func
* Update cereal. Simplify sync procedure
* Chain context managers
* New sub-socket reconnection procedure
* Fix linter issues
* Revert chaining of context managers
* Init controlsState only when replaying controlsd. Update cereal
* Update cereal
* Update process_replay to use new cereal API
* Update cereal
* Update cereal
* Update cereal
* Simplify radard recv callback
* Update release/files_common
old-commit-hash: e6ac6320ace377657446a1a16ccccd75091f5453
* Add support for whitelist-procs to toggle on/off specific processes during regen
* Use process CONFIGS from process_replay to generate fake processes instead of hard-coded values
* Add rawgpsd to fake_daemons. Remove duplicates from replayable_messages.
* Remove duplicate block of code from setup_env
* Remove rawgpsd comment
old-commit-hash: ba4a1c1b8749f67e264bfb6f2bfd0c3faac284de
* Add wideRoadCameraState support in regen
* Fix for ecam FrameReader when use_route_meta
* Pylint fixes
old-commit-hash: eee7dd082fe235be188052c6943cab5d8b4ddbb9
* refactor migrate fns to avoid needing to use azure keys on import
* move azure key init behind a function
* resolve comments
old-commit-hash: 5f7d9a519e98b446b14866a8920dd0493b4dce26
* Hyundai: share panda flags with CAN-FD platform
* move that
* only set bit
* bump panda
* panda master
* regen + update refs for new param
old-commit-hash: c782380fc1cfcbc7b521f14db37a360aef6b53ec
* wip torqued
* add basic logic
* setup in manager
* check sanity and publish msg
* add first order filter to outputs
* wire up controlsd, and update gains
* rename intercept to offset
* add cloudlog, live values are not updated
* fix bugs, do not reset points for now
* fix crashes
* rename to main
* fix bugs, works offline
* fix float in cereal bug
* add latacc filter
* randomly choose points, approx for iid
* add variable decay
* local param to capnp instead of dict
* verify works in replay
* use torqued output in controlsd
* use in controlsd; use points from past routes
* controlsd bugfix
* filter before updating gains, needs to be replaced
* save all points to ensure smooth transition across routes, revert friction factor to 1.5
* add filters to prevent noisy low-speed data points; improve fit sanity
* add engaged buffer
* revert lat_acc thresh
* use paramsd realtime process config
* make latacc-to-torque generic, and overrideable
* move freq to 4Hz, avoid storing in np.array, don't publish points in the message
* float instead of np
* remove constant while storing pts
* rename slope, offset to lat_accet_factor, offset
* resolve issues
* use camelcase in all capnp params
* use camelcase everywhere
* reduce latacc threshold or sanity, add car_sane todo, save points properly
* add and check tag
* write param to disk at end of route
* remove args
* rebase op, cereal
* save on exit
* restore default handler
* cpu usage check
* add to process replay
* handle reset better, reduce unnecessary computation
* always publish raw values - useful for debug
* regen routes
* update refs
* checks on cache restore
* check tuning vals too
* clean that up
* reduce cpu usage
* reduce cpu usage by 75%
* cleanup
* optimize further
* handle reset condition better, don't put points in init, use only in corolla
* bump cereal after rebasing
* update refs
* Update common/params.cc
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
* remove unnecessary checks
* Update RELEASES.md
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 4fa62f146426f76c9c1c2867d9729b33ec612b59
* push
* do process replay
* commit
* update refs
* clean up
* clean up controlsd
* clean up controlsd
* Add assert
* debubuggier param name
* can be peristent
* Revert "can be peristent"
This reverts commit 6e6d3f6423c26a202623cef728e038259e9e46cd.
* Update selfdrive/test/process_replay/process_replay.py
old-commit-hash: 87ca42e993f1cc96cc313e33b3c538143e0a737c
* get_fw_versions returns all fw versions with request's brand
* keep track of everything received
* debug
* need to regen or write a hack in build_fw_dict
* to be safe, still replace old responses within same brands (hyundai responds to two queries, can fix later)
to be safe, still replace old responses within same brands (hyundai responds to two queries, can fix later)
* update test_fw_query_on_routes
* clean up
* better name
* slightly cleaner
* fix test_startup unit test
del
* fix imports
* fix test_fw_fingerprint
fix test_fw_fingerprint
fix
* fingerprint on all FW_VERSIONS, not just brands with requests
* support old routes in test_fw_query_on_routes
* regen and update refs
* similar function style to before
* better comment
* space
switch name
* try to exact match first
* useless else
* fix debug script
* simpler dictionary
* bump cereal to master
old-commit-hash: ea241bf3dc1d6dec2610bec9fceb1b8659014436
* fix camera malfunction
* revert
* send in one process to fix frames out of sync
* not used
* revert
* fix and add --no-upload for CI testing
* fingerprint if source is fw
* no FW versions
old-commit-hash: 5dce006a82879f133ab69355b6c9b8c74d2b4d33
* regen and process replay clean up
* test_fuzzy actually uses fingerprint hardcoding
fix
* revert
* revert
* this can be a url or path so just print full variable
old-commit-hash: 170ed3d761a58222a626c86b9706f9be4900d058
* rgb to nv12
* nv12 works (w memcpy)
* correct now
* no copy
* fix nv12 with fast debayer
* reverts of unused stuff
* ui use nv12
* comment out thumbnails for now
* rebase fix
* dm read nv12
* model read nv12
* fix ffmpeg encoder
* thumbnails from nv12
* replay to nv12
* python framereader support nv12
* remove hardcoded frame/buffer sizes
* fix build
* ffmpeg encoder fix buffers
* small cleanup
* reduce power usage test
* fix cpu usage test
* fix snapshot
* fix loggerd test
* bump cereal
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Joost Wooning <jwooning@gmail.com>
old-commit-hash: ea5b8cdfb10686c972d8d2bc1778e6e6567e45a9
* remove log_name
* log without compression
* fix tests
* remove extension for bootlog
* another test fix
* uploader compresses
* also compress in athena
* only compress qlog
* more generic check in do_upload
* fix bootlog compression
* lower loggerd cpu usage
* dont link against bz2
* set core affinity to little cluster
* handle old files
old-commit-hash: 77a6f3d034a7b17d70b750b9ea454310f4b8edf1
* initialize CUDA runtime before predictions
* dmond pauses modeld execution...
* done in other PR
old-commit-hash: 60b7114024181f79819c9a8b14863a8f23fb0252
Harald Schäfer