Commit Graph

66 Commits

Author SHA1 Message Date
Willem Melching 503fe7421a Add script to rerun process on route and generate new logs (#22100)
* add script to rerun process on route and generate new logs

* cleanup

* move to root

* newline
old-commit-hash: 3b13eb8c7de713d2dcd18fb3a731a6529d66aa82
2021-09-01 14:48:41 -07:00
Adeeb Shihadeh 1244074094 add TSS2 replay route (#21953)
* add TSS2 replay route

* skip on sim

* do not set on import time

* update ref

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 86f68ff22ed184dc40bfe58761a554aea1e3995e
2021-08-31 10:48:21 -07:00
Adeeb Shihadeh 5c2d426053 process replay: fix hang after process time out
old-commit-hash: d68b0bd10460794811b2f3d12883e33aecf0f107
2021-08-05 14:26:15 -07:00
Adeeb Shihadeh 3f441b3627 debug message for process replay
old-commit-hash: 2f18715f7668b407cf752edbc0762726984bf371
2021-07-21 17:21:37 -07:00
ShaneSmiskol eca70237fd Merge Accord trims (#21105)
* Merge unique Accord 1.5 fw versions

* remove all instances of ACCORD_15

* bump opendbc and update dbcs

* Switch between gearbox messages by detecting presence of gearbox msg

* both accord (2t) and accord hybrid use the same gearbox, 1.5t is the outlier

* default to GEARBOX

* add old name to migration

* bump opendbc

* update refs

* change msg name, bump cereal

* Update selfdrive/test/test_routes.py

* update ref

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: e9e197eb3c5f3714134ebfc104c2e4523fe57177
2021-06-03 13:35:23 -07:00
Willem Melching 1f61e411f3 process replay: add timeout to C++ test in case of process crash (#20886)
old-commit-hash: 38acef1c6af274a3a187f51c5235e6158db704dd
2021-05-12 16:58:28 +02:00
Adeeb Shihadeh 916e019786 cleanup Honda car strings - part 2 (#20848)
* cleanup honda car strins

* fix process replay

* update ref

* forgot to build

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 0148c24147e05abe239fb5423a79ad517d29884c
2021-05-07 13:32:34 +02:00
Willem Melching 5a983be249 C++ Process Replay improvements - Part 2 (#20839)
old-commit-hash: 5856d7d549c464481fe25353b9c9017c5c480d95
2021-05-06 14:31:03 +02:00
Willem Melching 1acc570a4f hypothesis: speed up test case reduction
old-commit-hash: 0c29adcc76ce115cc5c490595d15148810b35d30
2021-05-05 18:06:37 +02:00
Willem Melching 36534127aa speed up fuzzing by sending SIGKILL when done
old-commit-hash: 32fa26075fa88598373de86e3c355bf70adc5b78
2021-05-05 17:27:30 +02:00
Willem Melching fa3cd32780 C++ Process replay improvements - Part 1 (#20828)
* C++ Process replay improvements

* revert that change

* create publisher before subscribers

* dont block forever, print warning

* add comment

* create sockets after process init

* try once more to receive the message

* SIMULATION env variable

* print message num when no response
old-commit-hash: d96edb68177ccbcf60a21b81ed1c0815f306efbc
2021-05-05 17:14:29 +02:00
Willem Melching b3838fb91e hypothesis fuzz testing (#20818)
* add hypothesis testing

* cleanup

* some cleanup

* check for infinity too

* one-liner

* add more fields that are used

* no print

* add locationd testing

* sensor timestamp is signed

* recursive finite checking

* keep locationd inputs finite for now

* specify proces name on command line

* increase timeout and add raw speed

* abstract runner in function

* add unittest class
old-commit-hash: 33edb629679ebf66b1cf7fe3dc5b75ff40dfe424
2021-05-05 13:25:29 +02:00
Adeeb Shihadeh 88434dc9e4 add CLEAR_ON_IGNITION param type (#20810)
old-commit-hash: b4447993c10b36628cb72b58dba8104c9060bb7f
2021-05-04 11:32:40 -07:00
Willem Melching 2c8e65a90d Remove unnecessary trim levels from car name (#20815)
* remove unnecessary trim levels from car name

* remove hardcoded strings

* fix process replay

* more fixes

* fix migration

* update ref
old-commit-hash: 7a8f61f4bf83d18d2fca5fd42eb2d24849d3e58f
2021-05-04 09:24:24 -07:00
Adeeb Shihadeh ec7913cbe5 delay controls start (#20761)
* delay controls start

* shouldn't need this stuff anymore

* only delay board

* bail after 2s

* fix loopback test

* fix process replay

* update refs

* bump cereal

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: f9a961f6fb69f36f8a113246920b2d71e6af8ae1
2021-04-30 13:55:17 -07:00
Willem Melching cca70e7b56 Use cached fw query in process replay (#20709)
* use fw query in process replay

* update ref

* only for supported cars
old-commit-hash: aae849ea45a71052252b36c5a524da067b6c30b0
2021-04-20 14:01:59 +02:00
Joost Wooning c0ac9bb63c convert locationd to c++ (#20622)
* live_kf to c++

* first locationd code

* Running in process_replay

* locationd handle cam_odo and live_calib

* log event handlers

* working message receiving

* compiling message sending

* correctly sending some messages

* correct receiving and sending

* update ref_commit with some all_alive_and_valid being false, minor fixes

* fix std abs

* linking on device fix

* fix cpu usage test

* generate kf constants and defines

* fix replay test

* replay without acks, cleanup

* operate on bytearray messages

* cleanup

* send msg fix

* small sleep, less flaky test

* remove python locationd

* review feedback

* bump rednose
old-commit-hash: 3420707ad58b060333246eb43db09474bb336d39
2021-04-20 11:56:43 +02:00
Joost Wooning ff90b71c5c Add flag to process replay config to use real submaster (#20701)
old-commit-hash: ff813b6b45e6fb9fed39c2d76b0da84236f9b3d8
2021-04-19 17:27:36 +02:00
Willem Melching 8f4a445171 add putBool/getBool wrappers to cython params class (#20611)
* add putBool/getBool wrappers to cython class

* use new API

* some more puts

* fix mockparams arguments

* add get_bool to MockParams

* typo
old-commit-hash: ae094042ade44815fdba50196c15ba552bbf33d7
2021-04-07 15:36:37 +02:00
Willem Melching 4bd1929d2b LateralPlanner should only compute curvature (#20289)
* get curvature from planner

* no need to check active

* remove that

* remove self

* liveParams not needed

* cast

* fix test bug

* fixes

* fix ui.py

* fix radians

* update refs

* update refs

* bump cereal

* bump cereal

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: c23ec9f75389c9ad86400e9a9d23ee6bc5b648a2
2021-03-11 21:08:51 -08:00
Willem Melching c993097393 Process config cleanup (#20276)
* add enabled flag

* remove hack

* only prepare when enabled
old-commit-hash: 476558b547a4747119819f9684baa81c61c86e97
2021-03-08 12:18:58 +01:00
Adeeb Shihadeh 3ed4ffbc30 fix managed_processes for tests
old-commit-hash: d54e4bd60af4b589f3bd8d35000570962a5331cc
2021-03-07 22:39:14 -08:00
Willem Melching c0098cec09 Manager cleanup (#20231)
* move manager in folder

* inital refactor

* call start

* small cleanup

* add comments

* use self.signal()

* order shouldnt matter

* newlines

* add helpers

* newlines

* add process config

* split out build part of manager

* this should fix most tests

* no sensord on pc

* dont start athena

* remove comment

* fix old athena test

* fix inject model

* fix test car models

* should be not none

* fix helpers exitcode

* ignore manage_athenad

* Use time.monotonic()

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* combine init, remove spinner

* move manager test

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 5a3b51130649356b14b24e3c82e014b3a0be95a8
2021-03-05 11:03:23 +01:00
Adeeb Shihadeh aa194a3cbb VW: update process replay route (#20239)
* VW: update process replay route

* update refs
old-commit-hash: f3f44e43e6c8fc3b70011a2364730d5f5b43f94c
2021-03-04 14:58:28 -08:00
Willem Melching 8ca071310a remove build arg from manager prepare_managed_process (#20229)
old-commit-hash: 6b5a5bd180383782445f58f40511dfd03ef8b5ea
2021-03-03 15:17:04 +01:00
Adeeb Shihadeh 05eb44115e cereal cleanup part 2 (#20092)
* car stuff

* thermal

* Revert "car stuff"

This reverts commit 77fd1c65ebd01abfa8493ae12c9e6b14f7ada976.

* panda state

* camera stuff

* start deg

* most is building

* builds

* planner + controls run

* fix up paramsd

* cleanup

* process replay passes

* fix webcam build

* camerad

* no more frame

* thermald

* ui

* paramsd

* camera replay

* fix long tests

* fix camerad tests

* maxSteeringAngle

* bump cereal

* more frame

* cereal master
old-commit-hash: 312b681a46b8153314a8420611b6479dd6f70dfc
2021-02-16 21:39:32 -08:00
Adeeb Shihadeh af95c26b26 remove gpsd (#20027)
old-commit-hash: fe7f3f0ec6b66e42b26451e180e3cde241e749bb
2021-02-10 16:39:39 -08:00
Adeeb Shihadeh 966945880b Cereal cleanup (#20003)
* start cleanup

* fan speed

* cleanup dm

* fix cereal

* hwType -> pandaType

* update refs

* update refs

* bump cereal

* freeSpacePercent

* cereal master
old-commit-hash: 000bd226aa9902da01e6010bf26762fca2c20df0
2021-02-03 19:57:30 -08:00
Willem Melching 9d1220b117 manager.py broadcast process states (#19880)
* broadcast managerstate

* Remove boardd

* show alert

* only trigger on actually receiving a manager state

* add managerstate to simulation exclude for longitudinal test

* broadcast managerState in process replay

* update alert text

* bump cereal

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: b6a220a133640c24fc596f6c3b181f5d0dd921a2
2021-01-26 14:49:55 +01:00
HaraldSchafer 5c2c6691b2 remove old model packet (#19769)
* remove publisher

* move to V2

* radard new model

* fix plant

* change packety

* need hack here too

* change to new

* this has been wrong all along

* no more model msg

* subscribe to new model

* not needed anymore

* make work

* need to ignore that too

* should pass tests, needs car test

* fix process replay

* no more poly

* update refs

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 124100d0fa42485edaf86cb25f77f27e8917eed1
2021-01-19 17:15:16 -08:00
Adeeb Shihadeh 77817dbd50 update VW and nissan test routes
old-commit-hash: 13ea3ccf6dd2108d16e2d520c8e1b3bf9bf7851d
2021-01-19 14:22:50 -08:00
HaraldSchafer c6d9b9565a Mpc rework2 (#19660)
* start again

* need that too

* this actually works

* not needed

* do properly

* still works

* still works

* still good

* all G without ll

* still works

* all still good

* cleanup building

* cleanup sconscript

* new lane planner

* how on earth is this silent too....

* update

* add rotation radius

* update

* pathplanner first pass

* misc fixes

* fix

* need deep_interp

* local again

* fix

* fix test

* very old

* new replay

* interp properly

* correct length

* another horrible silent bug

* like master

* fix that

* do doubles

* different delay compensation

* make robust to empty msg

* make pass with hack for now

* add some extra

* update ref for increased leg

* test cpu usage on this pr

* tiny bit faster

* purge numpy

* update ref

* not needed

* ready for merge

* try again after recompile

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 158210cde8e689daa04bcaa1e502727cf7bfddb6
2021-01-14 18:43:50 -08:00
Adeeb Shihadeh 781accd0b3 fix camera malfunction alert (#19757)
* fix camera alert malfunction

* remove old alert
old-commit-hash: 40830a216b70e4a68c0cb1d3495dde2f8e1eaa8b
2021-01-14 16:03:16 -08:00
Adeeb Shihadeh a633eaf660 GPS malfunction alert (#19756)
* GPS malfunction alert

* fix process replay

* fix long tests

* fix long tests again
old-commit-hash: c114316d94d91f09a759f575ed915436425dd177
2021-01-14 14:45:10 -08:00
Adeeb Shihadeh c64a8356fe move to github container registry + CI speedup (#19621)
old-commit-hash: 59d7c5e64ac3c8666c54c3443f912e4e0db92eb9
2020-12-31 14:57:01 -08:00
ZwX1616 3da8dc9b25 use enabled flag from controlsState instead of carState (#2518)
* use enabled from controls instead of carstate

* update process replay

* rm

* fix long test

* update reff

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: d8fea41b2af0de53d649612513535d9f9595c088
2020-11-12 17:30:33 -08:00
Adeeb Shihadeh f25cec394e grey panda is unsupported (#2458)
old-commit-hash: 47c21f10f598639307994392e96f4d9293b295c7
2020-11-03 19:56:25 -08:00
Adeeb Shihadeh 68b4380545 update process replay test routes (#2482)
* update bosch route

* update rfs

* bump refs
old-commit-hash: 37959207502c366d783972243a0d02f6ba0a91df
2020-11-03 18:44:35 -08:00
Adeeb Shihadeh b7c4c26012 camera malfunction alert (#2391)
* camera malfunction alert

* bump cereal

* fix process replay

* ugh, needs refactor
old-commit-hash: 88b956528e614dc7429d525d5d7e09b5431d7b38
2020-10-22 16:28:54 -07:00
Adeeb Shihadeh 09095e07fd numpy tolerance for INDI
old-commit-hash: 32496626b260a3c95440052a7d262f5859e136f1
2020-10-19 23:29:22 -07:00
grekiki 83b7ec3ce1 Process replay for C++ daemons (#2288)
* more like a stash

* mem

* comment cpp

* remove some tests

* WORKSpython test_processes.py python test_processes.py

* all tests work, time to clean up

* initialize cleanup

* fix spaces

* refactor

* Update selfdrive/test/process_replay/process_replay.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* revert debug change

* mini refactor

* remove submaster

* update README

* add delay

* check for missaligned start

* Update compare_logs.py

* should finally work now, I hope...

* update comment

* real fix

* real fix now

* fix styling

* fix styling

* Update process_replay.py

* fix code review

* speed up tests

* Update selfdrive/test/process_replay/process_replay.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Update selfdrive/test/process_replay/process_replay.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* fix reviews

* nicer code

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 870644b59eb61953b3355a3938cc272927708dfa
2020-10-12 11:18:53 +02:00
Adeeb Shihadeh 64a9728f2e Reduce paramsd and calibrationd CPU usage (#2119)
* reduce paramsd cpu

* reduce calibrationd cpu usage

* calibration_helpers was mostly unused

* more calibration cleanup

* update refs

* fix thresholds in CPU test
old-commit-hash: e0004d09810d9c3bcb8681bca110bf5bbd09445a
2020-09-10 12:16:29 -07:00
Adeeb Shihadeh a58dc92f20 paramsd process replay test (#2118)
* paramsd process replay test

* cleanup
old-commit-hash: 1e5a935ff00916efe65046f50d46a77d091c2e29
2020-09-01 18:31:26 -07:00
ZwX1616 a55099ac2a EfficientNet driver monitoring (#1907)
* e96f9be6

* bump cereal

* filter sunglasses

* fix unittest

* update refs

* udpate refs

* update refs

* add tolerance for dmonitoringd

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 2cfa0edb4ccc0f17fd926835de8fb966dd4d9fc3
2020-07-27 20:22:06 -07:00
Willem Melching dcef0e394b add tolerance to process replay compare (#1904)
old-commit-hash: 5139b827af21a71a5f07719486cb168773f838fa
2020-07-22 11:50:58 +02:00
ZwX1616 9bca4bfb20 recover EON/C2 AF (#1665)
old-commit-hash: 3aa99a01d7a29c69f1b767b3fca30d18a6047425
2020-06-23 14:33:32 -07:00
Willem Melching 76a465e0ec Write orientation & transform in C++ (#1637)
* locationd at 20hz

* update ref

* bump cereal

* dont modify global state

* add scons files

* ecef2geodetic and geodetic2ecef

* Finish local coords class

* Add header file

* Add orientation.cc

* cleanup

* Add functions to header file

* Add cython wrapper

* y u no work?

* This passes the tests

* test rot2quat and quat2rot

* Teste euler2rot and rot2euler

* rot_matrix

* test ecef_euler_from_ned and ned_euler_from_ecef

* add benchmark

* Add test

* Consistent newlines

* no more radians supported in geodetic

* test localcoord single

* test localcoord single

* all tests pass

* Unused import

* Add alternate namings

* Add source for formulas

* no explicit tests needed

* remove benchmark

* Add release files

* Typo

* Remove print statement

* no access to raw transform matrix

* temporarily add tolerance

* handcode quat2euler

* update ref
old-commit-hash: c18e7da3c25c59a19efda8ec3a1b716c2571cc2f
2020-06-09 16:44:26 -07:00
Willem Melching a56e2b01f8 Make pylint more strict (#1626)
* make pylint more strict

* cleanup in progress

* done cleaning up

* no opendbc
old-commit-hash: 843a64c72fb94397a1edf814fa66044c8d92acbf
2020-06-02 16:29:32 -07:00
Adeeb Shihadeh 9823f1164c enable flake8 E303: too many blank lines
old-commit-hash: f3dcf861c73b47c52b5dd77a8f1f8858005ae18b
2020-05-31 17:21:11 -07:00
Adeeb 7965569766 Flake8 E22X (#1607)
* e221

* e225

* bump opendbc
old-commit-hash: 6051061ff8e7809960cc1f2bad9a582801d5a83e
2020-05-31 00:48:47 -07:00