Commit Graph

250 Commits

Author SHA1 Message Date
grekiki 870644b59e Process replay for C++ daemons (#2288)
* more like a stash

* mem

* comment cpp

* remove some tests

* WORKSpython test_processes.py python test_processes.py

* all tests work, time to clean up

* initialize cleanup

* fix spaces

* refactor

* Update selfdrive/test/process_replay/process_replay.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* revert debug change

* mini refactor

* remove submaster

* update README

* add delay

* check for missaligned start

* Update compare_logs.py

* should finally work now, I hope...

* update comment

* real fix

* real fix now

* fix styling

* fix styling

* Update process_replay.py

* fix code review

* speed up tests

* Update selfdrive/test/process_replay/process_replay.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Update selfdrive/test/process_replay/process_replay.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* fix reviews

* nicer code

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2020-10-12 11:18:53 +02:00
Adeeb Shihadeh d5796e07e2 more accurate profiling (#2287) 2020-10-10 15:17:02 -07:00
Adeeb Shihadeh cb85a19350 add timeout to modeld replay 2020-10-09 16:25:21 -07:00
Adeeb Shihadeh 024c33e724 add acura rdx test route 2020-10-09 13:57:58 -07:00
Adeeb Shihadeh f1c3662311 report git branch to testing closet 2020-10-06 21:00:19 -07:00
Willem Melching 079c878adf Update radard cpu usage 2020-10-06 12:16:12 +02:00
Adeeb Shihadeh 176c06499d write car params before profiling 2020-10-05 21:34:57 -07:00
Adeeb Shihadeh 6709106025 don't want to profile that 2020-10-05 20:48:23 -07:00
Adeeb Shihadeh 0d11acf34e paramsd profiling 2020-10-05 20:41:24 -07:00
Willem Melching 3f88df62c7 Fix calibration invalid alert on startup (#2270)
* change controlsd calibration initial value

* update refs

* update refs

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2020-10-05 19:16:52 -07:00
ZwX1616 21d4ac1eeb Reduced wheel touch time (#2259)
* decrease wheel touch time

* update refs

* fix unittest

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2020-10-05 14:39:24 -07:00
grekiki a09fd7c860 CI: Add valgrind (#2245)
* prepare a test for valgrind by fixing linter issues

* something went wrong

* Try update cereal

* Not working, fixing replay_learning.py

* Testing

* Testing

* Working now

* More logs, a bit of cleaning, still no idea how this works

* Ok got 10% cleaning done

* trying some stackOverflow code

* Lots of cleaning

* wip

* Delete valgrind_testing.py

* Delete replay_learning.py

* Add to CI, cannot fail though

* Add to CI, cannot fail though

* Now the unit test should fail

* Dump valgrind output in case of a failure

* fix subrepos

* fix subs

* hopefully fixes every issue that we have

* wait for message confirmation

* Revert "wait for message confirmation"

This reverts commit ad7ba280ec6536015ac1a442c9732bfe42fd5664.

* fix local issues

* Revert "fix local issues"

This reverts commit 4498df21df471fa6e9360d50407eaefdf24ae69f.

* attempt 3 to fix things

* untested function extraction

* refactor

* add valgrind task

* add delay and BASEDIR

* Make test not fail, it is not designed for that

* fix subrepositories

* fix tests

* Real fix now :)

* scons

* ... stupid CI

* fix valgrind CI

* Update test.yaml

* Update test.yaml

* Update test.yaml

* add valgrind logs as file

* remove delays

* kill process more reliably

* rename action

* small cleanup

* fix casting to int in case of large leaks

Co-authored-by: Willem Melching <willem.melching@gmail.com>
2020-10-05 16:09:32 +02:00
Adeeb Shihadeh a77548bff6 radard cleanup (#2266)
* some cleanup

* more realistic profiling

* Update selfdrive/controls/radard.py

Co-authored-by: Willem Melching <willem.melching@gmail.com>

Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
2020-10-05 11:37:39 +02:00
Adeeb Shihadeh df6a66c785 radard profiling (#2265) 2020-10-04 15:55:25 -07:00
Adeeb Shihadeh 427d4a5a9e run loggerd tests in CI (#2241)
* run loggerd tests in jenkins

* fast

* check segs on the fly

* missing import

* wait for dir

* no thread

* relax FILE_SIZE_TOLERANCE

* cleanup

* unused

* set ci flag

* wait longer for first seg

* fix race condition with setting RecordFront

Co-authored-by: ZwX1616 <zwx1616@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
2020-10-01 18:42:43 -07:00
Adeeb Shihadeh 67aec50b88 Increase HKG torque limit (#2249)
* increase hkg torque limit

* update refs

* bump panda
2020-10-01 13:16:51 -07:00
Willem Melching 1c6fb56769 simplify testing closet client 2020-10-01 16:01:34 +02:00
Comma Device 3f0491b7e5 update testing closet client 2020-10-01 06:52:59 -07:00
qadmus cba53957bd Fix grade force in test_long plant (#2225)
Co-authored-by: user <email@web.com>
2020-09-28 11:54:48 +02:00
Adeeb Shihadeh 0040ac987a add type hints to selfdrive/version.py 2020-09-19 14:55:27 -07:00
Adeeb Shihadeh ef21b83937 Improve realtime performance on NEOS (#2166)
* fix setting core affinity

* dmonitoringd doesn't need rt priority

* android only gets two cores

* model and planner get core 2

* log missed cycle count

* neos update

* prod image

* revert NEOS changes

* still need this
2020-09-16 15:33:12 -07:00
ZwX1616 a2adfdb155 Cut down unnecessary DM uncertain alerts (#2157)
* cut down high std alerts

* clean comments

* uncertain curve tune

* update test gt

* update refs

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2020-09-14 10:43:19 -07:00
Adeeb Shihadeh e0004d0981 Reduce paramsd and calibrationd CPU usage (#2119)
* reduce paramsd cpu

* reduce calibrationd cpu usage

* calibration_helpers was mostly unused

* more calibration cleanup

* update refs

* fix thresholds in CPU test
2020-09-10 12:16:29 -07:00
Jafar Al-Gharaibeh 6c292c3f0c Split car identities to CX5, CX9, and Mazda3 (#2097)
Add test routes for CX9 and Mazda3

CX9: "10b5a4b380434151|2020-08-26--17-11-45"

Mazda3: "74f1038827005090|2020-08-26--20-05-50"

Signed-off-by: Jafar Al-Gharaibeh <to.jafar@gmail.com>
2020-09-09 16:02:26 -07:00
Adeeb Shihadeh 9cd88526b5 hide camera view when in reverse (#2144)
* partially hide camera view when in reverse

* lowest priority

* update ref commit

* fix type

* update refs
2020-09-09 00:11:12 -07:00
Adeeb Shihadeh 5838a88a3f update refs after new alert 2020-09-04 14:09:26 -07:00
HaraldSchafer 01111b3f28 remove vp everywhere (#2122)
* remove vp everywhere

* wrong dimension

* useful disclaimer

* switcheroo

* imcomplete switcheroo

* did it wrong again

* difference look small enough

* fix comment
2020-09-04 03:05:20 -07:00
Adeeb Shihadeh 848301b091 UI vision refactor (#2115)
* refactor vision

* don't show slow frame message when in preview mode

* change draws to uint32_t

* set vision_seen=false after destroy

* remove vision_connect_thread

* refactor ui_update

* seelp 30ms when vision is not connected

* remove should_swap

* call ui_update_sizes before ui_draw

* rebase

* start bigger UI refactor

* don't need the touch fd

* fix qt build

* more cleanup

* more responsive

* more refactor

* fix for pc

* poll for frames

* lower CPU usage

* cleanup

* no more zmq

* undo that

* cleanup speed limit

* fix sidebar severity for athena status

* not aarch64

Co-authored-by: deanlee <deanlee3@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
2020-09-03 16:32:55 -07:00
Adeeb Shihadeh 1e5a935ff0 paramsd process replay test (#2118)
* paramsd process replay test

* cleanup
2020-09-01 18:31:26 -07:00
Adeeb Shihadeh 21fbe26980 Reduce plannerd and dmonitoringd CPU usage (#2108)
* fix wasted cycles in locationd and dmonitoringd

* bump cereal

* calibrationd

* Revert "calibrationd"

This reverts commit 580051a33bc96e1e83300629e9c04817928d0851.

* this is cleaner

* calibrationd

* paramsd is driven by liveLocationKalman

* only log params once a minute

* stricter CPU usage test

* revert locationd for now

* revert calibrationd too

* revert thresholds
2020-09-01 16:41:09 -07:00
Adeeb Shihadeh 349040d958 driver monitoring cleanup (#2101)
* read rhd from param

* don't need that anymore

* fix build

* bump cereal

* read param from camerad too

* add read_db_bool helper

* bump model replay ref commit, IsRHD wasn't set
2020-08-29 17:16:00 -07:00
Adeeb Shihadeh 33fd13cc8c fix CI cache auto-deletion 2020-08-28 11:19:20 -07:00
Willem Melching c7152d5419 Hardware abstraction class (#2080)
* hardware abstraction class

* De Morgan

* Rename pc hardware class

* Fix sound card in controlsd

* Pc get sim info

* fix hardware in test

* two more

* No more random imei on android

* no randomness on android

* Need to return something that looks like imei for registration to work

* Return proper network strength

* Unused import

* Bug fixes + gpsd is only android
2020-08-26 14:57:17 +02:00
ZwX1616 87473fbc41 Loggerd rotation test (#2077)
* loggerd test

* delete afterwards

* add ccc

* fix pylint

* cleanup rotation test

* this works

* bump tolerance

* clear the data after test

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
2020-08-25 18:31:49 -07:00
Willem Melching b29d9da875 Revert "more init time in cpu test"
This reverts commit 03ec6af300.
2020-08-20 17:18:03 +02:00
Willem Melching 03ec6af300 more init time in cpu test 2020-08-20 15:20:59 +02:00
Adeeb Shihadeh 744fe71801 remove old tests (#2040) 2020-08-18 15:21:47 +02:00
Adeeb Shihadeh 5641aeee7a increase CPU test timeout to allow for installing new APKs 2020-08-13 15:10:00 -07:00
Adeeb Shihadeh cb5a2996e7 NEOS background updater (#1892) 2020-08-12 11:39:21 -07:00
Adeeb Shihadeh f3adedacb2 increase controlsd CPU test threshold 2020-08-11 13:43:19 -07:00
xps-genesis a3d754a8d8 Car Port: 2020 Hyundai Kona (#2010)
* update KONA car port

* update Kona  Car Port

* ignore kona EV

* add Kona route

* update readme for Hyundia Kona

* remove electric for regular Kona
2020-08-11 13:42:19 -07:00
martinl c9adc4900b Add preglobal Subaru Forester and Outback (#1993)
* Add preglobal Forester and Outback

* Tests and values cleanup

* Update units in carstate

* Remove ()

* Add OUTBACK_PREGLOBAL_2018 to non_tested_cars

* Add replay route for OUTBACK_PREGLOBAL_2018
2020-08-10 12:31:40 -07:00
xps-genesis a16a948f9e Car Port: Hyundai Genesis G70 2018 (#2000)
* Car port Genesis G70

* Car port G70

* rebase

* update G70 car port

* Update README.md

* no space

* rebase mistake

* Update values.py

* Update values.py

* Update values.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2020-08-08 22:20:25 -07:00
Adeeb Shihadeh ecf0a8c8d4 Improve CPU usage test reliability (#2002)
* run phone tests in parallel

* better cpu test

* re-enable test

* no root

* terms version

* not one

* yes

* debug

* that's coverd by min cpu percent
2020-08-08 20:59:32 -07:00
Adeeb Shihadeh cea8b9e67a update_ci_routes.py: upload route by arg 2020-08-08 14:30:31 -07:00
Adeeb Shihadeh 5e82578a1b Remove non-SCC Hyundai Kona port (#1997) 2020-08-08 11:48:16 -07:00
martinl e37b8e5d56 Subaru pre-global: add support for Subaru Legacy 2015-18 (#1805)
* Add support for Subaru Legacy 2015-18

* syntax fix

* Add Legacy 2018 FPv1

* Add Subaru Ascent from upstream

* Use GLOBAL_CAR and LEGACY_CAR lists

* Change LEGACY_2015 to LEGACY_PREGLOBAL

* Add LEGACY_CAR to carstate

* Change LEGACY_2015 to LEGACY_PREGLOBAL in test_car_models

* Add missing SafetyModel to Ascent

* Use GLOBAL_CAR and LEGACY_CAR to set safetyModel

* Change LEGACY_CAR to PREGLOBAL_CARS, remove GLOBAL_CAR

* Fix PREGLOBAL_CARS in carstate and subarucan

* Minor cleanups

* Add accelCruise button event

* Change Preglobal Driver Torque limit to match Global

* Match comments to upstream

* Use Steer_Warning and Steer_Error_1 only for Global

* Change mph units to match upstream values

* Increase Preglobal brakePressed  threshold to 2

* Add DashcamOnly to LEGACY_PREGLOBAL

* Fix typo in variable name

* Update README, add create_preglobal_steering_control

* cleanup carcontroller

* cleanup values

* missed that one

* Update STEER_STEP

* Update STEER_MAX

* Add preglobal signal frequency checks

* remove PREGLOBAL_CARS from subarucan

* Remove whitespace

* Use common frequency checks

* cleanup carstate

* cleanup subarucan

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2020-08-06 21:55:13 -07:00
Adeeb Shihadeh fe18a014c7 Updater tests (#1974)
* refactor exit handling

* test update

* more reliable?

* better

* init git in CI

* testy tester

* CI should work

* test overlay reinit

* only one

* still need to fix loop test

* more patience

* more patience in CI

* no ping in CI

* this is cleaner

* need to run these in jenkins

* clean up

* run in jenkins

* fix test file path

* it's a git repo now

* no commit

* reinit

* remove duplicate

* why not git

* la

* git status

* pythonpath

* fix

* no CI fro now

* check overlay consistent

* more tests

* make more changes in the update commit

* sample

* no k
2020-08-06 21:49:05 -07:00
HaraldSchafer d097abeb21 Track calib spread (#1988)
* add calib spread metric

* add field

* needs to be array

* update refs

* log valid blocks too

* update refs

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2020-08-06 14:47:17 -07:00
Adeeb Shihadeh c8f5281c4d second segment is ok for car unit tests 2020-08-06 14:34:42 -07:00