Commit Graph

860 Commits

Author SHA1 Message Date
Kacper Rączy 1fa42d0b97 process_replay: modeld and dmonitoringmodeld support (#28463)
* vipc support. modeld and dmonitoringmodeld configs

* Update cereal

* Add vision meta

* Use vision meta in process replay

* Exclude modeld and dmonitoringmodeld from test_processes

* Refactor other pieces of code to use vision meta

* remove unnecessary imports

* Add MAX_FRAMES_PER_SEGMENT

* cameraState migration

* Move camera state migration to migration module

* model_replay refactor

* Fix lint issues

* Reduce number of vipc buffers to 2

* Update spinner message

* Update model replay ref

* Support the new log order

* Replace CameraFrameSizes with dict. Add encode_index field

* Migrate camera states based on encode indices

* Refactor process replay

* Refactor model replay

* Remove unnecessary print

* Update model replay ref

* Make camera state migration optional

* Remove unused import

* Add ignore_alive_pubs field

* Add assertion for carParams inside fingerprinting callback

* Remove WideCameraOnly param setup

* Refactor ModeldCameraSyncRcvCallback

* Update model replay ref commit

* Fix camera state migration

* Only migrate camera states when process has vision pubs

* Refactor model replay again

* Fix linter issues

* One more linter fix

* Update model replay ref commit
old-commit-hash: 2c617e0c7a
2023-06-22 17:36:25 -07:00
Adeeb Shihadeh ffcc2e4c61 Revert "simple fuzzing test for all processes (#28584)"
This reverts commit 0e98836e857583849aa4e960b097103a4aeb863d.

old-commit-hash: 7783dc602c
2023-06-22 14:59:50 -07:00
Kacper Rączy 0b2580b20a process_replay: custom params (#28624)
* Add custom params argument

* Fix default arguments

* Fix typing issues
old-commit-hash: 3cae32a85f
2023-06-21 20:16:14 -07:00
Maxime Desroches 7be2b51229 simple fuzzing test for all processes (#28584)
* working test

* classmethod

* review

* add to ci
old-commit-hash: bac193bdd5
2023-06-20 10:57:02 -07:00
Mitchell Goff 429a638740 New map model: 917a2539-5e7a-4374-878a-9b356f0f1922/500 (#28579)
old-commit-hash: a9cb255017
2023-06-16 19:31:57 -07:00
Yassine 2fe79435a2 update model replay ref commit
old-commit-hash: fc61209f74
2023-06-16 15:04:06 -07:00
Harald Schäfer a0628ce816 Disable internet in laikad.py, even in CI (#28535)
* Limit OPENBLAS to 1 thread in manager

* Restrict openblas threads when running openpilot

* print in CI

* Disable internet for laika, even in CI

* update ref
old-commit-hash: 155cab9ec4
2023-06-13 23:39:11 -07:00
Kacper Rączy 5400564d71 regen: remove support for fake extra vision client (#28520)
* Remove extra client from camera replay

* Fix another device type check
old-commit-hash: 15fcd0d9d4
2023-06-13 16:13:20 -07:00
Shane Smiskol a9986892c0 Subaru: use latActive for steer request bit (#28453)
* subaru: use latactive

* Update ref_commit
old-commit-hash: bce19bf187
2023-06-12 23:03:04 -07:00
Dean Lee eddc84d104 automatically detect available camera streams (#27640)
* remove WideCameraOnly

* check in set_initial_state

* no block

* remove try block

* apply reviews
old-commit-hash: 4ae0378f63
2023-06-12 13:40:43 -07:00
Kacper Rączy 0541586636 process_replay: deprecated message migration (#28456)
* Move migration code to new file

* Migrate messages in process replay. Remove old code

* Fix old_logtime

* Keep old logtimes on migrated messages

* Update ref commit
old-commit-hash: 838346d8a3
2023-06-09 19:17:50 -07:00
Kacper Rączy d3a3c73b0c process_replay: progress bar support (#28447)
* Add support for tqdm progress bar

* Fix argument name
old-commit-hash: a2e75fdea6
2023-06-07 16:23:40 -07:00
Kacper Rączy 0a3d0b48f7 process_replay: improved support for drained pubs (#28452)
Stop triggering empty update if there're no drained messages in the queue
old-commit-hash: d932aae327
2023-06-07 16:23:02 -07:00
Kacper Rączy 8b4e704df3 process_replay: remove get_car_params_callback when it's not needed (#28451)
* Add assertion for can msgs in get_car_params_callback

* Remove get_car_params_callback from processes that don't need it
old-commit-hash: 02841cede3
2023-06-07 16:22:48 -07:00
Kacper Rączy 2edd65ad4e process_replay: helpers (#28367)
* process_replay helper

* Refactor

* refactor check_enabled uses

* fix __init__

* noqa in __init__ imports

* Move compare_logs outside of process_replay

* Move save_logs to tools.lib.helpers

* Remove save_log from compare_logs

* fix lint issues
old-commit-hash: 64377a88f9
2023-06-06 10:31:13 -07:00
Harald Schäfer 36aa81cdc3 Driving Personality setting (also changes follow distance) (#24742)
* Skeleton

* Adjustable follow parameter

* fix rebase

* long planner

* typo

* Add ui toggle

* Fix icon

* Improve text

* Better toggle position

* Im a UX engineer now

* add param reader

* CHange jerk to have same crash test performance

* Try reading param

* Unused comment

* translate ui text

* std stoi

* Parametrized buttons

* Empty strings are ints

* Move to generic

* Update translations

* Fix translation diffs

* Release notes

* update refs

* tweaks

* Misc fixes

* No param is standard
old-commit-hash: 205c900742
2023-06-05 22:17:41 -07:00
YassineYousfi 4de14c1130 hot coffee model (#28296)
* 1061b1c7-b944-43e3-a940-b56b64d66f54/700

* bump cereal

* bump cereal

* make mypy happy

* write TODO

* read height from written params

* fix certain_if_calib logic and unit tests

* factor moving_avg_with_linear_decay

* remove whitespace

* update model ref commit

* default value for CI

* update process replay ref commit

* update process replay ref commit

* update process replay ref commit

* bump cereal
old-commit-hash: 7925232a34
2023-06-02 20:55:13 -07:00
Kacper Rączy 64e8f332dc regen: fix params (#28375)
Fix environment setup for regen
old-commit-hash: 1a0f482d4d
2023-06-02 15:39:23 -07:00
Harald Schäfer 4477f8a3a3 Radard: just get relative speed from model (#27493)
* refactor radard

* Revert "refactor radard"

This reverts commit 4b3507ff58e753334969b6ba2c2f6b1b35a200cc.

* May work

* No radar for test

* check length

* no accel for now

* First accel

* Cleaner way

* Re-enable radar

* update proc replay

* This might cause oscillation

* Update ref commit
old-commit-hash: a446c1fa56
2023-06-02 14:38:28 -07:00
Mitchell Goff 3dc3978a10 Test navmodel (#28272)
* Test navmodel

* removed comment

* Updated model_replay ref

* read tiles from azure bucket

* updated ref commit
old-commit-hash: 2d34083cd8
2023-05-30 20:33:01 -07:00
Kacper Rączy e6855f049f process_replay: fix crash on segments without carParams (#28286)
* Fix crash on segments without carParams

* Add assertion for carParams
old-commit-hash: a075905c4a
2023-05-27 02:10:10 +02:00
Justin Newberry 8e51174066 Subaru: frequency based messaging (#28066)
* frequency based messaging

* frequency based messaging

* frequency based messaging

* frequency based messaging

* rename better

* use frame in if statement

* syntax

* remove extra space

* put all behind one if statement

* update refs

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
old-commit-hash: c1909df437
2023-05-25 22:33:04 -07:00
Kacper Rączy c63d3378c9 ubloxd: enable satReport parsing (#28037)
* Uncomment satReport parsing. New ublox recv callback logic in process_replay

* Typo

* Update replay ref commit

* Update ref commit again
old-commit-hash: 2bd37acef3
2023-05-25 07:41:45 +02:00
Kacper Rączy 7ab3f88015 process_replay: use PARAMS_ROOT (#28282)
Use PARAMS_ROOT in process_replay
old-commit-hash: ac0272d0cc
2023-05-24 13:16:22 -07:00
Harald Schäfer 74bb4956ab Calibrationd: allow more pitch angle (#28255)
* Calibrationd: allow more pitch angle

* Update ref_commit
old-commit-hash: 2c65b843a5
2023-05-24 11:41:01 +02:00
Kacper Rączy a48b67f720 process_replay: universal replay mechanism using cereal fake sockets (#28115)
* replay_process_with_fake_sockets implementation

* add missing polled_pubs to configs

* drained_pubs field

* updated cereal

* Remove python/native variations of process replay. Replace with universal one using cereal fake sockets

* Replace old py FakeSocket with DummySocket

* Invalidate and deregister fake sockets after replay is done

* Remove unused import

* Set up new prefix for each replay

* Fixes for radard

* Refactor ReplayContext and ProcessConfig

* Minor fixes

* Reimplement controlsd fingerprinting callback

* time.sleep for sockets to safely reconnect

* Fix fingerprinting for controlsd

* Fixes for regen to work

* Fix replay loop to respect submaster frames

* Fix profiler to use new ProcessConfig fields

* Remove tqdm

* Refactor tests to use new ProcessConfig

* Add FrequencyBasedRcvCallback

* Make tolerance None by default

* Update cereal

* Add get_process_config utility func

* Update cereal. Simplify sync procedure

* Chain context managers

* New sub-socket reconnection procedure

* Fix linter issues

* Revert chaining of context managers

* Init controlsState only when replaying controlsd. Update cereal

* Update cereal

* Update process_replay to use new cereal API

* Update cereal

* Update cereal

* Update cereal

* Simplify radard recv callback

* Update release/files_common
old-commit-hash: e6ac6320ac
2023-05-23 17:24:16 -07:00
Kacper Rączy dd70d2bdf3 process_replay: drain sockets instead recv_one (#28161)
* Drain the sockets until the next cycle in python process replay

* Add waiting mechanism to native process replay, which mimics the syncing

* Sort logs when comparing them. Drain all the sockets instead of only recv_socks.

* Reverse the retrieval order of FakeSocket

* Change pub order for torqued

* Update ref commit
old-commit-hash: 12b3ffcc49
2023-05-23 12:59:09 -07:00
Mitchell Goff 22c5053bbc Nicki Minaj Model (#28218)
* New model: 2ff7490f-8a2f-4c0d-87a8-b0fa3a4a6a71

* Updated model_replay_ref_commit
old-commit-hash: 328b5d9d47
2023-05-22 15:11:04 -07:00
Cameron Clough f5563f9049 Ford: longitudinal behind alpha toggle (#28196)
* bump panda

* set safety config/configure experimental longitudinal

* send inactive signals

* bump

* just calculate in function

* already in the variable

* clean that up

* add comment, on ford stock long, prchg seems to be set from the possible future accel

* comment

* this signal didn't have an impact on engaging

* add comment and fix

* worst case while AEB

* and kill ACCDATAs

* this could be dangerous

* need to test this too

* Revert "need to test this too"

This reverts commit 09bba75950fa55d90a82f0109e3138ffe5a1d08c.

* Revert "this could be dangerous"

This reverts commit 323143e84727f1a780bbb600be5f7ceb763516b1.

* Revert "and kill ACCDATAs"

This reverts commit 15f6804bf64d01145daf57a592c2f3fd44ceba27.

* Revert "worst case while AEB"

This reverts commit 85e1aaa8e1af90373c688d1973dbfbb07b1fb8b2.

* bump panda

* Update selfdrive/car/ford/fordcan.py

* move around

* was already here

* rm

* use variable

* update docs

* Update ref_commit

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
old-commit-hash: d4dec3ba5e
2023-05-18 15:25:24 -07:00
Harald Schäfer f6900301a5 QCOM laikad: add glonass support (#28217)
* QCOM laikad: add glonass support

* reject garbage timestamps

* update ref
old-commit-hash: 703fe85cf5
2023-05-18 00:19:40 -07:00
Kacper Rączy ca32ac861b process_replay: sort logs before comparing them (#28201)
* Sort logs before comparing them in process replay

* Simplify
old-commit-hash: 504768f922
2023-05-16 15:30:28 -07:00
Harald Schäfer 5ddceb553d Calibrationd: make recalibrating alert (#28149)
* Initial

* fixes

* not an int anymore

* elif

* revert ref

* update ref

* fix alert text

* regen refs

* update ref

* add recalibration unit test

* set into recalibration state

* fix words

* recalib

* text

* Update selfdrive/controls/lib/events.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 598343aad1
2023-05-15 09:29:57 -07:00
Vivek Aithal 4be83d0d57 Lateral Planner: Calibrate model speed with vEgo (#28049)
* calibrate speed in the lateral planner

* make speed err helper fn

* check if trans has values

* clip the vel_err

* update refs
old-commit-hash: a599890fed
2023-05-09 14:26:58 -07:00
Vivek Aithal dfa48835a0 RAM 1500 5TH GEN: Reduce friction (#28138)
* reduce ram friction

* u[pdate refs
old-commit-hash: 219b0708f3
2023-05-08 18:05:00 -07:00
Cameron Clough e7a8c65f21 test Ford in process replay (#28112)
old-commit-hash: 51d41a3336
2023-05-04 14:47:39 -07:00
Shane Smiskol e56c2f6ee4 Ford: remove from dashcam (#28103)
* no dashcam 🎉

* update docs

* not these

* update refs

* bump panda
old-commit-hash: d05d9dac04
2023-05-04 06:55:09 +00:00
Vivek Aithal 1bdb1407f9 RAM 1500 5TH GEN: Update offline params (#28099)
* add fric

* no 0 friction offline value

* update refs
old-commit-hash: 3aadad24f0
2023-05-03 20:01:48 -07:00
Harald Schäfer c8de368187 Laikad: blocking raw_gnss receive (#28083)
* Blocking receive

* redundant

* rm clocks

* timeout irrelevant now
old-commit-hash: bb3388f9d2
2023-05-03 13:03:25 -07:00
YassineYousfi fa6e10b739 new model: trained with augmented turn desire pulses (#28063)
* df733db3-fad2-4485-abe9-59a6a47f2233/449 85f20e13-dd4d-49a8-ba33-98e6afc161d9/700

* update ref commit
old-commit-hash: f80c1087fc
2023-05-01 16:03:16 -07:00
Harald Schäfer 08be43fe49 New process_replay segment with latest ublox logs (#28038)
* Add new segment

* Update ref_commit
old-commit-hash: 06756f4533
2023-04-30 18:24:20 -07:00
Kacper Rączy 46e075aa36 regen: whitelist-proc (#27980)
* Add support for whitelist-procs to toggle on/off specific processes during regen

* Use process CONFIGS from process_replay to generate fake processes instead of hard-coded values

* Add rawgpsd to fake_daemons. Remove duplicates from replayable_messages.

* Remove duplicate block of code from setup_env

* Remove rawgpsd comment
old-commit-hash: ba4a1c1b87
2023-04-28 19:36:31 -07:00
Bruce Wayne a6b4940c8b Revert "LaikaD: new proc_replay segment and no internet laikad (#28029)"
This reverts commit 1341b59160ffa9db29d589f3fe4dd38691361165.

old-commit-hash: 613bbcd626
2023-04-26 19:20:05 -07:00
Harald Schäfer bd9b02915f LaikaD: new proc_replay segment and no internet laikad (#28029)
* no internet in CI

* add new segment

* new ref
old-commit-hash: fbb7dcb19c
2023-04-26 16:01:39 -07:00
Kacper Rączy 650ed84920 regen: ecamera support (#27999)
* Add wideRoadCameraState support in regen

* Fix for ecam FrameReader when use_route_meta

* Pylint fixes
old-commit-hash: eee7dd082f
2023-04-22 02:43:04 +00:00
Shane Smiskol c8cf77b7a7 locationd: log time to first fix (#27990)
* locationd ttff

* log time to first fix

* rename

* max it like laikad

* Update selfdrive/locationd/locationd.cc

* Update ref_commit

* Log when gpsOK first becomes true

* don't forget to update current time!

* stash

* make it deterministic (no proc replay cur time)

* Update ref_commit

* rename to make this clear
old-commit-hash: 03eb02906d
2023-04-21 16:15:13 -07:00
Harald Schäfer fc6a779d12 Laikad: fix bad init elevation incorrect (#27974)
* Laikad: fix bad init elevation incorrect

* update ref
old-commit-hash: 922b09de96
2023-04-19 14:04:24 -07:00
Justin Newberry da2f2114d6 Subaru: infotainment status intercept and rewrite (#27829)
* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* remove compiler flag stuff

* force error for testing

* bump panda and fix mistake

* wip

* bump panda

* wip

* wip

* forgot checksum and stuff

* add to signals

* rename

* test

* test

* bump panda and opendbc

* bump cereal

* add blank filler

* test

* add steer required to infotainment

* fix missing bit

* fix missing bit

* cleanup for PR

* cleanup for PR

* bump submodules

* wip

* wip

* i wonder what 1 is

* seemed to also be obstacle detected?

* bumppanda

* only if global

* only global gen 2

* fix order

* detect and send

* detect in rest of places

* update refs

* bumpopendbc

* copy whole message (camera sometimes sets these signals)

* bumppanda

* update refs!

* bumppanda

* let's not change this

* same as all the other functions

* Revert "same as all the other functions"

This reverts commit e86dbb695ef84a18f3123720fed37a6b81391cc4.

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
old-commit-hash: d59bfa5519
2023-04-17 19:05:16 -07:00
Harald Schäfer f6e3dc289c Locationd qcom retune (#27739)
old-commit-hash: eca3838237
2023-03-29 16:35:30 -07:00
Vivek Aithal b6909a65e7 Bolt EUV: Non-linear torque function (#27696)
* add erf based ff

* silly bug; diff of nonlinear != nonlinear of diff

* add sigmoid based ff, ensure slope at 0 > 1

* reduce steer down limit and increase driver allowance

* rebase panda

* atry without friction, and with tanh nonlinear

* finalize the nonlinear function

* do not disable friction compensation in the ff

* bump panda

* bump panda

* update refs

* update refs

* resolve comments

* Add type hints

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 15b880c0ea
2023-03-29 15:10:39 -07:00
Adeeb Shihadeh 6f52cc09f4 process replay: fix socket-ful replay flakiness (#27721)
* process replay: fix socket-ful replay flakiness

* bump up laikad timeout

* bump

* bump again

* revert that
old-commit-hash: 85908f7e2b
2023-03-28 17:48:16 -07:00