Commit Graph

10759 Commits

Author SHA1 Message Date
Kacper Rączy e154f03a12 timed: use gps location packet for time (#33306)
* GPS helpers

* Use GPS socket in timed

* Use helper in controlsd

* Use updated and logMonoTime

* Helper type annot

* Not updated

* Increase time threashold
old-commit-hash: cf355ecf20
2024-08-22 23:30:29 -07:00
Dean Lee 2871822bd2 drive_helpers.py: iterate button_timers with items() (#33351)
iterate button_timers with items()
old-commit-hash: 13e58d33db
2024-08-21 11:03:55 -07:00
Shane Smiskol 093fac6f5a move some car interface tests into opendbc (#33352)
* bump

* this is in opendbc

* so is radar interface

* clean up

* bump

* can import from opendbc

* bump
old-commit-hash: 7af3c6dfee
2024-08-21 00:30:06 -07:00
Shane Smiskol d69c1f600b ui: fix wrong path color indexing (#33350)
* fix

* clean up

* clean up

* clean up
old-commit-hash: d8c9822421
2024-08-20 20:49:30 -07:00
Shane Smiskol 8d4770a65a move test_lateral_limits.py to opendbc
old-commit-hash: fe51a2fc62
2024-08-20 15:42:25 -07:00
Dean Lee 2119f7774e cereal/SubMaster: encapsulate frequency management in FrequencyTracker (#33252)
* encapsulate frequency management

* apply reviews

* early return, avoiding unnecessary calculations

* simplify avg freq calc
old-commit-hash: b14fca78e0
2024-08-19 16:53:13 -07:00
commaci-public 155934bd49 [bot] Update Python packages (#33327)
* Update Python packages

* fix opendbc

---------

Co-authored-by: Vehicle Researcher <user@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 9b2cafe597
2024-08-19 15:25:05 -07:00
Shane Smiskol 89725e7ac2 card: fix memory leak from nested function scoping (#33328)
* stash

* no other leaks! pm.send grows memory usage by ~20mb but that's it

* undo

* clean up
old-commit-hash: ee9977df2f
2024-08-19 14:27:50 -07:00
Adeeb Shihadeh ce9bea56ea update test
old-commit-hash: 08f64ae30a
2024-08-19 14:19:12 -07:00
Shane Smiskol 4f019b5f60 move selfdrive/car to opendbc (#32630)
* move most of /car

* move some car tests

move some car tests

* fix selfdrive/car/tests

* fix selfdrive/controls tests

* fix the rest of the selfdrive tests

* bump opendbc

* fix all tests

* few more non-test references

* remove opcar and move docs to car

fix these debugging scripts

fix docs

* bump opendbc and panda

forgot panda
old-commit-hash: e735a7f379
2024-08-17 00:54:51 -07:00
Shane Smiskol 93b11c816e car: move conversions.py into common/
old-commit-hash: 1eda5f4736
2024-08-16 15:53:37 -07:00
Shane Smiskol 95224db413 selfdrive/car: ban cereal and capnp (#33208)
* ban cereal and msgq

* common too

* do toyota/values.py

* do all fingerprints

* example without builder

* this still works, but no type checking anymore

* stash

* wtf, how does this work

* okay actually not bad

* safe

* epic!

* stash data_structures.py

* some clean up

* hell yeah

* clean up old file

* add to delete

* delete

This reverts commit 90239b7797ace31ee647a2fdbd67e0c3faa98dcf.

* switch more CarParams stuff over

remove unused

* fix car tests by removing cereal! mypy forgets about dataclass if we wrap it :(

* fix this too

* fix this too

* remove more cereal and add some good hyundai tests

* bunch more typing

* override default with 20hz radar

* temp capnp converter helper

* more lateralTuning

* small union replicator is better than what i was trying, and fixes mypy dynamic typing issues

* can keep all this the same now!

* type ret: CarParams, add more missing structs, revert lateralTuning changes (smaller diff!)

* revert more

* get first enum automatically, but ofc mypy doesn't pick up the new metaclass so can't use :(

would have been `CarParams.NetworkLocation()`

* Revert "get first enum automatically, but ofc mypy doesn't pick up the new metaclass so can't use :("

This reverts commit bb28b228becba932052d2fc5a4389784027435b1.

* remove cereal from car_helpers (TODO: caching)

* remove a bunch of temp lines

* use dataclass_transform!

* remove some car.CarParams from the interfaces

* remove rest of car.CarParams from the interfaces

* same which() API

* sort

* from cereal/cache from fingerprinting!

* more typing

* dataclass to capnp helper for CarParams, cached it since it's kinda slow

* (partial) fix process replay fingerprintig for new API

* latcontrollers take capnp

* forgot this

* fix test_models

* fix unit tests

* not here

* VehicleModel and controller still takes capnp CP since they get it from Params()

* fix modeld test

* more fix

* need to namespace to structs, since CarState is both class and struct

* this was never in the base class?!

* clean that up again

* fix import error

fix import error

* cmts and more structs

* remove some more cereal from toyota + convert CarState to capnp

* bruh this was wrong

* replace more cereal

* EventName is one of the last things...

* replace a bunch more cereal.car

* missing imports

* more

* can fix this typing now

* proper toyota+others CS typing!

* mypy can detect return type of CS.update() now

* fix redeclaration of cruise_buttons type

* mypy is only complaining about events now

* temp fix

* add carControl struct

* replace CarControl

i hope there's no circular imports in hyundai's CC

* fine now

* lol this was wrong too

* fix crash

* include my failed attempts at recursively converting to dataclass (doesn't implicitly convert types/recursively :( )

but attrs does, maybe will switch in the future

* clean up

* try out attr.s for its converter (doesn't work recursively yet, but interesting!)

* Revert "try out attr.s for its converter (doesn't work recursively yet, but interesting!)"

This reverts commit ff2434f7bbd45a4d4bfb21f7d6712d1f1c3bcde9.

* test processes doesn't fail anymore (on toyota)!

* fix honda crash

* stash

* Revert "stash"

This reverts commit c1762af4e776790e4ad1322ad4ce0610157346e0.

* remove a bunch more cereal!

* LET'S GOOO

* fix these tests

* and these

* and that

* stash, something is wrong with hyundai enable

* Revert "stash, something is wrong with hyundai enable"

This reverts commit 39cf327def258e2959fe23cd7a550a858f6d8f03.

* forgot these

* remove cereal from fw_versions

* Revert "remove cereal from fw_versions"

This reverts commit 232b37cd409b55d04b1afc90d4a80c49e710eb56.

* remove rest of the cereal exceptions!

* fix that

* add typing to radard since I didn't realize RI.update() switched from cereal to structs

* and here too!

* add TODO for slots

* needed CS to be capnp, fix comparisons, and type hint car_specific so it's easier to catch type issues (capnp isn't detected by mypy :( )

* remove the struct converter

* save ~4-5% CPU at 100hz, we don't modify after so no need to deepcopy

btw pickle.loads(pickle.dumps()) is faster by ~1% CPU

* deepcopy -> copy: we can technically make a reference, but copy is almost free and less error-prone

saves ~1% CPU

* add non-copying asdict function

* should save ~3% CPU (still 4% above baseline)

* fix that, no dict support

* ~27% decrease in time for 20k iterations on 3X (3.37857 -> 2.4821s)

* give a better name

* fix

* dont support none, capitalize

* sheesh, this called type() on every field

* remove CS.events, clean up

* bump card %

* this was a bug on master!

* add a which enum

* default to pid

* revert

* update refs

* not needed, but consistent

* just Ecu

* don't need to do this in this pr

* clean up

* no cast

* consistent typing

* rm

* fix

* can do this if we're desperate for the last few %

* Revert "can do this if we're desperate for the last few %"

This reverts commit 18e11ac7883a0a56583750b1cc5a2b13011e7299.

* type this

* don't need to convert carControl

* i guess don't support set either

* fix CP type hint

* simplify that
old-commit-hash: 6a15c42143
2024-08-16 15:13:00 -07:00
Kacper Rączy 8315623257 paramsd: remove usages of llk nested structures (#33317)
* Remove usages of llk nested structures

* Rename to debugFitlerState

* Semicolon

* Initial parameters debugFilterState
old-commit-hash: 51fae363e4
2024-08-16 14:25:42 -07:00
Shane Smiskol 6fc97576d6 test_fw_fingerprint.py: fix RAM HD test
old-commit-hash: e6b2996478
2024-08-16 01:00:26 -07:00
Shane Smiskol e19db6a5eb ecu_addrs.py: fix function argument typing
old-commit-hash: a255b8043a
2024-08-16 00:58:53 -07:00
Shane Smiskol 8dbf878f76 card: fix return signature for update_events
old-commit-hash: c9f9eba614
2024-08-16 00:56:31 -07:00
Shane Smiskol 7931926366 fw_versions.py: mark raw in f-string
old-commit-hash: 6a5bbb261e
2024-08-16 00:38:28 -07:00
Shane Smiskol 853a41ddaf radard: remove redundant NoneType check
old-commit-hash: c2ab62c2b2
2024-08-16 00:37:31 -07:00
Shane Smiskol b700f3db77 hyundai: test some feature detection (#33315)
test some feature detection
old-commit-hash: 207c77ea93
2024-08-16 00:30:11 -07:00
Shane Smiskol b65b1bf908 hyundai: declare type override of cruise_buttons
old-commit-hash: bce11e393f
2024-08-16 00:26:40 -07:00
Shane Smiskol 5cea99cb2d toyota: pycapnp enum which should be called
old-commit-hash: f6780fca2f
2024-08-16 00:18:37 -07:00
Shane Smiskol 1f04a80d38 run_process_on_route.py: use zstd
old-commit-hash: b41f9f2dfe
2024-08-16 00:08:17 -07:00
Shane Smiskol 4490156cb1 GM: remove basedir import (#33312)
* remove these exceptions

* whoop

* ahhh
old-commit-hash: d43bf89978
2024-08-14 22:55:17 -07:00
Shane Smiskol 9b0adebec8 docs: remove common import (#33310)
* add opcar

* fix references

* actually better to split this so opendbc will test docs conventions, and openpilot will test diffing

* not exe

* clean up
old-commit-hash: 424b657376
2024-08-14 20:29:14 -07:00
Shane Smiskol 9e5fe1e5c0 body: remove controls import (#33309)
* body uses car's PIDController

* use a simple version
old-commit-hash: 9d0180ca97
2024-08-14 20:27:53 -07:00
Shane Smiskol 51ea9f5799 move live fingerprint debugging code to debug/car (#33308)
* remove cereal from fw_versions

* fix it

* do ecu_addrs and vin

* do last one

* move executable-ness

* notexe

* nice test
old-commit-hash: 2ed567b0f5
2024-08-14 19:24:24 -07:00
Shane Smiskol 915524d408 Copy kalman filter to selfdrive/car (#33307)
move to car/common/ and give proper names
old-commit-hash: bcfb50d98c
2024-08-14 18:10:11 -07:00
Kacper Rączy e66855c54d ui: remove GPS status from the sidebar (#33304)
* Remove usage of llk in ui

* Remove GPS from sidebar

* Remove it from test
old-commit-hash: c61d504516
2024-08-14 15:52:47 -07:00
Shane Smiskol f8ef09fcb2 rm tesla (#33300)
* rm tesla

* more rm

* ugh we should remove dynamic imports soon
old-commit-hash: b9dec5e3b5
2024-08-14 15:06:00 -07:00
Maxime Desroches dc396b6301 lint.sh: better shebang lint (#33296)
-e
old-commit-hash: 585f362738
2024-08-14 11:34:52 -07:00
Shane Smiskol 35a99d7fc6 Common CI._update function (#33289)
* use CP

* no car control, consistent _update function signatures

* eh it's fine to name it whatever

* clean up

* oops

* !!

* now we can delete this!

* nobody does anymore
old-commit-hash: 7248b00086
2024-08-13 22:59:25 -07:00
Shane Smiskol fae517416e card: set mock carState fields (#33294)
* mock carstate inside card

* not used
old-commit-hash: cb61d0045c
2024-08-13 22:48:55 -07:00
Shane Smiskol 9cf575657e Move buttonEvents to CarState (#33292)
* move mazda button events to carstate

* do  more

* remove

* some more

* clean up
old-commit-hash: 9f14c447db
2024-08-13 22:30:46 -07:00
Shane Smiskol d26b49a409 Consistent spacing in car interfaces (#33293)
* formatting

* fix these

* not these
old-commit-hash: 29882b4519
2024-08-13 22:08:48 -07:00
Shane Smiskol 6ab415bc59 fix static analysis
old-commit-hash: d65e1d9500
2024-08-13 21:28:06 -07:00
Maxime Desroches c551f1d239 fix bash + python3 shebangs (#33287)
fix shebangs
old-commit-hash: 1dcd660815
2024-08-13 21:22:13 -07:00
Shane Smiskol b97ed10ea1 Car interface clean up (#33290)
* remove some defs

* now carstate

* remove carControl from CI update function

* almost merged that

* and that
old-commit-hash: 65fccbf756
2024-08-13 21:16:39 -07:00
Kacper Rączy 80bc61dc6c controlsd: use livePose (#33283)
* Pose calibrator

* Fix static analysis

* Fix static

* Fix test_latcontrol

* Fix test_latcontrol

* Update services in process replay

* Fix static

* Matmul not mul

* Add assertion

* Move pose calibration to data_sample

* Update ref commit

* Remove llk from cycle alerts

* Deprecated nogps event

* Switch power_draw to lp

* Bring back noGps alert

* Add handling code back

* get_bool

* Bring inputsok back
old-commit-hash: 9734015bbb
2024-08-13 21:11:16 -07:00
Shane Smiskol e46d96bb11 Move events out of car interfaces (#33280)
* chrysler down

* honda and ford

* we can pass the class for this

* do the rest

* clean that up

* remove EventName

* fix CI

* move smallest bodies to top

* rm todo

* eps_timer_soft_disable_alert is too ingrained in carcontroller

* re-did everything w/ no diff (except just passing cereal instead of class)
old-commit-hash: cf39cc823a
2024-08-13 20:40:36 -07:00
Shane Smiskol 6a15aa3f8c interfaces: assume CarState is instantiated (#33284)
test to make sure mock doesn't crash!
old-commit-hash: 3d2fbe9aa3
2024-08-13 19:36:21 -07:00
Shane Smiskol 7b4a538eaa fix fingerprint debug scripts (#33277)
* fix fp debugging

* fix these
old-commit-hash: 90ce7781f4
2024-08-12 15:41:08 -07:00
Shane Smiskol 7a4b2b5c44 [bot] Fingerprints: add missing FW versions from new users (#33276)
Export fingerprints
old-commit-hash: 4618e8c124
2024-08-12 12:41:14 -07:00
Shane Smiskol 11c9105a60 carState: add invalid sensors field (#33266)
* add to CS

* add vehicleSensorsInvalid to CarState

* fix ord

* clean up
old-commit-hash: 7ec9986340
2024-08-11 23:12:42 -07:00
Shane Smiskol 988d16a4c8 remove map from ui preview (#33265)
* rm map from ui preview

* fix
old-commit-hash: 4e122ed2d1
2024-08-11 21:54:40 -07:00
Shane Smiskol d18a0868c6 move the body events to card (#33262)
* move the body events to card

* rm import
old-commit-hash: 093c09a737
2024-08-11 20:25:08 -07:00
Shane Smiskol e4cdccb7fd Revert "spinner: fix missing colon in QProgressBar border style" (#33263)
Revert "spinner: fix missing colon in QProgressBar border style (#33258)"

This reverts commit 3ba8a152cc8326306640c7acf307ceb385f7a4e8.
old-commit-hash: d330358728
2024-08-11 20:24:43 -07:00
Shane Smiskol b014b1cc90 Fix some car typing (#33256)
* ??

* fix these

* more typing and some fixes

* fix

* rm this for now

* fix
old-commit-hash: 2dab8b31f2
2024-08-11 19:12:46 -07:00
Dean Lee 056426a674 spinner: fix missing colon in QProgressBar border style (#33258)
fix border style
old-commit-hash: 85d8d0eddd
2024-08-11 10:22:52 -07:00
Shane Smiskol 162436088f move capnp CarParams decoding out of car_helpers (#33251)
* move capnp byte decoding out of car_helpers

* always wanted to type this

* and process replay

* this does nothing

* might as well
old-commit-hash: ee62b9c88b
2024-08-10 00:06:56 -07:00
Shane Smiskol 7dd22b9567 Honda: round minEnableSpeed correctly (#33250)
round to even
old-commit-hash: 4300f37cc4
2024-08-09 23:42:40 -07:00