Commit Graph

7334 Commits

Author SHA1 Message Date
Shane Smiskol 5f3569faf2 HKG: use platform codes to fuzzy fingerprint (#28531)
* get gas/ev/hev from FW (not all correct, poc)

* add test for essential ecus for fuzzy fingerprinting

* kinda works

* stash

* clean up

* add code

* simpler

* use the function

* test it with our cars

* no re

no re

no re

* debugging

* handle empty dict

* simpl

* this is promising

start on making existing fingerprinting functions use the config, instead of entirely replacing them

* needs to allow 1 match

* lay out how this should look

* changes

* executable

* some work

* use config

* fuzzy ecus

* config test

* comment and some clean up

* test platform codes

* use regex, simpler and fixes bug

* in func

* rm bad func

* typing for new func and remove old from dc

* todo done

* tested!

* remove fake platform codes

* thought we needed this, but actually...

* not needed

* not applicable any more

* use config for essential ecus

* first draft of test to make adding/removing fuzzy FP platform intentional

* compile

* clean up test

* even cleaner

* fix default ecus type

* temp fix

* this is mostly in tests now

* test every fuzzy ecu fw returns one platform code

* experiment with dates

* Revert "experiment with dates"

This reverts commit 3251b9cc5c3ca41ca92c8b75ad9b2234b720aa0b.

* clean that up

* comment

* test

* work on all cars

* fix fuzz_fw_fingerprint

* comment

* get first by search

* bit more clean up

* and more

* use compiled pattern for nicer syntax

* default

* flip dat around, much cleaner

* clean up hyundai test a bit

* flip order

same here

* rename test and flip subTest

* fix pylint

* revert fw changes

revert fw changes

* line

* add original functions to test

* needs to be a list

* cmt

* draft (need to count one ecu as a match)

* tiny clean up

* todo: date range

* only in notebook

* remove comment (still can be either list or set)

* same, only notebook

* more consistent signature

* copilot inspired

* copilot no good

* test for date parsing

* better name

* good, now we don't have to worry about the dates mismatching in another test/logic

* comment up+

* some stuff

* clean up

fix test

fix test

* test

* comment

* use utils

* clean up (utils are cleaner and less buggy)

* clean up (utils are cleaner and less buggy)

* fixup test

* use a dash (prettier) and remove some platforms that can fingerprint now!

* compile global pattern

* same as what we do in values

* remove comments

* fuzzy_get_platform_codes is one or none here

* more clean up

* sort imports

* woah woah woah

* add comment

* fix reassigning different types

* add types

* adapt fuzzy test recently added (nice it caught this!)

* update lock

* options

comments

* stash

* comments and fixes

* better comments

* better

* test: run on exact fuzzy matching logic, same results!

* use match_fw_to_car

* test all fw

* ex

* unused random

* this is a possibility

* this is more clear

* fix

* revert

* revert to needing both ECUs to match to reduce false positives, test

* fix excluded platform test :( but it's ok

* add comment

* we actually want to only test fuzzy ecus to make it explicit

* fix mypy

* comment for tomorrow

* just add matches with fuzzy FP

* add comment

* this was the cleanest I could think of, but still working on it. not very easy to understand

* think this is better, but also worse...

* comment: reframing how this works

* revert back to what we did before

* was swapped

* else set

* remove old comment

* fixes from merge

* remove fuzzy_min_match_count from this pr

* fix static analysis

* also unused

* different method first draft

* copy existing fuzzy func

* check all possible ecus exist, only platform codes, slightly refactor main loop

* fix

* Revert recent

Revert "fix"

This reverts commit 5cdb7bda835f1e48e750ab4195e891afe08e11ea.

Revert "check all possible ecus exist, only platform codes, slightly refactor main loop"

This reverts commit d3e918fa20fa4ce881445850f5f7428a3c11adf8.

Revert "copy existing fuzzy func"

This reverts commit 34c8c0545097c84f55f4b4f61907606c93760ddd.

Revert "different method first draft"

This reverts commit b91139055d7d1802c1eb726504798c156a183c9c.

* new func

* fixup test

* remove changes from v1 from fw_versions.py

* clean up a bit

* return part as part of code

* fix test

* add original fuzzy function

* add an ecu match if the date is within range (or date doesn't exist)

* add format for what we're going to do

* not working stash

* the exact matching function does more of what we want with less code and less custom logic

* we don't care about found versions, only codes and dates

* actually we do have an exception

* this works pretty nicely now

* up here

* this is better

* some minor clean up

* old function=now junk

* fix platform code test

* remove old platform code function

* now rename _new to

* use FW_QUERY_CONFIG

* clean up imports

* rename that too

* one line

* correct typing

correct typing

* draft tests

* so that works

* fixup excluded platform test now too

* this is tested by excluded platform test

* test parts and dates

* remove old comment

* old import

* take platform code stuff out of FwQueryConfig

* fix test

* revert debug script

* flip order

* make this a set by default

* revert this part

* correct typing

* clean up comments

* clean that test up too/pylint

* combine these three tests ina clean way

* not right

* more general

* be consistent with quotes

* comment

* comment

* comment in fw_versions

* flip order

* this is more readable

* could test all this, but it's tested in test_hyundai and doesn't do a lot here

* only assert brands which use this

* invalidate all CAN FD ICE and hybrid

* tuple

* can get away without filtering

* add comment reasons

* fix

* some review suggestions

* this works (first draft)

* this is better

* script to print platform codes and dates

* sanity check for dates are in correct ecus and platforms

* mypy

* better variable name and comment

* rename

* same

* slightly better name

* subset

* exclude platforms and live car without dates

* consistent

* self explan

* better name

* test to make sure the functions agree

* clean that up

* comment

* we get other responses from queries not in DB, only check any

* not used or typed
old-commit-hash: f788edb6a5c8d3f516076f886fe0d831ee43b580
2023-06-15 02:50:45 -07:00
Shane Smiskol df924490d9 HKG: test list of platforms with no fwdCamera dates (#28555)
* no dates test

* sorted
old-commit-hash: 2166adda5f9c5a58c175c87d6e5f73e3d90d2e4f
2023-06-15 02:14:33 -07:00
Shane Smiskol 8e29e20860 FPv2: rename live FW versions dict (#28550)
rename
old-commit-hash: e771660fa331a34a111f1b5878c75adb50b216b8
2023-06-15 01:29:55 -07:00
Harald Schäfer 8b0492c8fe Alpha long control no longer called experimental (#28437)
* Fix words

* vanish

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: da3003ee41eb5e80a78d7639ecfdf16536f0fab9
2023-06-14 21:51:55 -07:00
Adeeb Shihadeh c945ddf8ef pandad: update time from RTC (#28466)
* pandad: update time from RTC

* Update pandad.py

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 4a0b5dacbb40bc20a3583be795756b5c23f13b91
2023-06-14 21:42:33 -07:00
Harald Schäfer 091964205d Laikad: Need to understand constellationId to understand clock (#28552)
Need to understand constellationId to understand clock
old-commit-hash: 6d25f66cf1cd8e3912719b79a44c4ff0fa013328
2023-06-14 19:54:51 -07:00
Shane Smiskol cfc79b5e8d HKG: add script to view platform codes (#28549)
add script
old-commit-hash: c4537714925bed4b380c4a981669491f7a692031
2023-06-14 15:54:04 -07:00
Cameron Clough 24c600b9ce Ford Escape 2020 FW (#28545)
old-commit-hash: 7a5b0b97e1d030dc896a559c292f86965bb51193
2023-06-14 15:53:58 +01:00
Harald Schäfer a0628ce816 Disable internet in laikad.py, even in CI (#28535)
* Limit OPENBLAS to 1 thread in manager

* Restrict openblas threads when running openpilot

* print in CI

* Disable internet for laika, even in CI

* update ref
old-commit-hash: 155cab9ec4f75da43cf2f89c51651bf74d11b021
2023-06-13 23:39:11 -07:00
Shane Smiskol a51819e9bb Hyundai FPv2 unit tests: clean up (#28542)
* be consistent with quotes

* combine tests

* cmt
old-commit-hash: d94c2a8ef7c0fd961c53ffb71ee79451eefa2d5f
2023-06-13 22:17:47 -07:00
Shane Smiskol 8464cdf3ec FPv2 timing unit test: halve runs (#28540)
Update test_fw_fingerprint.py
old-commit-hash: 6c619561ee7fc45ba8abb10bc37ec027fab0ba88
2023-06-13 21:26:31 -07:00
Shane Smiskol 4120ee014d FwQueryConfig: remove platform codes (#28538)
* bring platform codes out of config for now (can re-introduce later)

* clean that up

* flake8

* comment

* comments and better test names

* typo

* Update selfdrive/car/hyundai/tests/test_hyundai.py

* Update selfdrive/car/hyundai/tests/test_hyundai.py
old-commit-hash: 572a221a86d8048baba3fe50d6a950e4775f6f9f
2023-06-13 20:41:03 -07:00
Maxime Desroches 5a13d234d4 Fix index out of bound error for body carcontroller (#28539)
old-commit-hash: 348df9c974f0ce83a228c988d1508170f8edec1a
2023-06-13 20:37:17 -07:00
Shane Smiskol 1b7d771059 exact matching: use set for invalid (#28537)
use set
old-commit-hash: fcc268b8be70e72654252e5424840ca37ad04196
2023-06-13 20:00:54 -07:00
Kacper Rączy 5400564d71 regen: remove support for fake extra vision client (#28520)
* Remove extra client from camera replay

* Fix another device type check
old-commit-hash: 15fcd0d9d4f579265ac8c19c5fd5960c29c9074b
2023-06-13 16:13:20 -07:00
Kacper Rączy c11ead32d6 locationd: initial value for gps_std_factor (#28533)
* setup_gps method

* Add LocalizerGnssSource

* slight refactor

* make it more readable

* Move gnss_source initialization to configure_gnss_souce

* Add gps_variance_factor, gps_vertical_variance_factor and gps_time_offset

* add header changes
old-commit-hash: 242e8d2ca879665a0dbbf49ea291b86d4f62461d
2023-06-13 16:12:53 -07:00
Shane Smiskol 40bc230fef HKG: split up platform code parsing (#28532)
* test diff

* clean up

* clean up

* doesn't work :(

* fix mypy
old-commit-hash: 55e489db7cfeed8585825dda90f2ec9e122381f2
2023-06-13 14:47:45 -07:00
Shane Smiskol 24af8edc7f HKG: FW part number test (#28525)
* start on test

* better regex

* lookbehind

* comments to choose from

* i did not know that!

* common patterns in values.py

* messy messy

* need to remove these

* rmrmrm

* clean up test

* fixups

* not used yet

* none should be good enough

* Update selfdrive/car/hyundai/values.py
old-commit-hash: e54d05b42f9f3e161f168dcc352a6e95cc60ad28
2023-06-13 02:01:40 -07:00
Shane Smiskol 52de14c8a1 Hyundai: remove old Sonata FW (#28527)
* Update values.py

* can't find last 2 years
old-commit-hash: 7fffb892e43057895a425b0b79a8c1da4e5da24e
2023-06-13 00:26:02 -07:00
Shane Smiskol ef8e399237 Hyundai: remove old Elantra FW (#28526)
* Update values.py

* don't see this fw last 2 years

* add version from 3ea622c3c0ec3055

* Update selfdrive/car/hyundai/values.py
old-commit-hash: 8c784ae558a3f06375fd7960aff887532d3d10cc
2023-06-13 00:14:49 -07:00
Shane Smiskol a9986892c0 Subaru: use latActive for steer request bit (#28453)
* subaru: use latactive

* Update ref_commit
old-commit-hash: bce19bf187ed9c444bca834f64460f1648abe587
2023-06-12 23:03:04 -07:00
Adeeb Shihadeh 2b9b5e3646 manager: watchdog restart UI with SIGKILL (#28523)
old-commit-hash: 58d32a70d7c6cd8285a0bc2ae03926b71a2d004e
2023-06-12 21:46:20 -07:00
Kacper Rączy 8aa845a1c8 modeld: use any available stream as main, if there's only one (#28514)
* Use whatever stream is available as main, if there's only one

* Move logw somewhere else

* Add wideRoadCameraState to ignore_alive if its not available
old-commit-hash: 4eb3d541492f7695227f4d8a83127cbd0d32ff79
2023-06-12 20:13:56 -07:00
Dean Lee d0199b64b5 laikad: move 'from_qcom_source' into try block (#28510)
fix not cached except
old-commit-hash: 825c5a87df1bc4ac4630c550697e19f048d05317
2023-06-12 17:05:43 -07:00
Adeeb Shihadeh ebc311bdc9 thermald: must be in yellow band to go onroad (#28517)
old-commit-hash: 9bb9657c9cf052ea6a78cb201b6eda41beb457cc
2023-06-12 16:33:33 -07:00
Erich Moraga ace8d7433b Add several missing RAM_1500 firmwares (#28515)
`ProjectZ3d#8762` 2023 RAM 1500  DongleID|route 4e0a5220533d9a86|2023-06-11--19-45-36
old-commit-hash: 9444df4c80f553c5eeac1ceb8154cfb42dcaf2b8
2023-06-12 15:18:35 -07:00
Adeeb Shihadeh 4ab84b5dc1 thermald: common min date (#28457)
* thermald: common min date

* add to release files
old-commit-hash: d96361970b32a76422dc1acc7a78e5bdd55a4bed
2023-06-12 13:50:38 -07:00
Dean Lee eddc84d104 automatically detect available camera streams (#27640)
* remove WideCameraOnly

* check in set_initial_state

* no block

* remove try block

* apply reviews
old-commit-hash: 4ae0378f639826df5cc1518574842b61b118f371
2023-06-12 13:40:43 -07:00
Adeeb Shihadeh d2ec950790 test onroad: explicit memory leak check (#28502)
old-commit-hash: 2f117e88b775a0b53a3ae99ae943caaa66f952f2
2023-06-11 14:43:25 -07:00
Adeeb Shihadeh 846cd63f53 thneed: cleanup duplicate GPU config (#28487)
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: b22cadc04d569a6f3593fe32eaec3a3a0e21ef9b
2023-06-11 13:26:41 -07:00
Jason Young a77df10dba VW MQB: Add FW for 2018 SEAT Leon (#28500)
aef9c04d6ec5cd57|2023-06-11--17-40-14
old-commit-hash: 5250975fa32dbd5a5a3cc08cc0a9c15a36850b47
2023-06-11 13:07:46 -07:00
Cameron Clough a2bb797670 add Lincoln Aviator 2020 FW (#28494)
0b91b433b9332780|2023-06-11--13-43-59

VIN: 5LM5J7XC9LGL15606
old-commit-hash: a5a0d734ba4f504d997cb19fe4ca21291ea7334f
2023-06-11 12:57:22 -07:00
Cameron Clough c167ae232f Ford: shiftByWire ECU not used for fingerprinting (#28493)
old-commit-hash: 96420555e5766f835ec9b7d8f6207d87d9493571
2023-06-11 00:09:57 -07:00
Cameron Clough 1befc68287 Ford: detect auxiliary panda (#28491)
old-commit-hash: 30c12e45575d94563ae85a79e19823e9120ef76b
2023-06-10 23:22:12 -07:00
Cameron Clough 5afe1c0ed0 selfdrive/car: reusable CanBus helper (#28489)
old-commit-hash: 28bf7436937a14f16020dd00ee224c1d3fe26705
2023-06-10 22:50:19 -07:00
Cameron Clough 727b79b66f UI: consider border when setting map width (#28488)
old-commit-hash: 22ebd4fa8f7f9974daf096db6d3e11034149d6d9
2023-06-10 22:09:48 -07:00
Jason Wen f7824bffb0 offroad ui: remove irrelevant comment (#28485)
old-commit-hash: f0eef38dc0287baa0c8450290b90a948fa7bf01f
2023-06-10 13:01:16 -07:00
Shane Smiskol de4b702ec3 FwQueryConfig: add platform code support and tests (#28475)
* add config options

* you know what, platform codes don't need to be related to fuzzy fingerprinting at all

* better comment?

* add comment

* add test from other PR

* add platform code function to hyundai

* comment and add eps!

* clean up config test

* fix test

* add error message to test

* until we have multiple ways a brand can set up fuzzy FP, let's leave func name fuzzy-specific

* rename in comment too

* hyundai tests

* simpler test!

* check all ecus with platform codes

* add types-python-dateutil = "^2.8.19.13"

* these aren't used any more

* Update selfdrive/car/hyundai/tests/test_hyundai.py

* not to imply this is active yet
old-commit-hash: f5e032b67f6e37d2c12dcd90168a2b33b3b78831
2023-06-09 22:51:55 -07:00
Adeeb Shihadeh ab538d21f9 thermald: lower threshold to exit red band
old-commit-hash: a77d226f33f618b965204c700fd0bfeb5f1547ab
2023-06-09 20:15:13 -07:00
Kacper Rączy 0541586636 process_replay: deprecated message migration (#28456)
* Move migration code to new file

* Migrate messages in process replay. Remove old code

* Fix old_logtime

* Keep old logtimes on migrated messages

* Update ref commit
old-commit-hash: 838346d8a3a139a160e3cc602ba38d6f3b09a00a
2023-06-09 19:17:50 -07:00
Cameron Clough e199a1a953 MapPanel cleanup (#28474)
old-commit-hash: f7f5537af74625e3a08352fef73eebffd4991a49
2023-06-09 17:08:57 -07:00
Adeeb Shihadeh 678825e10f cloudlog process not running (#28472)
* cloudlog process not running

* error
old-commit-hash: a412cd07b105807a3fcd5fdc8b9caae0e227cf06
2023-06-09 15:36:15 -07:00
Maxime Desroches dcdb4db5b9 car docs: test print_docs_diff (#28459)
* test print docs

* delete

* remove this

* print
old-commit-hash: 181b44b28ea51429e270eb2c7a0cac20a871f214
2023-06-09 14:13:22 -07:00
Shane Smiskol 1b5e039afd Honda: set autoResumeSng for docs (#28458)
set autoResumeSng for Honda
old-commit-hash: 7a64385fcd5354efd3bd9dcf6972669c46d99c10
2023-06-09 11:20:42 -07:00
Lee Jong Mun c1e64b592e kor translation update (#28469)
old-commit-hash: b2288b366697a7ac16323e06419243a1785b371b
2023-06-09 10:54:39 -07:00
Shane Smiskol 1a3b5137b6 FPv2: add comment about nuance of fuzzy fingerprinting (#28465)
add comment describing this nuance of fuzzy fingerprint function
old-commit-hash: 3234243c97c7c6bf6fb4bb1298a7fd262e697c04
2023-06-08 20:47:55 -07:00
Shane Smiskol c73ef08d08 FPv2: fix accidental FW version concatenation (#28462)
* fix missing commas

* more

* Revert "more"

This reverts commit ebe481fee44f284a598ad9d5a83da37653faee99.

* only
old-commit-hash: 5736cb8a7ec2aab91a7b7d61908e8827e6031d51
2023-06-08 19:53:45 -07:00
Adeeb Shihadeh 380be7b25c boardd: log system and RTC time before sync (#28461)
old-commit-hash: 6bf1f81859bc03456a9a49245b434dbd35cc4442
2023-06-08 19:50:49 -07:00
Dean Lee e5f294783f ui: disable longitudinal personality settings when using stock long (#28443)
* disable longitdinal personality settings

* disable title label

* Revert "disable title label"

This reverts commit ef315ac2770191f1309f774185266e0cd9fe54b0.

* gray checked button on disable
old-commit-hash: 9295aca8eaebaadbc7ec96e82ece55dcaa3b668e
2023-06-08 16:03:18 -07:00
AlexandreSato aed0f7d1a2 Multilang: Fix text overlap in pt-BR translation (#28450)
* update pt-BR translations

* fix some cutoff texts

* update pt-BR translations

* Include the new relaxed explanation

* fix text overlaps
old-commit-hash: a250e1cb2f176b9de808f8ee76b6999562c47463
2023-06-08 12:54:23 -07:00