Commit Graph

39 Commits

Author SHA1 Message Date
Shane Smiskol 4221734433 CI: use azure-storage-blob for uploading (#30478)
* use azure-storage-blob

* fix pattern

* nsp
old-commit-hash: c2af245b85cb9a168b86446a41e665dc680f7242
2023-11-15 21:22:14 -08:00
Shane Smiskol 58cd3094dd openpilot CI: fix azure bucket names (#30477)
fix azure bucket names
old-commit-hash: 0addee2b4b9f4ad64d1cea12f4a6badf50e85e9c
2023-11-15 21:15:10 -08:00
Harald Schäfer 7c4d29c3d1 Rm laikad (#30299)
* rm laika

* Rm laika

* Needed this

* More rm

* More rm
old-commit-hash: 56dea7b0b42e7624a39fef0986cd0db151bb9512
2023-10-23 00:15:39 -07:00
Adeeb Shihadeh 34edef6a60 update azure-storage-blob (#29411)
Co-authored-by: Cameron Clough <cameronjclough@gmail.com>

old-commit-hash: c9e227a9c062aa5e9569472e88d720d1160819de
2023-08-25 22:01:10 +01:00
Justin Newberry c4f322ce2d Linter: remove pylint (#29611)
remove pylint
old-commit-hash: 1ee6ed4b16e2ade0dd887c0687243aee769043e5
2023-08-24 16:30:54 -07:00
Adeeb Shihadeh 16ec56398c add openpilot prefix to imports (#29498)
* add openpilot prefix to imports

* more

* more

* fix docs

* fix linter

* bump submodules

* fix patched tests

* update dynamic imports

* debug

* Revert "debug"

This reverts commit db5e13b9911cc74438bee123bc3430da6c31b24b.

* fix pm test
old-commit-hash: a9626f95b69af19306143fc4def02fb5769405d2
2023-08-20 20:49:55 -07:00
Justin Newberry f33b4de80b Ruff: b905 (strict zip) (#29336)
* added mutable default args

* most of the Bs

* add comment about lrucache

* b905
old-commit-hash: e4ead4f1830618f5f61978491930cb0b8d36ab26
2023-08-11 16:13:51 -07:00
Harald Schäfer ef407c9ad9 Qcom rawgps: Timestamp svpolys (#28738)
* Timestamp svpolys

* leap seconds handled fine

* Fix error

* bump laika

* Update test route

* update ref
old-commit-hash: 47ee0932db6911dd7fc064ae3a17e929d341c94e
2023-07-11 13:22:09 -07:00
Adeeb Shihadeh 87b5a744cd no more preserve bucket
old-commit-hash: ffc151ed8facbb6b29c6cf1aa6676f2c59271483
2022-10-19 15:34:06 -07:00
Shane Smiskol 59eae58840 Update CI routes: speed up (#26162)
* cache get_azure_keys

* tqdm
old-commit-hash: d2c1bb4238436dd5e39447f367b7ff1dc0b531b8
2022-10-19 14:13:06 -07:00
Vivek Aithal 7a826259c4 regen: Refactor log migrate functions to avoid needing azure keys (#26049)
* refactor migrate fns to avoid needing to use azure keys on import

* move azure key init behind a function

* resolve comments
old-commit-hash: 5f7d9a519e98b446b14866a8920dd0493b4dce26
2022-10-13 13:21:35 -07:00
Vivek Aithal 51d25b2011 Live torque (#25456)
* wip torqued

* add basic logic

* setup in manager

* check sanity and publish msg

* add first order filter to outputs

* wire up controlsd, and update gains

* rename intercept to offset

* add cloudlog, live values are not updated

* fix bugs, do not reset points for now

* fix crashes

* rename to main

* fix bugs, works offline

* fix float in cereal bug

* add latacc filter

* randomly choose points, approx for iid

* add variable decay

* local param to capnp instead of dict

* verify works in replay

* use torqued output in controlsd

* use in controlsd; use points from past routes

* controlsd bugfix

* filter before updating gains, needs to be replaced

* save all points to ensure smooth transition across routes, revert friction factor to 1.5

* add filters to prevent noisy low-speed data points; improve fit sanity

* add engaged buffer

* revert lat_acc thresh

* use paramsd realtime process config

* make latacc-to-torque generic, and overrideable

* move freq to 4Hz, avoid storing in np.array, don't publish points in the message

* float instead of np

* remove constant while storing pts

* rename slope, offset to lat_accet_factor, offset

* resolve issues

* use camelcase in all capnp params

* use camelcase everywhere

* reduce latacc threshold or sanity, add car_sane todo, save points properly

* add and check tag

* write param to disk at end of route

* remove args

* rebase op, cereal

* save on exit

* restore default handler

* cpu usage check

* add to process replay

* handle reset better, reduce unnecessary computation

* always publish raw values - useful for debug

* regen routes

* update refs

* checks on cache restore

* check tuning vals too

* clean that up

* reduce cpu usage

* reduce cpu usage by 75%

* cleanup

* optimize further

* handle reset condition better, don't put points in init, use only in corolla

* bump cereal after rebasing

* update refs

* Update common/params.cc

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* remove unnecessary checks

* Update RELEASES.md

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 4fa62f146426f76c9c1c2867d9729b33ec612b59
2022-09-19 15:19:26 -07:00
Lukas Petersson 4171e45e9c process replay: regen in parallel (#24628)
* regen in parallel

* prefixes

* clean regen

* clean output

* tqdm loc

* del swp file

* add routes back

* cleanup

* disable tqdm

* unique dirs

* unique dirs

* outdir in regen_all

* formatting when played from other dirs

* prefix dongle id

* local disable_tqdm

* formatting

* bug fix

* dont spam fakedata

* 16 char fake dongle ids

* formatting

* formatting

* more descriptive dongle

* fix azure path

* couple more fixes

* handle failures nicely

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 397da56c85d4d4932d25435dcb1d57f2cd2d8c4b
2022-06-06 14:21:12 -07:00
Adeeb Shihadeh 5fe40091bf update references to CARS.md and routes.py (#23993)
old-commit-hash: b9c48f12ad70ee4f5b4a8679ef674c2876fa318f
2022-03-18 13:30:06 -07:00
Adeeb Shihadeh 805a00b5f3 cleanup selfdrive/test (#23967)
* move test routes and test_models

* move fingerprints

* little more

* remove that
old-commit-hash: 8718a5933049d5934cc53ef31af9b5ded3223a7c
2022-03-14 15:46:16 -07:00
Ewout ter Hoeven a962365292 Convert format strings strings to f-strings (#23241)
* Convert all text strings to f-strings

Reformats all the text from the old "%-formatted" and .format(...) format to the newer f-string format, as defined in PEP 498. This requires Python 3.6+.

Flynt 0.69 was used to reformat the strings. 120 f-strings were created in 51 files.

F-strings are in general more readable, concise and performant. See also: https://www.python.org/dev/peps/pep-0498/#rationale

* revert pyextra changes

* revert ublox.py

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 55390d273f36f49da3896e687ac5530f40c1d150
2021-12-16 14:58:17 +01:00
Willem Melching fd3140fd6f cleanup unused pip packages (#22947)
* cleanup unused pip packages

* fix linter
old-commit-hash: f1c77f97b934fac877230d9438fb4a15d1813c52
2021-11-17 16:23:03 +01:00
Harald Schafer 6e8f439dce upload original
old-commit-hash: f60d169bb4fc56110ffc420395a1fb7d28b45094
2021-07-09 16:32:04 -07:00
Harald Schafer 1ab68e18d3 fix exclude pattern
old-commit-hash: 472442111b6077ff758ad9e46828c7c97925927b
2021-07-09 15:51:08 -07:00
Adeeb Shihadeh 59d54b2bfc exclude raw logger files from upload
old-commit-hash: 8f1fc93a5e69dfa55ae4f45dfb1256e918424b41
2021-06-30 00:40:48 -07:00
Adeeb Shihadeh d31397b84b segment regen (#21148)
* start seg regen

* send vipc

* fix up some paths

* set fp

* fix no entries

* engages

* seperate camera procs

* send real frames

* regen test routes

* nice argparser

* fix valgrind test

* move that

* fix that
old-commit-hash: 4a1aec27efb48bdba1d267c86ef66c8a044c4986
2021-06-28 21:44:40 -07:00
ShaneSmiskol fa75ee24f2 Clean up test_routes file (#21056)
* remove no enableCamera routes and add to missing

* use a named tuple

* split makes by \n, fix reference to routes

* Update selfdrive/test/test_routes.py

* Update selfdrive/test/test_routes.py

* Update selfdrive/test/test_routes.py

* Update selfdrive/test/test_routes.py

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: e7afb262033b3e7a5bfd05d54e1f63c1840d7428
2021-05-27 15:29:48 -07:00
ShaneSmiskol c2b41b8b55 Add missing Hondas and Toyotas to tests (#21044)
* Add new route for Acura ILX

* Add Lexus RXH

* Add CRV Hybrid route

* Add Insight route

* update sync script

* Add Avalon route with rlogs

* Update CRV route

* Update Pilot 2019 route

* Add Camry Hybrid 2018 route

* Add 2017 Highlander

* Add 2018 Highlander Hybrid

* Add TSS2 Highlander Hybrid

* Add Accord Hybrid

* Repalce old Accord

* Update Lexus RXH route with logs, CHR+H, skip Avalon for now (fixup in another PR)

* Add CRV

* How did I miss this!

* add exception for CRV Hybrid

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 997319fac19836a6b528b5b0d73ba6dfe0e3fb7f
2021-05-27 12:20:14 -07:00
Adeeb Shihadeh df17f65c61 cleanup car tests (#20562)
* cleanup test_car_models

* don't fail on that
old-commit-hash: 7e632900e5fc6581ead248581e5f90703f851d23
2021-04-01 16:46:08 -07:00
Willem Melching 8e706e29d6 update CI routes, add back destination key
old-commit-hash: 5b7d7622bf9bd897e7eb1da2a9d557ccd83ad4a9
2021-01-04 19:15:39 +01:00
Adeeb Shihadeh c1042b848e another update_ci_routes fix
old-commit-hash: 309384e2f78f41f205461829f6fe7771750ae500
2020-12-31 14:00:30 -08:00
Adeeb Shihadeh 1eb2e651f0 update CI route sync script for new version of azcopy
old-commit-hash: 35fbb9d097118eddfa58654872f28beee4a32593
2020-12-30 21:15:39 -08:00
Adeeb Shihadeh ea2bb39526 more external cleanup
old-commit-hash: d61b6647850278cadfba2f1bfbdf1c277bf96f0d
2020-12-18 13:28:50 -08:00
Adeeb Shihadeh 755c21f05c update_ci_routes.py: upload route by arg
old-commit-hash: cea8b9e67a34d39716f4be1e8be64e7aa8fca306
2020-08-08 14:30:31 -07:00
Adeeb Shihadeh 9823f1164c enable flake8 E303: too many blank lines
old-commit-hash: f3dcf861c73b47c52b5dd77a8f1f8858005ae18b
2020-05-31 17:21:11 -07:00
Adeeb Shihadeh 68a3061c9d enable E261 in flake8: two spaces before inline comment
old-commit-hash: 27754a277c36b82ef4040e536cc918ba8ad77bec
2020-05-31 14:07:29 -07:00
Willem Melching 4022d92155 make pre-commit pass without xx present
old-commit-hash: bee15f8abef98b35d070e931d5b34fd01ca8128e
2020-05-28 13:20:28 -07:00
Willem Melching 12a306021d flake8 in pre-commit(#1583)
old-commit-hash: 29aaa44740b5dae3c1cc0c273c72c7eb53135e5e
2020-05-27 20:33:05 -07:00
Willem Melching fd3db576af More public routes in test car models (#1208)
* remove non public routes

* Fix linter

* add rav4h

* add odyssey

* add pilot and civic_bosch

* cth and camry

* add regal
old-commit-hash: a25acaae0770a32aa54abd4d41dc0f5ab5077f9a
2020-03-06 13:44:34 -08:00
Willem Melching 952031d4fe fix update_ci_routes.py
old-commit-hash: a1a7c2b43733388eb4690d020e1854b2016b7c3c
2020-02-27 13:18:39 -08:00
Greg Hogan c7dfd582c3 exclude dcamera files from ci routes
old-commit-hash: dabe9d71ab1f7ee4fc4118ccce9b331ebcd801ca
2020-02-06 14:26:48 -08:00
Willem Melching c243cff6c0 Fix ci routes sync script target path
old-commit-hash: a97ebc28b5
2020-01-30 13:21:14 -08:00
Willem Melching 7ab5a1a675 Fix CI sync script
old-commit-hash: 09283f4d6a
2020-01-23 13:06:05 -08:00
George Hotz 06a02fd8bd selfdrive/test
old-commit-hash: c0bfbc12c7
2020-01-17 11:16:14 -08:00