Commit Graph

128 Commits

Author SHA1 Message Date
Justin Newberry 2fdde9b77d CI: switch to --cache-to type=inline for buildkit cache (#29575)
this is cleaner
2023-08-23 17:41:33 -07:00
Adeeb Shihadeh 91dc8457ae Revert Qt MOC hacks (#29528)
* Revert "CI: prevent moc from running in cache population step (#29401)"

This reverts commit d1aedccfbe.

* Revert "SCons: respect cache read only (#29437)"

This reverts commit 59abb469ea.

* don't change moc path
2023-08-22 11:16:58 -07:00
Kacper Rączy d1aedccfbe CI: prevent moc from running in cache population step (#29401)
* Do not remove moc_files from cache

* Add cache cleanup script

* Use cache cleanup script

* Dry-run in cache population command

* Add newline

* Temporarly disable master only constraint for cache cleanup step

* Add test lines

* one more

* Fix shebang

* Remove debug lines

* Bring back master branch constraints
2023-08-22 10:47:56 -07:00
Justin Newberry 3492e80d19 CI: use xdist for car model tests (#29514)
* bump panda

* try multithreaded for car models

* need pytest-cov

* upgraded to poetry 1.5.1 and regenerated
2023-08-21 20:51:27 -07:00
Kacper Rączy 0f7be5b1e6 Setup cleanup vol. 2 (#29456)
* code from setup cleanup #29419

update ci

update ci

export variables for mac os

check env

what is in the profile script?

install pyenv the same everywhere

temporarily disable brew cache

temporarily disable brew cache

try fixing pyenv virtualenv-init

try this

inject shims path earlier

try alternate install method

switch back to brew install

try         eval "$(pyenv init --path)"

add eval "\$(pyenv init --path)"

* Add local .env file to the cache list

* Change .env paths

* debug line

* order?

* remove .env

* Add .venv to caches

---------

Co-authored-by: Greg Hogan <gregjhogan@gmail.com>
2023-08-21 13:30:48 -07:00
Dean Lee 3eef63af9b common: C++ RateKeeper (#29374)
* c++ RateKeeper

* add to files_common

* use util::random_int

* improve monotor_time

* remove ~ratekeeper
2023-08-20 21:27:02 -07:00
Adeeb Shihadeh ff068dd722 move mypy config into pyproject.toml (#29501)
* move mypy config into pyproject.toml

* rm reference
2023-08-20 21:08:04 -07:00
Harald Schäfer bc4b75822a update process replay timeout (#29478)
* Always dict differ

* Update selfdrive_tests.yaml

* bump up more

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2023-08-20 17:24:33 -07:00
Justin Newberry 1944945d9d Revert "setup cleanup (#29419)" (#29451)
This reverts commit ad32816fd6.
2023-08-17 13:23:06 -07:00
Greg Hogan ad32816fd6 setup cleanup (#29419)
* setup cleanup

* update ci

* update ci

* export variables for mac os

* check env

* what is in the profile script?

* install pyenv the same everywhere

* temporarily disable brew cache

* temporarily disable brew cache

* try fixing pyenv virtualenv-init

* try this

* inject shims path earlier

* try alternate install method

* switch back to brew install

* try         eval "$(pyenv init --path)"

* add eval "\$(pyenv init --path)"
2023-08-17 08:51:16 -07:00
Kacper Rączy ae649ec68d macOS: fix GH actions cache (#29399)
Add lz4 and xz to dep cache exceptions
2023-08-14 16:13:35 -07:00
Adeeb Shihadeh b11b14aff8 CI: enable PYTHONWARNINGS=error (#29364)
* CI: enable PYTHONWARNINGS=error

* fixes

* more ignore

* more modeld ignore
2023-08-12 17:15:16 -07:00
Adeeb Shihadeh 0ced56b2ea remove xx dependencies (#29263)
* rm xx deps

* mv that

* fix

* fix a path

* relock

* relock

* update

* update sentry

* update

* revert sentry

* Update lock

* Dummy pip package

* Not needed with poetry

* dont need dummy

---------

Co-authored-by: Bruce Wayne <harald.the.engineer@gmail.com>
2023-08-11 20:05:44 -07:00
Justin Newberry 2482b58968 CI: move other caches out of /tmp (#29348)
* also move other caches

* macos can stay
2023-08-11 17:41:23 -07:00
Justin Newberry ace4d78e31 CI: move cache to home directory (#29347)
move cache to home dir
2023-08-11 15:45:38 -07:00
Justin Newberry a0f399677e CI: use default caching action (#29339) 2023-08-11 14:03:10 -07:00
Adeeb Shihadeh cd4bb412f5 CI: bump up model test timeout 2023-08-10 17:29:56 -07:00
Adeeb Shihadeh e53f9597f3 remove rest of pylint (#29302)
* remove rest of pylint

* fix release build
2023-08-09 19:03:36 -07:00
Adeeb Shihadeh ae8252c14a CI: move longitudinal tests into unit tests job (#29245)
* move long into unit test job

* try without these

* add that back
2023-08-07 06:48:06 -07:00
Adeeb Shihadeh 75ab960557 CI: add timeouts to selfdrive tests (#29239)
* CI: add timeouts to selfdrive tests

* ugh, so slow

* will have to come back to this one
2023-08-04 18:14:14 -07:00
Adeeb Shihadeh f714e7cb24 CI: update cache action (#29241)
* update that

* update one more
2023-08-04 17:59:55 -07:00
Adeeb Shihadeh 0df2cd4fa8 CI: only run on master + PRs (#29242) 2023-08-04 17:56:30 -07:00
Shane Smiskol 6ad6191e6a car docs diff bot: don't ignore failures
we have a test for this, so if that fails, doesn't matter if this fails too
2023-08-02 17:18:43 -07:00
Adeeb Shihadeh 34389acbbf CI: run plotjuggler test on mac (#29102)
* CI: run plotjuggler test on mac

* source

* python path
2023-07-22 23:10:31 -07:00
Adeeb Shihadeh a83dec9d94 CI: add docker images tagged with git commit (#29052)
* CI: add docker images tagged with git commit

* tag later

* debug

* fix tag

* test that

* cleanup
2023-07-19 23:35:33 -07:00
Adeeb Shihadeh 22882a0d22 CI: use locally built image as CL base (#29030) 2023-07-18 22:57:32 -07:00
Maxime Desroches 56a0f9e074 Force build of openpilot-base for OpenCL tests (#29022) 2023-07-18 16:25:05 -07:00
Adeeb Shihadeh ae6f13fb50 CI: update codecov action (#28967) 2023-07-15 22:55:33 -07:00
Maxime Desroches 0ebec253d0 simple fuzzing test for all processes (#28661)
* Revert "Revert "simple fuzzing test for all processes (#28584)""

This reverts commit 7783dc602c.

* determinism

* fingerprint
2023-06-29 21:49:23 -07:00
Adeeb Shihadeh 7783dc602c Revert "simple fuzzing test for all processes (#28584)"
This reverts commit bac193bdd5.
2023-06-22 14:59:50 -07:00
Kacper Rączy f7c520b0d9 macOS: re-order CI caching jobs (#28622)
Save scons cache before dependency cleanup
2023-06-21 14:01:33 -07:00
Kacper Rączy 45a6834a74 macOS: fix build issues & re-enable CI (#28258)
* Uncomment build_mac job

* Add PYCURL_CURL_CONFIG

* Acados universal binary

* Remove x86 macos references from sconscript

* Add missing include in cabana

* Update cereal

* Update workflow

* Remove unnecessary libpaths for darwin

* Add missing path to cached dirs

* Fix path in cache preparation step

* Add poetry caches to CI cache

* Compile acados with lower deployment target for CI

* Update cereal

* Pass -rpath in linker flags as scons doed not support RPATH on macos

* Use scons api instead of os

* @rpath in install name of acados dylibs

* SConstruct cleanup

* fix liblocationd tests by adding lib suffix based on platform

* Update cereal

* Update opendbc

* Update opendbc

* Add acados gitignore to release files

* Update cereal

* Update cereal

* Add scons_cache to build cache

* Add Caskroom to cache

* Fix typo

* Link all packages at once, instead of one by one

* Run cleanup stage using poetry

* Remove casks from cache

* Move scons cache to separate cache step

* Save scons cache only on master

* Remove restore-keys from save-scons-cache step

* Uncomment if conditions for scons save

* Add gcc-arm-embedded cask cache to cache

* Custom handling of gcc-arm-embedded toolchain cache

* Rename dep cache key

* Exclude .fseventsd from cache

* Fix glob pattern

* Remove .feventsd before caching

* Run mac_setup only if dependency cache-hit != true

* Update cereal to master

* Add overwrite flag to brew link

* Remove manual casadi build from mac_setup

* Remove restore-keys from dependency cache

* Remove linux requirement for casadi

* Restore restore-keys to dependency cache
2023-06-21 13:14:20 -07:00
Maxime Desroches bac193bdd5 simple fuzzing test for all processes (#28584)
* working test

* classmethod

* review

* add to ci
2023-06-20 10:57:02 -07:00
Adeeb Shihadeh a1b6697629 logmessaged: handle big cloudlogs (#28553)
* logmessaged: handle big cloudlogs

* revert

* switch
2023-06-14 22:48:51 -07:00
Kacper Rączy 23de5f1bac pre-commit: validate poetry lock (#28313)
* Add CI step to validate lock file

* Fix run script

* Build docker image before running the check

* Fix

* Use setup instead of docker build

* Add pre-commit check

* Update hooks

* Add files to lock validation hook

* Add pyproject.toml and poetry.lock to release files

* Cleanup
2023-05-26 19:21:34 -07:00
Adeeb Shihadeh 5ec7da96a6 ci: always upload process replay ref logs 2023-03-30 12:43:08 -07:00
Adeeb Shihadeh c97911dbad ubloxd: move to system/ (#27536)
* ubloxd: move to system/

* more fixes

* add missing sconscript

* fix valgrind tests

* uncomment
2023-03-08 16:11:18 -08:00
Adeeb Shihadeh 94eb215980 loggerd: move to system/ (#27534) 2023-03-08 11:20:49 -08:00
Shane Smiskol b536b9c4c0 process replay: don't upload if diff doesn't exist (#27333)
* fail the replay, successfully print

* should still run

* debug

* outside?

* don't fail

* don't fail

* don't fail

* test

* test

* test

* try this now

* clean up, works!
2023-02-13 21:39:06 -08:00
Adeeb Shihadeh 01bdf382c4 CI: temporarily remove timeouts 2023-02-07 12:52:50 -08:00
Kurt Nistelberger e2f5b164bd Ubloxd: glonass parsing tests (#27125)
* add glonass kaitai parsing

* add kaita generated files

* remove glonass from build

* add string non immediate type

* fix kaitai bug

* cleanUp

* add patch file

* fix scons order

* make lookup const

* remove comments

* rename

* add to release files

* remove printf

* add signs

* add glonass parsing test

* finish up glonass kaitai tests

* move cereal back to master

* ignore test_runner

* sign is not two complement

* address comments
---------

Co-authored-by: Kurt Nistelberger <kurt.nistelberger@gmail.com>
2023-01-30 16:34:07 -08:00
Shane Smiskol 3efb22e82b release pre-commit: test translations (#27017)
we should be able to run on the stripped dir now
2023-01-20 11:46:02 -08:00
Adeeb Shihadeh 1da6f6a6e2 nav model replay (#26697)
* nav model replay

* set token

* fix gh actions

* update refs

* fix pc
2022-12-07 19:36:30 -08:00
Cameron Clough a662af57c7 CI: use github.head_ref to group PR action runs (#26505)
* CI: use github.head_ref to group PR action runs

for push triggers, github.ref is set to the "branch or tag ref that was pushed"
for pull_request triggers, it is set to the "pull request merge branch" (master?)

github.head_ref is only set when the trigger is pull_request

https://docs.github.com/en/actions/learn-github-actions/contexts#github-context

* only check github.ref for push event
2022-11-15 13:07:46 -08:00
Dean Lee 80b088c332 Cabana: add save DBC dialog (#26282)
* export DBC to text edit

* added saveAs & Copy To Clipboard

* cleanup

* cleanup include

* add test case

* rename variable

* fix precision
2022-10-30 07:31:12 -07:00
Cameron Clough 335351123a Revert "ci: run some jobs only on push (#26202)"
This reverts commit 04b40aad92.
2022-10-22 01:04:54 -07:00
Cameron Clough 04b40aad92 ci: run some jobs only on push (#26202)
* ci: run some jobs only on push

alternative to #25900

* tools too
2022-10-21 21:13:55 -07:00
Cameron Clough dba8e8ec0e Revert "ci: don't trigger on pull request sync event (#25900)"
This reverts commit 68530f18b4.
2022-10-21 18:04:07 -07:00
HaraldSchafer a98d105cb9 Pipenv -> poetry (#24858)
* Try poetry

* Remove casadi for now

* Update docker

* Copy pipfiles

* add casadi back

* Too many slashes

* New poetry api

* Install system

* Try again

* No more pipenv

* new dependencies

* updates

* poetry 1.2.1, install dev dependencies

* keep install pipenv for xx for now?

* add pre-commit checks for poetry

* poetry lock is too slow

* update pip

* migrate to poetry groups

* update lockfile

* don't need to specify dev group unless it is made optional

* always install poetry

* set POETRY_VIRTUALENVS_CREATE instead, and use pipenv for xx

* use env for docs docker image

* alphabetical

* poetry 1.2.2

* add dev dependencies for typing

added in 4e310b80

* remove constraint

* fix PIPENV_SYSTEM

* remove constraint

* don't need this here

* bump

* bump pipenv

adds support for installing local pyprojects (can add openpilot as dependency of xx)

* README improvements

* probably not necessary

* bump pip

* maybe not necessary?

* revert

* don't install openpilot itself into the virtual env

* remove PySide2 and shiboken2

reverts c6b749fb96

* remove Pipenv, add xx dependencies, sync system python

* add pipenv as xx dep

* semver package constraints, use old lockfile versions

* fix casadi

* remove whitespace

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* disable poetry cache

* cleanup

* prefer config file

Co-authored-by: Cameron Clough <cameronjclough@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2022-10-21 16:23:56 -07:00
Cameron Clough 68530f18b4 ci: don't trigger on pull request sync event (#25900) 2022-10-20 13:23:59 -07:00