103 Commits

Author SHA1 Message Date
Daniel Koepping
f30f8cfa65 Fix car diff race condition (#3344) 2026-04-21 21:41:16 -07:00
Shane Smiskol
c011754081 Rivian: add GEN 2 B harness (#3286)
* add b

* update template

* no default

* capital

* we don't have a driving video?!
2026-04-03 16:05:54 -07:00
Jason Young
dc0e7d061b fix test_models CI workflow (#3244)
fix test_models flow
2026-03-27 21:10:29 -04:00
Adeeb Shihadeh
ddeba888a3 try no scons (#3194)
* try no scons

* lil more

* lil more

* lazy

* fix ty
2026-03-11 11:23:38 -07:00
Adeeb Shihadeh
37207f61e9 Replace mull with custom mutation test runner (#3130)
simple mutation!
2026-03-10 21:23:32 -07:00
Jason Wen
cbcc9c5c65 CI for the people, but in opendbc (#3163) 2026-02-28 19:46:47 -08:00
Adeeb Shihadeh
a2c3ad09bd use vendored cppcheck from dependencies repo (#3154) 2026-02-23 12:46:34 -08:00
Matt Purnell
b10b43105b CI: update CI to reflect removal of docker (#3149)
CI: replace docker with native setup for test_models

openpilot replaced docker-based CI with native `op setup` in
commaai/openpilot#37282, breaking the test_models job here.
2026-02-22 09:32:51 -08:00
Adeeb Shihadeh
7c78ee87b7 replace natsort with lil function (#3105)
* replace natsort with lil function

* sort
2026-02-02 08:07:10 -08:00
Daniel Koepping
b038e6e199 Car diff: skip comment on first timer PR (#3067)
skip comment if tests.yml never ran
2026-01-26 21:04:55 -08:00
Shane Smiskol
f64e0bfe8a Add misc bug template (#3057)
* misc bug

* rm
2026-01-21 22:34:30 -08:00
Daniel Koepping
3b75bd8536 Car diff: fix PR comment (#3045)
fix PR comment
2026-01-21 04:05:53 -08:00
Adeeb Shihadeh
4ec3892bcd pin python dependencies (#3047)
* check in uv.lock

* ty fixes
2026-01-20 09:30:31 -08:00
Adeeb Shihadeh
796ece26ac libsafety: switch to clang 18 and only build mull in standalone mode (#3044)
* just switch to 18

* try this

* just clang

* rm that

* try this
2026-01-19 15:30:32 -08:00
Daniel Koepping
80f030ac5d Car diff (#3024)
* Opendbc replay (#6)

* add replay POC

* compare HEAD to master

* split in compare and worker

* copy worker.py

* cleanup

* fix

* apply tesla brake PR

* fix

* fix mutation test

* add panda

* add timestamps

* simplify

* add falling edge

* add remaining carstate

* simple lines

* bump

* rename

* use zst as ref

* ref commit

* cleanup

* formatting

* no failing

* fix git

* clean

* use pool.map

* fix docker build

* clean

* Revert "fix docker build"

This reverts commit da3577441eaa4b7fdc5763f73e779dd32c03a3c3.

* use flat paths

* format

* use azure test instance

* print full diff

* no stderr output

* use GIT_REF

* Revert "apply tesla brake PR"

This reverts commit f377e21f3865c574db5d618be20b4efa86fba66f.

* allow overwrite blobs

* supress stderr

* add error on failed generation (#8)

* Opendbc replay (#129)

* add replay POC

* compare HEAD to master

* split in compare and worker

* copy worker.py

* cleanup

* fix

* apply tesla brake PR

* fix

* fix mutation test

* add panda

* add timestamps

* simplify

* add falling edge

* add remaining carstate

* simple lines

* bump

* rename

* use zst as ref

* ref commit

* cleanup

* formatting

* no failing

* fix git

* clean

* use pool.map

* fix docker build

* clean

* Revert "fix docker build"

This reverts commit da3577441eaa4b7fdc5763f73e779dd32c03a3c3.

* use flat paths

* format

* use azure test instance

* print full diff

* no stderr output

* use GIT_REF

* Revert "apply tesla brake PR"

This reverts commit f377e21f3865c574db5d618be20b4efa86fba66f.

* allow overwrite blobs

* supress stderr

* print upload refs

* add error on failed generation

* Revert "use azure test instance"

This reverts commit ba969ccda452a4841934440d3ced22829861f70f.

* Revert "fix mutation test"

This reverts commit 8f5e01de7743ee38c340df90751cf370634fe2b2.

* detect safety changes

* use logReader

* only use valid platforms

* use local database

* Revert "use local database"

This reverts commit 4ebe9fe0800fb1631efe8672817a8c21b8780b65.

* Reapply "use azure test instance"

This reverts commit e9968a04e4ddee00b69174fd30ee1cdcdfa506fb.

* cutoff diff

* parallel downloads

* enable stderr

* fix interface

* logprint errors

* add comment to PR

* fix

* FORMAT: lines

* FORMAT: plots

* FORMAT: fix

* modules

* Revert "use azure test instance"

This reverts commit ba969ccda452a4841934440d3ced22829861f70f.

* build on forks

* clean

* rename

* replace azure with ci-artifacts

* auto bootstrap

* help

* FORK TEST

* Revert "FORMAT: fix"

This reverts commit 0262b1fad4.

* Revert "FORMAT: plots"

This reverts commit 314417db1f.

* Revert "FORMAT: lines"

This reverts commit 5cdd4c567f.

* clean

* no comment on empty output

* output errors

* fix pr comment

* fix diff more

* increase tolerance

* less files

* one file

* Revert "FORK TEST"

This reverts commit fc691b500c.

* Revert "fix mutation test"

This reverts commit 8f5e01de7743ee38c340df90751cf370634fe2b2.

* fix comment

* fix comment

* move car_diff.py

* Revert "fix mutation test"

This reverts commit 8f5e01de7743ee38c340df90751cf370634fe2b2.

* move car_diff.py

* inline helpers

* inline helpers

* fix ruff

* fix ruff

* use all carstate fields

* add --all

* use all carstate fields

* add --all

* bootstrap

* bootstrap

* Revert "bootstrap"

This reverts commit c3c2ba41e8.

* add line formatting

* commit workflow

* adjust formatting

* return err

* subprocess

* comma_car_segments

* dead code

* minimal logreader

* remove openpilot

* add deps

* remove all deps

* fix source

* request

* less parallel

* fix push

* bootstrap

* Revert "bootstrap"

This reverts commit b4af0d3bbd.

* fix graph

* push

* regex

* optimize dict_diff

* reduce tolerance

* use comma_car_segments

* remove

* use requests

* timestamps

* frame_ms

* id

* logreader

* align logreader

* use logreader

* remove requests

* return

* more line

* ruff

* use test pip package

* push on commaai

* use zstandard lib

* clean

* rename

* use decompress

* fix

* index

* lr filter

* union types

* find edges

* group frames

* render waveform

* format timing

* signals

* numeric diff

* boolean diff

* real timestamp

* impreza fingerprint

* Revert "impreza fingerprint"

This reverts commit 692e34c7f8.

* apply tesla brake PR

* honda clear startup fault

* Revert "honda clear startup fault"

This reverts commit 91c4a5d3c8.

* skip unrelated edges

* fix exit

* fix down edge

* use hf pip package

* comment on fail

* fix

* comment

* no exit 1 in CI
2026-01-19 14:31:20 -08:00
Shane Smiskol
b899b2f84b Add issue templates (#3039)
* add some links

* bug template from op

* car-ify it

* more

* more

* more

* isn't

* woops
2026-01-16 00:03:55 -08:00
Adeeb Shihadeh
9fc469ae0f safety: always run tests with UBSAN (#3007) 2025-12-30 08:53:12 -08:00
Adeeb Shihadeh
7391f464de get mutation tests running on macOS (#2998)
* install mull on macOS

* runs

* run in ci

* more readable

* fail early

* who doesn't have curl

* fix that?

* uv sourcing

* unset that

* mit

* cleanup
2025-12-29 17:23:00 -08:00
Adeeb Shihadeh
df0f84b160 libsafety: fix building with mutation env (#3001)
* build_env

* default

* conditional

* need it there

* try that

* fix

* rm those
2025-12-29 17:14:04 -08:00
Adeeb Shihadeh
622f2b14b2 CI: use tags for cppcheck update (#2976) 2025-12-20 14:17:28 -08:00
Maxime Desroches
2e15594ead ci: longer timeout for forks (#2732)
slow
2025-09-03 16:40:22 -07:00
Shane Smiskol
e5b1987107 Increase timeout if cache not hit (#2678)
* no cache timeout

* hmm

* 90 fine
2025-08-18 17:36:51 -07:00
Adeeb Shihadeh
196e036112 Fix mutation test timing out for big changes (#2668) 2025-08-16 17:25:09 -07:00
Shane Smiskol
5616f1b547 Revert "CI: bump allowed time for test.sh"
This reverts commit 2d3b8d202a.
2025-08-06 14:13:13 -07:00
Jason Young
2d3b8d202a CI: bump allowed time for test.sh 2025-08-06 15:53:15 -04:00
Adeeb Shihadeh
886471046c test_models cleanup (#2619)
* check that

* revert
2025-08-04 10:11:22 -07:00
Adeeb Shihadeh
22b8df68fb CI: auto-update cppcheck (#2563)
* ci: add weekly cppcheck updater

* Update update-cppcheck.yml

* fix perms

* Update update-cppcheck.yml

* Update update-cppcheck.yml
2025-08-03 10:35:57 -07:00
Adeeb Shihadeh
76311e36f8 port over test_models from openpilot (#2578)
* start test models

* fix path

* env

* pytest

* less building

* msgq

* and opendbc
2025-07-28 17:00:56 -07:00
Shane Smiskol
76cd9c2e68 Revert "CI: move ubsan into test.sh matrix" (#2449)
Revert "CI: move ubsan into test.sh matrix (#2305)"

This reverts commit 90bad1f04c.
2025-07-09 16:00:02 -07:00
Adeeb Shihadeh
c1aa3f202b disbale re-draft job for now 2025-07-04 11:34:39 -07:00
Adeeb Shihadeh
06c013d48c forgot checkout 2025-07-04 11:22:21 -07:00
Adeeb Shihadeh
9fdbf2e283 CI: convert PRs to draft after review 2025-07-04 10:14:36 -07:00
Adeeb Shihadeh
a1a53e5ad1 Add PR template (#2344)
Create pull_request_template.md
2025-05-31 16:34:35 -07:00
Maxime Desroches
89c74c37cb ci: no timeout for forks (#2315)
t
2025-05-27 20:58:39 -07:00
Adeeb Shihadeh
90bad1f04c CI: move ubsan into test.sh matrix (#2305)
* CI: move ubsan into test.sh matrix

* try this
2025-05-25 13:22:10 -07:00
Adeeb Shihadeh
c2a8b02a34 move MISRA mutation tests into test.sh (#2304)
* move MISRA mutation tests into test.sh

* no sed

* lil cleanup

* this stuff is slow for the dumbest reasons

* sample
2025-05-25 13:15:11 -07:00
Shane Smiskol
7cfdb8fab9 Clean up CI caching (#2293)
* chat is this true?

* wtf is this

* try this

* replace

* use on missing jobs to speed up again

* rename

* we already installed in setup

* remove cd
2025-05-23 21:31:32 -07:00
Adeeb Shihadeh
58f4b86121 pre-commit -> lefthook (#2278)
* pre-commit -> lefthook

* fix cpplint

* cleanupg
2025-05-20 12:01:27 -07:00
Adeeb Shihadeh
de58e1910c move MISRA check into test.sh (#2276)
* move MISRA check into test.sh

* ignore those too
2025-05-20 11:12:14 -07:00
Adeeb Shihadeh
2996f960e7 run safety tests in test.sh (#2275)
* run safety tests in test.sh

* looks like this is just macos-latest now?

* namespace
2025-05-20 10:36:29 -07:00
Shane Smiskol
80c68c956d Fix cppcheck cache (#2264)
* fix

* no useless restore keys
2025-05-18 00:26:35 -07:00
Adeeb Shihadeh
35af9d9dde CI: cache pre-commit (#2241) 2025-05-14 14:27:41 -07:00
Trey Moen
06200ae89a fix(macos): macOS 15 and greater (#2180)
* remove mac handling

* test with 15, too

* Revert "remove mac handling"

This reverts commit 1f59c8dc8f1dff16f058b2cff2aa5cfbe5b0ba3a.

* use gcc on < macOS 15

* link to issue
2025-05-13 11:20:00 -07:00
Jason Wen
7621a8fd9c CI: Fix GIT_REF formatting in safety mutation workflow (#2070)
Replace string interpolation with format function for consistency and better readability. This ensures proper handling of default branch references in the workflow.
2025-04-01 11:47:24 -07:00
DevTekVE
8864b9b200 CI: Set GIT_REF as an environment variable for safety mutation tests (#1956)
* Set GIT_REF as an environment variable for mutation tests

This change moves the GIT_REF definition into the environment section, simplifying its use in the workflow steps. It ensures consistency and clarity by separating variable definition from execution commands.

* Update .github/workflows/tests.yml

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-03-30 14:51:23 -07:00
Maxime Desroches
a60db8a30a use Github Actions macOS runners (#2062)
switch
2025-03-28 21:18:08 -07:00
Mauricio Alvarez Leon
066277cc58 test_models_trigger.yaml: add checkout check to prevent opendbc bump fail (#1919)
add checkout check to prevent opendbc bump fail
2025-03-04 15:55:22 -08:00
Maxime Desroches
0dc30f0099 Revert "title for test_models trigger"
This reverts commit 6a19dcddb8.
2025-02-22 12:08:16 -08:00
Maxime Desroches
6a19dcddb8 title for test_models trigger 2025-02-22 12:05:56 -08:00
Maxime Desroches
b7b80e9f32 test_models trigger comment (#1799)
trigger
2025-02-22 12:00:16 -08:00