Daniel Koepping
f30f8cfa65
Fix car diff race condition ( #3344 )
2026-04-21 21:41:16 -07:00
Shane Smiskol
c011754081
Rivian: add GEN 2 B harness ( #3286 )
...
* add b
* update template
* no default
* capital
* we don't have a driving video?!
2026-04-03 16:05:54 -07:00
Jason Young
dc0e7d061b
fix test_models CI workflow ( #3244 )
...
fix test_models flow
2026-03-27 21:10:29 -04:00
Adeeb Shihadeh
ddeba888a3
try no scons ( #3194 )
...
* try no scons
* lil more
* lil more
* lazy
* fix ty
2026-03-11 11:23:38 -07:00
Adeeb Shihadeh
37207f61e9
Replace mull with custom mutation test runner ( #3130 )
...
simple mutation!
2026-03-10 21:23:32 -07:00
Jason Wen
cbcc9c5c65
CI for the people, but in opendbc ( #3163 )
2026-02-28 19:46:47 -08:00
Adeeb Shihadeh
a2c3ad09bd
use vendored cppcheck from dependencies repo ( #3154 )
2026-02-23 12:46:34 -08:00
Matt Purnell
b10b43105b
CI: update CI to reflect removal of docker ( #3149 )
...
CI: replace docker with native setup for test_models
openpilot replaced docker-based CI with native `op setup` in
commaai/openpilot#37282 , breaking the test_models job here.
2026-02-22 09:32:51 -08:00
Adeeb Shihadeh
7c78ee87b7
replace natsort with lil function ( #3105 )
...
* replace natsort with lil function
* sort
2026-02-02 08:07:10 -08:00
Daniel Koepping
b038e6e199
Car diff: skip comment on first timer PR ( #3067 )
...
skip comment if tests.yml never ran
2026-01-26 21:04:55 -08:00
Shane Smiskol
f64e0bfe8a
Add misc bug template ( #3057 )
...
* misc bug
* rm
2026-01-21 22:34:30 -08:00
Daniel Koepping
3b75bd8536
Car diff: fix PR comment ( #3045 )
...
fix PR comment
2026-01-21 04:05:53 -08:00
Adeeb Shihadeh
4ec3892bcd
pin python dependencies ( #3047 )
...
* check in uv.lock
* ty fixes
2026-01-20 09:30:31 -08:00
Adeeb Shihadeh
796ece26ac
libsafety: switch to clang 18 and only build mull in standalone mode ( #3044 )
...
* just switch to 18
* try this
* just clang
* rm that
* try this
2026-01-19 15:30:32 -08:00
Daniel Koepping
80f030ac5d
Car diff ( #3024 )
...
* Opendbc replay (#6 )
* add replay POC
* compare HEAD to master
* split in compare and worker
* copy worker.py
* cleanup
* fix
* apply tesla brake PR
* fix
* fix mutation test
* add panda
* add timestamps
* simplify
* add falling edge
* add remaining carstate
* simple lines
* bump
* rename
* use zst as ref
* ref commit
* cleanup
* formatting
* no failing
* fix git
* clean
* use pool.map
* fix docker build
* clean
* Revert "fix docker build"
This reverts commit da3577441eaa4b7fdc5763f73e779dd32c03a3c3.
* use flat paths
* format
* use azure test instance
* print full diff
* no stderr output
* use GIT_REF
* Revert "apply tesla brake PR"
This reverts commit f377e21f3865c574db5d618be20b4efa86fba66f.
* allow overwrite blobs
* supress stderr
* add error on failed generation (#8 )
* Opendbc replay (#129 )
* add replay POC
* compare HEAD to master
* split in compare and worker
* copy worker.py
* cleanup
* fix
* apply tesla brake PR
* fix
* fix mutation test
* add panda
* add timestamps
* simplify
* add falling edge
* add remaining carstate
* simple lines
* bump
* rename
* use zst as ref
* ref commit
* cleanup
* formatting
* no failing
* fix git
* clean
* use pool.map
* fix docker build
* clean
* Revert "fix docker build"
This reverts commit da3577441eaa4b7fdc5763f73e779dd32c03a3c3.
* use flat paths
* format
* use azure test instance
* print full diff
* no stderr output
* use GIT_REF
* Revert "apply tesla brake PR"
This reverts commit f377e21f3865c574db5d618be20b4efa86fba66f.
* allow overwrite blobs
* supress stderr
* print upload refs
* add error on failed generation
* Revert "use azure test instance"
This reverts commit ba969ccda452a4841934440d3ced22829861f70f.
* Revert "fix mutation test"
This reverts commit 8f5e01de7743ee38c340df90751cf370634fe2b2.
* detect safety changes
* use logReader
* only use valid platforms
* use local database
* Revert "use local database"
This reverts commit 4ebe9fe0800fb1631efe8672817a8c21b8780b65.
* Reapply "use azure test instance"
This reverts commit e9968a04e4ddee00b69174fd30ee1cdcdfa506fb.
* cutoff diff
* parallel downloads
* enable stderr
* fix interface
* logprint errors
* add comment to PR
* fix
* FORMAT: lines
* FORMAT: plots
* FORMAT: fix
* modules
* Revert "use azure test instance"
This reverts commit ba969ccda452a4841934440d3ced22829861f70f.
* build on forks
* clean
* rename
* replace azure with ci-artifacts
* auto bootstrap
* help
* FORK TEST
* Revert "FORMAT: fix"
This reverts commit 0262b1fad4 .
* Revert "FORMAT: plots"
This reverts commit 314417db1f .
* Revert "FORMAT: lines"
This reverts commit 5cdd4c567f .
* clean
* no comment on empty output
* output errors
* fix pr comment
* fix diff more
* increase tolerance
* less files
* one file
* Revert "FORK TEST"
This reverts commit fc691b500c .
* Revert "fix mutation test"
This reverts commit 8f5e01de7743ee38c340df90751cf370634fe2b2.
* fix comment
* fix comment
* move car_diff.py
* Revert "fix mutation test"
This reverts commit 8f5e01de7743ee38c340df90751cf370634fe2b2.
* move car_diff.py
* inline helpers
* inline helpers
* fix ruff
* fix ruff
* use all carstate fields
* add --all
* use all carstate fields
* add --all
* bootstrap
* bootstrap
* Revert "bootstrap"
This reverts commit c3c2ba41e8 .
* add line formatting
* commit workflow
* adjust formatting
* return err
* subprocess
* comma_car_segments
* dead code
* minimal logreader
* remove openpilot
* add deps
* remove all deps
* fix source
* request
* less parallel
* fix push
* bootstrap
* Revert "bootstrap"
This reverts commit b4af0d3bbd .
* fix graph
* push
* regex
* optimize dict_diff
* reduce tolerance
* use comma_car_segments
* remove
* use requests
* timestamps
* frame_ms
* id
* logreader
* align logreader
* use logreader
* remove requests
* return
* more line
* ruff
* use test pip package
* push on commaai
* use zstandard lib
* clean
* rename
* use decompress
* fix
* index
* lr filter
* union types
* find edges
* group frames
* render waveform
* format timing
* signals
* numeric diff
* boolean diff
* real timestamp
* impreza fingerprint
* Revert "impreza fingerprint"
This reverts commit 692e34c7f8 .
* apply tesla brake PR
* honda clear startup fault
* Revert "honda clear startup fault"
This reverts commit 91c4a5d3c8 .
* skip unrelated edges
* fix exit
* fix down edge
* use hf pip package
* comment on fail
* fix
* comment
* no exit 1 in CI
2026-01-19 14:31:20 -08:00
Shane Smiskol
b899b2f84b
Add issue templates ( #3039 )
...
* add some links
* bug template from op
* car-ify it
* more
* more
* more
* isn't
* woops
2026-01-16 00:03:55 -08:00
Adeeb Shihadeh
9fc469ae0f
safety: always run tests with UBSAN ( #3007 )
2025-12-30 08:53:12 -08:00
Adeeb Shihadeh
7391f464de
get mutation tests running on macOS ( #2998 )
...
* install mull on macOS
* runs
* run in ci
* more readable
* fail early
* who doesn't have curl
* fix that?
* uv sourcing
* unset that
* mit
* cleanup
2025-12-29 17:23:00 -08:00
Adeeb Shihadeh
df0f84b160
libsafety: fix building with mutation env ( #3001 )
...
* build_env
* default
* conditional
* need it there
* try that
* fix
* rm those
2025-12-29 17:14:04 -08:00
Adeeb Shihadeh
622f2b14b2
CI: use tags for cppcheck update ( #2976 )
2025-12-20 14:17:28 -08:00
Maxime Desroches
2e15594ead
ci: longer timeout for forks ( #2732 )
...
slow
2025-09-03 16:40:22 -07:00
Shane Smiskol
e5b1987107
Increase timeout if cache not hit ( #2678 )
...
* no cache timeout
* hmm
* 90 fine
2025-08-18 17:36:51 -07:00
Adeeb Shihadeh
196e036112
Fix mutation test timing out for big changes ( #2668 )
2025-08-16 17:25:09 -07:00
Shane Smiskol
5616f1b547
Revert "CI: bump allowed time for test.sh"
...
This reverts commit 2d3b8d202a .
2025-08-06 14:13:13 -07:00
Jason Young
2d3b8d202a
CI: bump allowed time for test.sh
2025-08-06 15:53:15 -04:00
Adeeb Shihadeh
886471046c
test_models cleanup ( #2619 )
...
* check that
* revert
2025-08-04 10:11:22 -07:00
Adeeb Shihadeh
22b8df68fb
CI: auto-update cppcheck ( #2563 )
...
* ci: add weekly cppcheck updater
* Update update-cppcheck.yml
* fix perms
* Update update-cppcheck.yml
* Update update-cppcheck.yml
2025-08-03 10:35:57 -07:00
Adeeb Shihadeh
76311e36f8
port over test_models from openpilot ( #2578 )
...
* start test models
* fix path
* env
* pytest
* less building
* msgq
* and opendbc
2025-07-28 17:00:56 -07:00
Shane Smiskol
76cd9c2e68
Revert "CI: move ubsan into test.sh matrix" ( #2449 )
...
Revert "CI: move ubsan into test.sh matrix (#2305 )"
This reverts commit 90bad1f04c .
2025-07-09 16:00:02 -07:00
Adeeb Shihadeh
c1aa3f202b
disbale re-draft job for now
2025-07-04 11:34:39 -07:00
Adeeb Shihadeh
06c013d48c
forgot checkout
2025-07-04 11:22:21 -07:00
Adeeb Shihadeh
9fdbf2e283
CI: convert PRs to draft after review
2025-07-04 10:14:36 -07:00
Adeeb Shihadeh
a1a53e5ad1
Add PR template ( #2344 )
...
Create pull_request_template.md
2025-05-31 16:34:35 -07:00
Maxime Desroches
89c74c37cb
ci: no timeout for forks ( #2315 )
...
t
2025-05-27 20:58:39 -07:00
Adeeb Shihadeh
90bad1f04c
CI: move ubsan into test.sh matrix ( #2305 )
...
* CI: move ubsan into test.sh matrix
* try this
2025-05-25 13:22:10 -07:00
Adeeb Shihadeh
c2a8b02a34
move MISRA mutation tests into test.sh ( #2304 )
...
* move MISRA mutation tests into test.sh
* no sed
* lil cleanup
* this stuff is slow for the dumbest reasons
* sample
2025-05-25 13:15:11 -07:00
Shane Smiskol
7cfdb8fab9
Clean up CI caching ( #2293 )
...
* chat is this true?
* wtf is this
* try this
* replace
* use on missing jobs to speed up again
* rename
* we already installed in setup
* remove cd
2025-05-23 21:31:32 -07:00
Adeeb Shihadeh
58f4b86121
pre-commit -> lefthook ( #2278 )
...
* pre-commit -> lefthook
* fix cpplint
* cleanupg
2025-05-20 12:01:27 -07:00
Adeeb Shihadeh
de58e1910c
move MISRA check into test.sh ( #2276 )
...
* move MISRA check into test.sh
* ignore those too
2025-05-20 11:12:14 -07:00
Adeeb Shihadeh
2996f960e7
run safety tests in test.sh ( #2275 )
...
* run safety tests in test.sh
* looks like this is just macos-latest now?
* namespace
2025-05-20 10:36:29 -07:00
Shane Smiskol
80c68c956d
Fix cppcheck cache ( #2264 )
...
* fix
* no useless restore keys
2025-05-18 00:26:35 -07:00
Adeeb Shihadeh
35af9d9dde
CI: cache pre-commit ( #2241 )
2025-05-14 14:27:41 -07:00
Trey Moen
06200ae89a
fix(macos): macOS 15 and greater ( #2180 )
...
* remove mac handling
* test with 15, too
* Revert "remove mac handling"
This reverts commit 1f59c8dc8f1dff16f058b2cff2aa5cfbe5b0ba3a.
* use gcc on < macOS 15
* link to issue
2025-05-13 11:20:00 -07:00
Jason Wen
7621a8fd9c
CI: Fix GIT_REF formatting in safety mutation workflow ( #2070 )
...
Replace string interpolation with format function for consistency and better readability. This ensures proper handling of default branch references in the workflow.
2025-04-01 11:47:24 -07:00
DevTekVE
8864b9b200
CI: Set GIT_REF as an environment variable for safety mutation tests ( #1956 )
...
* Set GIT_REF as an environment variable for mutation tests
This change moves the GIT_REF definition into the environment section, simplifying its use in the workflow steps. It ensures consistency and clarity by separating variable definition from execution commands.
* Update .github/workflows/tests.yml
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com >
2025-03-30 14:51:23 -07:00
Maxime Desroches
a60db8a30a
use Github Actions macOS runners ( #2062 )
...
switch
2025-03-28 21:18:08 -07:00
Mauricio Alvarez Leon
066277cc58
test_models_trigger.yaml: add checkout check to prevent opendbc bump fail (#1919 )
...
add checkout check to prevent opendbc bump fail
2025-03-04 15:55:22 -08:00
Maxime Desroches
0dc30f0099
Revert "title for test_models trigger"
...
This reverts commit 6a19dcddb8 .
2025-02-22 12:08:16 -08:00
Maxime Desroches
6a19dcddb8
title for test_models trigger
2025-02-22 12:05:56 -08:00
Maxime Desroches
b7b80e9f32
test_models trigger comment ( #1799 )
...
trigger
2025-02-22 12:00:16 -08:00