Commit Graph

195 Commits

Author SHA1 Message Date
Adeeb Shihadeh 5733c516c3 move pigeond to system/ubloxd/ (#31848)
* move pigeond to system/ubloxd/

* update release

* more

* mv test
old-commit-hash: 147ccc7a582518e565755262e36799b540b5ddf7
2024-03-12 17:13:13 -07:00
Justin Newberry f318325a25 jenkins: reduce connection timeouts (#31431)
reduce jenkins timeouts
old-commit-hash: cccf28b9cabb5b38e4243bd50ddd2c22ae023ca6
2024-02-13 11:02:21 -08:00
Justin Newberry 71ad682759 jenkins: kill subprocesses on exit (#31422)
* kill-on-exit

* kill all
old-commit-hash: 7010aae0a905457cb026b20a19e049104f4b45f7
2024-02-12 15:41:04 -08:00
Justin Newberry f8cf60f292 jenkins: no changeset (#31374)
no changeset

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: e3028cbdcabb7bd7ee70d00db2ab27698760504e
2024-02-08 09:59:47 -08:00
Justin Newberry 4ad5ba1864 jenkins: remove pc / car tests (#31353)
* move to scripts

* clean first

* cant have test_*?

* move
old-commit-hash: 8f67d3cab9bb7031f3350b0c320606aa843503d5
2024-02-07 11:33:52 -08:00
Justin Newberry 378c5cb50b Pytest: reenable gc in pytest fixture + re-combine jenkins car tests (#31351)
* Revert "jenkins: spilt car tests in two steps (#31346)"

This reverts commit 03bf426f569151598070a073f658a323eb03b9db.

* enable gc

* codespell

* useless comment
old-commit-hash: 6933d0560aa37e9cdace3a9b8adda85bd774ec6f
2024-02-07 08:35:32 -08:00
Justin Newberry cdcdfa2cf8 jenkins: spilt car tests in two steps (#31346)
fix
old-commit-hash: 8a00b30029c80ca71a0596134d1d91db8f5b24f0
2024-02-07 00:04:27 -08:00
Justin Newberry 558b925b86 jenkins: limit cpu and memory (#31329)
* limit that

* we can use 32g

* addopts

* half
old-commit-hash: 03c183cb052ff1d9da5c7a927f0abbb37434fe2a
2024-02-06 13:51:55 -08:00
Justin Newberry dd7899d409 jenkins: lock device resource first before making container (#31330)
lock first
old-commit-hash: 052519570dea002a9c9a5e4b0c7cfc6d3c180e38
2024-02-06 13:35:08 -08:00
Justin Newberry 93c6540eba jenkins: cleanup stage names for analysis (#31327)
fix names
old-commit-hash: 88b635c4e10d5a3781bdff3cc34856566598da8e
2024-02-06 12:50:44 -08:00
Justin Newberry fd799bc05a Pytest: consistent hardware state for tici tests (#31279)
* consistent hardware

* consistent hardware

* moved

* this too

* ruff

* s

* duplicated

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 0277fc5548bc87a17ae34b914df0593d034e5e94
2024-02-02 14:18:01 -08:00
Justin Newberry 15600bced8 Jenkins: select devices randomly (#31274)
radnomly select devices
old-commit-hash: 08d9681cf604832d495274a5d8317d9240537053
2024-02-01 17:24:28 -08:00
Justin Newberry c999573836 Jenkins: better timeout when disconnected from devices (#31256)
* timeout better

* timeoutes
old-commit-hash: be33b0049982ade3cc639998c8142b373693c929
2024-01-31 18:46:40 -08:00
Adeeb Shihadeh 14898a7845 jenkins: cleanup /dev/shm (#31095)
old-commit-hash: 332a21965da4060d411fb65286cddc61b555ae48
2024-01-20 15:24:34 -08:00
Adeeb Shihadeh 972650f0eb remove dashcam branch (#31081)
* remove dashcam branch

* fix

* more cleanup

* remove param

* one more
old-commit-hash: 7cd9568423a2e78187d16018b70a78f56c02027d
2024-01-19 14:05:03 -08:00
Adeeb Shihadeh e3cb318151 cleanup startup params (#31068)
old-commit-hash: b4ebba384b0d5e884f99a56caa8de92675cbd60f
2024-01-18 22:09:55 -08:00
Justin Newberry 2b9b880ab0 jenkins: lock "pc" label to limit concurrent workers (#30902)
* lock pc label

* remove that
old-commit-hash: 4430944b2966d0bcdf54357dfdfafacf24e6de32
2024-01-03 16:55:16 -08:00
Mitchell Goff c24bdc1503 new delhi model (#30822)
* 027a1efa-10fb-4291-ad58-90cf0ff150b5/700

* debug

* rm for now

* bump refs

* revert that

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 7e71fd7baefef14d2987b28377e310df41251644
2024-01-02 13:27:15 -08:00
Shane Smiskol f65ccca8e0 test_models: fuzz test panda and CarState (#30443)
* pre-hypothesis

* some hypothesis junk

* this kinda works but is really slow due to counter check

* choose addrs from fingerprint

* stash

* honda nidec brake pressed mismatches fixed

* bump panda

* stash

* tesla: use DI_torque2 (panda msg)

* run

* run

* ah this honda mismatch too

* no more multi can msgs

* clean up, remove old file

* add todo

* prob can remove urandom

* stash, huge examples

* fix pq standstill mismatch

* yuge

* yup there's a leak somewhere

* try to find leak

* skip dashcam (pq and tesla)

* PR comments

* bump

* draft stash

* fix alt brake hondas

* bump

* bump

* bump

* some clean up

* minor clean up

* more clean up

* stash

* fix honda bug

* more

* 100 examples

* revert tesla

* no memory leak any more?

* bring back tests with skips

* parameterize max_examples

* skip interceptor

* is jenkins on my branch?

* ooh that's fast

* 50 is not bad for GH CI

* 300 might be better with rest of test_models

* no more detection

* bump

* need CS_prev to catch bugs where openpilot changes and panda doesn't (eg. not setting interceptor safety mode)

* need to simplify all this

* need a warm up first, since some signals are 1 by default (toyota's gas_released!=1)

* changes

* set honda safety param

* set toyota safety param

* bump panda

* clean up honda

* rm interceptor

* thought interleaving addrs might help, but we can fine tune later

* Revert "thought interleaving addrs might help, but we can fine tune later"

This reverts commit 153301384b48c9f33f9e2af3c224241eaeec41c1.

* get size from dict

* what

* add nocapture marker

* clean up

* try to raise logging level

* need to run last as pytest_runtest_call, since it starts capturing

* get capman conditionally

* mark

* type fingerprint

* should use gen_empty_fingerprint

* no longer needed

* draft

* no longer need gc

* clean that up

* test everything!

* more clean up

* more

* no point

* fix that

* fix errors

* bump

* nice even 300 examples for 300 segs

* final bump :fingers_crossed:

* better import order

* remove debugging prints

* warm up kinda works

* Revert "warm up kinda works"

This reverts commit 7fc77b07d592edb13eadca77deb49540954a7d69.

* random seed

* revert

* strat

strat

* add expl comment

* cmt

* check controls allowed

* Revert "check controls allowed"

This reverts commit e82a0e5396810dd4670e6847aa555194a709e10f.

* not unittests

* run tests!

* run tests 2!

* run tests 3!

* seed unused

* revert

* add shrink phase, and remove health check suppression

* hello

* oncemore

* Update selfdrive/car/tests/test_models.py
old-commit-hash: 5052b55c440f3a778f9db9c854fa385077dd7ab9
2023-12-19 03:18:54 -06:00
Adeeb Shihadeh 6f13688747 jenkins: only do replay when relevant files change
old-commit-hash: 7aeefaad65b1d31789031a904a0a5e66180537af
2023-12-16 23:35:43 -08:00
Adeeb Shihadeh 030614e180 full clean for onroad device
old-commit-hash: 6f143f6c45b04702de24371db2d836210be9b860
2023-12-14 23:00:07 -08:00
Adeeb Shihadeh 129c2b9f16 also run qcomgpsd on path update
old-commit-hash: 0830f62b36fd4e802ea6f1a74062ae9e8bd7ecd1
2023-12-14 20:44:14 -08:00
Adeeb Shihadeh 71d4a05d86 jenkins: only run pandad tests when paths change (#30741)
* jenkins: only run pandad when paths changed

* fix

* ugh shadow
old-commit-hash: 2cad6dfa58f58af09ff70c70ad557fdf761b9293
2023-12-14 20:41:11 -08:00
Adeeb Shihadeh 2a08d484a1 jenkins: run test_onroad in the normal env (#30740)
old-commit-hash: 303f1cf9cf2f0c933fca103f104b382523db6cf2
2023-12-14 19:59:16 -08:00
Justin Newberry 0939b25bc4 CI: move test_maprenderer to GH actions (#30610)
maprenderer to ci
old-commit-hash: 5d668701cb69c1e3d170109a8e788a2acbacebd3
2023-12-14 16:59:28 -08:00
Justin Newberry a20c934d2f jenkins: retry docker_build (#30629)
* retry docker build

* retry docker build

* retry docker build

* does this work nicely?

* docker fail!

* Revert "docker fail!"

This reverts commit ab227a1ea37fad3d6413081e4516211b474b0712.
old-commit-hash: 02373fcb05e3c5fcb3fe2596024bca02fa7f8ab8
2023-12-12 18:12:19 -08:00
Justin Newberry 758426375d jenkins: retry pc setup (#30659)
* retry pc setup

* sleep and retry

* exception

* throw e

* remove force exit

* make a function for it

* remove force exit

* move to top

* separate exception
old-commit-hash: 93cd19e3a553d34d2f8bcd1aea121d09a7b2196b
2023-12-12 17:54:17 -08:00
Justin Newberry 60d5e98920 jenkins: remove old root user permission fixes (#30684)
* Batman

* add debug stuff

* Revert that for now

* remove debug stuff
old-commit-hash: c066fdd7a32b2d5b419419ac3f19ab4e8ba34280
2023-12-12 17:48:03 -08:00
Shane Smiskol 930ff9a0c1 jenkins: run all car tests with one command (#30661)
* run all jenkins car tests in one script, less down time?

* fix

* speed up

* u
old-commit-hash: e78b80c8fe4f1cf6e6350c9f613ba8c9a43e9d57
2023-12-08 22:15:27 -08:00
Justin Newberry 12da944f1c jenkins: retry build_devel (#30628)
* will it work

* retry build devel

* correct p[ath

* try a failure

* Revert "try a failure"

This reverts commit ba4e6a0a2096b94887fcfbf7d011e34aa2a16c41.
old-commit-hash: 36bebb1aa064b4b40580aa48d35b21bd9ebe14c2
2023-12-06 17:22:32 -08:00
Justin Newberry 62d0647ab3 pytest: group test_models by route instead of car name (#30625)
* group by route

* dont need those
old-commit-hash: f16df8e4b7901f5e38b6f90a8900eef02faab504
2023-12-06 16:00:59 -08:00
Justin Newberry a8c97eec3f jenkins: disable xdist on tici (#30624)
to preserve it
old-commit-hash: 3777bf7fb9b6d63f49118d010ac13cee89d13d06
2023-12-06 15:51:29 -08:00
Justin Newberry f945b8ebaa jenkins: remove pytest tici conf (#30621)
* remove pytest conf

* remove that too
old-commit-hash: 31ab43ce41d6d0f88cb8a9b6df8e79f23b6309fe
2023-12-06 11:13:22 -08:00
Justin Newberry 31eede7722 jenkins auto cpu count (#30544)
* auto cpu

* build too

* need bash
old-commit-hash: 5030824572c90862dbe0acca2b095b3899311e39
2023-11-28 14:34:00 -08:00
Adeeb Shihadeh ca85e5b82a rename rawgpsd to qcomgpsd (#30493)
* rename rawgpsd to qcomgpsd

* fix more paths

* that moved

* forgot the d
old-commit-hash: 4cae08e6369c0f63229222c0b3815da983928787
2023-11-18 23:23:16 -08:00
Justin Newberry efaa3ea500 Pytest: default settings on PC improvements (#30441)
* always multithreaded

* multithreaded

* pkill correct process

* escape more

* load for interfaces
old-commit-hash: 2ad82cbfb064676401876a20e49e3965c40344a0
2023-11-13 10:45:24 -08:00
Adeeb Shihadeh 8d3a5970d4 jenkins: use build.py to manage cache size (#30440)
* jenkins: use build.py to manage cache size

* label

* set pp

* double

* cleanup

* non mimimal build on PC

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
old-commit-hash: 5f7143df02b857201e2615240ccd1be06daa32fe
2023-11-10 16:55:25 -08:00
Adeeb Shihadeh 554528351b jenkins: retry on failed git checkouts (#30345)
* jenkins: retry on failed git checkouts

* test

* Revert "test"

This reverts commit ea57ba025630eb3105a9ccdce3bdc17f72678c72.
old-commit-hash: 57c8304c2562e807d5b95d0edd78636de215e526
2023-10-30 09:58:57 -07:00
Adeeb Shihadeh 87f77825db test_onroad: log sizes check (#30265)
* test_onroad: check log sizes

* fix

* check logs

* rb

* len

* pytest

* mb

* corolla log is small

* adjust qlog
old-commit-hash: 13d780a5f2b049731df2cbf617cc6dfdd648e622
2023-10-18 19:44:46 -07:00
Adeeb Shihadeh bf4b441687 jenkins: clear commacache dir (#30290)
old-commit-hash: 71a9b2c24c4a23a7b6d0ed3911076be373436bda
2023-10-18 19:37:29 -07:00
Justin Newberry 845cb6b670 CI: run jenkins as batman (#30184)
* I'm batman

* chown batman

* sudo

* add batman to sudo group

* try without cleanup

* Revert "try without cleanup"

This reverts commit f59554f2f373417f2c59fd250463eca2fda4d49e.

* comment
old-commit-hash: 8b2b72499fb49fa2c01c806b54e2bfe6a2c28844
2023-10-06 11:12:41 -07:00
Adeeb Shihadeh 52752a3131 jenkins speedup (#29869)
* jenkins speedup

* cleanup
old-commit-hash: d0361485504fe5af47a9e8ffaf0b64cfcdf03ac9
2023-09-10 16:47:07 -07:00
Adeeb Shihadeh 58bb1afb9a jenkins scripted pipeline (#29865)
* scripted

* exclude branches

* try that

* fix credentials

* fix

* tag with commit
old-commit-hash: a411af4f02ab778b78a98bfc424769e0c6a5974a
2023-09-09 21:30:21 -07:00
Adeeb Shihadeh 15e071f88c fixup power draw test output (#29844)
* fixup power draw test

* no pytest
old-commit-hash: 947abbcba0f685ae89d6d6a1b05f3f55f9739848
2023-09-08 13:01:04 -07:00
Shane Smiskol ce1c61d59a car interfaces: long running fuzzy test (#29592)
* draft

* draft 2

* increase deadline and run

* imports

* run -> use
old-commit-hash: 821cfff56d00b61fc3b4fba12bf0830cdb21ed27
2023-08-24 10:45:50 -07:00
Shane Smiskol 11466f786b internal test_models: run on more segments (#29443)
100 more
old-commit-hash: ac3f87bad519df408a295d2e007e0de58b11690c
2023-08-17 00:25:14 -07:00
Shane Smiskol 6be9e66073 jenkins: re-enable test_models (#29394)
* re-enable test_models

* now?

* Remove bad Volt segment

* Update Jenkinsfile

* use first n segments
old-commit-hash: fb235238addb73e04f59fca941040e3785be103e
2023-08-14 16:08:34 -07:00
Adeeb Shihadeh 1e72e9b094 jenkins: remove test that's now run in Actions
old-commit-hash: de66ba01874c630bebd2468237f4eda35171f4d2
2023-08-13 21:21:54 -07:00
Adeeb Shihadeh 1ca3343d0c add small ui for jenkins runners (#29382)
old-commit-hash: 09ffce80737ec54ada27be5643e223ba1db12bd1
2023-08-13 18:01:51 -07:00
Adeeb Shihadeh e76af64065 CI: enable PYTHONWARNINGS=error (#29364)
* CI: enable PYTHONWARNINGS=error

* fixes

* more ignore

* more modeld ignore
old-commit-hash: b11b14aff86a4c993bf5342ee37af169788c9026
2023-08-12 17:15:16 -07:00