Commit Graph

53 Commits

Author SHA1 Message Date
Adeeb Shihadeh 9a3cb26a57 raise jenkins timeout
old-commit-hash: 6075683474be5b8851b2f24fda6b463d83dd09d3
2021-05-03 21:53:28 -07:00
robbederks 5cd4a9ba36 Zookeeper support (#20000)
* zookeeper lib

* add ft4222 to dev pip packages and fix include error

* started on CI

* it's a file

* now it should be happy

* use docker for all on-device tests

* test scripts

* does this work?

* access to devices

* too broad. only usb enough?

* permissions for zookeeper usb

* as env var maybe?

* this?

* try this for now

* all devices

* move to correct location for impoerts

* right paths

* not running in the right agent?

* ofc not

* fix broken merge

* add ft4222 package again

* add timeout

* power monitor

* cleanup

Co-authored-by: Batman <batman@openpilot-ci.internal>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 6a824d765137e5141115e1727bcd553bd17eaaef
2021-04-13 15:08:00 -07:00
Adeeb Shihadeh 4561ff3a34 fix master-ci typo
old-commit-hash: 4e06665f55eb0f0cf169c2d654ccf52e8f14df66
2021-04-11 20:29:46 -07:00
Adeeb Shihadeh 998ccacd70 more tici CI coverage (#20639)
* run onroad test in tici

* run in jenkins

* no /data/media

* doesn't exists there yet

* more updates

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 01dc011f9f47d86804f74a0538c6d9a7e63ae24b
2021-04-11 15:56:17 -07:00
Adeeb Shihadeh 6387e8da63 wait for all jenkins tests before pushing master-ci (#20462)
* test on devel build

* fix athena test

* onroad test

* more of a unit test

* use scons cache

* script

* wait for all tests before pushing

* undo that

* add to release files

* onroad

* copy test files
old-commit-hash: 1858c696f23a92083ff649f65da9965f08e8f683
2021-04-11 15:05:14 -07:00
ZwX1616 f9a37f647f Revert "jenkins device maintenance"
This reverts commit 5088b6c2573962559ff114a70a278da24c34a4f6.

old-commit-hash: dd8f9a7263a9eec1eb2f8ac8b114979a8fa92bf0
2021-03-31 16:48:10 -07:00
ZwX1616 32b224662a jenkins device maintenance
old-commit-hash: e8d0d480396e380259a1baa2b62357565cb05454
2021-03-30 18:41:32 -07:00
ZwX1616 40b1877c04 camerad jenkins box test (#20413)
* separate test

* send

* update test

* snapshot is rgb

* this does not belong here

* clean up

* tici

* no if

* no black frames

* flaky leds

* rename and cleanup

* should be stable and avoid lucky pass

* print

* logical and

* run in jenkins

* source profile on tici

Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 97133a8facf848d5fc709a0ab98ab2c26690ee19
2021-03-26 13:23:18 -07:00
Adeeb Shihadeh 51c13aa552 APK purge (#20446)
* purge begins

* release files

* remove those

* no more android

* only qt

* text and spinner

* neos update script

* update sounds

* update cpu usage

* all done

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: e76c80ffa1b6167fd69465c66f31fbe475762330
2021-03-24 14:30:41 -07:00
Adeeb Shihadeh 5f00564755 auotmatic jenkins setup (#20448)
* auotmatic jenkins setup

* fix quote

* ne wkey
old-commit-hash: 7aade3db43e1a651be0b8af76b214a691ec08884
2021-03-23 17:46:53 -07:00
Willem Melching c0098cec09 Manager cleanup (#20231)
* move manager in folder

* inital refactor

* call start

* small cleanup

* add comments

* use self.signal()

* order shouldnt matter

* newlines

* add helpers

* newlines

* add process config

* split out build part of manager

* this should fix most tests

* no sensord on pc

* dont start athena

* remove comment

* fix old athena test

* fix inject model

* fix test car models

* should be not none

* fix helpers exitcode

* ignore manage_athenad

* Use time.monotonic()

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* combine init, remove spinner

* move manager test

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 5a3b51130649356b14b24e3c82e014b3a0be95a8
2021-03-05 11:03:23 +01:00
Adeeb Shihadeh e2f847fc26 disable release3 build for now
old-commit-hash: c33a0d54ac5d0688fd0844fde633a2cfa7b2c927
2021-02-09 17:32:16 -08:00
Adeeb Shihadeh 8de51bbd65 fix failing CI jobs
old-commit-hash: 46c0e0e6f34e25cfdded9e19fdaa6abf30d8a7c2
2021-02-09 13:59:34 -08:00
Comma Device 1acdd80998 split the build and test running
old-commit-hash: 8f84f190629e5724b1eaff6c1e02b4972967ae1d
2021-02-01 20:35:37 -08:00
Adeeb Shihadeh 88566ec71c logcatd bugfix + tests (#19689)
* hack to exit cleanly

* move the hack

* add test

* run in ci

* unused

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 49d4d5820190836d32089c3e79a2e47a02e7ce36
2021-02-01 15:15:29 -08:00
Adeeb Shihadeh 162e363c02 build release3 (#19984)
* build release3

* copy agnos manifest

* build in jenkins

* nproc doesn't work

* no pandaextra

* revert that

* don't modify version from source

* build after tests

* restore the symlink

* only master

* remove apk

* revert that

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: a712a4bd9c2f3b403485fa8bf7a66e0ac48fa6e5
2021-01-31 18:49:34 -08:00
ZwX1616 099a5a21e2 camerad frame lag/drop jenkins tests (#19945)
* clean up test

* not needed for now

* this be enough

* comment this out

* clean up

* adjust tolerance

* use sof on tici

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 1a95127b0ef62fd744b2f9277b86d130020f5bde
2021-01-28 14:21:59 -08:00
Adeeb Shihadeh edd881fa16 more tici tests in jenkins (#19908)
* run loggerd tests on tici

* boardd loopback

* fix up seg length

* this doesn't add more coverage
old-commit-hash: 810ed30cab46baa737abcc8986ba7b2c69cad355
2021-01-24 17:54:03 -08:00
Adeeb Shihadeh 7a47f65f6c tici jenkins build (#19505)
* tici jenkins

* /usr/bin/bash

* source all

* fix model replay

* onroad tests
old-commit-hash: 8b1e51bbdd9bd8a0e7c6ee81cd0e60f8a0d48ecb
2021-01-23 18:34:18 -08:00
Adeeb Shihadeh 9e1f524965 On-device onroad CI test (#19792)
* start onroad test

* cpu usage test works

* nice print

* run in jenkins

* pretty reliable

* bump loggerd cpu usgae

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 5a9769020d7031e31a7b80bfea0245a0b0fa238d
2021-01-16 18:11:53 -08:00
Adeeb Shihadeh 386ca29c6a reenable cpu usage test
old-commit-hash: def24ae27ad4cd5948731770745d5039f20ffcf2
2021-01-15 14:22:25 -08:00
Adeeb Shihadeh 2b02e086f8 build master-ci with the relase2 build device
old-commit-hash: cc2490bb1286a7fb5fecd679349708efaaafeae3
2021-01-12 16:24:34 -08:00
Adeeb Shihadeh afa522964a use scons cache for QCOM replay build in CI
old-commit-hash: 10268b66692b96888f4a63c015def5cdf884a26d
2021-01-12 16:10:18 -08:00
Adeeb Shihadeh c70fe39172 disable again for now, replay hw is down
old-commit-hash: 24ce55c2c20e94dc9be529d84cc8107101b42432
2021-01-10 21:58:09 -08:00
Adeeb Shihadeh 8a621c739d reenable cpu usage test
old-commit-hash: fa2d2a7162338229522c421242c5adbae4f7d957
2021-01-08 16:32:58 -08:00
Willem Melching 3f950832b9 VisionIPC 2.0 (#19641)
* Squashed vipc

* Update release files

* Remove else

* add visionipc to release files

* use poller in vipc receive

* opencl framework instead of lib on macos

* Fix camera webcam

* Fix opencl on mac in ui

* more webcam fixes

* typo in ui sconsfile

* Use cur_yuv_buf

* visionbuf c++ class

* Camera qcom was still using visionbuf_allocate

* Turn loggerd back on

* fix snapshot

* No build needed

* update test camerad

* no more release callback

* make encoder c++

* Revert "no more release callback"

This reverts commit e5707b07002fee665d0483d90713154efc2d70d4.

* fix exit handlers

* No need to check errno

* move release callback call

* s/VIPCBufExtra/VisionIpcBufExtra/g

* use non blocking connect

* ui use non blocking connect

* Lower condition variable wait time

* Snapshot cleanup

* bump cereal

* bump cereal
old-commit-hash: fb496c692a9ebdcda15069a8d4eb95734b587d68
2021-01-08 14:54:25 +01:00
Adeeb Shihadeh 0d895ad82a loggerd tests (#19671)
old-commit-hash: af81190cfcf96201f59b0461cc3fdd80cf8651a3
2021-01-06 19:18:35 -08:00
Adeeb Shihadeh 1362886a60 disable cpu usage test until CAN replay hw is fixed
old-commit-hash: a01a2ecc2411751a21cbf426f8256d09de9ae7f5
2020-12-31 15:01:38 -08:00
Adeeb Shihadeh 5bbe4f3d52 manager tests + make all processes exit cleanly (#19595)
* manager tests

* logcatd exits cleanly

* sigint

* boardd

* multiple dbus connections hangs for some reason

* clocksd proclogd

* network type from thermal

* fix tests

* fix android logcatd

* fix mac

* fix mac proclogd

* move on device athena tests

* build first

* build first

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: ffa7e0cbdb0859751685caae1321d3ccf732fed9
2020-12-29 22:32:03 -08:00
Adeeb Shihadeh c4bff3f93b manager cleanup (#2634)
* start cleanup

* add uninstall to hw abstraction layer

* cleanup

* litte more

* don't build at import time

* fix tests

* don't build by default

* sync
old-commit-hash: 220853730d1d3163f5534ed5fd31ec5c30ad129f
2020-12-17 11:45:41 -08:00
Willem Melching 6e6410cd65 Jenkins: 1 hour pipeline timeout
old-commit-hash: 9e919fb5e0e9f14bc515bd686a4d5ca2cb810749
2020-10-15 19:16:28 +02:00
ZwX1616 a54d95fdbb Test camerad in CI (#2297)
* remove unused junk

* check frame pkts

* from magic

* self

* cleanup

* add todo

* no opencv

* run in J

* fix conv

* make 250x faster

* abs

* should be +1

* depends on starting phase

* block on furniture refactor

* fixed

* restart test

* check ex

* need scaling
old-commit-hash: cb58e79ee83c15662a1191a39aeb75f276c7c591
2020-10-09 16:31:25 -07:00
Adeeb Shihadeh 27b7daec32 don't run jenkins on testing closet branches
old-commit-hash: 4422d0c8a829f315848a9c17168f6a471324ef22
2020-10-07 15:51:59 -07:00
Adeeb Shihadeh 0184a43999 run loggerd tests in CI (#2241)
* run loggerd tests in jenkins

* fast

* check segs on the fly

* missing import

* wait for dir

* no thread

* relax FILE_SIZE_TOLERANCE

* cleanup

* unused

* set ci flag

* wait longer for first seg

* fix race condition with setting RecordFront

Co-authored-by: ZwX1616 <zwx1616@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 427d4a5a9eaf3a593db43ee78315dd38664dbb47
2020-10-01 18:42:43 -07:00
Adeeb Shihadeh 25400f9456 jenkins: clean workspace (#2248)
old-commit-hash: 846b56831f2cddb5c3bd471920b2bd6a98bfede0
2020-09-29 22:14:54 -07:00
Adeeb Shihadeh 993b6b43ac split dockerfile into base image and CI image (#2066)
* split dockerfile into base image and CI

* doesn't exist yet

* fix path

* cache on this branch

* latest

* use cache

* don't double pull
old-commit-hash: a3f56430195d5b2d0119f8bbf929f07c9a625959
2020-08-23 18:18:19 -07:00
Adeeb Shihadeh 32be24d601 add missing agent for jenkins job
old-commit-hash: 100f2958fc08f58e6b175336b91c66850107051a
2020-08-12 12:47:32 -07:00
Adeeb Shihadeh c2b1d97b20 NEOS background updater (#1892)
old-commit-hash: cb5a2996e75658ac61f057fb729c229a554c551e
2020-08-12 11:39:21 -07:00
Adeeb Shihadeh 072f8bd84d Test standalone binary builds in CI (#2008)
* test updater, spinner, and text window build in CI

* we dont ship the libs for updater in release branches
old-commit-hash: 1f4714ba9807e3b641154d06479c6ee76b684242
2020-08-10 21:52:26 -07:00
Adeeb Shihadeh 37f8ca00aa Improve CPU usage test reliability (#2002)
* run phone tests in parallel

* better cpu test

* re-enable test

* no root

* terms version

* not one

* yes

* debug

* that's coverd by min cpu percent
old-commit-hash: ecf0a8c8d49dddb18767d929d381f5bbf946c5d8
2020-08-08 20:59:32 -07:00
Adeeb Shihadeh ff65bef323 Setup PC testing in Jenkins (#1984)
* build openpilot docker container in jenkins

* use cache

* run all stages in parallel

* move device tests

* wrap in stages

* it's docker

* doesn't work, but jenkins should cache the image

* steps

* disable phone tests for now

* we're root

* enable everything

* clean up our mess

* skip checkout

* need a plugin for that

* remove that

* parallel

* Revert "parallel"

This reverts commit e3e5af9dc9db692d1b5552012d62393a5b8520dd.

* this is ugly

* Revert "this is ugly"

This reverts commit e83995935294584e264a8fcb3d08bcf7d9305434.
old-commit-hash: 90d5383354365f58415cc5e99e92c4010394832c
2020-08-05 20:21:04 -07:00
Adeeb Shihadeh 011c336047 Improve on-device CI reliability (#1922)
old-commit-hash: 90fc1c602814b87c1a09fca02e3846a332bc5e03
2020-07-25 02:12:19 -07:00
Adeeb Shihadeh bda90d828e increase Jenkins timeout, clean builds take a long time
old-commit-hash: 63ab7930de371f3216adf75292f55e61a457e35a
2020-07-09 10:43:19 -07:00
Adeeb Shihadeh b38c33cc47 Boardd loopback test (#1840)
* start boardd loopback test

* let's try this in CI

* fix jenkinsfile

* remove old

* rename

* check msgs

* should be reliable now

* send more
old-commit-hash: 3ab0b4965663bfae88885c503da0c7de2af37f74
2020-07-08 19:42:03 -07:00
Adeeb Shihadeh 617c6fa84c use special 'eon-build' device for release build
old-commit-hash: 65d800c4f5844b8167a0ae5421ece265dcc20863
2020-07-07 16:41:04 -07:00
Adeeb Shihadeh 44afc4ae3c Build release2 and dashcam in CI (#1834)
* start building release2 in CI

* build script

* bring over changes from test branch

* fix build release test

* remove references to test branches

* ucnomment push

* fix duplicate remove

* two commits for dashcam

* need the key
old-commit-hash: c7156616568ce2fa780db3eafc5f912ab2ead14e
2020-07-07 14:17:09 -07:00
Adeeb Shihadeh 0d79150606 Sound test (#1820)
* WIP sound test

* it does something

* refactor

* phone only

* update release files

* test sound card init

* add to CI

* check writes

* increase time

* unused

* only build cereal

* small tolerance

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: f1afb3e3ae4b95a1de0262d1408c49093c5ada6f
2020-07-05 17:56:24 -07:00
Adeeb Shihadeh de457fddc2 On-device CI framework (#1784)
* let's see if this works

* fix build_release actions job

* does jenkins like this config

* separate jenkinsfile for release build

* fix devel build

* devel build should work

* always pass that for now

* run modeld replay

* release2 build will be a separate PR

* pass env to phone shell

* force checkout

* run on real jenkins eons

* add timeout

* rsync

* more timeout

* trailing slash

* fix branch detection

* debug

* not sure why paramiko doesn't pass it through

* newline

* CI_PUSH

* still not passing it

* test branch

* should be good now
old-commit-hash: 32f03ec8a52c7c5fa56d5cce19fbbd7ecf24b7dd
2020-07-03 19:12:05 -07:00
Willem Melching ce6dd8d4e9 Model + camerad test (#1622)
* kind of works

* move that

* hack to get camerad to reliably terminate

* not sure why SIGTERM wasn't working before

* compare bytes

* clean up some hacks

* gitignore

* fix that

* WIP

* no reboot

* comparison works

* pretty print

* fix build

* run in jenkins

* python path

* space

* raise timeout

* new eon

* skip the copy

* spinner

* spin less

* update model ref commit

* reenable that

* clean up

* fix jenkinsfile

* parallel

* wrap it in a stage

* fix linter

* better progress

* lower timeout

Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 63c8e8439b6d19020055f922340d8e33d906363a
2020-06-04 18:57:25 -07:00
Willem Melching b80ad41680 Re enable athenad test (#1058)
* Renable athena test

* debug

* Revert "debug"

This reverts commit 30f68055f8ea047ba4e2989d63a5020e0468487f.

* Specify correct pythonpath for tests

Co-authored-by: Andy <andyh2@me.com>

old-commit-hash: 960b42c523819238e20ce343306872cc0cb03465
2020-02-11 19:26:34 -08:00