Commit Graph

115 Commits

Author SHA1 Message Date
Justin Newberry 934225a448 replace pytest-timeouts with pytest-timeout (#31053)
* one timeout

* timeout

* higher timeout for now

* bump
old-commit-hash: d98b33adc8aaf10d0174d59e4065802c70a3413a
2024-01-18 16:19:49 -08:00
YassineYousfi 2742a6d3f4 update onnxruntime to 1.16.3 (#31024)
old-commit-hash: 86ac700805ef1ca913cfc859b6bfb1c528d83605
2024-01-16 20:22:05 -08:00
Adeeb Shihadeh 8277f37c4b camerad: move ae test to pytest/catch2 (#30994)
* mv ae gray test

* cleanup
old-commit-hash: 3e601b5e8fcaf2fd0885cc64949fa1349a8069eb
2024-01-13 15:40:25 -08:00
Adeeb Shihadeh c0cd180e01 unpin metadrive package (#30944)
* unpin metadrive package

* lock
old-commit-hash: 90010754d6da2fa62c1b19d660510fc53af8c7da
2024-01-08 17:16:15 -08:00
Justin Newberry ceec7907cc Pytest: exclude teleoprtc (#30829)
exclude
old-commit-hash: cfc85f016b401017ce6003a9a36760418945f0b2
2023-12-20 15:22:48 -08:00
Adeeb Shihadeh 9ae1b6473c run test_fuzzy.py with pytest
old-commit-hash: b0b4ae9c15e5e4651a83bc9a0a857baf27513d4b
2023-12-18 14:38:57 -08:00
Adeeb Shihadeh fbb4a865c0 packages cleanup, part two
old-commit-hash: 846be323d52ea07c7b303759beb3c4c45f526c45
2023-12-17 16:37:33 -08:00
royjr d41f215df8 dependency: remove pycurl package (#30771)
* Update qcomgpsd.py

* Update url_file.py

* remove pycurl

* requests -> urllib3

* unused

* redundant

* fix import

* Revert "requests -> urllib3"

This reverts commit 7ca39e618917986f50356519d2795a432e3a5280.

* headless

* fix trail

* use requests.exceptions.RequestException

* use fp.tell

* fix indents

* reorder imports

* change timeout

* fix debug timing

* remove exception

* add timeout

* missing headers

* move to constructor

* move import

* unused import

* fix debug

* try

* no retries
old-commit-hash: 70624ffc819c29d842cb68fd86f42eac95421b10
2023-12-17 16:25:25 -08:00
royjr 6161996653 dependency: remove atomicwrites package (#30769)
* Update file_helpers.py

* remove dependency

* Revert "remove dependency"

This reverts commit e2bd5f4edab7d14b75f65c296631855d886e38d1.

* remove atomicwrites

* allow overwrite

* fix indents

* add type hints

* Update poetry.lock

* optional

* wrap
old-commit-hash: 7f9e41ce2e9da4c712eba469a0f4407afbe3583f
2023-12-16 21:58:19 -08:00
Adeeb Shihadeh ab31860658 remove PyYAML package (#30770)
* remove PyYAML package

* remove those

* add comments back

* fix lock

* fix those
old-commit-hash: bc54ed794b2cd9dcb9522cdeb241ad78ac30d998
2023-12-16 20:48:57 -08:00
Adeeb Shihadeh 33c46434b9 remove sconscontrib package (#30767)
* remove sconscontrib package

* lock
old-commit-hash: a7828eba3ce73b523dc1bbd2c897c760329e7f7a
2023-12-16 19:16:34 -08:00
Adeeb Shihadeh 46e4e96440 cleanup python dependencies (#30764)
* less

* try to remove that

* little more

* update

* ugh still need this
old-commit-hash: dfa2e9146f1997f3879e4a2bb4be00c4e6068228
2023-12-16 18:52:15 -08:00
Justin Newberry 0939b25bc4 CI: move test_maprenderer to GH actions (#30610)
maprenderer to ci
old-commit-hash: 5d668701cb69c1e3d170109a8e788a2acbacebd3
2023-12-14 16:59:28 -08:00
Justin Newberry 9ef90e214d Simulator: remove carla (#30690)
* no carla

* no arg and stylize metadrive
old-commit-hash: 11ec5bf25e82e53bbefa88643c81ab5b7581e913
2023-12-11 20:38:37 -08:00
Shane Smiskol e46c20ac61 test_models: randomize internal segment list (#30653)
* randomize internal seg list segments

* random

* pytest-randomly sets random.seed to a consistent value for all the workers/processes

* noeol

* update

* Revert "update"

This reverts commit aff9a69c4e5e3934deebaa33986b42f44b55b002.

* lock

* don't randomize by default

* remove random-order

* strict

* random

* one fix

* test

* does nothing

* rm tests

* Revert "rm tests"

This reverts commit b548e3fcd48e60538695506888d863c01b459d27.

* (can't repro locally) just athena should be fine

* bs1

* bs2

* bs3

* bs4

* bs5

* wrong way

* no controls

* no car

* no board

* controls?

* crazy -common

* Revert "crazy -common"

This reverts commit 02365d712b3d09cab1893cce2261a4b418bb3851.

* test athena

* test athena 2

* test athena 3

* test athena 4

* test athena 5

* test athena 6

* test athena 7

* test athena 8

* test athena 9

* ??

* in one commit

* common?

* car and board

* -controls -board

* random-order

* no board

* revert

* car/tests

* least likely

* try

* try 2

* draft

* draft

* so much better

* cmt

* use randomly

* not needed here

* directly modify option works

* bb

* test time

* Revert "test time"

This reverts commit 2c5caabe2b470b47b7322e37800680b92773fccc.

* tmut

* i concur

* revert
old-commit-hash: ac83318ac4f54c46deef02c69d46c549bd741cb3
2023-12-09 14:28:32 -08:00
Shane Smiskol f5d1c4f371 ruff: check newline (#30668)
* check newline

* nothing catches this
old-commit-hash: 97da129e11e58b07d5d136093827cd1c62311fea
2023-12-09 13:24:18 -08:00
Justin Newberry 0159b6394b ruff: ignore teleoprtc repo (#30627)
ignore it
old-commit-hash: 9dc8ecf722733d645e0a1492c7aff1e73908ab54
2023-12-06 15:33:17 -08:00
Kacper Rączy d062a97a26 webrtcd: webrtc streaming server (audio/video/cereal) (#30186)
* WebRTCClient and WebRTCServer abstractions

* webrtc client implementation

* Interactive test scripts

* Send localDescriptions as offer/asnwer, as they are different

* Tracks need to be added after setting remote description for multi-cam streaming to work

* Remove WebRTCStreamingMetadata

* Wait for tracks

* Move stuff to separate files, rename some things

* Refactor everything, create WebRTCStreamBuilder for both offer and answers

* ta flight done time to grind

* wait for incoming tracks and channels

* Dummy track and frame reader track. Fix timing.

* dt based on camera type

* first trial of the new api

* Fix audio track

* methods for checking for incoming tracks

* Web migration part 2

* Fixes for stream api

* use rtc description for web.py

* experimental cereal proxy

* remove old code from bodyav

* fix is_started

* serialize session description

* fix audio

* messaging channel wrapper

* fix audiotrack

* h264 codec preference

* Add codec preference to tracks

* override sdp codecs

* add logging

* Move cli stuff to separate file

* slight cleanup

* Fix audio track

* create codec_mime inside force_codec function

* fix incoming media estimation

* move builders to __init__

* stream updates following builders

* Update example script

* web.py support for new builder

* web speaker fixes

* StreamingMediaInfo API

* Move things around

* should_add_data_channel rename

* is_connected_and_ready

* fix linter errors

* make cli executable

* remove dumb comments

* logging support

* fix parse_info_from_offer

* improve type annotations

* satisfy linters

* Support for waiting for disconnection

* Split device tracks into video/audio files. Move audio speaker to audio.py

* default dt for dummy video track

* Fix cli

* new speaker fixes

* Remove almost all functionality from web.py

* webrtcd

* continue refactoring web.py

* after handling joystick reset in controlsd with #30409, controls are not necessary anymore

* ping endpoint

* Update js files to at least support what worked previously

* Fixes after some tests on the body

* Streaming fixes

* Remove the use of WebRTCStreamBuilder. Subclass use is now required

* Add todo

* delete all streams on shutdown

* Replace lastPing with lastChannelMessageTime

* Update ping text only if rtc is still on

* That should affect the chart too

* Fix paths in web

* use protocol in SSLContext

* remove warnings since aiortc is not used directly anymore

* check if task is done in stop

* remove channel handler wrapper, since theres only one channel

* Move things around

* Moved webrtc abstractions to separate repository

* Moved webrtcd to tools/webrtc

* Update imports

* Add bodyrtc as dependency

* Add webrtcd to process_config

* Remove usage of DummyVideoStreamTrack

* Add main to webrtcd

* Move webrtcd to system

* Fix imports

* Move cereal proxy logic outside of runner

* Incoming proxy abstractions

* Add some tests

* Make it executable

* Fix process config

* Fix imports

* Additional tests. Add tests to pyproject.toml

* Update poetry lock

* New line

* Bump aiortc to 1.6.0

* Added teleoprtc_repo as submodule, and linked its source dir

* Add init file to webrtc module

* Handle aiortc warnings

* Ignore deprecation warnings

* Ignore resource warning too

* Ignore the warnings

* find free port for test_webrtcd

* Start process inside the test case

* random sleep test

* test 2

* Test endpoint function instead

* Update comment

* Add system/webrtc to release

* default arguments for body fields

* Add teleoprtc to release

* Bump teleoprtc

* Exclude teleoprtc from static analysis

* Use separate event loop for stream session tests
old-commit-hash: f058b5d64eed31878533a85f25eb53386ff9e330
2023-12-01 21:13:37 -08:00
Justin Newberry 52500d88fb Pytest: add cpp harness (#30471)
cpp harness
old-commit-hash: 8d3bf1f41a52825e43ce9542ee86dea4b32f9b6c
2023-11-22 13:45:49 -08:00
Justin Newberry b28343e276 Revert "Pytest: run tests in random order" (#30469)
Revert "Pytest: run tests in random order (#30134)"

This reverts commit bdc0624d0320e75b521a8edcf4aebacb6ab96a75.
old-commit-hash: ba3067a560dca8d94ebf2c63b0d5fab7922c56e4
2023-11-15 10:41:11 -08:00
Justin Newberry 586fe682e4 Pytest: run tests in random order (#30134)
* enable random order

* logprint info

* revert that

* better logging

* go to dfu

* try to flash every panda if not up to date

* revert panda debugging
old-commit-hash: a5d99e0ebbfdad405ec86ca4907325926f3e0bfb
2023-11-15 10:16:51 -08:00
Kacper Rączy 7cac430ecc Remove laika submodule (#30453)
* Remove laika submodule

* Remove laika check for minimal builds

* Fix minimal build check

* Bring back exclude for opendbc in codespell

* Fix typo

* Copy GNSS indices from laika

* Delete laika dependencies
old-commit-hash: 2de13bea91d7c095491d9f3f21cb71d995c63bb4
2023-11-15 10:06:37 +01:00
Justin Newberry 337b156518 Pytest: load by group by default (#30466)
* wip

* use a class marker

* this one should be grouped too
old-commit-hash: 31c682d40743f4b102a70d72e6993b383d85a040
2023-11-14 17:33:47 -08:00
Justin Newberry efaa3ea500 Pytest: default settings on PC improvements (#30441)
* always multithreaded

* multithreaded

* pkill correct process

* escape more

* load for interfaces
old-commit-hash: 2ad82cbfb064676401876a20e49e3965c40344a0
2023-11-13 10:45:24 -08:00
Justin Newberry a0b0c1c4e7 CI: codecov for multiprocessing (#30432)
old-commit-hash: 26294173207cd5e3c586ca71a88fdd3a09fc7345
2023-11-10 10:02:05 -08:00
Justin Newberry 0a901ebe02 Revert "CI: codecov for multiprocessing" (#30431)
Revert "CI: codecov for multiprocessing (#30428)"

This reverts commit 3b07eefe35677ba9cd35680864b88d5eacd3a25e.
old-commit-hash: 863fdec50e6e222b4b50157c7fe2e254de3435bd
2023-11-09 15:52:28 -08:00
Justin Newberry 81e3076dc6 CI: codecov for multiprocessing (#30428)
* concurrencty codecov

* its a list

* retrigger ci

* increase delay
old-commit-hash: 1e91cf92a180f7093279d19e4a8694c353910d15
2023-11-09 15:19:10 -08:00
Justin Newberry 3027a428cb Pytest: tici mark for skipping on-device tests (#30412)
* mark tici

* not those ones

* missed that one

* add those

* add pypoetry

* oops
old-commit-hash: aec7cea30d48dc8915eea38c86de7d4effa0548d
2023-11-07 17:35:44 -08:00
Dean Lee 3a637fe455 athenad: fix memory leak in _do_upload() (#30237)
* fix memory leak

* test: stash

* clean up

* clean up

* ruff

* rm

* add py memory profiler

* test compress and no compress

* proper test

* comment

---------

Co-authored-by: Shane Smiskol <shane@smiskol.com>
old-commit-hash: 61288dfe068e6127dcff64b8e7ac81844f7c31ff
2023-10-29 07:08:28 -10:00
Adeeb Shihadeh 58df021bd7 Update Python packages and pre-commit hooks (#30269)
* Update Python packages and pre-commit hooks

* fix pyqt

---------

Co-authored-by: adeebshihadeh <adeebshihadeh@users.noreply.github.com>
old-commit-hash: 13bf8c26f35073cdadc7d3d5e38e06c776a362f1
2023-10-18 20:18:08 -07:00
Justin Newberry 5b16fda00c add random order plugin (#30166)
add random order
old-commit-hash: 2048808827bff61977465939297b9d5941e91cb7
2023-10-04 11:51:24 -07:00
Adeeb Shihadeh a24af381f7 remove some python packages (#30135)
* less dependencies

* rm that

* add that back for now

* revert for now
old-commit-hash: 0694d3b8f6727a5a83cb52e978c7e3743eb928ab
2023-10-02 17:13:45 -07:00
Justin Newberry 07c27071a4 remove carla dependency (#30139)
* only docs and default

* remove carla dependency

* remove carla dependency
old-commit-hash: 3c55f76790a5663a62892581c9554391aebae1de
2023-10-02 16:11:56 -07:00
Justin Newberry fb4e774a2e Update metadrive (#30128)
update metadrive
old-commit-hash: f32294772d15d5797f087c006601d2aa783e6088
2023-10-02 13:18:03 -07:00
Justin Newberry eb33a751f6 Revert "run unit tests in a random order (#29799)" (#30116)
This reverts commit 36bcfb117d12049be554ec0f82684827fc99f68a.
old-commit-hash: 2dd13c60ccdd513821cad4570fe140c9749d06f3
2023-09-30 17:23:38 -07:00
Adeeb Shihadeh f7d5a2b216 run unit tests in a random order (#29799)
* run unit tests in a random order by default

* bump panda

* fix startup

* re-add random order plugin

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
old-commit-hash: b483efe764c001454b0fe917ce0b1023bc08ab88
2023-09-30 15:56:23 -07:00
Kacper Rączy fedd4a886d aarch64: onnxruntime (#30095)
base onnxruntime for aarch64
old-commit-hash: bfddcdaf891b76ac0eb1e7aa781ef07f80ceb85f
2023-09-28 22:32:21 -07:00
Justin Newberry ef75f0ab12 CI: use "slow" marker for pytest (#30063)
* skip to mark

* fix quotes
old-commit-hash: 0251742079b206ce40a3b4d8ae9cec1381494d4a
2023-09-26 13:44:18 -07:00
Shane Smiskol 6156911322 hypothesis: fix too slow health check (#30001)
* update hypothesis

* change less
old-commit-hash: fb8f7ba8477e8243d9811bce941a2b11e180e033
2023-09-21 17:40:14 -07:00
Adeeb Shihadeh 46f3493e40 add ruff package
old-commit-hash: 844b2815d535b444534c33e841a1f0fab2470b53
2023-09-17 15:44:34 -07:00
Shane Smiskol 9a28d2a59d ruff: check mutable default values for data class attributes (#29945)
* Update pyproject.toml

* Update pyproject.toml
old-commit-hash: 5cb4e8352885aec86b800f3e981571a175f3b931
2023-09-16 15:11:09 -07:00
Justin Newberry 1ef92c57f2 update metadrive (#29938)
old-commit-hash: ad7432b45d00cf05fb9635a850bae878d3b686b9
2023-09-15 14:55:08 -07:00
Adeeb Shihadeh 1f8459d285 use pytest for cpp tests (#29833)
* add pytest-cpp package (#29828)

* add pytest-cpp package

* disable for now

* use in ci

* use pytest cpp

* use my branch

* add missing tests

* that doesn't make sense

* it was merged upstream

* replace TEST_RLOG_URL with a publicly accessible url

* PR Cleanup

* assert instead

* update poetry lock

* add comment about  pytest-cpp

---------

Co-authored-by: Justin Newberry <jnewberry0502@gmail.com>
Co-authored-by: Justin Newberry <justin@comma.ai>
Co-authored-by: deanlee <deanlee3@gmail.com>
old-commit-hash: 2c1dfc2f341b09381af2cc7872c4092df28dc9d5
2023-09-11 14:01:50 -07:00
Adeeb Shihadeh 52752a3131 jenkins speedup (#29869)
* jenkins speedup

* cleanup
old-commit-hash: d0361485504fe5af47a9e8ffaf0b64cfcdf03ac9
2023-09-10 16:47:07 -07:00
Justin Newberry 759ab03b03 Ruff: disallow non-openpilot imports (#29841)
old-commit-hash: 110cfef1c2a56b333b684cd7ae98b321ae0e72eb
2023-09-08 10:43:02 -07:00
Adeeb Shihadeh bc6367bdf9 Revert "add pytest-cpp package (#29828)"
This reverts commit 9e739aa27d8eb163de74320cfb2f3ea43ca2cb48.

old-commit-hash: 0d042624ae236fa9b58448a1eaeba841d4eff73e
2023-09-07 20:40:25 -07:00
Adeeb Shihadeh 01ee6fd1bb add pytest-cpp package (#29828)
* add pytest-cpp package

* disable for now
old-commit-hash: 773d0944d8b51fe2a64c13f0a9b6b0ff9457cf4f
2023-09-07 19:42:30 -07:00
Kacper Rączy 2092a38bde disable metadrive on linux/aarch64 (#29802)
old-commit-hash: 2487db14b06df91d43d277c4e4a35cce2baa1bc6
2023-09-06 21:29:36 +02:00
Adeeb Shihadeh 53e0f5eb49 pytest: use a clean environment for all tests (#29788)
* pytest: use a clean environment for all tests

* rm that

* fix pj

* put build back

* fix params

* fix that

* handle no key

* that was removed

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
old-commit-hash: 7b6afbc1623b8c159a92f6a5a951fb4d688045ee
2023-09-05 18:52:40 -07:00
Justin Newberry 1ed42179c3 Pytest: don't rerun cereal unittests (#29781)
pytest don't rerun cereal
old-commit-hash: 16c99e3e7febdac58cc67726768f6413a6cbf74f
2023-09-05 14:06:03 -07:00