Commit Graph

96 Commits

Author SHA1 Message Date
Harald Schäfer 05ed3d8c15 Restructure msgq (#32652)
* Update ref

* Compiles

* compiles

* Refactor rest of libs

* import all

* small fiex

* cleanup import

* Need msgq simlink too

* Add to openpilot docker too

* try repo

* Updates

* Fix lint

* fix docs

* Try blank slate

* Revert "Try blank slate"

This reverts commit f078ce04acacfe115c19e23e86038b01e2b84a6d.

* Maybe scons needs this to clear cache

* fix tests

* Disable test for now

* Update SConstruct

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Fix whitespace

* Write skip normal

* small fixes

* add test path

* Revert repo

* linting

* whitespace

* Bump msgq

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: e70dc90a452e7c045d9a207f3680d846406ef789
2024-06-09 17:44:34 -07:00
Adeeb Shihadeh ad42b61427 test_encoder: adjust file size tolerance
old-commit-hash: b51472048ce5b37f4069ad14a60fc911e47b724e
2024-06-07 23:09:41 -07:00
Harald Schäfer f870a968e9 Split cereal into cereal/msgq (#32631)
* squash

* fix doc

* compile device

* compile device

* Update ref

* add msgq to precommit exclusions

* No service ports

* fix compile

* address comments

* More comments

* Delete logger

* Update opendbc

* Linting

* bump msgq
old-commit-hash: e71ec4e8d7e39a56235f590227e7cb361cd8b79d
2024-06-06 14:31:56 -07:00
Adeeb Shihadeh 86b6103657 test_*.py files are no longer executable (#32610)
* test_*.py files are no longer executable

* cleanup empty lines

* update precommit

* fixme

* enable

* build
old-commit-hash: c59887c8109dd8d33ea2e7169995184fbe38cc3a
2024-06-03 15:48:56 -07:00
Adeeb Shihadeh cc4f53e6c6 manager: move to system/ (#32538)
* manager: move to system/

* one more
old-commit-hash: accdade4cfe73cdca41f5afa73cf4ad085802930
2024-05-25 12:41:17 -07:00
Adeeb Shihadeh 3358745103 ruff: enable UP
old-commit-hash: b2e4c64cf8fe3256d1e411e8715c29e2eb6f4f00
2024-05-20 17:43:54 -07:00
Dean Lee 46183bc11b encoderd: publish i-frame as thumbnail (#32202)
* pusblish i-frame as thumbnail

* generic

* disable for now

* fix

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: b742776bffb3e49649c17b54197a993e9d547403
2024-05-18 17:46:34 -07:00
cl0cks4fe 639a634f7c Unittest to pytest (#32366)
* add pytest-asyncio

* switch common

* switch selfdrive

* switch system

* switch tools

* small fixes

* fix setUp and valgrind pytest

* switch to setup

* fix random

* switch mock

* switch test_lateral_limits

* revert test_ui

* fix poetry.lock

* add unittest to banned-api

* add inline ignores to remaining unittest imports

* revert test_models

* revert check_can_parser_performance

* one more skip

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: dd9d5d4528ff0a61c7699abc1b63ba8fd282632f
2024-05-17 11:01:44 -07:00
Dean Lee 0147c559c0 loggerd/logger.cc: use std::stoul instead of std::stol (#32133)
old-commit-hash: 99285ef1f2da4ba3852c376f4cae0c50e5dc3c79
2024-04-09 10:46:07 -07:00
Dean Lee fc1d2edf81 loggerd/logger.cc: fix typo (#32134)
old-commit-hash: cad7b96c3a12e58c17f0d80936a8b9e4c39e7365
2024-04-09 10:45:48 -07:00
Adeeb Shihadeh da31ce154a refactor camera transformations (#31818)
* refactor camera transormations

* update users

* more stuff

* more fix

* swap

* tici

* lil shorter
old-commit-hash: e3589e4b5cc783001c95b52cce066647b4ae0c6c
2024-03-10 16:56:50 -07:00
Adeeb Shihadeh b73a5fba4c fix old route sorting (#31787)
* fix old route sorting

* cleanup

* Update system/loggerd/uploader.py

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 158e36976b8793610ac1f39f51d82f5eeeb099b2
2024-03-07 19:22:06 -08:00
Adeeb Shihadeh 402e8f8b0e encoderd: fix large frames (#31681)
* encoderd: fix large frames

* Update camera_common.cc

* just do this for now

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 84797482e909ce017385fb3510d564ee5b08045d
2024-03-06 16:19:08 -08:00
Adeeb Shihadeh 9735cf2eb6 timeless routes (#31119)
* timeless route

* update sort

* update test

* fix param name
old-commit-hash: 7cfc571f5698c8f5d5bce2e39ccbd8a56c729395
2024-03-05 20:43:33 -08:00
Cameron Clough a09300385b mypy: use implicit-optional (#31590)
* mypy: set implicit-optional = true

* find and replace '| None = None' -> '= None' in function args
old-commit-hash: 80da3aee147867e46f566b63a96f4fe199e0628d
2024-02-25 13:29:18 -08:00
Cameron Clough 9bd90112d0 use pyupgrade to update to new typing syntax (#31580)
* add pyupgrade hook

* run pyupgrade (pre-commit run -a)

* ruff --fix

* Revert "add pyupgrade hook"

This reverts commit 56ec18bb6b8602a0b612f3803d96cdad14b52066.

* revert changes to third_party/

* manual type fixes

* explicit Optional wrapping capnp objects
old-commit-hash: 995250ae4967943ee33a3699a1d89a7a770d95e9
2024-02-24 16:41:23 -08:00
Adeeb Shihadeh dd3b005456 uploader: sleep more when no files in queue (#31523)
* uploader: sleep more when no files in queue

* fix test
old-commit-hash: 1c794b710cdcf682205b3f3724d8858073e5370c
2024-02-20 17:25:12 -08:00
Adeeb Shihadeh df6154b591 log git commit date (#31490)
* log git commit date

* unix ts

* fix

* bump cereal

* cleanup
old-commit-hash: 0723c2bc5f22a079685c1643fa2d72f70eeff087
2024-02-16 13:19:10 -08:00
Adeeb Shihadeh 35c9578c5e fix bootlog count (#31319)
old-commit-hash: cbd46802b05b8883d6fa3f64fa069a5d5aaabd17
2024-02-05 23:00:45 -08:00
Adeeb Shihadeh 2632a41c1e encoderd: get frame size over vipc (#31276)
* encoderd: get frame size over vipc

* bump cereal

* fix ffmpeg

* no print
old-commit-hash: a5766e27967707d51c4e7181a3509c78b3671d16
2024-02-02 12:53:12 -08:00
Adeeb Shihadeh 048629564e bootlog: remove timestamp from filename (#31187)
* bootlog: remove timestamp from filename

* revert route

* test

* revert that

* fix loggerd test
old-commit-hash: 25043410705f2a7a275e69ec513c8889465d4ba3
2024-01-26 19:17:38 -08:00
Adeeb Shihadeh 5441587c6b mark as flaky for now
old-commit-hash: 6fbd8442164fbc4dde8949d63c67a9a600a3f896
2024-01-26 14:37:22 -08:00
Justin Newberry 1e197545c6 Revert "test_loggerd: make rotation test more robust" (#31168)
old-commit-hash: 979dba33cda2c54686e0e07f439ce06aa2598b1f
2024-01-25 17:11:03 -08:00
Justin Newberry 1dae90e219 test_loggerd: make rotation test more robust (#31160)
* no randomness

* lots

* Revert "lots"

This reverts commit 2052fd6f7b8dc4c53fbb7c726026070918d5de00.
old-commit-hash: 35374f4d577d0bf835ae146954010ef61a3c2fa4
2024-01-25 12:13:43 -08:00
Adeeb Shihadeh dc6a23a1bc loggerd: speedup unit tests (#31115)
* first speed it up

* pytestify

* no sleep
old-commit-hash: 694fc378dd1b4dc4b26847efb25af538133d0685
2024-01-22 17:24:42 -08:00
Adeeb Shihadeh 972650f0eb remove dashcam branch (#31081)
* remove dashcam branch

* fix

* more cleanup

* remove param

* one more
old-commit-hash: 7cd9568423a2e78187d16018b70a78f56c02027d
2024-01-19 14:05:03 -08:00
Adeeb Shihadeh 6124ecf1c1 uploader: restrict qcam upload on metered connctions (#31047)
* uploader: restrict qcam upload on metered connctions

* route requesting

* rename

* str

* cleanup

* strip dongle

* upload bookmarked segments

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 2280ac50b76264dadd170e8f23bf0c3bf68ef61c
2024-01-17 21:41:58 -08:00
Adeeb Shihadeh 3d85d3d857 uploader: delay uploading crash and boot logs on metered connections (#31045)
* uploader: delay uploading some files on metered connections

* just crash and boot for now
old-commit-hash: 19630c5af989fb62d1c920e54f838969c6158453
2024-01-17 17:43:41 -08:00
Adeeb Shihadeh 6c21bbacae update param in loggerd unit test
old-commit-hash: 5f1e7649e3725667a7a753a89f31834aa28eb2b1
2024-01-17 15:08:36 -08:00
Adeeb Shihadeh d6a8213c80 uploader cleanup (#31035)
* Reapply "uploader cleanup" (#31033)

This reverts commit a2723989bced503a4506684a4a6fdc6c8101f7b2.

* always sleep

* more cleanup

* little more

* fix linter

* little more
old-commit-hash: 0b5fd7287e715707e32b7e6978e296918dd34234
2024-01-17 14:24:09 -08:00
Justin Newberry 7f09117bf0 Revert "uploader cleanup" (#31033)
old-commit-hash: 5e4df41b2f4c379157844dc4c19ef496ca658088
2024-01-17 11:07:38 -08:00
Adeeb Shihadeh 4580cd1eb9 uploader cleanup (#31029)
* cleanup

* startup cleanup

* step

* Update test_uploader.py
old-commit-hash: c6c6a441eb61c7ac28fb94b05b91fbb8837b9236
2024-01-16 19:54:07 -08:00
Dean Lee 16266338c6 uploader.py/listdir_by_creation: list directories only (#30806)
list only directories

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: a1f53c70e6d955898a3ddb95b74d1d6b3f40da3e
2023-12-26 16:05:45 -08:00
Adeeb Shihadeh c0c898d83a uploader: reduce max qlog/qcam size (#30746)
old-commit-hash: 37351cbdc1e40c5d990035d867008aec44b64c76
2023-12-14 22:30:46 -08:00
Dean Lee 5ab1fc7674 encoder: reduce memory allocations and copying (#28704)
* reduce memory allocations and copying

* #include <vector>
old-commit-hash: a4179a7c230e687bebd15581ccdb3f7d34a690f4
2023-12-12 19:15:47 -08:00
Adeeb Shihadeh 59eb2988de swaglog.py goes in common/ (#30631)
* swaglog.py goes in common/

* all of these go in release

* we'll even include the pyx
old-commit-hash: 35f819c8239b8ac3a000087a0f791b91ccea5e5e
2023-12-06 17:27:51 -08:00
Adeeb Shihadeh 1cc4f1a634 new msgs default to invalid (#30587)
* new msgs default to invalid

* fix lm

* set more valid

* update rest

* update refs

* fix logMessage

* more valids

* cleanup

* fix llk test

* pigeond is also valid

* more valids
old-commit-hash: a1d36961cf9fa0c6a9c41fe92d6504de5d36cbaa
2023-12-03 10:50:17 -08:00
Justin Newberry 661132be5a Pytest: more post-test path cleanup (#30556)
* test cleanup

* missed this one

* remove that

* static class
old-commit-hash: 4086795c29bacd245a7cc372a16730e1a6ff974f
2023-11-30 09:55:48 -08:00
Adeeb Shihadeh e56998ca26 one more
old-commit-hash: c055fdc8539c3c89ffa6b71b82fe70a599fac768
2023-11-18 22:22:31 -08:00
Adeeb Shihadeh 07ea94cf7b rm old loggerd debug scripts
old-commit-hash: 3d36a0f70d2cd64dc8e6002b803f844f470d0731
2023-11-18 22:20:10 -08:00
Dean Lee 00e5f37d2a loggerd: c++ LoggerState (#25869)
* c++ LoggerState

* trigger ci

* trigger ci

* merge master

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 3527c1da6759e54e42f80ab7cfde038a8ae96680
2023-11-18 22:11:13 -08:00
Justin Newberry 3027a428cb Pytest: tici mark for skipping on-device tests (#30412)
* mark tici

* not those ones

* missed that one

* add those

* add pypoetry

* oops
old-commit-hash: aec7cea30d48dc8915eea38c86de7d4effa0548d
2023-11-07 17:35:44 -08:00
Adeeb Shihadeh eeecc35e0b loggerd: add wall time to initData (#30251)
* loggerd: add wall time to initData

* bump cereal

* fix
old-commit-hash: f616dd77a18197e8d1d25bf8afbfc01c1ab2562b
2023-10-15 15:21:51 -07:00
Adeeb Shihadeh 61eb6f4f66 finish hardware move to system/ (#30140)
* finish hardware move to system/

* fix release

* couple more
old-commit-hash: c347096c3ee275ccedc3c39e1888c44d40f77a56
2023-10-02 16:49:07 -07:00
Shane Smiskol 13381ed446 services: capitalize constant service list (#30005)
* rename

* bump

* Apply suggestions from code review
old-commit-hash: 7f073483bb2586053d6c5508ef3f420947941d90
2023-09-21 18:25:15 -07:00
Adeeb Shihadeh 1f8459d285 use pytest for cpp tests (#29833)
* add pytest-cpp package (#29828)

* add pytest-cpp package

* disable for now

* use in ci

* use pytest cpp

* use my branch

* add missing tests

* that doesn't make sense

* it was merged upstream

* replace TEST_RLOG_URL with a publicly accessible url

* PR Cleanup

* assert instead

* update poetry lock

* add comment about  pytest-cpp

---------

Co-authored-by: Justin Newberry <jnewberry0502@gmail.com>
Co-authored-by: Justin Newberry <justin@comma.ai>
Co-authored-by: deanlee <deanlee3@gmail.com>
old-commit-hash: 2c1dfc2f341b09381af2cc7872c4092df28dc9d5
2023-09-11 14:01:50 -07:00
Justin Newberry dc6078a6c3 System: use paths for download folders too (#29818)
* use paths for download folders too

* trailing slash

* reset that
old-commit-hash: 73eda51a11955627f4d149fdf12c1c781983d52e
2023-09-07 12:49:03 -07:00
Justin Newberry c7029ea15a System: cleanup paths to use a common class (#29816)
* use OP prefix for logmessage

* cleanup paths too

* cleanup the paths too

* add hw.py to release

* fix those issues

* fix unittests

* fix unittests

* fix unittests

* do swaglog_ipc properly across all the files

* fix that

* fix swaglog in c++

* review suggestions
old-commit-hash: bfe990b112a83f245bb5244553c84202aec7d86c
2023-09-07 11:32:47 -07:00
Justin Newberry 3b91610c0b Precommit: ensure executable bit is set (#29784)
* precommit ensure executable

* exclude tinygrad

* bump submodules

* exclude tinygrad globally
old-commit-hash: 4e69937d0d3fbdc7d1d42cbc18d7ccf8ddb115f1
2023-09-05 16:33:26 -07:00
Kacper Rączy 4040d85159 encoderd: fix crash when filename is null (#29748)
Use publish_name for thread name and debugging messages
old-commit-hash: 0bda43d71c46b02b8d9d2043243388f8a2839497
2023-09-01 11:51:59 -07:00