Commit Graph

70 Commits

Author SHA1 Message Date
Adeeb Shihadeh 6124ecf1c1 uploader: restrict qcam upload on metered connctions (#31047)
* uploader: restrict qcam upload on metered connctions

* route requesting

* rename

* str

* cleanup

* strip dongle

* upload bookmarked segments

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 2280ac50b76264dadd170e8f23bf0c3bf68ef61c
2024-01-17 21:41:58 -08:00
Adeeb Shihadeh 3d85d3d857 uploader: delay uploading crash and boot logs on metered connections (#31045)
* uploader: delay uploading some files on metered connections

* just crash and boot for now
old-commit-hash: 19630c5af989fb62d1c920e54f838969c6158453
2024-01-17 17:43:41 -08:00
Adeeb Shihadeh 6c21bbacae update param in loggerd unit test
old-commit-hash: 5f1e7649e3725667a7a753a89f31834aa28eb2b1
2024-01-17 15:08:36 -08:00
Adeeb Shihadeh d6a8213c80 uploader cleanup (#31035)
* Reapply "uploader cleanup" (#31033)

This reverts commit a2723989bced503a4506684a4a6fdc6c8101f7b2.

* always sleep

* more cleanup

* little more

* fix linter

* little more
old-commit-hash: 0b5fd7287e715707e32b7e6978e296918dd34234
2024-01-17 14:24:09 -08:00
Justin Newberry 7f09117bf0 Revert "uploader cleanup" (#31033)
old-commit-hash: 5e4df41b2f4c379157844dc4c19ef496ca658088
2024-01-17 11:07:38 -08:00
Adeeb Shihadeh 4580cd1eb9 uploader cleanup (#31029)
* cleanup

* startup cleanup

* step

* Update test_uploader.py
old-commit-hash: c6c6a441eb61c7ac28fb94b05b91fbb8837b9236
2024-01-16 19:54:07 -08:00
Dean Lee 16266338c6 uploader.py/listdir_by_creation: list directories only (#30806)
list only directories

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: a1f53c70e6d955898a3ddb95b74d1d6b3f40da3e
2023-12-26 16:05:45 -08:00
Adeeb Shihadeh c0c898d83a uploader: reduce max qlog/qcam size (#30746)
old-commit-hash: 37351cbdc1e40c5d990035d867008aec44b64c76
2023-12-14 22:30:46 -08:00
Dean Lee 5ab1fc7674 encoder: reduce memory allocations and copying (#28704)
* reduce memory allocations and copying

* #include <vector>
old-commit-hash: a4179a7c230e687bebd15581ccdb3f7d34a690f4
2023-12-12 19:15:47 -08:00
Adeeb Shihadeh 59eb2988de swaglog.py goes in common/ (#30631)
* swaglog.py goes in common/

* all of these go in release

* we'll even include the pyx
old-commit-hash: 35f819c8239b8ac3a000087a0f791b91ccea5e5e
2023-12-06 17:27:51 -08:00
Adeeb Shihadeh 1cc4f1a634 new msgs default to invalid (#30587)
* new msgs default to invalid

* fix lm

* set more valid

* update rest

* update refs

* fix logMessage

* more valids

* cleanup

* fix llk test

* pigeond is also valid

* more valids
old-commit-hash: a1d36961cf9fa0c6a9c41fe92d6504de5d36cbaa
2023-12-03 10:50:17 -08:00
Justin Newberry 661132be5a Pytest: more post-test path cleanup (#30556)
* test cleanup

* missed this one

* remove that

* static class
old-commit-hash: 4086795c29bacd245a7cc372a16730e1a6ff974f
2023-11-30 09:55:48 -08:00
Adeeb Shihadeh e56998ca26 one more
old-commit-hash: c055fdc8539c3c89ffa6b71b82fe70a599fac768
2023-11-18 22:22:31 -08:00
Adeeb Shihadeh 07ea94cf7b rm old loggerd debug scripts
old-commit-hash: 3d36a0f70d2cd64dc8e6002b803f844f470d0731
2023-11-18 22:20:10 -08:00
Dean Lee 00e5f37d2a loggerd: c++ LoggerState (#25869)
* c++ LoggerState

* trigger ci

* trigger ci

* merge master

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 3527c1da6759e54e42f80ab7cfde038a8ae96680
2023-11-18 22:11:13 -08:00
Justin Newberry 3027a428cb Pytest: tici mark for skipping on-device tests (#30412)
* mark tici

* not those ones

* missed that one

* add those

* add pypoetry

* oops
old-commit-hash: aec7cea30d48dc8915eea38c86de7d4effa0548d
2023-11-07 17:35:44 -08:00
Adeeb Shihadeh eeecc35e0b loggerd: add wall time to initData (#30251)
* loggerd: add wall time to initData

* bump cereal

* fix
old-commit-hash: f616dd77a18197e8d1d25bf8afbfc01c1ab2562b
2023-10-15 15:21:51 -07:00
Adeeb Shihadeh 61eb6f4f66 finish hardware move to system/ (#30140)
* finish hardware move to system/

* fix release

* couple more
old-commit-hash: c347096c3ee275ccedc3c39e1888c44d40f77a56
2023-10-02 16:49:07 -07:00
Shane Smiskol 13381ed446 services: capitalize constant service list (#30005)
* rename

* bump

* Apply suggestions from code review
old-commit-hash: 7f073483bb2586053d6c5508ef3f420947941d90
2023-09-21 18:25:15 -07:00
Adeeb Shihadeh 1f8459d285 use pytest for cpp tests (#29833)
* add pytest-cpp package (#29828)

* add pytest-cpp package

* disable for now

* use in ci

* use pytest cpp

* use my branch

* add missing tests

* that doesn't make sense

* it was merged upstream

* replace TEST_RLOG_URL with a publicly accessible url

* PR Cleanup

* assert instead

* update poetry lock

* add comment about  pytest-cpp

---------

Co-authored-by: Justin Newberry <jnewberry0502@gmail.com>
Co-authored-by: Justin Newberry <justin@comma.ai>
Co-authored-by: deanlee <deanlee3@gmail.com>
old-commit-hash: 2c1dfc2f341b09381af2cc7872c4092df28dc9d5
2023-09-11 14:01:50 -07:00
Justin Newberry dc6078a6c3 System: use paths for download folders too (#29818)
* use paths for download folders too

* trailing slash

* reset that
old-commit-hash: 73eda51a11955627f4d149fdf12c1c781983d52e
2023-09-07 12:49:03 -07:00
Justin Newberry c7029ea15a System: cleanup paths to use a common class (#29816)
* use OP prefix for logmessage

* cleanup paths too

* cleanup the paths too

* add hw.py to release

* fix those issues

* fix unittests

* fix unittests

* fix unittests

* do swaglog_ipc properly across all the files

* fix that

* fix swaglog in c++

* review suggestions
old-commit-hash: bfe990b112a83f245bb5244553c84202aec7d86c
2023-09-07 11:32:47 -07:00
Justin Newberry 3b91610c0b Precommit: ensure executable bit is set (#29784)
* precommit ensure executable

* exclude tinygrad

* bump submodules

* exclude tinygrad globally
old-commit-hash: 4e69937d0d3fbdc7d1d42cbc18d7ccf8ddb115f1
2023-09-05 16:33:26 -07:00
Kacper Rączy 4040d85159 encoderd: fix crash when filename is null (#29748)
Use publish_name for thread name and debugging messages
old-commit-hash: 0bda43d71c46b02b8d9d2043243388f8a2839497
2023-09-01 11:51:59 -07:00
Justin Newberry e3053e6659 Tests: loggerd reduce iterations (#29713)
* reduce those iterations

* sleep time could be decreased too

* in case it's negative
old-commit-hash: a5ef9febb9bb2ddd646ea8051fc31bb7247ad73a
2023-08-30 13:36:55 -07:00
Adeeb Shihadeh cc29c6640d pytest: strict config (#29676)
* pytest: strict config

* collection works

* fixes
old-commit-hash: 72e2e2c9ec4e3a42cf35c23dfc0d66ea0565ace6
2023-08-28 10:26:19 -07:00
Dean Lee d5631664d3 v4l_encoder: convert macro checked_ioctl to funtion (#29609)
* break to multiple lines

* convert to function

* format errno

* use safe_ioctl

* cleanup
old-commit-hash: 1e62999e75b2ba85b7c443af0d8b3132e8e909d2
2023-08-25 11:05:22 -07:00
Adeeb Shihadeh 61cf541322 Minimal build (#29600)
* add build flag for minimum build

* add minimal build

* update

* fix pj

* bump opendbc

* update subaru
old-commit-hash: 4917e22615adbfcc9b3c3ec89b00d240e0b48883
2023-08-24 14:58:30 -07:00
Dean Lee 86692bf177 v4l_encoder: fix error handling for poll (#29166)
* fix error handling for poll

* revert

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: d54fa5c7f198af93474a73643b9363fc2a2043ba
2023-08-24 12:56:06 -07:00
Dean Lee de809632bf cpplint: add filter whitespace/comma (#29595)
old-commit-hash: 7bfd3dac811ae95bfd09495e88377dfbaacda393
2023-08-24 10:42:06 -07:00
Dean Lee 0984736972 cpplint: add filter build/include_subdir (#29585)
old-commit-hash: 21da5a216fc8f5269d2deedc538c2f543a1c270a
2023-08-24 15:42:17 +01:00
Dean Lee 56b582a059 cpplint: add filter whitespace/forcolon (#29582)
whitespace/forcolon
old-commit-hash: ac939029835542a02b866e8a0d174f09773e4e6e
2023-08-23 22:46:02 -07:00
Dean Lee 9bb3316925 encoder/VideoWriter: remove unnecessary call to avcodec_close (#29039)
old-commit-hash: 95e9232963ad2deed377a3d840f25e40f921b8ca
2023-08-23 20:08:19 -07:00
Dean Lee 8c6cb78f38 encoderd: remove unnecessary calls to encoder_close() on exit. (#28970)
old-commit-hash: ddd849a882ded042c1f5fb71cb4e200fe2cb8327
2023-08-23 17:56:22 -07:00
Adeeb Shihadeh 6b2ffe9490 bump cereal (#29561)
old-commit-hash: e726505918bfbaa4ee75714bd6ea391d7fff7fb8
2023-08-23 13:42:37 -07:00
Dean Lee 97e9d55588 cpplint: build/include_what_you_use (#29556)
* include_what_you_use

* remove comments

* include <memory>

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 2d99521e7500902070d0aacce69528bcfd8b9964
2023-08-23 13:25:17 -07:00
Dean Lee 004a097c95 cpplint: add readability/braces filter (#29554)
old-commit-hash: 363740a497620249066522c87ddb03e1362749d4
2023-08-23 10:13:46 -07:00
Adeeb Shihadeh 16ec56398c add openpilot prefix to imports (#29498)
* add openpilot prefix to imports

* more

* more

* fix docs

* fix linter

* bump submodules

* fix patched tests

* update dynamic imports

* debug

* Revert "debug"

This reverts commit db5e13b9911cc74438bee123bc3430da6c31b24b.

* fix pm test
old-commit-hash: a9626f95b69af19306143fc4def02fb5769405d2
2023-08-20 20:49:55 -07:00
Adeeb Shihadeh f50fedb647 Fixes for PYTHONWARNINGS=error (#29381)
old-commit-hash: db287496d82be87971a619b2659c47737142a385
2023-08-13 17:22:56 -07:00
Dean Lee cfef62bbd6 encoderd: fix indentation (#29356)
fix indentation
old-commit-hash: 51cdf155d94aa7ed4fac79db8b042a591ba8c75d
2023-08-12 13:30:54 -07:00
Vivek Aithal 8d11558056 [commabody] setup and run live stream encoders (#29087)
* op changes needed for body

* remove logmessaged callback

* add newlines

* add stream arg

* add stream_encoder to config

* supersets, avoid two encoderd

* fix recursive exit error

* fix loggerd crash

* add stream_encoderd cpu usage to test

* Update system/loggerd/loggerd.h

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* resolve comments

* stream_encoderd onroad to false

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 81322a48059bfb77c1e5613dea35e24181c8bb14
2023-08-11 15:34:25 -07:00
Justin Newberry a14f162bc7 Ruff: comprehensions conventions (#29317)
ignore c408
old-commit-hash: 4a9afd7554060ac5353e96f1d7feb06d3a3671e9
2023-08-10 16:40:30 -07:00
Justin Newberry 7b677910df Linter: Fix >160 line length test (#29287)
* test

* fix line length

* fix line length

* fix file size

* revert poetry

* cleanup for PR
old-commit-hash: cf64b27168614f851087adab2d7f766425922f64
2023-08-08 17:13:35 -07:00
Dean Lee b80325aa04 swaglog: enable type-checked against format string (#29096)
* check&fix fmt

* bump rednose

* correct format string

* bump rednose

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 940954c13e4fb352618448e435b5c1a722fdc3aa
2023-07-31 17:49:50 -07:00
Dean Lee c4aeaba7c6 loggerd: check userFlag outside the while loop (#29095)
* improve check userFlag

* rename to ServiceState

* setxattr once
old-commit-hash: c0c00e1997a6919701a183b9d4757a74b17ac141
2023-07-23 12:33:06 -07:00
Cameron Clough b120aec2f5 deleter: preserve flagged segments (#28814)
old-commit-hash: 98a30f10f447b3c28d92f089012ec66c93066bf0
2023-07-20 21:30:26 +01:00
Dean Lee bd93cd7db3 encoder: remove function publisher_init, init PubMaster in constructor (#28980)
old-commit-hash: 65fe3c8c344233832e6aa79a2007ff5624a2c914
2023-07-17 19:25:41 -07:00
Cameron Clough c22ad5e0cf loggerd: fix whitespace and indentation
old-commit-hash: f14447ad660b16755449a6fbe7fc0b9426227c50
2023-07-17 22:55:20 +01:00
Dean Lee ad461bedb2 encoder: remove public function encoder_init (#28971)
old-commit-hash: 06aef9edd35b09382fac2616b190816bd8fe9a98
2023-07-15 23:57:44 -07:00
Dean Lee d4cd751101 encoderd: get avaiable streams from vipc server (#28935)
* get avaiable streams

* use std::thread

* assert buf size

* Update system/loggerd/encoderd.cc

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: cbed0577899433be6c351b402b59a2104eb7f952
2023-07-15 12:41:49 -07:00