6f5f8e7746
loggerd: reduce debug log frequency
2025-02-17 15:06:16 -08:00
27b5a727e3
Revert "Mypy: Got passing on macos ( #34591 )"
...
This reverts commit b09b48130e
2025-02-16 08:50:46 -08:00
b09b48130e
Mypy: Got passing on macos ( #34591 )
...
* Mypy: Got mypy passing on macos
* common/realtime.py refactor
* Mypy: mypy passing on darwin
* Refactor: Removed else: pass statement
* Refactor: Removed unnecessary check
* added xattr to pyproject
* loggerd: switched to xatter module
* loggerd: removed unused module in xattr_cache.py
* UV: update uv.lock
* Update system/athena/athenad.py
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com >
* athenad: fixed blank lines
* loggerd: refactor of xattr_cache
* cleanup
---------
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com >
2025-02-16 00:05:52 -08:00
644130ca3d
encoderd: use AV_CODEC_ID_H264 codec for qcamera encoding ( #34498 )
2025-02-11 12:46:43 +00:00
3c0990e716
move thumbnail generation from camerad to encoderd ( #34554 )
...
Co-authored-by: Cameron Clough <cameronjclough@gmail.com >
2025-02-10 23:43:46 +00:00
27c11eb597
athena upload: streaming file upload ( #34559 )
...
streaming file upload
2025-02-10 13:57:31 -08:00
4b7a25efc3
loggerd: remove unused zlib and libswscale linkage ( #34552 )
...
remove unused link
2025-02-09 09:13:58 -08:00
9ec54f59c6
loggerd: switch logging from raw file format to zstd compressed files ( #34549 )
...
* switch logging from raw file format to zstd compressed files
* more zst suffix
* compress bootlog
* remove class RawFile
* Optimize ZstdFileWriter by adding input caching
* use ZSTD_compressStream2
* cleanup
* LOG_COMPRESSION_LEVEL=10
* space
* add zst suffix to LOGS_SIZE_RATE
2025-02-08 12:55:31 -08:00
9bc35c0919
Revert "athena upload: reduce memory usage and improve efficiency with streaming ( #34528 )"
...
This reverts commit 4c65f51a55
2025-02-06 11:50:04 -08:00
4c65f51a55
athena upload: reduce memory usage and improve efficiency with streaming ( #34528 )
...
* reduce memory usage and improve upload efficiency with streaming
* space
2025-02-04 13:10:13 -08:00
e7b63dce65
encoderd: enhance robustness of open() with HANDLE_EINTR Macro ( #34478 )
...
HANDLE_EINTR
2025-01-27 19:46:43 -08:00
3219fe1472
encoder: optimize MessageBuilder data handling by adopting encoded data ( #34391 )
...
optimize data handing by adopting external data
2025-01-19 16:22:40 -08:00
47b13f54f6
encoderd: refactor VideoEncoder::publisher_publish to standardize member variable access ( #34342 )
...
remove redundant pointer parameter
2025-01-12 11:38:20 -08:00
08779941e5
loggerd: typing and remove unused default arg ( #34349 )
2025-01-09 22:12:10 +00:00
f761f53205
deleter cleanups ( #34345 )
2025-01-09 20:00:45 +00:00
29577a3346
bootlog: monotonic ts for journalctl
2024-11-25 15:41:21 -08:00
c287232374
uploader: increase max qlog size ( #34106 )
2024-11-25 09:40:23 -08:00
7d5031a6d6
ci: reduce sleep in test_uploader ( #34009 )
...
less
2024-11-12 19:41:00 -08:00
ce7317407f
ci: faster test_encoder ( #33968 )
...
* try
* timeout
* fix
2024-11-08 11:49:04 -08:00
e0acd86ca1
ci: faster unit_tests ( #33962 )
...
faster
2024-11-07 18:44:12 -08:00
853febe21d
visionipc: remove RGB support ( #33739 )
...
* visionipc: remove RGB support
* bump
* msgq master
* fix sim
2024-10-07 13:24:57 -07:00
0bdad1fee0
loggerd: direct Initialize params instead of copy ( #33622 )
...
Direct Initialize Instead of Copy
2024-09-22 14:12:07 -07:00
2b37624dee
encoderd: use const reference for VisionBuf access ( #33621 )
...
use const reference for VisionBuf access
2024-09-22 14:11:59 -07:00
467bd74944
camerad: remove CameraType enum from camera_common.h ( #33588 )
...
remove CameraType from camera_common.h
2024-09-19 10:33:24 -07:00
102f1b0d85
loggerd: fix mac build
2024-09-18 22:16:25 -07:00
718835a825
camerad: prep part 2 ( #33584 )
...
* no camerastate in sensors
* bring this over
* and encoder
2024-09-18 21:10:45 -07:00
139f4034a8
Revert "uploader.py: simplify clear_locks by using rglob ( #32974 )"
...
This reverts commit 870f5cbeb39fa63829e6f3a64fa8df57e82d52c3.
old-commit-hash: 9474523addb78d3b16a72949c6d85c4059fffa92
2024-08-03 12:12:42 -07:00
7fcba71725
uploader.py: simplify clear_locks by using rglob ( #32974 )
...
simplify clear_locks
old-commit-hash: cafca4f89176855585835ff7c67dea5a9b08ca23
2024-08-02 13:40:57 -07:00
d802a423a6
loggerd: Initialize atomic variables to zero ( #33130 )
...
Initialize atomic variables in LoggerdState to zero
old-commit-hash: 8f3fc699d4e06811fd29fbf64fe89032cce563b9
2024-08-02 12:01:56 -07:00
cb306fd7a8
CI: fix recent test_rotation skip ( #33167 )
...
old-commit-hash: 5b4b7a08fcabdc22bb52c2abeeda87772d7990d7
2024-08-01 16:28:26 -07:00
d59f9262c8
disable test_rotation until it's fixed
...
old-commit-hash: bfa8e0b2ec20727db070945e99549828c1f4bc0e
2024-08-01 15:36:44 -07:00
3c1af12490
uploader.py: ensure proper resource management with io.BytesIO ( #33108 )
...
* ensure proper resource management with io.BytesIO
* improve
old-commit-hash: 2728c95b0d8f95faca4c1ee11a77a050f0d1c5fb
2024-07-29 13:43:31 -07:00
8cc6b66cde
docs: add concepts section
...
old-commit-hash: 5ebc65f254f66ff13c679f9f699a92458c41aa8a
2024-07-28 16:38:41 -07:00
7b67994a05
use zstandard library ( #33110 )
...
* use zstandard
* run 10
* bye bye
* this was a little overzealous
* clean up
old-commit-hash: 1b3b5ab75857465f58ec8a687db04c8ee0470e05
2024-07-28 02:03:47 -07:00
b0a8b3bc9d
uploader: compress with zstd ( #32736 )
...
* zstd uploader
* fix that
* fix name of function
* comment
* log failed
* fix comma_api_source for routes with both bz2 and zst rlogs
* TODO
* 10-14 achieves almost no benefit on qlogs in a few cases, but takes 2x the time
* these aren't written out
* regen: specify any list of sources
ooh this is pretty nice
* regen and process replay
* damn, actually we don't need all this (cool tho)
Revert "regen: specify any list of sources"
This reverts commit ceb0b4abed9ad463a9fe98d9b98a05875a52806f.
* just let it auto resolve
* fix athenad/uploader tests
* zst here too
* TODOs
* yes
* Revert "TODOs"
This reverts commit 8c7da1dbd0340c72290b5eb5563b642080ddc131.
* Revert "zst here too"
This reverts commit 23b0023ddfd22c8090be7a7caa09e7026a12aa5c.
* Revert "just let it auto resolve"
This reverts commit f296d62424227ad05facc62abc18a6f81b474e84.
* Revert "regen and process replay"
This reverts commit 0768330e96974a42616d229d159780619d049cd0.
* revert readme
* not in save_log either
* lfg
* Revert "lfg"
This reverts commit 3718559c6c4de7d1f0c80dc9f1a1d335fe679a89.
old-commit-hash: 7dec7c39bec0b7015c9cc12ee78f07a07ed47ee6
2024-07-26 19:33:35 -07:00
82ebea3d12
deleter: preserve two previous segments on user flag ( #32822 )
...
preserve 2 segs
old-commit-hash: dc418485970952a780baef7ef069d858220e58e5
2024-06-24 15:11:20 -07:00
05ed3d8c15
Restructure msgq ( #32652 )
...
* Update ref
* Compiles
* compiles
* Refactor rest of libs
* import all
* small fiex
* cleanup import
* Need msgq simlink too
* Add to openpilot docker too
* try repo
* Updates
* Fix lint
* fix docs
* Try blank slate
* Revert "Try blank slate"
This reverts commit f078ce04acacfe115c19e23e86038b01e2b84a6d.
* Maybe scons needs this to clear cache
* fix tests
* Disable test for now
* Update SConstruct
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
* Fix whitespace
* Write skip normal
* small fixes
* add test path
* Revert repo
* linting
* whitespace
* Bump msgq
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
old-commit-hash: e70dc90a452e7c045d9a207f3680d846406ef789
2024-06-09 17:44:34 -07:00
ad42b61427
test_encoder: adjust file size tolerance
...
old-commit-hash: b51472048ce5b37f4069ad14a60fc911e47b724e
2024-06-07 23:09:41 -07:00
f870a968e9
Split cereal into cereal/msgq ( #32631 )
...
* squash
* fix doc
* compile device
* compile device
* Update ref
* add msgq to precommit exclusions
* No service ports
* fix compile
* address comments
* More comments
* Delete logger
* Update opendbc
* Linting
* bump msgq
old-commit-hash: e71ec4e8d7e39a56235f590227e7cb361cd8b79d
2024-06-06 14:31:56 -07:00
86b6103657
test_*.py files are no longer executable ( #32610 )
...
* test_*.py files are no longer executable
* cleanup empty lines
* update precommit
* fixme
* enable
* build
old-commit-hash: c59887c8109dd8d33ea2e7169995184fbe38cc3a
2024-06-03 15:48:56 -07:00
cc4f53e6c6
manager: move to system/ ( #32538 )
...
* manager: move to system/
* one more
old-commit-hash: accdade4cfe73cdca41f5afa73cf4ad085802930
2024-05-25 12:41:17 -07:00
3358745103
ruff: enable UP
...
old-commit-hash: b2e4c64cf8fe3256d1e411e8715c29e2eb6f4f00
2024-05-20 17:43:54 -07:00
46183bc11b
encoderd: publish i-frame as thumbnail ( #32202 )
...
* pusblish i-frame as thumbnail
* generic
* disable for now
* fix
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
old-commit-hash: b742776bffb3e49649c17b54197a993e9d547403
2024-05-18 17:46:34 -07:00
639a634f7c
Unittest to pytest ( #32366 )
...
* add pytest-asyncio
* switch common
* switch selfdrive
* switch system
* switch tools
* small fixes
* fix setUp and valgrind pytest
* switch to setup
* fix random
* switch mock
* switch test_lateral_limits
* revert test_ui
* fix poetry.lock
* add unittest to banned-api
* add inline ignores to remaining unittest imports
* revert test_models
* revert check_can_parser_performance
* one more skip
---------
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
old-commit-hash: dd9d5d4528ff0a61c7699abc1b63ba8fd282632f
2024-05-17 11:01:44 -07:00
0147c559c0
loggerd/logger.cc: use std::stoul instead of std::stol ( #32133 )
...
old-commit-hash: 99285ef1f2da4ba3852c376f4cae0c50e5dc3c79
2024-04-09 10:46:07 -07:00
fc1d2edf81
loggerd/logger.cc: fix typo ( #32134 )
...
old-commit-hash: cad7b96c3a12e58c17f0d80936a8b9e4c39e7365
2024-04-09 10:45:48 -07:00
da31ce154a
refactor camera transformations ( #31818 )
...
* refactor camera transormations
* update users
* more stuff
* more fix
* swap
* tici
* lil shorter
old-commit-hash: e3589e4b5cc783001c95b52cce066647b4ae0c6c
2024-03-10 16:56:50 -07:00
b73a5fba4c
fix old route sorting ( #31787 )
...
* fix old route sorting
* cleanup
* Update system/loggerd/uploader.py
---------
Co-authored-by: Comma Device <device@comma.ai >
old-commit-hash: 158e36976b8793610ac1f39f51d82f5eeeb099b2
2024-03-07 19:22:06 -08:00
402e8f8b0e
encoderd: fix large frames ( #31681 )
...
* encoderd: fix large frames
* Update camera_common.cc
* just do this for now
---------
Co-authored-by: Comma Device <device@comma.ai >
old-commit-hash: 84797482e909ce017385fb3510d564ee5b08045d
2024-03-06 16:19:08 -08:00
9735cf2eb6
timeless routes ( #31119 )
...
* timeless route
* update sort
* update test
* fix param name
old-commit-hash: 7cfc571f5698c8f5d5bce2e39ccbd8a56c729395
2024-03-05 20:43:33 -08:00
Adeeb Shihadeh