fbf5ada69f
LogReader: live_logreader helpers ( #31416 )
...
live helper
old-commit-hash: 0a92c5bf966530335e804a8f240b10ae982bfcb2
2024-02-12 12:58:25 -08:00
1384c10fb0
logreader: skip internal source if not available ( #31400 )
...
* logreader: skip internal source if not available
* raise exception
* but only when appropriate
old-commit-hash: 667693b8c2ca7ef0b0457823cd76b93b22764038
2024-02-10 00:20:43 -08:00
02aea8b757
test_caching: use with_http_server ( #31393 )
...
use http server
old-commit-hash: 664a3c86babf84b64ae7856bc25789b165cf1e83
2024-02-09 20:06:11 -08:00
bcd22c1683
LogReader: test auto mode fallback ( #31390 )
...
* test auto mode
* better
* slow
* better
old-commit-hash: f87322423534a28ef1680bc86ec072b2914fd217
2024-02-09 15:22:43 -08:00
cb6a47c6bf
simplify URLFile ( #31365 )
...
* simplify URLFile
* more space
old-commit-hash: ec9f3dcef367e6c29756ededa7e83783ef280cfa
2024-02-08 10:24:45 -08:00
3f934381fe
test_logreader: test run_across_segments ( #31305 )
...
* more logreader tests
* not in ci for now
* enable cache
old-commit-hash: b17f24d68ea560722a1596840ec0c79cf928f0ab
2024-02-05 18:35:12 -08:00
54dc43fe14
make URLFile safe after fork() ( #31309 )
...
* make URLFile safe after fork()
* cache the pool manager in each instance
* type hints
old-commit-hash: a8aa04e6bda2fc8ca31db055f584bfc52d104d2c
2024-02-05 18:07:48 -08:00
9b4b5d3cf5
LogReader: skip file_exists check for comma_api ( #31251 )
...
* valid file
* missed this one
old-commit-hash: 6010a39bf8cb030b5b10e1d0657f9291467b6872
2024-01-31 16:43:58 -08:00
16e0907129
LogReader: add ``.filter`` ( #31222 )
...
add filter
old-commit-hash: c782fbc34e05922765959ee3c3b6bba38c0150fb
2024-01-29 17:33:47 -08:00
223b1ed065
LogReader: add tqdm back to run_across_segments ( #31216 )
...
tqdm
old-commit-hash: 7835f9cce05b2f8743bbd632dd6a3093741e6bd2
2024-01-29 13:18:49 -08:00
abfa8fcda9
CommaCarSegments: BIG Database! ( #31169 )
...
* sanetized selector
* god damn
* add to re
* slog branch
* slog
* source
* big
* not slog
* cleanup
* no space
* works!
* trigger
* main!
old-commit-hash: 824ddffec8c67758f3ea080c75e805d4b27f38ef
2024-01-27 01:07:29 -08:00
048629564e
bootlog: remove timestamp from filename ( #31187 )
...
* bootlog: remove timestamp from filename
* revert route
* test
* revert that
* fix loggerd test
old-commit-hash: 25043410705f2a7a275e69ec513c8889465d4ba3
2024-01-26 19:17:38 -08:00
f1a81dd57e
tools: add LOG_ID regex pattern ( #31186 )
...
old-commit-hash: 52c7514452f984db5036994c20be652ec0b44a6c
2024-01-26 16:44:12 -08:00
0d0e6191a8
commaCarSegments cleanup ( #31182 )
...
* cleanup
* no space
old-commit-hash: 9518b66c9e49f744591f8da858b201342a8c096d
2024-01-26 13:20:25 -08:00
01eccef5de
filereader should use connection pool for file_exists ( #31158 )
...
* filereader should use connection pool for file_exists
* remove debug var
old-commit-hash: 6901aada14df6aa68b5e3970da0487b8d2b4df8c
2024-01-25 13:26:12 -08:00
9edc902106
LogReader: fail-fast on invalid segments ( #31152 )
...
* don't check all
* is
old-commit-hash: edd2428b6067381ffaa25420d6fd9f0f142038a8
2024-01-25 11:09:09 -08:00
7d76ac8eba
LogReader: replace get_first_message with LogReader.first ( #31146 )
...
* first
* str
old-commit-hash: dd0c474e6cc09d17cd07b51098d826dc40bc5403
2024-01-24 10:21:57 -08:00
67bb21219c
LogReader: no redownloading on multiple iterations ( #31141 )
...
* no redownload
* sort
old-commit-hash: 88dcaa51c4d1fcc338d44f55134593760334ae23
2024-01-23 23:54:11 -08:00
0d558d02ee
auto_source: add commaCarSegments source ( #31137 )
...
add source
old-commit-hash: ac71c30ad5d8a5f303ac7a08cc73b8a4b0174498
2024-01-23 21:40:04 -08:00
6a1d7fd732
comma_api_source: fix qlogs ( #31136 )
...
fix qlogs
old-commit-hash: 3d9b483e107e119fd5322e00494a769ef0e081bc
2024-01-23 20:51:15 -08:00
8768be968b
LogReader: don't use route for max_segment ( #31129 )
...
* dont use route
* fix and cleanup
old-commit-hash: d574013d7bda94a43b29095887e176b9723d13cb
2024-01-23 14:51:45 -08:00
0fb7448a9d
LogReader: remove redirect message for internal data ( #31088 )
...
fix logging
old-commit-hash: 0234cadec3aefdca2e71c251ff6f8885a247c34a
2024-01-23 12:55:50 -08:00
c5c522c984
plotjuggler: auto fallback to qlogs with prompt ( #31110 )
...
* qlog fallback
* show a warning for that
* qlog fallback
* fix
* wording
old-commit-hash: 65490bb3c55fa81d5144eba2c09f054b73179cc4
2024-01-23 12:53:19 -08:00
0ae82f96c6
SegmentRange: __str__ get preferred format ( #31126 )
...
get canonical
old-commit-hash: 35e1e8ecd2e2a8a458467ecb3ec18730610da18a
2024-01-23 11:40:22 -08:00
c03fe6bb13
add example of using the comma car segments database ( #31117 )
...
* add vin fingerprinting example
* perhaps!
* remove segment
* easier
old-commit-hash: 389b8ca30d62f81ae40a7d026a299ce3930183da
2024-01-22 18:23:07 -08:00
f447062b66
CommaCarSegments: public database of segments for each platform ( #31114 )
...
* comma car segments
* comma car segments for test_models
* oneliner
Co-authored-by: Shane Smiskol <shane@smiskol.com >
* better name
* not used here
* sort
* remove print
* better comment
---------
Co-authored-by: Shane Smiskol <shane@smiskol.com >
old-commit-hash: caa9153974c21fd827d0e991f1789cf3e81b5c3b
2024-01-22 17:33:03 -08:00
b29eea47ce
sanitizer: sanitize vin number ( #31090 )
...
old-commit-hash: 2c86c023fe2d3072910ed33ff97cd6d3ddf2915d
2024-01-21 12:22:32 -05:00
3d0ae1aaaa
prevent typing issue in azure_container ( #31044 )
...
prvent that issue
old-commit-hash: 840db1f1b70e5014f504908eb1beb6358c555cf2
2024-01-17 15:34:24 -08:00
09b95b715c
cleanup azure handling ( #31034 )
...
* wip cleanup
* Wip
* fixes
* fix
* cleanup
* keep this for now
* dest
old-commit-hash: 3f0b56b36472b04dca653ac5870f10d4bd53bc01
2024-01-17 14:21:47 -08:00
a9676e7086
auto_source: optimize api calls and use head to determine if file exists ( #31025 )
...
* fast
* catch all
* source
* fix file_exists
* remove duplicate reset
* test multiple loops
* iterations
* cleanup imports
old-commit-hash: 2967cada71fd1b40e86356585fa5d68301d9f1c8
2024-01-16 17:24:37 -08:00
5df01b3d22
LogReader: fix plotjuggler not reading properly ( #31023 )
...
* fix plotjuggler
* simpler
* fix juggler
* fix that
old-commit-hash: 61fe705160ddb9e5c55292c7f702c5502e2c0d2e
2024-01-16 12:40:49 -08:00
4b7edec2b0
LogReader: move opci to tools/lib ( #31021 )
...
move opci
old-commit-hash: 7d400112df6692ef026245b03951345cc36dd83e
2024-01-16 10:58:51 -08:00
35dcd7ccd8
LogReader: support lists of identifiers ( #31020 )
...
* support lists of logs
* mark as slow instead
old-commit-hash: 0739d5d7b25f1fbcb70a4dd2ef9b5071afb2c526
2024-01-16 10:40:00 -08:00
13e7366b6d
LogReader: support only_union_types ( #31019 )
...
support only-union-types
old-commit-hash: 4da8d165144404e7356e611e68b036ecb33126ef
2024-01-16 10:03:55 -08:00
96e9a7d3ce
CI: speedup unit test job ( #30995 )
...
* start
* mv to buildjet
* fix
old-commit-hash: e17e66180c3a9432e6d303ca36ff0e4af763dace
2024-01-13 21:16:35 -08:00
c8cc30112d
rename segmentrangereader to logreader ( #30981 )
...
* Replace multilogiterator
* replace logreader
* update readme
* fix from_Bytes
* new section
* reset before iter
* selector
* fix internal
* whitespace
old-commit-hash: 3d73512c0702598d27e04039976fe0a91d5952f0
2024-01-12 12:53:50 -08:00
a729e102c7
Replace multilogiterator ( #30980 )
...
old-commit-hash: 9f1b72ac792b8961cd903e425874f3a00a33ab3e
2024-01-12 11:43:32 -08:00
1b65d5cd85
segmentrangereader: support direct parsing ( #30973 )
...
* use correct source
* revert
* cleanup imports
* clean
* direct parsing
* rename
* move up
* fixes
* fix that
* better error message
old-commit-hash: eb09294fc265ffc9cc2ed7f03acc5037d064de81
2024-01-11 16:56:48 -08:00
11449845e7
segmentrangereader: support more sources ( #30970 )
...
* support more sources
* remove this
old-commit-hash: fb994ae782259e8ed4d9212edc3c9fb277f831f6
2024-01-11 12:55:19 -08:00
3b86243f1f
SegmentRangeReader: log type selector ( #30960 )
...
* log type selector
* test this too
* and this
* invalid selector
* use strenum
* don't hardcode size
* oneline
old-commit-hash: be814ed44747ab09f8db429ff0ee1e7f87180fec
2024-01-11 10:25:24 -08:00
9e6c6d92b0
segmentrangereader: support sort_by_time ( #30954 )
...
support sort-by-time
old-commit-hash: cfb23eb2d160639b870690a9bd6e7ba5350e3bc6
2024-01-10 13:36:55 -08:00
1f434b2714
SegmentRangeReader: new format for reading multiple segments ( #30940 )
...
* segment range reader
* rename that
* revert that
* cleanup
* revert this for now
* revert this for now
* Fix + test
* rm that
* rm that
* use for auto_fingerprint
* simpler
* for notebook too
* match numpy indexing
* just use numpy directly
* remove that
* spacing
* spacing
* use qlog for auto fingerprint
* add 'read mode'
* pass in read mode
* add test for modes
* numpy indexing
* fix that case
* more examples
* fix the notebook
* cleanup the notebook
* cleaner
* fix those
old-commit-hash: 0d126e1e9e60a3d995bc90454bee206b5d70024f
2024-01-10 11:55:19 -08:00
7aecd2f91d
url_file: fix non-200 files being cached ( #30886 )
...
* fix + test
* fix unclosed
* easier to read
Co-authored-by: Shane Smiskol <shane@smiskol.com >
* fix that
---------
Co-authored-by: Shane Smiskol <shane@smiskol.com >
old-commit-hash: fba521ecc6d4c260de8f3e93dadbc3e157a9a9a6
2024-01-02 12:42:08 -08:00
207073dc4c
fix unused
...
old-commit-hash: 51a93cf9aaa3c1bc07738a412a4e19cb3dc6dcba
2023-12-17 16:32:56 -08:00
d41f215df8
dependency: remove pycurl package ( #30771 )
...
* Update qcomgpsd.py
* Update url_file.py
* remove pycurl
* requests -> urllib3
* unused
* redundant
* fix import
* Revert "requests -> urllib3"
This reverts commit 7ca39e618917986f50356519d2795a432e3a5280.
* headless
* fix trail
* use requests.exceptions.RequestException
* use fp.tell
* fix indents
* reorder imports
* change timeout
* fix debug timing
* remove exception
* add timeout
* missing headers
* move to constructor
* move import
* unused import
* fix debug
* try
* no retries
old-commit-hash: 70624ffc819c29d842cb68fd86f42eac95421b10
2023-12-17 16:25:25 -08:00
e91032efb3
replace common.file_helpers.mkdirs_exists_ok with python os.makedirs funtion ( #30618 )
...
replace common.file_helpers.mkdirs_exists_ok with python os.makedirs function
old-commit-hash: db35dcd0b5353d9c009fcf5817e611125a6b0b8b
2023-12-06 09:55:29 -08:00
661132be5a
Pytest: more post-test path cleanup ( #30556 )
...
* test cleanup
* missed this one
* remove that
* static class
old-commit-hash: 4086795c29bacd245a7cc372a16730e1a6ff974f
2023-11-30 09:55:48 -08:00
6f51ee8267
URLFile: exception type for failed requests ( #30330 )
...
URLFileException for URLFile request errors
old-commit-hash: c27e977475e33e19c8042dfead745f5cbc1ad9ee
2023-10-25 16:20:12 -07:00
a544533476
framereader: eliminate tempfile usage ( #30289 )
...
old-commit-hash: 68acb26aa2dde973bd7a8b48dca4fa8a06d79fe3
2023-10-18 19:48:26 -07:00
99d094a006
fix ffprobe on device ( #30286 )
...
* fix ffprobe on device
* use FileReader
* no more requests
old-commit-hash: 59e947dc6c70f515e887cc2e09ed2ea0b39fa679
2023-10-18 18:31:14 -07:00
Justin Newberry