d35cdb510d
Sync: commaai/msgq:master into sunnypilot/msgq:master
...
Sync: `commaai/opendbc:master` into `sunnypilot/opendbc:master`
Sync: `commaai/panda:master` into `sunnypilot/panda:master`
2024-08-03 21:22:09 -04:00
9474523add
Revert "uploader.py: simplify clear_locks by using rglob ( #32974 )"
...
This reverts commit cafca4f891
2024-08-03 12:12:42 -07:00
cafca4f891
uploader.py: simplify clear_locks by using rglob ( #32974 )
...
simplify clear_locks
2024-08-02 13:40:57 -07:00
2728c95b0d
uploader.py: ensure proper resource management with io.BytesIO ( #33108 )
...
* ensure proper resource management with io.BytesIO
* improve
2024-07-29 13:43:31 -07:00
1b3b5ab758
use zstandard library ( #33110 )
...
* use zstandard
* run 10
* bye bye
* this was a little overzealous
* clean up
2024-07-28 02:03:47 -07:00
7dec7c39be
uploader: compress with zstd ( #32736 )
...
* zstd uploader
* fix that
* fix name of function
* comment
* log failed
* fix comma_api_source for routes with both bz2 and zst rlogs
* TODO
* 10-14 achieves almost no benefit on qlogs in a few cases, but takes 2x the time
* these aren't written out
* regen: specify any list of sources
ooh this is pretty nice
* regen and process replay
* damn, actually we don't need all this (cool tho)
Revert "regen: specify any list of sources"
This reverts commit ceb0b4abed9ad463a9fe98d9b98a05875a52806f.
* just let it auto resolve
* fix athenad/uploader tests
* zst here too
* TODOs
* yes
* Revert "TODOs"
This reverts commit 8c7da1dbd0340c72290b5eb5563b642080ddc131.
* Revert "zst here too"
This reverts commit 23b0023ddfd22c8090be7a7caa09e7026a12aa5c.
* Revert "just let it auto resolve"
This reverts commit f296d62424227ad05facc62abc18a6f81b474e84.
* Revert "regen and process replay"
This reverts commit 0768330e96974a42616d229d159780619d049cd0.
* revert readme
* not in save_log either
* lfg
* Revert "lfg"
This reverts commit 3718559c6c4de7d1f0c80dc9f1a1d335fe679a89.
2024-07-26 19:33:35 -07:00
9e3f57d53e
Merge branch 'master' into SP-59-sync-priv-20240507
2024-05-09 15:48:29 -04:00
abb18380a1
Merge branch 'upstream/openpilot/master' into sync-20240502
...
# Conflicts:
# cereal
# common/params.cc
# opendbc
# panda
# selfdrive/car/chrysler/carcontroller.py
# selfdrive/car/honda/carstate.py
# selfdrive/car/honda/fingerprints.py
# selfdrive/car/honda/hondacan.py
# selfdrive/car/honda/interface.py
# selfdrive/car/honda/values.py
# selfdrive/car/hyundai/carcontroller.py
# selfdrive/car/hyundai/carstate.py
# selfdrive/car/hyundai/hyundaican.py
# selfdrive/car/hyundai/interface.py
# selfdrive/car/hyundai/values.py
# selfdrive/car/subaru/carstate.py
# selfdrive/car/subaru/interface.py
# selfdrive/car/torque_data/override.toml
# selfdrive/car/torque_data/params.toml
# selfdrive/car/toyota/carcontroller.py
# selfdrive/car/toyota/carstate.py
# selfdrive/car/toyota/interface.py
# selfdrive/car/toyota/toyotacan.py
# selfdrive/controls/lib/longitudinal_planner.py
# selfdrive/modeld/modeld.py
# selfdrive/monitoring/dmonitoringd.py
# selfdrive/ui/qt/onroad/annotated_camera.cc
Revert "remove STM32F2 sources (#1873 )"
This reverts commit 7bfba5ef
2024-05-04 23:49:28 -04:00
158e36976b
fix old route sorting ( #31787 )
...
* fix old route sorting
* cleanup
* Update system/loggerd/uploader.py
---------
Co-authored-by: Comma Device <device@comma.ai >
2024-03-07 19:22:06 -08:00
f588a0367b
Merge branch 'master' into sync-priv-20240227
...
# Conflicts:
# panda
# selfdrive/car/chrysler/values.py
# selfdrive/car/ford/carstate.py
# selfdrive/car/ford/interface.py
# selfdrive/car/ford/values.py
# selfdrive/car/interfaces.py
# selfdrive/car/nissan/values.py
# selfdrive/car/subaru/interface.py
# selfdrive/car/volkswagen/interface.py
# selfdrive/car/volkswagen/values.py
# selfdrive/controls/radard.py
# selfdrive/manager/process.py
# selfdrive/modeld/modeld.py
2024-02-27 21:22:16 -05:00
4124c4593f
Merge remote-tracking branch 'commaai/openpilot/master' into sync-20240224
...
# Conflicts:
# cereal
# opendbc
# panda
2024-02-26 16:39:04 -05:00
80da3aee14
mypy: use implicit-optional ( #31590 )
...
* mypy: set implicit-optional = true
* find and replace '| None = None' -> '= None' in function args
2024-02-25 13:29:18 -08:00
9aca2536aa
Merge branch 'upstream/openpilot/master' into sync-20240224
...
# Conflicts:
# selfdrive/car/subaru/values.py
2024-02-24 20:46:45 -05:00
995250ae49
use pyupgrade to update to new typing syntax ( #31580 )
...
* add pyupgrade hook
* run pyupgrade (pre-commit run -a)
* ruff --fix
* Revert "add pyupgrade hook"
This reverts commit 56ec18bb6b8602a0b612f3803d96cdad14b52066.
* revert changes to third_party/
* manual type fixes
* explicit Optional wrapping capnp objects
2024-02-24 16:41:23 -08:00
8eb043ec7d
Merge branch 'master' into sync-priv-20240220
...
# Conflicts:
# CHANGELOGS.md
# panda
# selfdrive/car/toyota/interface.py
# selfdrive/controls/controlsd.py
# selfdrive/manager/manager.py
# selfdrive/modeld/fill_model_msg.py
# selfdrive/modeld/modeld.py
2024-02-24 09:35:16 -05:00
8945fffab0
Merge branch 'upstream/openpilot/master' into sync-20240220
...
# Conflicts:
# cereal
# common/version.h
# selfdrive/controls/controlsd.py
# selfdrive/thermald/power_monitoring.py
2024-02-24 09:14:42 -05:00
1c794b710c
uploader: sleep more when no files in queue ( #31523 )
...
* uploader: sleep more when no files in queue
* fix test
2024-02-20 17:25:12 -08:00
75b38db870
Merge branch 'sync-20240201' into sync-priv-20240201
2024-02-07 22:49:01 -05:00
daae551ea8
Merge remote-tracking branch 'commaai/openpilot/master' into sync-20240201
2024-02-05 11:41:19 -05:00
2280ac50b7
uploader: restrict qcam upload on metered connctions ( #31047 )
...
* uploader: restrict qcam upload on metered connctions
* route requesting
* rename
* str
* cleanup
* strip dongle
* upload bookmarked segments
---------
Co-authored-by: Comma Device <device@comma.ai >
2024-01-17 21:41:58 -08:00
19630c5af9
uploader: delay uploading crash and boot logs on metered connections ( #31045 )
...
* uploader: delay uploading some files on metered connections
* just crash and boot for now
2024-01-17 17:43:41 -08:00
0b5fd7287e
uploader cleanup ( #31035 )
...
* Reapply "uploader cleanup" (#31033 )
This reverts commit 5e4df41b2f
2024-01-17 14:24:09 -08:00
5e4df41b2f
Revert "uploader cleanup" ( #31033 )
2024-01-17 11:07:38 -08:00
c6c6a441eb
uploader cleanup ( #31029 )
...
* cleanup
* startup cleanup
* step
* Update test_uploader.py
2024-01-16 19:54:07 -08:00
a1f53c70e6
uploader.py/listdir_by_creation: list directories only ( #30806 )
...
list only directories
Co-authored-by: Comma Device <device@comma.ai >
2023-12-26 16:05:45 -08:00
37351cbdc1
uploader: reduce max qlog/qcam size ( #30746 )
2023-12-14 22:30:46 -08:00
35f819c823
swaglog.py goes in common/ ( #30631 )
...
* swaglog.py goes in common/
* all of these go in release
* we'll even include the pyx
2023-12-06 17:27:51 -08:00
a1d36961cf
new msgs default to invalid ( #30587 )
...
* new msgs default to invalid
* fix lm
* set more valid
* update rest
* update refs
* fix logMessage
* more valids
* cleanup
* fix llk test
* pigeond is also valid
* more valids
2023-12-03 10:50:17 -08:00
c4ee64c0aa
Disable Onroad Upload: Cleanup
2023-10-31 00:27:53 -04:00
eb2a58185d
Merge branch 'upstream/openpilot/master'
...
# Conflicts:
# .pre-commit-config.yaml
# README.md
# cereal
# opendbc
# panda
# selfdrive/car/torque_data/override.yaml
2023-09-22 23:49:13 -04:00
bfe990b112
System: cleanup paths to use a common class ( #29816 )
...
* use OP prefix for logmessage
* cleanup paths too
* cleanup the paths too
* add hw.py to release
* fix those issues
* fix unittests
* fix unittests
* fix unittests
* do swaglog_ipc properly across all the files
* fix that
* fix swaglog in c++
* review suggestions
2023-09-07 11:32:47 -07:00
ebfe40b76a
Merge remote-tracking branch 'commaai/openpilot/master'
...
# Conflicts:
# .github/workflows/selfdrive_tests.yaml
# .pre-commit-config.yaml
# cereal
# opendbc
# panda
2023-09-06 23:58:35 -04:00
4e69937d0d
Precommit: ensure executable bit is set ( #29784 )
...
* precommit ensure executable
* exclude tinygrad
* bump submodules
* exclude tinygrad globally
2023-09-05 16:33:26 -07:00
9bc73b85ff
Merge remote-tracking branch 'commaai/openpilot/master'
...
# Conflicts:
# .github/workflows/selfdrive_tests.yaml
# .pre-commit-config.yaml
# README.md
# cereal
# common/version.h
# opendbc
# panda
# selfdrive/car/chrysler/carcontroller.py
# selfdrive/car/chrysler/carstate.py
# selfdrive/car/chrysler/interface.py
# selfdrive/car/gm/carstate.py
# selfdrive/car/honda/carstate.py
# selfdrive/car/hyundai/carcontroller.py
# selfdrive/car/hyundai/carstate.py
# selfdrive/car/hyundai/hyundaican.py
# selfdrive/car/hyundai/interface.py
# selfdrive/car/hyundai/radar_interface.py
# selfdrive/car/hyundai/values.py
# selfdrive/car/interfaces.py
# selfdrive/car/subaru/carcontroller.py
# selfdrive/car/subaru/carstate.py
# selfdrive/car/subaru/interface.py
# selfdrive/car/subaru/subarucan.py
# selfdrive/car/torque_data/override.yaml
# selfdrive/car/toyota/carcontroller.py
# selfdrive/car/toyota/carstate.py
# selfdrive/car/toyota/interface.py
# selfdrive/car/toyota/toyotacan.py
# selfdrive/car/volkswagen/carstate.py
# selfdrive/controls/lib/desire_helper.py
# selfdrive/controls/lib/longitudinal_planner.py
# selfdrive/monitoring/dmonitoringd.py
# selfdrive/thermald/power_monitoring.py
# system/loggerd/uploader.py
2023-09-05 11:50:47 -04:00
a9626f95b6
add openpilot prefix to imports ( #29498 )
...
* add openpilot prefix to imports
* more
* more
* fix docs
* fix linter
* bump submodules
* fix patched tests
* update dynamic imports
* debug
* Revert "debug"
This reverts commit db5e13b9911cc74438bee123bc3430da6c31b24b.
* fix pm test
2023-08-20 20:49:55 -07:00
4a9afd7554
Ruff: comprehensions conventions ( #29317 )
...
ignore c408
2023-08-10 16:40:30 -07:00
cf64b27168
Linter: Fix >160 line length test ( #29287 )
...
* test
* fix line length
* fix line length
* fix file size
* revert poetry
* cleanup for PR
2023-08-08 17:13:35 -07:00
6c2a58f2e9
Merge branch 'upstream/openpilot/master'
...
# Conflicts:
# cereal
# common/params.cc
# panda
# selfdrive/car/subaru/subarucan.py
# selfdrive/controls/lib/lateral_planner.py
# selfdrive/controls/lib/longitudinal_planner.py
2023-05-25 12:17:54 -04:00
7f7637f3e5
uploader: check upload key value ( #28206 )
...
* fix check
* tests
* fix test
* fix
* xattr truthy and falsy tests
---------
Co-authored-by: Cameron Clough <cameronjclough@gmail.com >
2023-05-16 21:55:24 -07:00
7126363093
uploader: log actual uploaded file size ( #28000 )
...
* uploader: log actual uploaded file size
The size will be less if compressed before uploading.
* cleanup
* fix return type
* add request to FakeResponse
* cleanup
* fix
2023-04-26 20:45:58 -07:00
8a61496937
Merge remote-tracking branch 'upstream/commaai/openpilot/master'
...
# Conflicts:
# .pre-commit-config.yaml
# cereal
# opendbc
# panda
# selfdrive/car/hyundai/carstate.py
# selfdrive/car/hyundai/interface.py
# selfdrive/car/toyota/interface.py
2023-04-25 01:10:56 -04:00
e03efa723b
uploader: add missing types
2023-04-21 23:06:47 -07:00
a27ce83b28
uploader: add typing ( #28001 )
...
* uploader: add typing
* fix types
2023-04-21 22:03:26 -07:00
b475e28087
Merge remote-tracking branch 'upstream/commaai/openpilot/master'
...
# Conflicts:
# cereal
# panda
# selfdrive/car/hyundai/interface.py
# selfdrive/car/toyota/carcontroller.py
2023-03-12 14:52:12 -04:00
94eb215980
loggerd: move to system/ ( #27534 )
2023-03-08 11:20:49 -08:00
Jason Wen