3a637fe455
athenad: fix memory leak in _do_upload() ( #30237 )
...
* fix memory leak
* test: stash
* clean up
* clean up
* ruff
* rm
* add py memory profiler
* test compress and no compress
* proper test
* comment
---------
Co-authored-by: Shane Smiskol <shane@smiskol.com >
old-commit-hash: 61288dfe068e6127dcff64b8e7ac81844f7c31ff
2023-10-29 07:08:28 -10:00
61eb6f4f66
finish hardware move to system/ ( #30140 )
...
* finish hardware move to system/
* fix release
* couple more
old-commit-hash: c347096c3ee275ccedc3c39e1888c44d40f77a56
2023-10-02 16:49:07 -07:00
13381ed446
services: capitalize constant service list ( #30005 )
...
* rename
* bump
* Apply suggestions from code review
old-commit-hash: 7f073483bb2586053d6c5508ef3f420947941d90
2023-09-21 18:25:15 -07:00
759ab03b03
Ruff: disallow non-openpilot imports ( #29841 )
...
old-commit-hash: 110cfef1c2a56b333b684cd7ae98b321ae0e72eb
2023-09-08 10:43:02 -07:00
37e4b2cba9
CI: run unittests in parallel with xdist ( #29756 )
...
* parallel tests
* review suggesions
* add to pyproject
* add a bit more buffer on that
* fix rare athena issue
* remove from pypoetry
old-commit-hash: dde225221e8fa0063bb52786232be33b8374dfcd
2023-09-07 16:29:36 -07:00
c7029ea15a
System: cleanup paths to use a common class ( #29816 )
...
* use OP prefix for logmessage
* cleanup paths too
* cleanup the paths too
* add hw.py to release
* fix those issues
* fix unittests
* fix unittests
* fix unittests
* do swaglog_ipc properly across all the files
* fix that
* fix swaglog in c++
* review suggestions
old-commit-hash: bfe990b112a83f245bb5244553c84202aec7d86c
2023-09-07 11:32:47 -07:00
390ccdf632
athenad: update typing
...
old-commit-hash: 059cb0130dd5a6cc3b44495799abb491c668c4bb
2023-08-30 12:05:30 +01:00
16ec56398c
add openpilot prefix to imports ( #29498 )
...
* add openpilot prefix to imports
* more
* more
* fix docs
* fix linter
* bump submodules
* fix patched tests
* update dynamic imports
* debug
* Revert "debug"
This reverts commit db5e13b9911cc74438bee123bc3430da6c31b24b.
* fix pm test
old-commit-hash: a9626f95b69af19306143fc4def02fb5769405d2
2023-08-20 20:49:55 -07:00
51634f52dc
replace custom clock helpers with time module ( #29499 )
...
* replace custom clock stuff wtih time module
* fix double
* fix release
* bump cereal
* update type
* fix one more
old-commit-hash: d61f86d3398900ef01423d24cfdf897392a8efbb
2023-08-20 18:50:58 -07:00
d487c0501f
Ruff: enable most of bugbear ( #29320 )
...
* added mutable default args
* most of the Bs
* add comment about lrucache
old-commit-hash: 62c1e6592439119f360dd64b854e7047f35222ba
2023-08-11 15:33:49 -07:00
715f028a0e
Ruff: enable flake8-builtins ( #29315 )
...
* enable flake8-builtins
* replace any with contains
* fix typo in pack
* fix type
* format is from the parent module, has to be enabled
* item_id
* fix item_id
* disable for id since that's what the remote server returns
old-commit-hash: 8793cbff40662a92bff16d75b51479c80517305a
2023-08-10 18:58:22 -07:00
989c79d8d3
athenad: remove duplicate exception clause ( #29220 )
...
old-commit-hash: fbc56b6c733266c11935d8c63fd2a4d25e3f6a30
2023-08-03 10:23:38 -07:00
e833a10a42
athenad: update comment about timeout constant ( #29216 )
...
* in socket!
https://bugs.python.org/issue26273
* clean up
* ignore mypy bug
* comment
* just comment
old-commit-hash: 0f7b775884a85b6831e28bd4f0362ed3874aa67c
2023-08-03 04:24:51 -07:00
e65fb3123f
athena: stricter socket timeout when onroad ( #29017 )
...
old-commit-hash: 4d10ba8af8fca860b6ccf11ff6fb3358a16ac4cc
2023-07-24 17:43:30 +01:00
b0c3778aae
agnos 8 ( #28843 )
...
* agnos 8
* update to python 3.11.4 (#27452 )
* rebase
* optional
* lower cython
* TEMP don't pull cl to use python3.11
* Revert "lower cython"
This reverts commit c5132f8a2727c212bdfc01e77aa53e50a17ead9d.
* fix cython
* remove tensorrt
* carla + opencv
* macos
* update timm and smp
* pynvc
* https
* downgrade numpy
* pin scipy
---------
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com >
Co-authored-by: Yassine <yassine.y10@gmail.com >
* revert that
* fix linter
---------
Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com >
Co-authored-by: Yassine <yassine.y10@gmail.com >
old-commit-hash: 1945c356c2c127cfe1f2d1930e33f2f3af7a1eb4
2023-07-20 21:56:57 -07:00
dcd74839f9
athenad: test connection timeout ( #28864 )
...
old-commit-hash: 915aec3f5c2a9321866ee79a69b59534c29234b9
2023-07-17 20:21:52 +01:00
077c687827
athenad: log connection retries and duration ( #28888 )
...
old-commit-hash: 9ecf98c4ce52dc8ecf7be7e7cb000370d78f1a72
2023-07-11 21:40:59 +01:00
7c7276f3dd
athena: raise log level for call method ( #28334 )
...
old-commit-hash: 7e141f25f9454d245e09bbdc8d7cc826e4095592
2023-05-29 14:46:15 -07:00
54afe04e2f
athenad: add getGithubUsername method ( #28025 )
...
* athenad: add getGithubUsername method
* add test
* order
old-commit-hash: 09d25ad9997ae08c22a84310bec6e7d3821aa408
2023-04-26 20:42:43 -07:00
3a968c67e1
loggerd: move to system/ ( #27534 )
...
old-commit-hash: 94eb2159802d3dba99620db0b08731c68a7e4733
2023-03-08 11:20:49 -08:00
c5cbd60a34
athenad: more types ( #25877 )
...
* add typing hints
* missed these
* revert functional changes and changes to uploader
* remove
* try any
* add types to test code
* try dataclass instead
* mypy needs this
* comments
* remove Any type
* remove unused method
* cleanup
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
old-commit-hash: e1c739f7091942cf4108b3cc3564c09a7b0404d7
2022-12-12 17:15:37 -08:00
d9c279aea9
params: make python and c++ API match ( #25573 )
...
* params: make python and c++ API match
* few more
old-commit-hash: 90a4565eb29fe95fc83acf6e4f0ea0851c284d61
2022-08-26 20:46:19 -07:00
5c97a090b6
athena: skip duplicate upload requests ( #25062 )
...
* athena: skip duplicate upload requests
* cleanup
* keep simple
* just ignore
old-commit-hash: 7e187426c7f02b8d63bce394f08219307e5900ca
2022-07-07 18:00:07 +02:00
d9d83b0225
Move camerad to system/ ( #24836 )
...
* mv camerad
* add hardware symlink
* fix unit tests
old-commit-hash: 6123ab3d1c901ed3763e1a7cb8e1aac3f6b8fda3
2022-06-19 14:43:49 -07:00
3c48bc47b7
Move a bunch of stuff to system/ part 3 ( #24829 )
...
* move swaglog.py
* timezoned
* logmessaged
* version.py
* fix linter
old-commit-hash: 0fce5d90459b77bf2cfa70f55f322f0e1fb8d01c
2022-06-11 23:19:27 -07:00
9a45a3b99b
Move selfdrive/hardware/ to system/ ( #24725 )
...
* move hardware to system/
* fix mypy
old-commit-hash: 1139fe507b01f34de9714c99228f411558b44231
2022-06-11 16:38:24 -07:00
753045c73d
less TICI when not needed ( #24698 )
...
* less TICI when not needed
* fix process replay
* move reading voltages into hw abstraction layer
* Update selfdrive/hardware/tici/hardware.h
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
* Update selfdrive/hardware/hw.h
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
* Update selfdrive/hardware/base.h
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
* rename init function
* Update selfdrive/athena/athenad.py
Co-authored-by: Robbe Derks <robbe.derks@gmail.com >
* Update selfdrive/boardd/boardd.cc
* Apply suggestions from code review
* Update selfdrive/thermald/thermald.py
* update ref
* fix alert width if all cameras are bad
* add ecam to test_loggerd
* bump cereal
* bump cereal
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
Co-authored-by: Robbe Derks <robbe.derks@gmail.com >
old-commit-hash: f49a9c9fd2100a4f1401a93d88064ddbbbd935c1
2022-06-02 15:20:51 +02:00
402a0800dd
athena: remove redirect detection for old prime ( #24662 )
...
This worked on old magenta, but doesn't work on new magenta
or blue prime.
old-commit-hash: e38b93fc31f3ff89a3806675bc090c2149434cf7
2022-05-26 16:09:22 -07:00
7cd23af9b1
Mypy fixes for --check-untyped-defs ( #24372 )
...
more type fixes
old-commit-hash: 17e33978cdd9322918e9d5d388f7fa47aa30e9b7
2022-05-12 14:08:11 +02:00
be08693d5c
delay bz2 compression from logging to uploading ( #24392 )
...
* remove log_name
* log without compression
* fix tests
* remove extension for bootlog
* another test fix
* uploader compresses
* also compress in athena
* only compress qlog
* more generic check in do_upload
* fix bootlog compression
* lower loggerd cpu usage
* dont link against bz2
* set core affinity to little cluster
* handle old files
old-commit-hash: 77a6f3d034a7b17d70b750b9ea454310f4b8edf1
2022-05-03 14:09:17 +02:00
709e683bf4
athena: fix random test failure ( #24278 )
...
old-commit-hash: 0fbb7a4673ae02a5d2efafabfdccba194a0a8ebf
2022-04-20 13:20:50 -07:00
85aa5e2706
uploader: azure returns 401 for files already uploaded ( #24141 )
...
old-commit-hash: e7f23ceca252fb4c62819b29c38eaaa62d66ce39
2022-04-05 20:09:05 -07:00
34e0b26dc4
athena.upload_handler.upload_start log retry count ( #24139 )
...
old-commit-hash: 714efe828a10b1c9cf5f4b37b96af13c3d9333a1
2022-04-05 17:57:01 -07:00
2eded18267
C3: detect metered Android hotspot ( #23734 )
...
* C3: detect metered networks
* show in ui
* fix text layout
* bump cereal
* revert ui changes
* set networkMetered
* add athena method
* add metered logging to uploader
* use in athena uploader
* remove param
* use networkmanager properties to set cell to unmetered
* fix indentation
* no need to check
* bump cereal
* review
* bump cereal
old-commit-hash: da5a0c41a00e4de076c2846ed54049c3dff3bc5a
2022-03-09 11:36:52 +01:00
eda2f8c090
Fix unmetered upload over cell ( fix #23811 ) ( #23820 )
...
old-commit-hash: a6214ff3b10114f727c9ec89dfa0ac275979f62f
2022-02-22 13:01:53 +01:00
7ef4b9115f
Param to allow upload over cellular ( #23811 )
...
* param to allow upload over cellular
* brackets to be consistent
* move outside loop
* fix tests
Co-authored-by: Willem Melching <willem.melching@gmail.com >
old-commit-hash: 5f64f1c08906a06889617e88aecc2f8ae74b4f21
2022-02-21 12:17:47 +01:00
8788555f10
athena: expire items after 31 days ( #23751 )
...
* athena: expire items after 31 days
* add test
old-commit-hash: f03549c276e3877081273c713470e5184ef07ff5
2022-02-11 13:52:44 +01:00
a7fa889605
improve logging around uploading ( #23750 )
...
* improve logging around uploading
* use int
* use raw
* duplicate
old-commit-hash: 7765bc216677026d7b8919525eff310716fd3e7d
2022-02-11 12:58:41 +01:00
48a9bd55c6
athena: specify network type for file uploads ( #23687 )
...
* athena: specify network type for file uploads
* add comment
* catch abort transfer
* fix tests
* put athena upload args in dict
* fix defaults
Co-authored-by: Joost Wooning <jwooning@gmail.com >
old-commit-hash: e9153fdb4b66c8175e4c0363ae74da6505348098
2022-02-09 17:28:49 +01:00
db3eef978f
athena: add suport for download bandwith setting ( #23727 )
...
* athena: add suport for download bandwith setting
* clean ingress rules
old-commit-hash: 0d099e07aa1b16e2df5034835c1a6be3a721caa0
2022-02-08 12:07:11 +01:00
fb18d7b789
Add setUploadLimit method to athena ( #23693 )
...
* Add setUploadLimit method to athena
* add comments
* move to hw abstraction layer
* move to hw
* better errors
old-commit-hash: 4c406cdbe5c702d50a93410adf9d2d5b7f1b987a
2022-02-07 16:55:16 +01:00
d947f4ff5b
athena: unsuccessful upload handler requests. ( #23620 )
...
* Retry unsuccessful upload handler requests.
* test both cases
Co-authored-by: Willem Melching <willem.melching@gmail.com >
old-commit-hash: 1d4191956b117483a32e5fe217ff78a612976a80
2022-01-26 15:23:59 +01:00
323febbf37
Statsd ( #23413 )
...
* device side of statsd
* need to start it
* enable in manager
* add sleep
* cleanup
* remove aggregates for now and standardize on industry terms
* manager needs main
* need to have a try/except
* atomic_write_on_fs_tmp does not work
* cleaner
* use dump
Co-authored-by: Willem Melching <willem.melching@gmail.com >
* one file at a time
* limit amount of files
* move to influx line protocol and cleanup
* needs to be a list
* fix timezone bug
* actually rate limit
* add to release
* normalized origin
* also log deviceType
* more stats
Co-authored-by: Willem Melching <willem.melching@gmail.com >
old-commit-hash: 1b49ce6ec401966b0c56f62ea2b71209e9d4075b
2022-01-10 15:21:48 +01:00
ce94c27569
athena: uploads, show which items fail on error ( #23412 )
...
* athena: uploads, show which items fail on error
* fix upload-id
* no more 404
* Update selfdrive/athena/athenad.py
Co-authored-by: Willem Melching <willem.melching@gmail.com >
old-commit-hash: 3ffebf4df5063e926ce530453f202cd7de4a6f99
2022-01-05 18:18:11 +01:00
dd05972019
athena: methods for adding and cancelling multiple upload requests ( #23366 )
...
* multiple upload cancel
* multiple uploads athena method
* cleanup
* cleanup
* more cleanup
* isnt used
* fix test
* actually fix test
old-commit-hash: 47bb62b875fe2099a7a99482767bbd99b478f9e5
2022-01-04 17:01:33 +01:00
f206ebd054
Pyupgrade 3.6: Update syntax with Python 3.6+ features ( #23305 )
...
Updated Python code with Python 3.6+ features:
- utf-8 encoding is now the default (PEP 3120)
- Replace list comprehensions by Generator Expressions (PEP 289)
- Replace yield loop by yield from (PEP 380)
- Remove the (object) subclass when defining a class
- Replace the IOError alias by OSError (PEP 3151)
- Define sets with curly braces {} instead of set()
- Remove "r" parameter from open function, which is default
Co-Authored-By: Adeeb Shihadeh <8762862+adeebshihadeh@users.noreply.github.com >
Co-Authored-By: GregorKikelj <96022003+GregorKikelj@users.noreply.github.com >
Co-authored-by: Adeeb Shihadeh <8762862+adeebshihadeh@users.noreply.github.com >
Co-authored-by: GregorKikelj <96022003+GregorKikelj@users.noreply.github.com >
old-commit-hash: 332f568a8241fba9459cb70c76840b9670e6993a
2021-12-24 11:18:39 -08:00
20a2b9d0a2
athena: persist upload queue to disk ( #22659 )
...
* revert submodules
* lowercase
* addressed comments
* add test for cancelled uploads
* formatting
* catch all exceptions
* handle empty param
Co-authored-by: Willem Melching <willem.melching@gmail.com >
old-commit-hash: 8cb83b29a6b0cb1e5081651e96745c425e7e31f9
2021-12-14 13:29:17 +01:00
969e181cff
nav: athena destination with name and details ( #23155 )
...
old-commit-hash: 4a73445ee5b78549f28755110e068268d9e56cd8
2021-12-08 14:40:31 +01:00
28dd415759
Do not run code on version.py import ( #23063 )
...
* Do not run code on version.py import
* fix athena
old-commit-hash: f7c46c694985456e569ce2313b29e43607c62a12
2021-11-29 19:38:55 +01:00
8a0c57433e
navigation: use mapbox proxy server ( #22660 )
...
* use mapbox proxy
* remove MapboxToken param
* do not log jwt
* remove import
* move to staging url
* put has_prime in ui state
* logic was flipped
* Update selfdrive/ui/qt/maps/map.h
old-commit-hash: cca07c0c730eb6e0d8dab0bde099a2ed706d14de
2021-10-26 18:59:17 +02:00
Dean Lee