Commit Graph

128 Commits

Author SHA1 Message Date
Justin Newberry d487c0501f Ruff: enable most of bugbear (#29320)
* added mutable default args

* most of the Bs

* add comment about lrucache
old-commit-hash: 62c1e6592439119f360dd64b854e7047f35222ba
2023-08-11 15:33:49 -07:00
Justin Newberry 715f028a0e Ruff: enable flake8-builtins (#29315)
* enable flake8-builtins

* replace any with contains

* fix typo in pack

* fix type

* format is from the parent module, has to be enabled

* item_id

* fix item_id

* disable for id since that's what the remote server returns
old-commit-hash: 8793cbff40662a92bff16d75b51479c80517305a
2023-08-10 18:58:22 -07:00
Justin Newberry 3ee0786de3 CI: Pylint to ruff (#29294)
* pylint to riff

* pylint to riff

* pylint to riff

* revert more

* undo exclude removal

* exclude tinygrad

* set line length

* pylint exclusions to ruff

* same excludes as old linter

* fix tools QA

* remove unrequired check

* revert linting third_party

* ignore e402
old-commit-hash: 7fdd9fc37c1c5febf1cd3dc86441ebf0dec7f370
2023-08-09 13:26:54 -07:00
Justin Newberry 7b677910df Linter: Fix >160 line length test (#29287)
* test

* fix line length

* fix line length

* fix file size

* revert poetry

* cleanup for PR
old-commit-hash: cf64b27168614f851087adab2d7f766425922f64
2023-08-08 17:13:35 -07:00
Shane Smiskol 989c79d8d3 athenad: remove duplicate exception clause (#29220)
old-commit-hash: fbc56b6c733266c11935d8c63fd2a4d25e3f6a30
2023-08-03 10:23:38 -07:00
Shane Smiskol e833a10a42 athenad: update comment about timeout constant (#29216)
* in socket!

https://bugs.python.org/issue26273

* clean up

* ignore mypy bug

* comment

* just comment
old-commit-hash: 0f7b775884a85b6831e28bd4f0362ed3874aa67c
2023-08-03 04:24:51 -07:00
Shane Smiskol 8089a6e4f6 athenad test: use helper function (#29217)
old-commit-hash: b53bf005554d12a2503dd85799a875493dc3e5d4
2023-08-03 11:54:12 +01:00
Cameron Clough e65fb3123f athena: stricter socket timeout when onroad (#29017)
old-commit-hash: 4d10ba8af8fca860b6ccf11ff6fb3358a16ac4cc
2023-07-24 17:43:30 +01:00
Adeeb Shihadeh b0c3778aae agnos 8 (#28843)
* agnos 8

* update to python 3.11.4 (#27452)

* rebase

* optional

* lower cython

* TEMP don't pull cl to use python3.11

* Revert "lower cython"

This reverts commit c5132f8a2727c212bdfc01e77aa53e50a17ead9d.

* fix cython

* remove tensorrt

* carla + opencv

* macos

* update timm and smp

* pynvc

* https

* downgrade numpy

* pin scipy

---------

Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
Co-authored-by: Yassine <yassine.y10@gmail.com>

* revert that

* fix linter

---------

Co-authored-by: Maxime Desroches <desroches.maxime@gmail.com>
Co-authored-by: Yassine <yassine.y10@gmail.com>
old-commit-hash: 1945c356c2c127cfe1f2d1930e33f2f3af7a1eb4
2023-07-20 21:56:57 -07:00
Cameron Clough dcd74839f9 athenad: test connection timeout (#28864)
old-commit-hash: 915aec3f5c2a9321866ee79a69b59534c29234b9
2023-07-17 20:21:52 +01:00
Cameron Clough 077c687827 athenad: log connection retries and duration (#28888)
old-commit-hash: 9ecf98c4ce52dc8ecf7be7e7cb000370d78f1a72
2023-07-11 21:40:59 +01:00
Adeeb Shihadeh ee363d69e3 fix a bunch of python warnings (#28576)
* fix a bunch of python warnings

* fix that
old-commit-hash: 111b4eee30d3a8f79d082b78e9158cbe262f1a14
2023-06-16 13:22:30 -07:00
Adeeb Shihadeh 7c7276f3dd athena: raise log level for call method (#28334)
old-commit-hash: 7e141f25f9454d245e09bbdc8d7cc826e4095592
2023-05-29 14:46:15 -07:00
Cameron Clough 54afe04e2f athenad: add getGithubUsername method (#28025)
* athenad: add getGithubUsername method

* add test

* order
old-commit-hash: 09d25ad9997ae08c22a84310bec6e7d3821aa408
2023-04-26 20:42:43 -07:00
Adeeb Shihadeh 3a968c67e1 loggerd: move to system/ (#27534)
old-commit-hash: 94eb2159802d3dba99620db0b08731c68a7e4733
2023-03-08 11:20:49 -08:00
Cameron Clough c5cbd60a34 athenad: more types (#25877)
* add typing hints

* missed these

* revert functional changes and changes to uploader

* remove

* try any

* add types to test code

* try dataclass instead

* mypy needs this

* comments

* remove Any type

* remove unused method

* cleanup

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: e1c739f7091942cf4108b3cc3564c09a7b0404d7
2022-12-12 17:15:37 -08:00
Cameron Clough d3dbd91280 athenad: small tests cleanup (#26037)
* test helpers

* create file helper

* clearer

* type

* fix default create path

* static methods
old-commit-hash: 9e2a1121ea1103efaceaf52cca83370da73ba988
2022-10-17 12:55:40 -07:00
Cameron Clough 597b949813 networking: add unmetered cellular toggle (#25902)
* add metered toggle to UI

* add GsmMetered param

* add NMMetered constants

* change LTE connection settings: connection.metered

* change to GsmUnmetered override

* update translations

* debug ui

* remove comment

* Revert "debug ui"

This reverts commit 2ad9e65ea229b814782be9f30cc7664125d7e908.

* 'Force Unmetered Cellular' toggle

* update translations

* remove description

* update translations

* change unmetered to metered
old-commit-hash: f6119603912efa4fe28f5da21f3d57f6903a0c77
2022-10-01 14:47:06 -07:00
Adeeb Shihadeh 0325a33752 add pyside2 package (#25602)
old-commit-hash: c6b749fb96b3b6332fd850e733140357f84d53a4
2022-08-30 15:10:52 -07:00
Adeeb Shihadeh d9c279aea9 params: make python and c++ API match (#25573)
* params: make python and c++ API match

* few more
old-commit-hash: 90a4565eb29fe95fc83acf6e4f0ea0851c284d61
2022-08-26 20:46:19 -07:00
Willem Melching 5c97a090b6 athena: skip duplicate upload requests (#25062)
* athena: skip duplicate upload requests

* cleanup

* keep simple

* just ignore
old-commit-hash: 7e187426c7f02b8d63bce394f08219307e5900ca
2022-07-07 18:00:07 +02:00
Adeeb Shihadeh d9d83b0225 Move camerad to system/ (#24836)
* mv camerad

* add hardware symlink

* fix unit tests
old-commit-hash: 6123ab3d1c901ed3763e1a7cb8e1aac3f6b8fda3
2022-06-19 14:43:49 -07:00
Adeeb Shihadeh 3c48bc47b7 Move a bunch of stuff to system/ part 3 (#24829)
* move swaglog.py

* timezoned

* logmessaged

* version.py

* fix linter
old-commit-hash: 0fce5d90459b77bf2cfa70f55f322f0e1fb8d01c
2022-06-11 23:19:27 -07:00
Adeeb Shihadeh 9a45a3b99b Move selfdrive/hardware/ to system/ (#24725)
* move hardware to system/

* fix mypy
old-commit-hash: 1139fe507b01f34de9714c99228f411558b44231
2022-06-11 16:38:24 -07:00
Maykon Pacheco fe24326066 test for the strip_bz2_extension method (#24826)
old-commit-hash: 1847a70a47b12ff5c7e7db9361f69d6d1e79a919
2022-06-11 11:08:24 -07:00
Willem Melching 753045c73d less TICI when not needed (#24698)
* less TICI when not needed

* fix process replay

* move reading voltages into hw abstraction layer

* Update selfdrive/hardware/tici/hardware.h

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Update selfdrive/hardware/hw.h

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Update selfdrive/hardware/base.h

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* rename init function

* Update selfdrive/athena/athenad.py

Co-authored-by: Robbe Derks <robbe.derks@gmail.com>

* Update selfdrive/boardd/boardd.cc

* Apply suggestions from code review

* Update selfdrive/thermald/thermald.py

* update ref

* fix alert width if all cameras are bad

* add ecam to test_loggerd

* bump cereal

* bump cereal

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Robbe Derks <robbe.derks@gmail.com>
old-commit-hash: f49a9c9fd2100a4f1401a93d88064ddbbbd935c1
2022-06-02 15:20:51 +02:00
Adeeb Shihadeh 402a0800dd athena: remove redirect detection for old prime (#24662)
This worked on old magenta, but doesn't work on new magenta
or blue prime.
old-commit-hash: e38b93fc31f3ff89a3806675bc090c2149434cf7
2022-05-26 16:09:22 -07:00
Dylan Herman 2dfba97175 add mypy check for return-any (#24379)
* add mypy check for return-any

* remove unused import

* typing

* remove unnecessary variable typing

* cleanup

* cleanup

* bump submodules

* small fixes

* only a problem on mac

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: d2eef1955c777ef6110c7a74d2a9ca9e4e1d958c
2022-05-12 14:59:00 +02:00
grekiki 7cd23af9b1 Mypy fixes for --check-untyped-defs (#24372)
more type fixes
old-commit-hash: 17e33978cdd9322918e9d5d388f7fa47aa30e9b7
2022-05-12 14:08:11 +02:00
Willem Melching be08693d5c delay bz2 compression from logging to uploading (#24392)
* remove log_name

* log without compression

* fix tests

* remove extension for bootlog

* another test fix

* uploader compresses

* also compress in athena

* only compress qlog

* more generic check in do_upload

* fix bootlog compression

* lower loggerd cpu usage

* dont link against bz2

* set core affinity to little cluster

* handle old files
old-commit-hash: 77a6f3d034a7b17d70b750b9ea454310f4b8edf1
2022-05-03 14:09:17 +02:00
grekiki cc943ac9a5 mypy: enable --warn-unreachable (#24282)
* Optional solves mypy assuming None is always None

* oops

* spaces

* Update registration.py

* fix local error

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: b8b15d5cf1d2507c89bbe0e3b1de1ff043d9078e
2022-04-21 18:27:45 +02:00
Adeeb Shihadeh 709e683bf4 athena: fix random test failure (#24278)
old-commit-hash: 0fbb7a4673ae02a5d2efafabfdccba194a0a8ebf
2022-04-20 13:20:50 -07:00
Willem Melching 85aa5e2706 uploader: azure returns 401 for files already uploaded (#24141)
old-commit-hash: e7f23ceca252fb4c62819b29c38eaaa62d66ce39
2022-04-05 20:09:05 -07:00
Willem Melching 34e0b26dc4 athena.upload_handler.upload_start log retry count (#24139)
old-commit-hash: 714efe828a10b1c9cf5f4b37b96af13c3d9333a1
2022-04-05 17:57:01 -07:00
Willem Melching 2eded18267 C3: detect metered Android hotspot (#23734)
* C3: detect metered networks

* show in ui

* fix text layout

* bump cereal

* revert ui changes

* set networkMetered

* add athena method

* add metered logging to uploader

* use in athena uploader

* remove param

* use networkmanager properties to set cell to unmetered

* fix indentation

* no need to check

* bump cereal

* review

* bump cereal
old-commit-hash: da5a0c41a00e4de076c2846ed54049c3dff3bc5a
2022-03-09 11:36:52 +01:00
Robbe Derks eda2f8c090 Fix unmetered upload over cell (fix #23811) (#23820)
old-commit-hash: a6214ff3b10114f727c9ec89dfa0ac275979f62f
2022-02-22 13:01:53 +01:00
Robbe Derks 7ef4b9115f Param to allow upload over cellular (#23811)
* param to allow upload over cellular

* brackets to be consistent

* move outside loop

* fix tests

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 5f64f1c08906a06889617e88aecc2f8ae74b4f21
2022-02-21 12:17:47 +01:00
Willem Melching 8788555f10 athena: expire items after 31 days (#23751)
* athena: expire items after 31 days

* add test
old-commit-hash: f03549c276e3877081273c713470e5184ef07ff5
2022-02-11 13:52:44 +01:00
Willem Melching a7fa889605 improve logging around uploading (#23750)
* improve logging around uploading

* use int

* use raw

* duplicate
old-commit-hash: 7765bc216677026d7b8919525eff310716fd3e7d
2022-02-11 12:58:41 +01:00
Willem Melching 48a9bd55c6 athena: specify network type for file uploads (#23687)
* athena: specify network type for file uploads

* add comment

* catch abort transfer

* fix tests

* put athena upload args in dict

* fix defaults

Co-authored-by: Joost Wooning <jwooning@gmail.com>
old-commit-hash: e9153fdb4b66c8175e4c0363ae74da6505348098
2022-02-09 17:28:49 +01:00
Willem Melching db3eef978f athena: add suport for download bandwith setting (#23727)
* athena: add suport for download bandwith setting

* clean ingress rules
old-commit-hash: 0d099e07aa1b16e2df5034835c1a6be3a721caa0
2022-02-08 12:07:11 +01:00
Willem Melching fb18d7b789 Add setUploadLimit method to athena (#23693)
* Add setUploadLimit method to athena

* add comments

* move to hw abstraction layer

* move to hw

* better errors
old-commit-hash: 4c406cdbe5c702d50a93410adf9d2d5b7f1b987a
2022-02-07 16:55:16 +01:00
Adeeb Shihadeh d17f80fa2d don't show registration error on pc
old-commit-hash: 52d4189e96e827d85ede52a557f7a8e940945a11
2022-01-29 18:10:41 -08:00
Adeeb Shihadeh eac8bd839a sentry improvements (#23627)
* sentry: filter out unregistered devices and PC

* add daemon name
old-commit-hash: 8b5b0ae3415e1ea44a1eecb6e70cec16b0fb1565
2022-01-26 11:44:10 -08:00
Ryan d947f4ff5b athena: unsuccessful upload handler requests. (#23620)
* Retry unsuccessful upload handler requests.

* test both cases

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 1d4191956b117483a32e5fe217ff78a612976a80
2022-01-26 15:23:59 +01:00
Robbe Derks 323febbf37 Statsd (#23413)
* device side of statsd

* need to start it

* enable in manager

* add sleep

* cleanup

* remove aggregates for now and standardize on industry terms

* manager needs main

* need to have a try/except

* atomic_write_on_fs_tmp does not work

* cleaner

* use dump

Co-authored-by: Willem Melching <willem.melching@gmail.com>

* one file at a time

* limit amount of files

* move to influx line protocol and cleanup

* needs to be a list

* fix timezone bug

* actually rate limit

* add to release

* normalized origin

* also log deviceType

* more stats

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 1b49ce6ec401966b0c56f62ea2b71209e9d4075b
2022-01-10 15:21:48 +01:00
Cameron Clough dbbdcb32d1 fix typo in athena/registration.py (#23434)
old-commit-hash: 1de0757c5e7dba1ea9696cbed80f871c8965c1c4
2022-01-06 16:11:32 -08:00
Joost Wooning ce94c27569 athena: uploads, show which items fail on error (#23412)
* athena: uploads, show which items fail on error

* fix upload-id

* no more 404

* Update selfdrive/athena/athenad.py

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 3ffebf4df5063e926ce530453f202cd7de4a6f99
2022-01-05 18:18:11 +01:00
Joost Wooning dd05972019 athena: methods for adding and cancelling multiple upload requests (#23366)
* multiple upload cancel

* multiple uploads athena method

* cleanup

* cleanup

* more cleanup

* isnt used

* fix test

* actually fix test
old-commit-hash: 47bb62b875fe2099a7a99482767bbd99b478f9e5
2022-01-04 17:01:33 +01:00
Ewout ter Hoeven f206ebd054 Pyupgrade 3.6: Update syntax with Python 3.6+ features (#23305)
Updated Python code with Python 3.6+ features:
- utf-8 encoding is now the default (PEP 3120)
- Replace list comprehensions by Generator Expressions (PEP 289)
- Replace yield loop by yield from (PEP 380)
- Remove the (object) subclass when defining a class
- Replace the IOError alias by OSError (PEP 3151)
- Define sets with curly braces {} instead of set()
- Remove "r" parameter from open function, which is default

Co-Authored-By: Adeeb Shihadeh <8762862+adeebshihadeh@users.noreply.github.com>
Co-Authored-By: GregorKikelj <96022003+GregorKikelj@users.noreply.github.com>

Co-authored-by: Adeeb Shihadeh <8762862+adeebshihadeh@users.noreply.github.com>
Co-authored-by: GregorKikelj <96022003+GregorKikelj@users.noreply.github.com>
old-commit-hash: 332f568a8241fba9459cb70c76840b9670e6993a
2021-12-24 11:18:39 -08:00