Commit Graph

93 Commits

Author SHA1 Message Date
Robbe Derks eda2f8c090 Fix unmetered upload over cell (fix #23811) (#23820)
old-commit-hash: a6214ff3b10114f727c9ec89dfa0ac275979f62f
2022-02-22 13:01:53 +01:00
Robbe Derks 7ef4b9115f Param to allow upload over cellular (#23811)
* param to allow upload over cellular

* brackets to be consistent

* move outside loop

* fix tests

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 5f64f1c08906a06889617e88aecc2f8ae74b4f21
2022-02-21 12:17:47 +01:00
Willem Melching 8788555f10 athena: expire items after 31 days (#23751)
* athena: expire items after 31 days

* add test
old-commit-hash: f03549c276e3877081273c713470e5184ef07ff5
2022-02-11 13:52:44 +01:00
Willem Melching a7fa889605 improve logging around uploading (#23750)
* improve logging around uploading

* use int

* use raw

* duplicate
old-commit-hash: 7765bc216677026d7b8919525eff310716fd3e7d
2022-02-11 12:58:41 +01:00
Willem Melching 48a9bd55c6 athena: specify network type for file uploads (#23687)
* athena: specify network type for file uploads

* add comment

* catch abort transfer

* fix tests

* put athena upload args in dict

* fix defaults

Co-authored-by: Joost Wooning <jwooning@gmail.com>
old-commit-hash: e9153fdb4b66c8175e4c0363ae74da6505348098
2022-02-09 17:28:49 +01:00
Willem Melching db3eef978f athena: add suport for download bandwith setting (#23727)
* athena: add suport for download bandwith setting

* clean ingress rules
old-commit-hash: 0d099e07aa1b16e2df5034835c1a6be3a721caa0
2022-02-08 12:07:11 +01:00
Willem Melching fb18d7b789 Add setUploadLimit method to athena (#23693)
* Add setUploadLimit method to athena

* add comments

* move to hw abstraction layer

* move to hw

* better errors
old-commit-hash: 4c406cdbe5c702d50a93410adf9d2d5b7f1b987a
2022-02-07 16:55:16 +01:00
Adeeb Shihadeh d17f80fa2d don't show registration error on pc
old-commit-hash: 52d4189e96e827d85ede52a557f7a8e940945a11
2022-01-29 18:10:41 -08:00
Adeeb Shihadeh eac8bd839a sentry improvements (#23627)
* sentry: filter out unregistered devices and PC

* add daemon name
old-commit-hash: 8b5b0ae3415e1ea44a1eecb6e70cec16b0fb1565
2022-01-26 11:44:10 -08:00
Ryan d947f4ff5b athena: unsuccessful upload handler requests. (#23620)
* Retry unsuccessful upload handler requests.

* test both cases

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 1d4191956b117483a32e5fe217ff78a612976a80
2022-01-26 15:23:59 +01:00
Robbe Derks 323febbf37 Statsd (#23413)
* device side of statsd

* need to start it

* enable in manager

* add sleep

* cleanup

* remove aggregates for now and standardize on industry terms

* manager needs main

* need to have a try/except

* atomic_write_on_fs_tmp does not work

* cleaner

* use dump

Co-authored-by: Willem Melching <willem.melching@gmail.com>

* one file at a time

* limit amount of files

* move to influx line protocol and cleanup

* needs to be a list

* fix timezone bug

* actually rate limit

* add to release

* normalized origin

* also log deviceType

* more stats

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 1b49ce6ec401966b0c56f62ea2b71209e9d4075b
2022-01-10 15:21:48 +01:00
Cameron Clough dbbdcb32d1 fix typo in athena/registration.py (#23434)
old-commit-hash: 1de0757c5e7dba1ea9696cbed80f871c8965c1c4
2022-01-06 16:11:32 -08:00
Joost Wooning ce94c27569 athena: uploads, show which items fail on error (#23412)
* athena: uploads, show which items fail on error

* fix upload-id

* no more 404

* Update selfdrive/athena/athenad.py

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 3ffebf4df5063e926ce530453f202cd7de4a6f99
2022-01-05 18:18:11 +01:00
Joost Wooning dd05972019 athena: methods for adding and cancelling multiple upload requests (#23366)
* multiple upload cancel

* multiple uploads athena method

* cleanup

* cleanup

* more cleanup

* isnt used

* fix test

* actually fix test
old-commit-hash: 47bb62b875fe2099a7a99482767bbd99b478f9e5
2022-01-04 17:01:33 +01:00
Ewout ter Hoeven f206ebd054 Pyupgrade 3.6: Update syntax with Python 3.6+ features (#23305)
Updated Python code with Python 3.6+ features:
- utf-8 encoding is now the default (PEP 3120)
- Replace list comprehensions by Generator Expressions (PEP 289)
- Replace yield loop by yield from (PEP 380)
- Remove the (object) subclass when defining a class
- Replace the IOError alias by OSError (PEP 3151)
- Define sets with curly braces {} instead of set()
- Remove "r" parameter from open function, which is default

Co-Authored-By: Adeeb Shihadeh <8762862+adeebshihadeh@users.noreply.github.com>
Co-Authored-By: GregorKikelj <96022003+GregorKikelj@users.noreply.github.com>

Co-authored-by: Adeeb Shihadeh <8762862+adeebshihadeh@users.noreply.github.com>
Co-authored-by: GregorKikelj <96022003+GregorKikelj@users.noreply.github.com>
old-commit-hash: 332f568a8241fba9459cb70c76840b9670e6993a
2021-12-24 11:18:39 -08:00
Willem Melching 4b13d224bd manage_athenad.py: add daemon argument to launcher
old-commit-hash: d09cc197d11efa2181ce68ef4212cb9df5ee285c
2021-12-15 17:03:12 +01:00
Devin Leamy 20a2b9d0a2 athena: persist upload queue to disk (#22659)
* revert submodules

* lowercase

* addressed comments

* add test for cancelled uploads

* formatting

* catch all exceptions

* handle empty param

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 8cb83b29a6b0cb1e5081651e96745c425e7e31f9
2021-12-14 13:29:17 +01:00
Shane Smiskol ef38c36435 version.py: make function names more clear (#23216)
* rename a few version functions

* and is_prebuilt

* and some formatting 😊
old-commit-hash: b745a14ff71622fe1fe4c9c043c7d7694d23dc08
2021-12-14 12:15:13 +01:00
Joost Wooning 969e181cff nav: athena destination with name and details (#23155)
old-commit-hash: 4a73445ee5b78549f28755110e068268d9e56cd8
2021-12-08 14:40:31 +01:00
Adeeb Shihadeh 4d43279023 registration: remove key generation (#23111)
* registration: remove key generation

* add test
old-commit-hash: 9ceb1a15eb87ba9ea5d7c8dbcc176f2466c82338
2021-12-03 22:58:34 -08:00
Willem Melching 28dd415759 Do not run code on version.py import (#23063)
* Do not run code on version.py import

* fix athena
old-commit-hash: f7c46c694985456e569ce2313b29e43607c62a12
2021-11-29 19:38:55 +01:00
Willem Melching e8b1e69ac1 remove broken athena test
old-commit-hash: 0e785021815cc573702ac537248bf53d24a7a18e
2021-11-11 17:32:26 +01:00
Willem Melching 8a0c57433e navigation: use mapbox proxy server (#22660)
* use mapbox proxy

* remove MapboxToken param

* do not log jwt

* remove import

* move to staging url

* put has_prime in ui state

* logic was flipped

* Update selfdrive/ui/qt/maps/map.h
old-commit-hash: cca07c0c730eb6e0d8dab0bde099a2ed706d14de
2021-10-26 18:59:17 +02:00
Willem Melching f78eacb3a5 athena: listUploadQueue, check None first
old-commit-hash: bde568205e5fe930d99fa4a7f16830077e962c15
2021-10-21 11:15:09 +02:00
Devin Leamy 5b5269cb06 athena: Do not show canceled upload items in listUploadQueue (#22627)
* do not show canceled upload items in listUploadQueue

* return item._asdict()

* athena: updated test for listUploadQueue
old-commit-hash: 12165c8865d8534e133af483cd15d7dfb3a0579a
2021-10-20 16:16:05 +02:00
Adeeb Shihadeh ad96d0d130 move athena tests to github actions (#22475)
* move athena tests to actions

* run

* fix timeout
old-commit-hash: de7a9e01160399228c30795769dc1ec6039cb8f4
2021-10-07 13:22:14 -07:00
Adeeb Shihadeh e9cd2a5561 need a jwt for those tests
old-commit-hash: f7bd264db888e2250a425c2a9249fc37ba539818
2021-08-19 15:48:26 -07:00
Adeeb Shihadeh 4da8cf4f31 athena: hardcode jwt for tests
old-commit-hash: 7e3d00206697ed552f8b3ae7018dd2c879906ee2
2021-08-19 14:19:14 -07:00
Greg Hogan 6cbe7f0749 athena: change test tearDown to setUp (#21935)
old-commit-hash: 1d64c18e499ee4ca51d8fca126488861e9943d4f
2021-08-14 22:27:22 -07:00
Greg Hogan b143411521 athena: split data into multiple frames (#21918)
old-commit-hash: a6debb999c1a4cd8e82ce71bdfb128d76f2923ef
2021-08-13 08:38:36 -07:00
Greg Hogan 9357587ace athena: add prefix param to listDataDirectory (#21906)
* athena: add prefix param to listDataDirectory

* only traverse directories that match prefix

* tests
old-commit-hash: 2dff84121e6966088c4941470a3d9fce12234d8f
2021-08-13 12:14:20 +02:00
Willem Melching dad760624a athena: return current upload status in listUploadQueue (#21903)
* return current upload item in listUploadQueue

* update progress on read

* move to file helpers

* use dict instead of global
old-commit-hash: 28823917ea87edebf66f568f15f965028b0a2ff5
2021-08-13 11:51:08 +02:00
Willem Melching 705988abb5 api_get: keep same api (#21838)
old-commit-hash: 267a0b343b0ad607ee0cddcf62de5e18966d4390
2021-08-03 15:33:41 +02:00
Dean Lee ceb40d8384 api: use API_HOST env variable everywhere (#21814)
* api base url to global constant

* update api/__init__.py
old-commit-hash: 543e019f715a7e485c7402d1e145dc8e81d43611
2021-08-03 13:49:49 +02:00
Willem Melching dd824ffe34 athenad: retry failed and timed out uploads (#21745)
* retry failed uploads

* test cleanup

* update comment

* also catch SSL error

* use defaults

* sleep in chunks
old-commit-hash: d5b6746ac55ec2947a7e7d14c12035168b73505d
2021-07-29 11:13:59 +02:00
Adeeb Shihadeh e8161a42ee athena: detect no prime (#21718)
* detect no prime

* show in sidebar

* revert timeout

* clear ping param

* fix typo

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 7b94cf0ca79e570dd217f164b0a0ca163566eea9
2021-07-26 13:50:58 -07:00
Greg Hogan 88f6e9e1d2 athenad: fix log sort (#21703)
* athenad: fix log sort

* add test for logs to send

* use temp dir for logs

* fix changing SWAGLOG_DIR

* better way to patch SWAGLOG_DIR

* fix grammar
old-commit-hash: 0964871239aed73d34ac7730d62d60139ecb1236
2021-07-24 20:11:29 -07:00
Joost Wooning f3a8d2a385 athena: primeActivated response (#21670)
old-commit-hash: d4e0e8c6cf97a4d0dd4bd6f6b105a59922c28c33
2021-07-22 13:48:27 +02:00
Adeeb Shihadeh 444649d4f6 show registration debug info after 60s (#21679)
* show registration debug info after 60s

* little nicer

* larch

* aarch

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 987abb31ddd7affb18f9d93153eb00cf3bfb9c23
2021-07-21 23:30:02 -07:00
Willem Melching 4c85b400c9 athena: primeActivated endpoint (#21623)
old-commit-hash: 51ee3be91a9290c4415c91e2a0b7ddb28c15d34f
2021-07-16 14:38:46 +02:00
Willem Melching cf2f6b964d Athena getNetworks method (#21597)
* add iwlist scan

* return using athena

* add lte

* add last one too

* unused

* add release files

* more compact

* typo

* remove debug code

* different file

* array

* rebase mistake
old-commit-hash: a7aa22253bf607c6cc3087b3e0471d6d1b52126b
2021-07-14 16:16:45 +02:00
Adeeb Shihadeh d38c75a726 more athena logging (#21558)
old-commit-hash: 49e316a34bc8fc025a8c8e71f8a91c32557ac976
2021-07-11 21:18:28 -07:00
Willem Melching 56b8bd1717 Athena: increase timeouts (#21316)
* fix typo in thread name

* bump send/upload timeout to 30 seconds
old-commit-hash: fc569694e9960d91dad8ed82b7d546b6b96b1c46
2021-06-17 19:20:41 +02:00
Willem Melching 6f757fdd60 Fetch mapbox token from API (#21136)
* delay widget creation until going onroad

* let athena fetch mapbox token

* only tici

* add token

* cleaner

* rename slots

* that was missing
old-commit-hash: 21be4434998476669c807c3d1ba9b25c1cbc495f
2021-06-07 12:14:08 +02:00
Greg Hogan 0401206b6b athenad: send log files one at a time (#21092)
old-commit-hash: 1a7b0dfb3c90d31668aefcb615cc7d38e03cd61b
2021-06-01 15:49:01 -07:00
Willem Melching a8c569f2da Add more logging to athena threads (#21086)
* add more logging to athena threads

* add debug to local proxy

* log athena method calls

* data is a json string
old-commit-hash: a065eb694242046c0863ba96a604e63aff2eabbe
2021-05-31 12:15:31 +02:00
Willem Melching 345d9abe7c Disable Sentry exceptions from athena (#21085)
old-commit-hash: 6a04baffc452c808635b145d40099a7e5dc34e05
2021-05-31 11:07:22 +02:00
Greg Hogan a86a549b5d athena: version endpoint (#21045)
* athena: version endpoint

* get_version function

* more explicit version validation
old-commit-hash: ea0f7e27979fc2e39909c778b75f138fd3113a3b
2021-05-26 18:33:27 -07:00
Willem Melching a46e3c5cb4 athena: log before trying to connect
old-commit-hash: 8f3e395a1fb65f812a0782b9808a9cac1c5b862c
2021-05-25 17:47:20 +02:00
Willem Melching c02d7a1061 athenad: set timeout when creating websocket
old-commit-hash: 466f5f091e23afdf899f4c7c40722b4ce7b544f2
2021-05-21 13:20:48 +02:00