Commit Graph

411 Commits

Author SHA1 Message Date
Willem Melching c6f2700ac3 qt ui add gitignore to release
old-commit-hash: 52035170578ccdf0b70da7a481731e3e794fe36e
2021-03-26 14:57:01 +01:00
Adeeb Shihadeh 099baadff9 add prebuilt text window to release files
old-commit-hash: f2763a7ce3fbfbbf414b833946ec681da50b99b5
2021-03-25 19:47:53 -07:00
Greg Hogan 183d9f98a1 log to file and send through athena (#20250)
* log to file and send through athena

* rename logging level

* pass thru log formatter

* logMessage is TEXT

* send queue always strings

* switch to xattr and lower priority queue

* enable cloud logging for devices

* time or size based log rotation

* basename -> dirname

* remove HARDWARE.get_cloudlog_enabled

* fix errors

* fix another exception

* xattrs need to be bytes

* sending works

* cleanup files at start

* add id and adjust formatting

* do not send active log file

* better names

* separate log formatters

* fix formatter super init

* fix log file order

* ensure file always has file formatter

* i see why there was no formatter

* apply same formatting to cpp log msgs

* apply same formatting to cpp log msgs

* update queue names in tests

* strip deprecated keys in STATUS_PACKET

* strip DEPRECATED from dict recursively

* athena log queue test

* instanceof instead of type

* isinstance instead of type

* use super

* remove logentries

* last_scan param unused

* comment about special log msg attr names

* add dict_helpers.py to release files

* use monotonic time and counter for log rotation

* update for adjusted log file naming

* use monotonic clock for tracking last log file scan
old-commit-hash: 3d48bd934d6c84a5352c2a1d56e6f93ed59e28c4
2021-03-25 13:30:09 -07:00
Willem Melching f1e9dda1ec add spinner to release files
old-commit-hash: dcc77451c4c0e6b97c023d1fad6e2076435e3e77
2021-03-25 17:43:24 +01:00
Adeeb Shihadeh 51c13aa552 APK purge (#20446)
* purge begins

* release files

* remove those

* no more android

* only qt

* text and spinner

* neos update script

* update sounds

* update cpu usage

* all done

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: e76c80ffa1b6167fd69465c66f31fbe475762330
2021-03-24 14:30:41 -07:00
Adeeb Shihadeh 5fc14c8db3 Qt UI: power saving (#20456)
* c2 power saving

* clean that up

* that works

* add to hw

* set power

* release files

* add that

* include hw base

* pc joins the party

* util

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 49748d5dc109322f73b2abcbe6d5efa60a394750
2021-03-24 11:09:39 -07:00
Willem Melching 285e086d80 use scons to build panda fw (#20457)
* use scons to build panda fw

* add arm gcc to dockerfile

* install gcc on macOS

* pandad shutdown test is flaky and broken due to faster startup

* bump panda
old-commit-hash: 0e338d2b91f35af6a7222eeb414951cd88784092
2021-03-24 14:44:39 +01:00
Adeeb Shihadeh 0addefc40a remove legacy launch.sh script
old-commit-hash: c9275f262d219d8dab1c1c4d42f023d4d1e059e8
2021-03-18 18:30:29 -07:00
Willem Melching 379e4b2185 add latcontrol angle to release files
old-commit-hash: 63f1237e091119a703cf592de16ed1f67da6f6e9
2021-03-12 10:34:07 +01:00
Adeeb Shihadeh 1c930d1e9e UI HW Abstraction layer (#20301)
* start cpp hw abstraction layer

* cleanup

* only set brightness on change

* confirmation dialogs

* add to release files

* fix tici brightness

* using percentage now

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: d45550c4246aa2ad12082767e68326bf4015bd75
2021-03-10 22:51:50 -08:00
Willem Melching 4d6c98aa6b Add watchdog check to manager (#20277)
* this should work but doesnt

* Only offroad

* works

* make it work offorad

* reduce diff

* cleanup

* need util

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: a94ba4fb8b704a5462352af4501290f63c987754
2021-03-08 19:17:46 -08:00
Willem Melching c0098cec09 Manager cleanup (#20231)
* move manager in folder

* inital refactor

* call start

* small cleanup

* add comments

* use self.signal()

* order shouldnt matter

* newlines

* add helpers

* newlines

* add process config

* split out build part of manager

* this should fix most tests

* no sensord on pc

* dont start athena

* remove comment

* fix old athena test

* fix inject model

* fix test car models

* should be not none

* fix helpers exitcode

* ignore manage_athenad

* Use time.monotonic()

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* combine init, remove spinner

* move manager test

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 5a3b51130649356b14b24e3c82e014b3a0be95a8
2021-03-05 11:03:23 +01:00
Adeeb Shihadeh 41d6e5c021 bump cereal
old-commit-hash: a6b673e6a11f1b9c0f8900367cf48eae9ed4c8db
2021-02-11 17:28:28 -08:00
Adeeb Shihadeh af95c26b26 remove gpsd (#20027)
old-commit-hash: fe7f3f0ec6b66e42b26451e180e3cde241e749bb
2021-02-10 16:39:39 -08:00
Willem Melching 7c53d310ef add visionipc cython to release files
old-commit-hash: 4a724489c5a25a2f515795627af2f367fde99018
2021-02-09 17:29:00 +01:00
Adeeb Shihadeh 966945880b Cereal cleanup (#20003)
* start cleanup

* fan speed

* cleanup dm

* fix cereal

* hwType -> pandaType

* update refs

* update refs

* bump cereal

* freeSpacePercent

* cereal master
old-commit-hash: 000bd226aa9902da01e6010bf26762fca2c20df0
2021-02-03 19:57:30 -08:00
Adeeb Shihadeh 02788f3a0e skip dashcam3 build for now
old-commit-hash: 449e60cb82626e772060389724898fe0b4842957
2021-02-01 21:14:02 -08:00
Adeeb Shihadeh 33fa938674 need to build from here since we link against the absolute paths
old-commit-hash: 4dcb22f03f2aa61f1bb4e06f011c18e3af992185
2021-01-31 20:05:53 -08:00
Comma Device 8554408282 copy into installer/
old-commit-hash: 592f994c05d26f749de93eb1f0bccaa371e6ce88
2021-02-01 03:31:55 +00:00
Comma Device 94932b5871 copy continue.sh into release3
old-commit-hash: e069e7ca9873a06c087e6a2cfa2970f314e03e0c
2021-02-01 03:09:40 +00:00
Adeeb Shihadeh 162e363c02 build release3 (#19984)
* build release3

* copy agnos manifest

* build in jenkins

* nproc doesn't work

* no pandaextra

* revert that

* don't modify version from source

* build after tests

* restore the symlink

* only master

* remove apk

* revert that

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: a712a4bd9c2f3b403485fa8bf7a66e0ac48fa6e5
2021-01-31 18:49:34 -08:00
Dean Lee 06ac698691 OMXEncoder: remove pthread_mutex_t lock from member variables (#19948)
* remove mutex

* rebase master
old-commit-hash: 9a9641a296dcc0887d902412214510f0ff912fa2
2021-01-30 19:11:03 -08:00
Dean Lee da9b0e8baa remove cqueue, use class SafeQueue (#19774)
* class SafeQueue

* cleanup includes

* space

* add timeout

use try_poll

* add function empty() & size()

* class SafeQueue

* add timeout

use try_poll

* add function empty() & size()

* rebase master

* rebase master

* for loop

* fix bug
old-commit-hash: e6783f4d9f10a256a4c301eb1d1843d9e2a17ab6
2021-01-28 15:12:45 +01:00
Adeeb Shihadeh 05737dd550 move Qr code lib to phonelibs (#19871)
old-commit-hash: e54db636f7453665d5e8317d9c9fb4c54196dc3e
2021-01-21 11:17:21 -08:00
George Hotz 3484683199 Thneed load/save (#19700)
* start thneed load/save

* compiling

* fix loading

* build thneed model in scons

* don't hardcode /data/openpilot

* release files

* those too

* support for loading/saving binary kernels

* save binaries out of json band

* make binary a command line flag to the compiler

* need include assert

* fix shadowed common in SConscript

* cleanup run.h

* hmm, the recurrent buffer wasn't 0ed

* ugh, unique ptr

* remove power constraint, refactor record

* Revert "remove power constraint, refactor record"

This reverts commit bb6fa52db6df59cd9d6420a6f630430e35af8a5e.

* print on thneed stop

* fingers crossed for this one

* recorded

* just curious

* okay okay, pass tests?

* cleanups

* refactor wait

Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 59fac9fdc630fa78f520fc9a244f9f9cd39fa562
2021-01-19 18:08:31 -08:00
Dean Lee 57b1b4c456 loggerd: split bootlog to a separate program (#19831)
* bootlog

* blank lines

* move file_exists to util.h

* src = ['loggerd.cc']

* log_init_data

* Revert "src = ['loggerd.cc']"

This reverts commit 18a587023d75b3a3a54f1ceaf9cb31a51640a067.

* add bootlog to .gitignore

* use s->has_qlog instead of true

* add blank lines & remove extern C
old-commit-hash: f973c56a3695525442ac6c3e89c644b27cbeb384
2021-01-19 12:16:12 -08:00
Adeeb Shihadeh 9e1f524965 On-device onroad CI test (#19792)
* start onroad test

* cpu usage test works

* nice print

* run in jenkins

* pretty reliable

* bump loggerd cpu usgae

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 5a9769020d7031e31a7b80bfea0245a0b0fa238d
2021-01-16 18:11:53 -08:00
Dean Lee c3043515d8 text.c->text.cc (#19734)
old-commit-hash: c5c9b6f7123e573f6c3171c5d5843fcfc8af5dcd
2021-01-15 13:42:26 -08:00
Dean Lee 74dc639515 convert glutil.c to gltuil.cc & add class GLShader (#19720)
* c++ glutil

* function getUniformLocation

* rebase master
old-commit-hash: cef469cbed1d835e70e952d06e1fd8b4eabca450
2021-01-12 15:43:34 +01:00
Adeeb Shihadeh 9909060b4d Video Encoder abstraction (#19729)
old-commit-hash: a1c7f19fe46fe79d84543a9388f4b131fc42051b
2021-01-12 00:03:31 -08:00
Dean Lee 4c1919f41e merge utilpp.h into util.h (#19710)
old-commit-hash: 595830135bb79c8b23eb8339ae768ca7b6a822f8
2021-01-10 14:57:32 -08:00
Willem Melching 3f950832b9 VisionIPC 2.0 (#19641)
* Squashed vipc

* Update release files

* Remove else

* add visionipc to release files

* use poller in vipc receive

* opencl framework instead of lib on macos

* Fix camera webcam

* Fix opencl on mac in ui

* more webcam fixes

* typo in ui sconsfile

* Use cur_yuv_buf

* visionbuf c++ class

* Camera qcom was still using visionbuf_allocate

* Turn loggerd back on

* fix snapshot

* No build needed

* update test camerad

* no more release callback

* make encoder c++

* Revert "no more release callback"

This reverts commit e5707b07002fee665d0483d90713154efc2d70d4.

* fix exit handlers

* No need to check errno

* move release callback call

* s/VIPCBufExtra/VisionIpcBufExtra/g

* use non blocking connect

* ui use non blocking connect

* Lower condition variable wait time

* Snapshot cleanup

* bump cereal

* bump cereal
old-commit-hash: fb496c692a9ebdcda15069a8d4eb95734b587d68
2021-01-08 14:54:25 +01:00
Adeeb Shihadeh 1c2560352c loggerd cleanup (#19668)
old-commit-hash: 206d072bb4df0187b97c808f0a0478cbb9223976
2021-01-07 23:08:40 -08:00
Adeeb Shihadeh 5bbe4f3d52 manager tests + make all processes exit cleanly (#19595)
* manager tests

* logcatd exits cleanly

* sigint

* boardd

* multiple dbus connections hangs for some reason

* clocksd proclogd

* network type from thermal

* fix tests

* fix android logcatd

* fix mac

* fix mac proclogd

* move on device athena tests

* build first

* build first

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: ffa7e0cbdb0859751685caae1321d3ccf732fed9
2020-12-29 22:32:03 -08:00
Adeeb Shihadeh 0f22f60170 small ubloxd cleanup
old-commit-hash: c131f9db57ba92bdf69481757203a6ac72fac986
2020-12-19 15:05:40 -08:00
Adeeb Shihadeh 349429836c agnos updater (#2600)
* agnos updater

* add manifest

* fix path

* get manifest from overlay

* update manifest

* remove merge markers

* add streaming decompressor

* dont need read all

* Unsparsify

* Fix output filename

* Optimization

* cleanup

* Small cleanup

* Read manifest from merged overlay

* Write hash at end of partition

* Sync before writing hash

* Write bytes in file

* add manifest with image sizes

* Fix manifest path

* File was closed already

* Format string

* Put raw hash

* Read hashes in launch script

* update launch script

* should be agnos version

* fix slot

* Make sure we clear the hash

* Verify partition size

* move updated

* Standalone flasher

* Don't rely on ordering

* Get path

* Debug log

* Download agnos

* Info is enough

* update manifest

* Remove f

* Check downloader return code

* Exit on wrong manifest

* Fix typos

* Set pythonpath before hardware init

* move agnos into hardware folder

* remove comments

* Fix abstractmethod

Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: b276881fcdb95b6160bae23600ed204f521bdbb4
2020-12-18 13:17:12 +01:00
Adeeb Shihadeh b950cab874 HW abstraction layer (#19530)
* start hw refactor

* move that

* pins

* put that back
old-commit-hash: 8674b023bab2b44405139ceec5785a389f837682
2020-12-16 21:30:23 -08:00
Dean Lee 75e3d20dac convert loadyuv.c to loadyuv.cc (#2754)
old-commit-hash: d6eead25d0448d11c552d4d56a663e455deae720
2020-12-12 17:10:51 -08:00
Dean Lee 0066e93b34 covert rgb_to_yuv.c to rgb_to_yuv.cc (#2757)
old-commit-hash: 3d63b3d4149efb1e597d8d97790fddd28abdbde0
2020-12-12 16:52:15 -08:00
Dean Lee 9be81a6f99 clutil refactor (#2733)
* cleaup clutil.h

* clutil.c -> clutil.cc

* std::hash

* try simplify functions

* using namespace group help functions

* continue

* add function get_platform_info

* continue

* remove caching

* struct CLContext

* std::cout & CL_ERR_TO_STR

* remove CLU_NO_CACHE

* Revert "struct CLContext"

This reverts commit 882e413f227e4c1ba4bb83f956cc67739a189221.

* cl_get_error_string : remove undefied error codes

* replace all printf with std::cout

* util::read_file

* cleanup

* revert CL_ERR_TO_STR

* simplify

* add macro CL_ERR_TO_STR

* cl_get_error_string: fix undeclared errors

* log_size should not +1

* use std::stirng log

* apply review
old-commit-hash: 3c08d0f1f7e7c9f376fd69fd46067c6f6ff59d39
2020-12-11 13:05:32 +01:00
Adeeb Shihadeh fa147c5d6e add wifi to setup (#2604)
* add wifi to setup

* wifi looks better

* move widgets

* this looks ok

* small fixups

* fix relase tests
old-commit-hash: 6a2678aae7fa353617ec111bd46181cdc422e15b
2020-11-30 22:35:17 -08:00
Adeeb Shihadeh 0c87036b54 fix release build
old-commit-hash: db0d4cdd86569090154dab4c16a50b2578931a75
2020-11-26 16:15:59 -08:00
Adeeb Shihadeh 5447224a0b bump cereal again
old-commit-hash: 15456ad4a4d1421a796e60695db8696fdb98946a
2020-11-25 17:25:06 -08:00
Adeeb Shihadeh 86bc11f219 fix double awk
old-commit-hash: ce8a040cc2ea5b4a430c60962a9fa1dc0072d9de
2020-11-24 13:30:11 -08:00
Adeeb Shihadeh 24a4a30a61 fix release version tag
old-commit-hash: 51919ff2ff5eeb7a52fc8219d8ea0b785f723085
2020-11-24 13:13:09 -08:00
Willem Melching 215918c7d4 put hash in version (#2607)
old-commit-hash: 6c49c6a9f17cc2ee11607417bb3c17b8b9cdea3c
2020-11-23 21:32:16 +01:00
HaraldSchafer 008f37c749 Torch model (#2452)
* refactor draw model

* rebase master

* correct valid_len

* rename function

* rename variables

* white space

* rebase to master

* e16c13ac-927d-455e-ae0a-81b482a2c787

* start rewriting

* save proress

* compiles!

* oops

* many fixes

* seems to work

* fix desires

* finally cleaned

* wrong std for ll

* dont pulse none

* compiles!

* ready to test

* WIP does not compile

* compiles

* various fixes

* does something!

* full 3d

* not needed

* draw up to 100m

* fix segfault

* wrong sign

* fix flicker

* add road edges

* finish v2 packet

* Added pytorch supercombo

* fix rebase

* no more keras

* Hacky solution to the NCHW/NHWC incompatibility between SNPE and our frame data

* dont break dmonitoringd, final model 229e3ce1-7259-412b-85e6-cc646d70f1d8/430

* fix hack

* Revert "fix hack"

This reverts commit 5550fc01a7881d065a5eddbbb42dac55ef7ec36c.

* Removed axis permutation hack

* Folded padding layers into conv layers

* Removed the last pad layer from the dlc

* Revert "Removed the last pad layer from the dlc"

This reverts commit b85f24b9e1d04abf64e85901a7ff49e00d82020a.

* Revert "Folded padding layers into conv layers"

This reverts commit b8d1773e4e76dea481acebbfad6a6235fbb58463.

* vision model: 5034ac8b-5703-4a49-948b-11c064d10880/780  temporal model: 229e3ce1-7259-412b-85e6-cc646d70f1d8/430  with permute + pool opt

* fix ui drawing with clips

* ./compile_torch.py 5034ac8b-5703-4a49-948b-11c064d10880/780 dfcd2375-81d8-49df-95bf-1d2d6ad86010/450 with variable history length

* std::clamp

* not sure how this compiled before

* 2895ace6-a296-47ac-86e6-17ea800a74e5/550

* db090195-8810-42de-ab38-bb835d775d87/601

* 5m is very little

* onnx runner

* add onnxruntime to pipfile

* run in real time without using the whole CPU

* bump cereal;

* add stds

* set road edge opacity based on stddev

* don't access the model packet in paint

* convert mat.h to a c++ header file (#2499)

* update tests

* safety first

Co-authored-by: deanlee <deanlee3@gmail.com>
Co-authored-by: mitchell <mitchell@comma.ai>
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: George Hotz <george@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 08846b5c0ec3a5299c8cb73904da15a18d3aaccf
2020-11-11 20:31:46 -08:00
grekiki 0b902a02c1 Scons builder for cython extensions (#2485)
* complie boardd without python

* not good, but don't want to lose the file, because it works

* clean a bit

* update dbc

* should build on CI

* not good, but don't want to lose the file, because it works

* clean a bit

* should build on CI

* remove unneeded path

* reorder paths

* reduce diff

* and now it works?!

* ... should work in CI

* add kj, 30% chance to fix macos

* pydebug

* new way to find path

* fix :)

* tested

* sanity check

* repl. MacOS flags

* hope it works

* need more logs

* need more logs2

* test if it works

* should work on CI

* correct python file

* should not work

* cleanup

* real cleanup

* more removals

* 50% of file

* transformations

* fixed a hardcoded variable

* more logs

* simpl.

* kalman

* all donw if it passes tests

* cleanup

* reduce code by 20 lines if this works

* fix bugs

* cleanup

* SharedLibrary

* cleanup

* ...

* remove unused

* CI fix maybe?

* add more valid path

* more logs

* ...:

* fix webcam CI

* remove WError flag

* deprecated is not an error

* more Wno things

* reduce diff, add Wno to env

* don't import nonexistent stuff

* SharedLibrary v2

* less custom env

* renaming, remove SharedLibs

* pack libs in envCython

* experiment

* better docker caching

* whitespace

* more docker caching

* improvement

* improvements

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 9529764549b8c59f7cf141ff3d2d9613ab53beab
2020-11-11 21:14:51 +01:00
Willem Melching fc0b6f099f Revert "convert mat.h to a c++ header file (#2499)"
This reverts commit 607866bb60ba1c69c6f777082c5ea787e895a251.

old-commit-hash: f2c8a6122d881fbee5bbdd1cf16f8541ce33260b
2020-11-09 01:41:36 -08:00
Dean Lee 13a25b9e27 convert mat.h to a c++ header file (#2499)
old-commit-hash: 519c043a63c9286f55b5a4325604489da087957a
2020-11-09 01:19:09 -08:00