Commit Graph

66 Commits

Author SHA1 Message Date
HaraldSchafer 008f37c749 Torch model (#2452)
* refactor draw model

* rebase master

* correct valid_len

* rename function

* rename variables

* white space

* rebase to master

* e16c13ac-927d-455e-ae0a-81b482a2c787

* start rewriting

* save proress

* compiles!

* oops

* many fixes

* seems to work

* fix desires

* finally cleaned

* wrong std for ll

* dont pulse none

* compiles!

* ready to test

* WIP does not compile

* compiles

* various fixes

* does something!

* full 3d

* not needed

* draw up to 100m

* fix segfault

* wrong sign

* fix flicker

* add road edges

* finish v2 packet

* Added pytorch supercombo

* fix rebase

* no more keras

* Hacky solution to the NCHW/NHWC incompatibility between SNPE and our frame data

* dont break dmonitoringd, final model 229e3ce1-7259-412b-85e6-cc646d70f1d8/430

* fix hack

* Revert "fix hack"

This reverts commit 5550fc01a7881d065a5eddbbb42dac55ef7ec36c.

* Removed axis permutation hack

* Folded padding layers into conv layers

* Removed the last pad layer from the dlc

* Revert "Removed the last pad layer from the dlc"

This reverts commit b85f24b9e1d04abf64e85901a7ff49e00d82020a.

* Revert "Folded padding layers into conv layers"

This reverts commit b8d1773e4e76dea481acebbfad6a6235fbb58463.

* vision model: 5034ac8b-5703-4a49-948b-11c064d10880/780  temporal model: 229e3ce1-7259-412b-85e6-cc646d70f1d8/430  with permute + pool opt

* fix ui drawing with clips

* ./compile_torch.py 5034ac8b-5703-4a49-948b-11c064d10880/780 dfcd2375-81d8-49df-95bf-1d2d6ad86010/450 with variable history length

* std::clamp

* not sure how this compiled before

* 2895ace6-a296-47ac-86e6-17ea800a74e5/550

* db090195-8810-42de-ab38-bb835d775d87/601

* 5m is very little

* onnx runner

* add onnxruntime to pipfile

* run in real time without using the whole CPU

* bump cereal;

* add stds

* set road edge opacity based on stddev

* don't access the model packet in paint

* convert mat.h to a c++ header file (#2499)

* update tests

* safety first

Co-authored-by: deanlee <deanlee3@gmail.com>
Co-authored-by: mitchell <mitchell@comma.ai>
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: George Hotz <george@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 08846b5c0ec3a5299c8cb73904da15a18d3aaccf
2020-11-11 20:31:46 -08:00
Adeeb Shihadeh 2403db7084 stop sounds after going offroad
old-commit-hash: ffbd5e9f2d2660f6527219e4b4f2dc37aa475919
2020-10-27 14:05:13 -07:00
Adeeb Shihadeh 53b2a39a90 tap to wake with accelerometer (#2267)
old-commit-hash: 9e03c2e9293eadd6853382b1b5c7e853ddc808f1
2020-10-18 19:03:41 -07:00
Willem Melching 498ecbdf3c Params refactor, simplified (#2300)
* always c++

* Create C++ params class

* get works

* tests hang now

* passes tests

* cleanup string formatting

* handle interrupt in blocking read

* fix memory leak

* remove unused constructor

* Use delete_db_value directly

* Rename put -> write_db_value

* filename cleanup

* no semicolons in cython

* Update common/SConscript

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* add std::string version of delete_db_value

* This is handled

* cleanup encoding

* Add clear method to clear all

* add persistent params

* fix android build

* Should be called clear_all

* only import params when needed

* set params path on manager import

* recusrively create directories

* Fix function order

* cleanup mkdirp

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 2e182e5c574ea1468678b5fd8d0597e34ed5898d
2020-10-13 16:23:23 +02:00
Adeeb Shihadeh f27bdfbee7 UI: refactor light sensor (#2129)
* refactor light thread

* qcom low power mode

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 06cb2f963ddd3a1e25d592ac4d2d25358e69c94a
2020-10-03 20:58:46 -07:00
Adeeb Shihadeh be29b8f236 tici light sensor (#2238)
old-commit-hash: 2490be762ddb4c05d3ed8fc9c865138115d24666
2020-09-28 14:49:07 -07:00
Comma Device 934fce64ab wait 5s before showing waiting for controls
old-commit-hash: d6571aa633ba3a4602bcb1cf5f8cbad134e18c10
2020-09-09 13:19:20 -07:00
Adeeb Shihadeh 0ae5e7403e QT UI: sounds (#2078)
* move android into own dir

* fix name

* maybe this works? qt ui doesn't work on mac

* fix that

* pc sound works

* fix pc build

* lowercase

* that needs to be real_arch

* split into classes

* fix typo in lib

* Fix cycle alerts

* Add qt multimedia libs to install scripts

* Add ui/android folder

* Fix android build

* Raise exception if sound init fails

* add missing return

Co-authored-by: Willem Melching <willem.melching@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: acd1bde496904fbc0d97f4d89e630358c4d11f7f
2020-09-09 19:04:28 +02:00
Adeeb Shihadeh 8a5dfc571e Always keep display on with ignition (#2138)
* keep display on with ignition

* fix typo

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: e386133c4b8bc2c27de2291257d6441d930b00a7
2020-09-07 13:13:10 +02:00
Adeeb Shihadeh c3f623e432 UI vision refactor (#2115)
* refactor vision

* don't show slow frame message when in preview mode

* change draws to uint32_t

* set vision_seen=false after destroy

* remove vision_connect_thread

* refactor ui_update

* seelp 30ms when vision is not connected

* remove should_swap

* call ui_update_sizes before ui_draw

* rebase

* start bigger UI refactor

* don't need the touch fd

* fix qt build

* more cleanup

* more responsive

* more refactor

* fix for pc

* poll for frames

* lower CPU usage

* cleanup

* no more zmq

* undo that

* cleanup speed limit

* fix sidebar severity for athena status

* not aarch64

Co-authored-by: deanlee <deanlee3@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 848301b091af11e129ba6873f7d297d4890c562b
2020-09-03 16:32:55 -07:00
Willem Melching fff4680443 Fix camera view on PC
old-commit-hash: 01b30794518ef1e8d8a4315baf5678095f3a8283
2020-08-31 13:16:30 +02:00
Adeeb Shihadeh cb3f689e36 remove read_param_timeout (#2095)
* remove read_param_timeout

* missed that
old-commit-hash: 9cd5180b43e03f84adb870fa25c91428a18394e0
2020-08-27 19:24:51 -07:00
Adeeb Shihadeh d2cdd7706c UI cleanup (#2091)
* remove unused UI code

* these params aren't used anymore

* this is cleaner

* remove one more timeout

* read that from carParams

* only android needs pm

* fix that

* fix that

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 43e3ec1bc1ee0d7b8044c5cabbe4022c5ddc9783
2020-08-27 11:57:31 -07:00
Willem Melching 473fb11d34 Qt ui for PC (#2023)
* qt ui boilerplate

* this kinda works

* cleanup

* render inside other widget

* cleanup

* more cleanup

* Not needed

* Handle click

* Draw at 20Hz

* create paint.hpp

* move stuff around

* update sidebar

* Draw vision

* this works again

* add clickable settings button

* Only collapse sidebar when started

* always use qt on linux

* fix width

* scrollable area

* talk to NetworkManager

* code to add a connection

* params toggles

* small cleanup

* add qt5 to dockerfile

* Qt on mac

* Add qt to release files

* fix macos build

* nore more ifdefs needed

* add icons

* make a bit nicer

* Hide scrollbar

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: e115c514521c7705112bd0cb2e4bf865b536501a
2020-08-20 17:16:44 +02:00
Dean Lee ebd4f68cba ui: refactor model related functions (#2026)
* remove read_model

* remove structs for c-capnp

* remove duplicate #define from modeld

* add function fill_path_points

* fix Indentation

* use MODEL_PATH_DISTANCE instead of 192

* fix type

use validLen

* rename left_path_points&right_path_points to xxx_lane_points
old-commit-hash: f8ab6bd009410a9f7ab9c30ce7b72a82c6d2507b
2020-08-18 15:26:43 +02:00
Dean Lee 3e083c1074 remove duplicate call to getDMonitoringState (#1964)
old-commit-hash: 56e63bafa87995eb6795bd77df931a29bf89c684
2020-08-02 10:55:24 -07:00
Adeeb Shihadeh 069bd4061e Driver view refactor (#1869)
* quick driver view cleanup

* send at correct freq

* let manager handle that

* don't block starting on driver view

* fix UI hacks

* ui cleanup

* move driver view functionality into dmonitoringd

* dmonitoring thresholds shouldnt be in UI

* remove driver view file from release files

* timeout on frontview

* bump cereal
old-commit-hash: a7ee2a53a8a832f3678171403471380a9a72b9cb
2020-08-01 17:26:35 -07:00
Dean Lee b35f7909ba UI cleanup (#1941)
* remove unused variables

* remove unused variables
old-commit-hash: 2953ae28104c3ccde59a7659c25b853ea0421adc
2020-07-28 11:13:37 -07:00
Adeeb Shihadeh cdfb090c7a Wunused (#1841)
* enable Wunused, first pass

* unused stuff in snpe model

* these are used on phone

* handle sigint and sigterm in modeld

* fix phone build

* camera qcom

* QCOM build works

* delete unused camerad vars

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: eb1aa3d831fd0d7fffd9aacec1accb0a5bdb0304
2020-07-09 09:25:32 -07:00
Dean Lee 9c33f51990 remove offroadLayout from sm (#1846)
old-commit-hash: 11fbe85c1436c67bf9e42fdc5f7a6f36f9a837a0
2020-07-08 21:24:55 -07:00
Dean Lee fa06882a72 better update_offroad_layout_state (#1808)
apply review suggestion
old-commit-hash: 9de015f588352ef1a81be1139733eea0c927f19c
2020-07-03 12:52:43 -07:00
Adeeb Shihadeh 219b117c21 fix hardcoded frequencies in UI
old-commit-hash: 2f16349c4cffe592d9b97a37ded37e8215ed8892
2020-07-03 12:30:47 -07:00
Adeeb Shihadeh d10d3287a3 remove unused UI variables
old-commit-hash: e8259895f7d29b153aa2d5e9c86391f47413a133
2020-06-29 14:12:28 -07:00
Adeeb Shihadeh 3d56b4cc35 better alert when controls takes too long to start
old-commit-hash: f8ce6502a9d66008d3a90b521707c4d1cbc51756
2020-06-23 16:07:10 -07:00
Willem Melching 31e0931cee ui, fix vision_seen when starting with camerad already running
old-commit-hash: 99949cc27db23662bb97747ce911a99829e9cc15
2020-06-23 15:16:55 -07:00
Adeeb Shihadeh ab66589a46 fix engage/disengage sounds
old-commit-hash: 51b7dc0e385945faf0341c52b14555e75e804d04
2020-06-23 10:50:24 -07:00
Adeeb Shihadeh 4c19a49586 Fix some alert sounds not repeating (#1763)
* fix sounds not repeating

* fix PC build

* 3 loop

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: af22b282ff20201914a462488700971cfe32cb20
2020-06-22 19:22:02 -07:00
Adeeb Shihadeh dd3247d128 Alert when controls fails to start (#1750)
* alert when controls fails to start

* more friendly

* fix sound

* remove that

* just else

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 968443c545ab1443fb2aefe0583d414c384182a7
2020-06-19 19:28:56 -07:00
Dean Lee dffb9800ad Sound refactor (#1589)
* Soud refactor

* remove files from  files_common

* add timeout to set_volumn

* add param volume to init

* done

* test.cc

* fix typo

* add repeat param instead of loop

* revert submodule

* add member function currentSound

* remove function create_player from class member

* fix build error

fix repeat

* rename CHECK_RESULT to ReturnOnError

* set currentSound_ before posible err

* use std::map to initialize sound table

cleanup

cleanup

cleanup

fix bug in stop

change paramater name

* done

* remove function CreatePlayer, create player in init()

* resolve conflict

* remove sound test

* rebase

* remove whitespace

* Apply great review suggestion

* use player's SLVolumeItf interface to set volume

* use float

* leave the volume control the way it is
old-commit-hash: 8cacc14b3180e831ed4fa0782102f973efe8851f
2020-06-15 15:26:38 -07:00
George Hotz 5d069eb8c3 Fixups for Mac, and a bunch for PC (#1654)
* fix mac nui

* fix cereal

* builds on mac without warnings

* ui swap shouldn't be instant on pc

* camerad builds on mac

* modeld, and now everything, builds on mac

* ui draws pictures on mac now

* fix camerad shutdown

* support ui looping on pc

* python3 on that

* SCNu64 should be cross platform

* bump cereal and new apk

* clean up

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 344a9a369983f58fe1e71f84478ded5c766e0d1b
2020-06-11 18:21:59 -07:00
Dean Lee 0f9202c4b7 add set_brightness in framebuffer.h (#1659)
old-commit-hash: 8ad1135e80f93b19bb2f0a6b4c7531a9b5eb7d8a
2020-06-10 10:28:18 -07:00
Dean Lee 36ee93e0fe remove function is_leon (#1660)
old-commit-hash: 5fdb60d43e8d141c086d9c25f2235cfb18106a17
2020-06-08 17:24:55 -07:00
George Hotz 4b6c80336b Getting PC openpilot working again (#1650)
* fixup keras_runner to work and be nicer

* truncate the lane lines based on the valid len
old-commit-hash: 7770041f9201c4f84717435b7a585fd70a937923
2020-06-05 17:40:56 -07:00
Dean Lee 92b5c00d0e ui.cc: remove variables from UIScene, use event::Reader to get data (#1585)
* use struct to store lead status

* remove white space

* use RadarState::LeadData::Reader

* use reader to get thermal data

* use reader

* continue

* remove variables

reset submodules,fix some errors

reset submodules

revert

* remove s->scene.gps_planner_active

* modify

* cleanup

* done

* resolve conflict

* remove irrelevant comment

* remove white space
old-commit-hash: d720f28ecb35c06a5ffb6004e79d82c80707fcde
2020-06-05 15:33:45 -07:00
Willem Melching f9036398e8 ui.cc: read_db_value is not null terminated
old-commit-hash: 884b327374890358424c90d1fc20b459f599987e
2020-06-01 16:41:04 -07:00
Dean Lee 32fa3e26be Template version of read_param (#1593)
old-commit-hash: c9dbaf821c5654019dec0ac814c56ed54c3cacf3
2020-06-01 14:30:53 -07:00
Dean Lee 7db5410f10 UI: better read_model (#1586)
* update model struct inplace

* refer params

* pass path by refer
old-commit-hash: 108a13ead84ea5f06bba77d81cae371a08c020c6
2020-05-28 15:10:49 -07:00
Willem Melching 56bddd9105 Fix #1566, athena status flicker in sidebar
old-commit-hash: 4de2c57bd104b18557a0364f7b3e08aa1df45827
2020-05-26 13:41:02 -07:00
Willem Melching 91f1082394 -Werror (#1567)
* werror

* -Wno-inconsistent-missing-override

* Silence ffmpeg deprecation warnings

* add some more pragmas to ignore warnings

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 50f3f1d3357b356c5b1144c518f35375f5bb9924
2020-05-26 13:27:01 -07:00
Dean Lee 38e7d99d2f change light_sensor to atomic variable (#1560)
old-commit-hash: b3ab7ae3921e19c237284ec02683e739e68387f3
2020-05-26 09:59:49 -07:00
Willem Melching 7f0b3180a4 Use C++ version of SubMaster and PubMaster (#1548)
* add PubMaster & SubMaster

remove 'delete msg'

remove headers

* use constructor to initial all submster

* modify drain sockets

* fix typo in ssconscript.remove lines

no checkValid in loggerd

last modify

handle_message:event->&event

fix type

remove heads

event to auto

* new interface

* api changed

* Revert "use constructor to initial all submster"

This reverts commit 73be7ea46250a325ce41d3a0445e34395a2ae692.

* change to new api

* revert loggerd

* dd

* use new PubSub api

* update to new interface

don't modify loggerd

reset panda

reset opendbc

remove empty lines

* switch to new pubMaster

* update to the new inteface

change

remove error code

. to ->

merge paramsd.cc

update panda

fix typo

simplify

fix typo

* Fix build

* always conflate

Co-authored-by: deanlee <deanlee3@gmail.com>
old-commit-hash: ab5af232b243ba8137695f68c125f922fb412d44
2020-05-21 16:04:33 -07:00
Jason Young 30e1e9f91c Make timeout setting code reachable (#1509)
old-commit-hash: d8d490ef6d3ac849ae05d1183020fb469b218dcc
2020-05-14 13:03:47 -07:00
Willem Melching 83d02c8c4a Don't show "no gps" when ubloxd is not running (#1479)
* dont show no gps when ubloxd is not running

* Just s

* Dropped that

* Connected is too long
old-commit-hash: f7c8707bf854f40c54d3c0b9676e26584b95103c
2020-05-08 21:04:55 -07:00
robbederks 5a12fc32e7 Ambient light calibration parameters on persist partition (#1429)
* WIP: light sensor persistent params

* fix params writing

* Persistent params argument in C params lib. Fixed symlink flow

* Removed debug prints

* fix boardd

* fix ui

* remove debug print
old-commit-hash: 71bebc4fca91681669c86b5600b67bf2b7f899bf
2020-05-08 19:39:18 -07:00
Dean Lee 90af65c41c UI: move c-capnp to c++ (#1455)
* ui:move c-capnp to c++

* move Subsockets into vector

* rename reader to msg

include cereal/gen/cpp/log.capnp

* fix some errors

restore some changes

restore previous

* cleanup codes

cleanup codes

* remove unused variable alert_size

* handle capnproto's enum in a robust way

add break to default

* switch -> std:map

* use static std::map instead of switch

do cleanup

* fix wrong variable name

* use FlatArrayMessageReader instead of custom MessageReader

remove messagehelp.h

Revert "use FlatArrayMessageReader instead of custom MessageReader"

This reverts commit 57d8b6b1e2b4bad908246f35eb068535b1627167.

use FlatArrayMessageReader instead of custom MessageReader

add header file

remove capnp_c lib,add kj lib

include serialize.h

fix

remove duplicate includes
old-commit-hash: ee725534bb1ae2335705562e9f1eb176e5cd91fd
2020-05-06 08:38:26 -07:00
Dean Lee 7f561f2d3d close sensors when it's done (#1367)
old-commit-hash: 24495a2278cd52a74d071b8ae7e571ba3563dece
2020-04-17 15:52:40 -07:00
ZwX1616 f90b956f47 RHD support for driver monitoring (#1299)
old-commit-hash: 133b1a20b42e56dc67a013dc2ee856360e4d1d1c
2020-04-15 16:48:44 -07:00
andyh2 f7e3d8349d offroad/ui: Fix layout bugs (offroad drawing on top, settings open after drive)
old-commit-hash: 76052865cd0b8fdc7ba323390bd4e686fb794258
2020-04-13 08:53:52 -07:00
Willem Melching ce4958dc3a ui.cc: use thermald to decide when to go onroad (#1351)
* use thermald to decide when to go onroad

* Check for stopped

* set alert timeout to 0 when going offroad

* set controls seen to false

* Don't mark as seen when already stopped

* Don't process controlsState when stopped

* Needs free

* Small cleanup

* Remove that again

* Process controlsState when started

* Need that back
old-commit-hash: 54d8f9c27b49efe56b813eb2538b3aa9dc1c2897
2020-04-10 16:12:39 -07:00
George Hotz 24f5831a94 Remove bg_thread from ui (#1347)
* remove bg_thread

* debug print app

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: ef8aaa77b79194cd0bc25b1e2a42ca857c34a401
2020-04-09 20:55:54 -07:00