Commit Graph

58 Commits

Author SHA1 Message Date
HaraldSchafer 7c8ea30532 fix frame drop percentage (#2578)
* correct, I think

* add model execution time

* remove unused

* token is a file

* this is gonna change

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 7378bc42845a094bbb22fb76154cb40ecb098aaf
2020-11-19 21:05:29 -08:00
HaraldSchafer faad598e29 Minor fixes 08 (#2565)
* correct indexes

* best metrics yet 30231f46-08af-477e-9d30-776593913c24/700

* sometimes x decreases

* update model refs

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 7b216e7cbb30f9a7b164cc17bb66b348d728b65e
2020-11-17 20:04:32 -08:00
HaraldSchafer 008f37c749 Torch model (#2452)
* refactor draw model

* rebase master

* correct valid_len

* rename function

* rename variables

* white space

* rebase to master

* e16c13ac-927d-455e-ae0a-81b482a2c787

* start rewriting

* save proress

* compiles!

* oops

* many fixes

* seems to work

* fix desires

* finally cleaned

* wrong std for ll

* dont pulse none

* compiles!

* ready to test

* WIP does not compile

* compiles

* various fixes

* does something!

* full 3d

* not needed

* draw up to 100m

* fix segfault

* wrong sign

* fix flicker

* add road edges

* finish v2 packet

* Added pytorch supercombo

* fix rebase

* no more keras

* Hacky solution to the NCHW/NHWC incompatibility between SNPE and our frame data

* dont break dmonitoringd, final model 229e3ce1-7259-412b-85e6-cc646d70f1d8/430

* fix hack

* Revert "fix hack"

This reverts commit 5550fc01a7881d065a5eddbbb42dac55ef7ec36c.

* Removed axis permutation hack

* Folded padding layers into conv layers

* Removed the last pad layer from the dlc

* Revert "Removed the last pad layer from the dlc"

This reverts commit b85f24b9e1d04abf64e85901a7ff49e00d82020a.

* Revert "Folded padding layers into conv layers"

This reverts commit b8d1773e4e76dea481acebbfad6a6235fbb58463.

* vision model: 5034ac8b-5703-4a49-948b-11c064d10880/780  temporal model: 229e3ce1-7259-412b-85e6-cc646d70f1d8/430  with permute + pool opt

* fix ui drawing with clips

* ./compile_torch.py 5034ac8b-5703-4a49-948b-11c064d10880/780 dfcd2375-81d8-49df-95bf-1d2d6ad86010/450 with variable history length

* std::clamp

* not sure how this compiled before

* 2895ace6-a296-47ac-86e6-17ea800a74e5/550

* db090195-8810-42de-ab38-bb835d775d87/601

* 5m is very little

* onnx runner

* add onnxruntime to pipfile

* run in real time without using the whole CPU

* bump cereal;

* add stds

* set road edge opacity based on stddev

* don't access the model packet in paint

* convert mat.h to a c++ header file (#2499)

* update tests

* safety first

Co-authored-by: deanlee <deanlee3@gmail.com>
Co-authored-by: mitchell <mitchell@comma.ai>
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: George Hotz <george@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 08846b5c0ec3a5299c8cb73904da15a18d3aaccf
2020-11-11 20:31:46 -08:00
Willem Melching fc0b6f099f Revert "convert mat.h to a c++ header file (#2499)"
This reverts commit 607866bb60ba1c69c6f777082c5ea787e895a251.

old-commit-hash: f2c8a6122d881fbee5bbdd1cf16f8541ce33260b
2020-11-09 01:41:36 -08:00
Dean Lee 13a25b9e27 convert mat.h to a c++ header file (#2499)
old-commit-hash: 519c043a63c9286f55b5a4325604489da087957a
2020-11-09 01:19:09 -08:00
Willem Melching 498ecbdf3c Params refactor, simplified (#2300)
* always c++

* Create C++ params class

* get works

* tests hang now

* passes tests

* cleanup string formatting

* handle interrupt in blocking read

* fix memory leak

* remove unused constructor

* Use delete_db_value directly

* Rename put -> write_db_value

* filename cleanup

* no semicolons in cython

* Update common/SConscript

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* add std::string version of delete_db_value

* This is handled

* cleanup encoding

* Add clear method to clear all

* add persistent params

* fix android build

* Should be called clear_all

* only import params when needed

* set params path on manager import

* recusrively create directories

* Fix function order

* cleanup mkdirp

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 2e182e5c574ea1468678b5fd8d0597e34ed5898d
2020-10-13 16:23:23 +02:00
Willem Melching a331861873 Remove czmq part 1 (#2332)
* remove czmq

* remove streaming mode from loggerd

* Add include for usleep
old-commit-hash: a4ccfcffe8247bf467bddfb0e6c5b3eb8851e21a
2020-10-13 16:01:07 +02:00
ZwX1616 fb77feccd8 improve tici camerad robustness (#2135)
* equalize performance on three threads

* need to request first

* clean up indexing

* obsolete

* handling skips and drops

* clean up repeated chunks

* use main frame id

* oneshot

* real skip check

* move to test

* should be cropped H here

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 13588e4255e3667459bc5b23068dbccd2fab2a39
2020-09-14 16:05:57 -07:00
Adeeb Shihadeh ac3422fc0f message builder (#2161)
* use custom MessageBuilder from cereal

* use MesageBuilder.toBytes

* bump cereal

* unused

* another one

* fix ui msg

Co-authored-by: deanlee <deanlee3@gmail.com>
old-commit-hash: 4d5733924a2fdd8a3bbaf5f48869ac744b983401
2020-09-12 21:48:15 -07:00
Adeeb Shihadeh 3372b5e878 tici driver monitoring (#2158)
* use cpu for now on tici

* pin to core 5

* fix driver view

* probably wrong

* correct this time

* RHD too

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: fdbfe5292797c5638855fb947ebc5f4eb161353c
2020-09-12 17:50:22 -07:00
ZwX1616 912611b539 swap ur/dl (#2153)
old-commit-hash: e9f49254da35072f9b2d124ea05ca2782dbcf7cf
2020-09-11 11:29:19 -07:00
Adeeb Shihadeh 91ac4efab2 driver monitoring cleanup (#2101)
* read rhd from param

* don't need that anymore

* fix build

* bump cereal

* read param from camerad too

* add read_db_bool helper

* bump model replay ref commit, IsRHD wasn't set
old-commit-hash: 349040d9580bf7c9b98273dd2745fc4b147d3254
2020-08-29 17:16:00 -07:00
Dean Lee aa41930178 remove device_id&context from ModelFrame (#2064)
old-commit-hash: 727055e0a077ceb4ea9ff55de9fd795cf675b48a
2020-08-24 14:04:52 +02:00
Dean Lee ebd4f68cba ui: refactor model related functions (#2026)
* remove read_model

* remove structs for c-capnp

* remove duplicate #define from modeld

* add function fill_path_points

* fix Indentation

* use MODEL_PATH_DISTANCE instead of 192

* fix type

use validLen

* rename left_path_points&right_path_points to xxx_lane_points
old-commit-hash: f8ab6bd009410a9f7ab9c30ce7b72a82c6d2507b
2020-08-18 15:26:43 +02:00
Dean Lee 1bc3801c9b Make sure memory is released by using unique_ptr (#1958)
old-commit-hash: ef435ef2ac14dd7f842d4f59909330ba57f6d177
2020-08-05 12:27:56 +02:00
ZwX1616 a55099ac2a EfficientNet driver monitoring (#1907)
* e96f9be6

* bump cereal

* filter sunglasses

* fix unittest

* update refs

* udpate refs

* update refs

* add tolerance for dmonitoringd

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 2cfa0edb4ccc0f17fd926835de8fb966dd4d9fc3
2020-07-27 20:22:06 -07:00
Adeeb Shihadeh cd317b0780 Fix most remaining LGTM alerts (#1893)
* fixups from LGTM

* short globals

* fix spinner and textwindow

* total ordering

* no spinner/text window when import from manager

* not android
old-commit-hash: 5db81f60ca8fbc0ef28924b7e93f25a1d4bb3764
2020-07-19 16:12:22 -07:00
ZwX1616 556752a77b Revert "EfficientNet driver monitoring (#1866)"
This reverts commit 0bc9d737dde1a50937d421f7a417260732f90480.

Need to fix test

old-commit-hash: c2be31c10be18893fbb1f45b37e34f291fa6b97d
2020-07-17 18:20:04 -07:00
ZwX1616 7a8bf9d7de EfficientNet driver monitoring (#1866)
* e96f9be6

* bump cereal

* filter sunglasses

* fix unittest

* update refs

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 2d0e994674dcd1965bb28158d49428fb43df8902
2020-07-17 15:34:02 -07:00
Adeeb Shihadeh c374f03187 Revert modeld vipc conflate behavior and alert on dropped frame percent (#1877)
* Revert "Fix modeld dropping frames if processing takes over 50 ms"

This reverts commit fb908877a50d72e20a047bd4138316b12c8a30cc.

* track frame drop

* fix unused

* alert on frame drop perc

* reduce thresholds

* posenet is invalid on non-consecutive frames

* Refactor filter time constant

* Use vipc_dropped_frames for posenet valid check

* Actually set frame drop percentage

* Add explicit cast just to be sure

* Prevent frames dropped to go up to quickly on startup

* bump cereal

* reduce soft disable threshold to 1%

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 58c3b5ba84f6c3da3c660770148cea98c708fce5
2020-07-14 14:23:27 -07:00
Adeeb Shihadeh 4d9200f307 only check frame age for posenet too
old-commit-hash: c8f3ff8913ce7e18d755ae8015a27af3365029e9
2020-07-09 20:55:56 -07:00
Adeeb Shihadeh c8a9fb9321 only check frame age for model validity
old-commit-hash: 587bdf593799f9c6612c26703ffcfcd031f98f92
2020-07-09 20:37:28 -07:00
Adeeb Shihadeh a1dbb38a0c Alert when modeld is lagging by more than a frame (#1823)
* alert when modeld is lagging by more than 1 frame

* log frameAge in modelData

* set posenet valid

* compute frame_age once
old-commit-hash: 03e824a4b558daa15191408e88b73fee7ab1792f
2020-07-09 17:02:21 -07:00
Adeeb Shihadeh cdfb090c7a Wunused (#1841)
* enable Wunused, first pass

* unused stuff in snpe model

* these are used on phone

* handle sigint and sigterm in modeld

* fix phone build

* camera qcom

* QCOM build works

* delete unused camerad vars

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: eb1aa3d831fd0d7fffd9aacec1accb0a5bdb0304
2020-07-09 09:25:32 -07:00
Willem Melching 2e056ae2a3 Fix unsigned overflow in modeld frame age computation
old-commit-hash: 5e10efead11073279f7119f07df2825713f033c4
2020-06-22 19:31:57 -07:00
Willem Melching b772d12f87 Make model packets invalid when frames are too old (#1759)
* make model packets invalid when frames are too old

* add frame numbers to cloudlog
old-commit-hash: 88f92663780665b27fafdb5ab86ad501cad4cbcf
2020-06-22 14:27:58 -07:00
Dean Lee e04a272892 release resources in modeld (#1700)
old-commit-hash: c8082190a07b6534dffcd7c88945af8b26b241c0
2020-06-19 11:38:39 -07:00
George Hotz 5d069eb8c3 Fixups for Mac, and a bunch for PC (#1654)
* fix mac nui

* fix cereal

* builds on mac without warnings

* ui swap shouldn't be instant on pc

* camerad builds on mac

* modeld, and now everything, builds on mac

* ui draws pictures on mac now

* fix camerad shutdown

* support ui looping on pc

* python3 on that

* SCNu64 should be cross platform

* bump cereal and new apk

* clean up

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 344a9a369983f58fe1e71f84478ded5c766e0d1b
2020-06-11 18:21:59 -07:00
Dean Lee 5fb85ede56 add function read_db_bytes (#1662)
old-commit-hash: 90d97de74ddc4672b35a5186e868794468a44345
2020-06-09 13:46:49 -07:00
Dean Lee bbafa5a72d pass DMonitoringResult as referer (#1639)
old-commit-hash: c7ff6dd194b48629dbd05a2cc87afd328fffa3a5
2020-06-05 12:42:01 -07:00
George Hotz 669977eb1f save valid_len
old-commit-hash: 4e7fe3a9ec4fddd517ea470af3b7eb3a6fd415e3
2020-06-03 14:18:42 -07:00
Dean Lee dbc8ca1d26 dmonitoring : use memory cache to avoid malloc/free on every frame (#1599)
* use memory cache

* use template function to return buffer

* inline function

* const size_t

* use std::vector instead of kj::array
old-commit-hash: cdb48cc180bd22fbad75785d07a7f47da959880c
2020-06-01 14:00:43 -07:00
Dean Lee b72fcb69e2 driving.cc: Pass ModelDataRaw by reference (#1600)
* pass ModelDataRaw by reference

* pass NVGpaint by refer
old-commit-hash: af36aa28abeb55a4445cbc1ff13ac55993d989d9
2020-05-30 10:08:44 -07:00
Willem Melching 7f0b3180a4 Use C++ version of SubMaster and PubMaster (#1548)
* add PubMaster & SubMaster

remove 'delete msg'

remove headers

* use constructor to initial all submster

* modify drain sockets

* fix typo in ssconscript.remove lines

no checkValid in loggerd

last modify

handle_message:event->&event

fix type

remove heads

event to auto

* new interface

* api changed

* Revert "use constructor to initial all submster"

This reverts commit 73be7ea46250a325ce41d3a0445e34395a2ae692.

* change to new api

* revert loggerd

* dd

* use new PubSub api

* update to new interface

don't modify loggerd

reset panda

reset opendbc

remove empty lines

* switch to new pubMaster

* update to the new inteface

change

remove error code

. to ->

merge paramsd.cc

update panda

fix typo

simplify

fix typo

* Fix build

* always conflate

Co-authored-by: deanlee <deanlee3@gmail.com>
old-commit-hash: ab5af232b243ba8137695f68c125f922fb412d44
2020-05-21 16:04:33 -07:00
Willem Melching aedf223401 remove eigen from phonelibs (#1505)
old-commit-hash: add784a7df0bd27aa1df115e38d43d5159c832f9
2020-05-13 16:41:52 -07:00
Willem Melching 8505259e41 Library cleanup (#1491)
* library cleanup

* remove fastcv

* Fix build step

* bump cereal

* bump cereal

* Install capnp

* bump

* no docker cache

* Update installation instructions

* Needs sudo

* Can we sudo?

* Cache was not the problem

* remove static libraries from boardd install script

* Update setup script

* Remove import

* No capnp install in lgtm

* Fix dockerfile
old-commit-hash: 72db8d890d04e6eb3ce652be3da9bdf23ebda510
2020-05-12 18:50:07 -07:00
Harald Schafer 02eeef5f2b safer
old-commit-hash: ee10697d861c422545ce29ce7869c328e42c7a7c
2020-05-10 22:00:41 -07:00
robbederks 5a12fc32e7 Ambient light calibration parameters on persist partition (#1429)
* WIP: light sensor persistent params

* fix params writing

* Persistent params argument in C params lib. Fixed symlink flow

* Removed debug prints

* fix boardd

* fix ui

* remove debug print
old-commit-hash: 71bebc4fca91681669c86b5600b67bf2b7f899bf
2020-05-08 19:39:18 -07:00
HaraldSchafer f3747d2fe5 Better poly (#1437)
- better polyfitting
- no mpc cost change during lane change
- model trained with better ll gt, sim noise and guaranteed memories
old-commit-hash: 65fcc7c45ff1d4d747dc52ff5791afb84a18744a
2020-05-08 17:14:43 -07:00
Dean Lee 0b0674ef20 camerad: move c-capnp to c++ (#1472)
* convert c-capnp to c++

change paramater type

* remove c-capnp header from commonmodel.c

* unsigned short -> uint16_t

* MSM_CAMERA_I2C_ADDR_TYPE_MAX->4
old-commit-hash: b6d6f520327226004c328a4b7cbbb3b855b2909d
2020-05-07 20:14:30 -07:00
Dean Lee 451af5865c unmap a previously mapped buff (#1410)
old-commit-hash: 98ec06e125b605405900673be0305677ad5efce3
2020-04-22 10:16:05 -07:00
Dean Lee 83fde61d3b fixes the error with OpenCL depreciation warnings (#1394)
old-commit-hash: 25ab2521abb08e58b80f45f16ff51f949e28f05c
2020-04-19 14:04:33 -07:00
ZwX1616 f1a05ef594 fix RHD memory leak
old-commit-hash: 6c5080fa9860dbdfc6b97febc85ad1b537e42df9
2020-04-16 17:31:59 -07:00
HaraldSchafer 5d6131d711 add traffic convention (#1372)
* I think this works

* clean up
old-commit-hash: f5b28ad2d267adae0d6e6fd7816389d3f8d32200
2020-04-15 21:19:25 -07:00
ZwX1616 f90b956f47 RHD support for driver monitoring (#1299)
old-commit-hash: 133b1a20b42e56dc67a013dc2ee856360e4d1d1c
2020-04-15 16:48:44 -07:00
HaraldSchafer cd44a6b07f Traffic b2 (#1345)
* add traffic convention

* hope this work

* no comment

* latest and gratest

* big gru model

* 1af55c7d-ee15-414a-9e98-a0cb08c3441f/75

* much later in training

* wrong temporal size

* converged

* fix lane changes
old-commit-hash: d3edc594cef776847645a6cd14e9e3ce6893bd29
2020-04-13 13:27:06 -07:00
George Hotz f5078e87bc tici: add (somewhat) broken camerad support (#1300)
* capnparm

* building in progress

* scons build works

* that script fixes opencl

* start new camera code

* includes and more camera scripts

* control c works now

* no device control yet

* phy too

* just one camera for now

* fix capnparm

* hmm, the inits are needed

* more cameras

* link stop start

* doesn't work yet

* fix ion on qcom2

* start poll ish

* 4 pictures and done

* no jpeg

* it works to picture

* destroy sync obj

* both work for now

* defined QCOM2

* fix fd leak

* run modeld

* 10 bit mode

* real frame stride

* needs digital gain

* dnew

* no color correcting on new

* that snpe doesn't work

* qcom2 gate

* cleanups

* oops, fix aarch64 detector

* update cereal

* modeld works with SNPE

* fix driver monitoring model

Co-authored-by: Tici <robbe@comma.ai>
old-commit-hash: 8db0993663d7f16cddde00a2dfac8347a152b34e
2020-03-31 16:34:55 -07:00
ZwX1616 a004735b19 add webcam to cameras (#1201)
old-commit-hash: a95e61edf4176c034c0537293a3cf0753c45daa1
2020-03-26 19:19:47 -07:00
Harald Schafer 5f17520b8e add long_x
old-commit-hash: d02f55ae0b0ee39ed758c5b8a19411fddc4905a4
2020-03-26 17:40:12 -07:00
HaraldSchafer 544d198bed Pulse desire (#1172)
* initial

* compilation fixes

* add desire

* pulse desire

* 0d5728f6-a918-40a6-bce3-a9d0f1238180/20

* cleaner

* inject model

* inject model

* test runs

* ah already done I see

* remove useless

* update

* updates, doesnt work

* fix generating new references

Co-authored-by: Willem Melching <willem.melching@gmail.com>

old-commit-hash: 63d3bb517fdac3d953e67ca4a16f2c742388cdc5
2020-03-04 18:51:45 -08:00