Commit Graph

130 Commits

Author SHA1 Message Date
Justin Newberry d487c0501f Ruff: enable most of bugbear (#29320)
* added mutable default args

* most of the Bs

* add comment about lrucache
old-commit-hash: 62c1e6592439119f360dd64b854e7047f35222ba
2023-08-11 15:33:49 -07:00
Justin Newberry a14f162bc7 Ruff: comprehensions conventions (#29317)
ignore c408
old-commit-hash: 4a9afd7554060ac5353e96f1d7feb06d3a3671e9
2023-08-10 16:40:30 -07:00
Adeeb Shihadeh b7f6b6dc95 pytest unit test running (#29261)
* setup config

* collect passes

* pytest system/ works
old-commit-hash: 670fa9af5f66278152acf477b19d19559733094f
2023-08-10 08:23:19 -07:00
Harald Schäfer 1fd2125bfa Laikad cpu usage: enable test onroad (#28926)
* enable test onroad

* Better

* specify range

* fix printing

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 7613f6918bb22ace90887e6025ee1e6cb93050ed
2023-07-15 23:06:42 -07:00
Shane Smiskol 945169aa2c test_onroad: lower ui CPU usage (#28927)
lower from multiple runs
old-commit-hash: c541074669fad39d73ea7a87574d3006c48b6ce5
2023-07-13 23:47:12 -07:00
Adeeb Shihadeh c699443eee revert accidental enable
old-commit-hash: 69e7f386a759c54d866c64c37ef85f6c7c61cd08
2023-07-10 17:22:09 -07:00
Adeeb Shihadeh 74981f0d8d Update test_onroad.py
old-commit-hash: 24de4a6204997e1f0b00cecd9b99adb313de2444
2023-07-10 16:40:09 -07:00
Adeeb Shihadeh 48808e274d test onroad: stricter ui timings check (#28853)
old-commit-hash: 740380bf05f67aebfba77fefdc808789c741b75b
2023-07-08 22:26:53 -07:00
Mitchell Goff 77b5e197aa Enable nav features in modeld (#28448)
* Enable nav features in modeld

* Enable mapsd/navmodeld

* Updated model_replay_ref_commit and added mapsd/navmodeld to test_onroad

* fixed process name

* always publish from mapsd
old-commit-hash: aadd9ae269e682b6893557a89a02a7ae357206ee
2023-06-16 21:27:35 -07:00
Adeeb Shihadeh d2ec950790 test onroad: explicit memory leak check (#28502)
old-commit-hash: 2f117e88b775a0b53a3ae99ae943caaa66f952f2
2023-06-11 14:43:25 -07:00
ZwX1616 f499b6dc64 ci: test sof diffs in onroad test (#27723)
* add diff test

* skip

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: a2e11b2f48c9c77b453f418ebcde3c1454e5bce2
2023-06-02 21:23:32 -07:00
Adeeb Shihadeh 4174ac224d test_onroad: tizi updates (#28379)
* test_onroad: add tizi support

* don't clear params on desk device

* update

* fix mypy

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 80d8dcd22eefb39e44e32127ce3479a50f063e1a
2023-06-02 21:18:51 -07:00
Adeeb Shihadeh 7e64d60f4b test_onroad: ignore vehicleModelInvalid (#28335)
* test_onroad: ignore vehicleModelInvalid

* not for all ci
old-commit-hash: cd57b340c1974c52146015b0211bd6ec50388c7e
2023-06-01 10:26:08 -07:00
Adeeb Shihadeh 2aa55ce54a update loggerd and ui cpu
old-commit-hash: 9f3c0a778113313e7d390f672abfe40a0d242b7d
2023-05-24 10:04:53 -07:00
Adeeb Shihadeh 1ae2769a72 adjust uploader cpu usage
old-commit-hash: a3d59132283f97faadf0be2ca55264b895e4c232
2023-05-22 10:48:15 -07:00
Adeeb Shihadeh 8de1d811da test onroad: add gpsLocationExternal to gps proc list
old-commit-hash: 1b12f17ee3826b7553b9d907f9d33d58799c4688
2023-05-22 01:10:24 -07:00
Adeeb Shihadeh a3dcc5cd97 time to onroad test (#28242)
* time to onroad test

* run few times

* test on stripped builds

* manager

* cleanup

* split those out

* run first

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 39c5d492bfb4ca1630fed1a4ab6990c171c5e797
2023-05-20 17:59:41 -07:00
Adeeb Shihadeh 2bb12fc0fc test_onroad: handle spotty gps in testing closet (#28194)
old-commit-hash: fbcf6ced51aa7ca510293799c3e553095cd4577e
2023-05-15 12:45:19 -07:00
Adeeb Shihadeh 8cb0a252ae test onroad: ensure 100% engageability (#28132)
old-commit-hash: 984029b6064aff44f2d3b442357b50bd8857afed
2023-05-08 13:48:42 -07:00
Adeeb Shihadeh e631d24d77 Jenkins tuneup (#28095)
* tuneup

* use service messages

* logmono

* not passive
old-commit-hash: d5a0a4b3e8a52b5a0e1da325c15cdb99d2a71350
2023-05-03 16:52:20 -07:00
Adeeb Shihadeh a25d2f95de test_onroad: enforce CPU usage test for all procs (#28024)
* cleanup

* add missing procs

* ugh not systemd

* floor

* unused

* handle laikad

* continue

---------

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 64df41c9afbfb19fd527eb107af5c83691db3202
2023-05-01 21:35:10 -07:00
Adeeb Shihadeh 5df915f197 ci: locationd cpu has increased a bit
old-commit-hash: cddb7c37e6a3e267d568725f6ed70a1dd24ff3b7
2023-04-01 16:05:51 -07:00
Adeeb Shihadeh 3a968c67e1 loggerd: move to system/ (#27534)
old-commit-hash: 94eb2159802d3dba99620db0b08731c68a7e4733
2023-03-08 11:20:49 -08:00
Harald Schäfer 73561f01e0 Expand lateral MPC to 10s (#27343)
* 10s lat

* Full length MPC

* redfine N

* Leave controls the same for now

* Updates

* use long plan in lat plan

* interp plan

* add new interp

* simplergit add selfdrive/controls/plannerd.py selfdrive/controls/

* expand to 10s

* revert this

* fix linter

* Update sconscripts

* fix test

* fix test

* fix test

* Revert "Update sconscripts"

This reverts commit 6e23c69dcebd5ed003e37e01921f6af7c31de0db.

* Dont import drive helpers

* better compile deps

* fix compile

* comment

* update replay

* Update plannerd time
old-commit-hash: 04fe6c4ec72dfcf89456a484d03f85502c237701
2023-02-17 15:28:26 -08:00
Adeeb Shihadeh 3a3ae6c75f bump up controlsd cpu usage
old-commit-hash: 0589ff23a52efb90269d270f13a3d921176d377b
2022-11-02 15:51:52 -07:00
Adeeb Shihadeh 96ba2b3c1a test_onroad: temp disable max UI draw time check
old-commit-hash: bdbdd42d5b736c2d10d2e586c382a5989b38a250
2022-11-01 23:18:56 -07:00
Adeeb Shihadeh 60cb813af5 ui: publish draw times + add test (#26119)
* ui: publish draw times + add test

* add some checks

* adjust

* fix linter

* update max

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 15b8c7d1dc3a75d78c0bbaa4f6b866374f6e8672
2022-10-17 17:14:38 -07:00
Vivek Aithal 51d25b2011 Live torque (#25456)
* wip torqued

* add basic logic

* setup in manager

* check sanity and publish msg

* add first order filter to outputs

* wire up controlsd, and update gains

* rename intercept to offset

* add cloudlog, live values are not updated

* fix bugs, do not reset points for now

* fix crashes

* rename to main

* fix bugs, works offline

* fix float in cereal bug

* add latacc filter

* randomly choose points, approx for iid

* add variable decay

* local param to capnp instead of dict

* verify works in replay

* use torqued output in controlsd

* use in controlsd; use points from past routes

* controlsd bugfix

* filter before updating gains, needs to be replaced

* save all points to ensure smooth transition across routes, revert friction factor to 1.5

* add filters to prevent noisy low-speed data points; improve fit sanity

* add engaged buffer

* revert lat_acc thresh

* use paramsd realtime process config

* make latacc-to-torque generic, and overrideable

* move freq to 4Hz, avoid storing in np.array, don't publish points in the message

* float instead of np

* remove constant while storing pts

* rename slope, offset to lat_accet_factor, offset

* resolve issues

* use camelcase in all capnp params

* use camelcase everywhere

* reduce latacc threshold or sanity, add car_sane todo, save points properly

* add and check tag

* write param to disk at end of route

* remove args

* rebase op, cereal

* save on exit

* restore default handler

* cpu usage check

* add to process replay

* handle reset better, reduce unnecessary computation

* always publish raw values - useful for debug

* regen routes

* update refs

* checks on cache restore

* check tuning vals too

* clean that up

* reduce cpu usage

* reduce cpu usage by 75%

* cleanup

* optimize further

* handle reset condition better, don't put points in init, use only in corolla

* bump cereal after rebasing

* update refs

* Update common/params.cc

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* remove unnecessary checks

* Update RELEASES.md

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 4fa62f146426f76c9c1c2867d9729b33ec612b59
2022-09-19 15:19:26 -07:00
Kurt Nistelberger 763cfa8c4e sensord: increase cpu usage in onroad test (#25773)
Co-authored-by: Kurt Nistelberger <kurt.nistelberger@gmail.com>
old-commit-hash: 98c843bfb425bb1dd44f99715f81fa7d327a77e7
2022-09-13 22:28:00 -07:00
Adeeb Shihadeh 600d136bbf fix encoderd cpu usage
old-commit-hash: 21d7c540d2cbe37bbfc4bb979a1b155bcabdeb29
2022-08-28 21:20:19 -07:00
Adeeb Shihadeh f68770eb3a test onroad: update dmonitoringd cpu usage
old-commit-hash: 62bb70ef2987647e9a9bb93af21f5424c617bafe
2022-08-21 14:29:52 -07:00
Adeeb Shihadeh bbad107007 test onroad: more robust CPU usage test (#25375)
* test onroad: more robust CPU usage test

* fix linter

* remove debug print

* Revert "remove debug print"

This reverts commit 172cb655fe3558abeb0ec6432ff24b90c0aab183.

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 80cbcafb5f10f474efd86a085032705c994bab15
2022-08-05 16:12:32 -07:00
Willem Melching 0c2afda822 enable laikad (#25013)
* enable laikad

* increase logprint for onroad test
old-commit-hash: cdc7a6dbea75f10316e45833be6bade9f2e1694d
2022-07-01 08:26:41 -07:00
Willem Melching 1fc567d40b test onroad: lower camerad cpu usage
old-commit-hash: 30ddadc8b4d510c824221d2010e4aef853741a92
2022-06-30 13:25:42 +02:00
ZwX1616 cd2a98aa11 fullframe DM model (#24860)
* Revert "put cereal on master"

This reverts commit 4646c132bae7358079c9b2867725f8382906c1e5.

* Revert "Revert fullframe DM model (#24812)"

This reverts commit 59e8af4c3101785cead69a9880cc03e0a18081e1.

* revert revert cereal

* clip6

* 0.8 is fair

* Fiction compensation should be based on error

* Update refs

* Add deadzone

* not that

* good mg

* ref

* ref

* ee8f

* minor tweak

* ref

* recompile

* ref

* cereal

* match driverstatus

* new ref

* new ref

* pass token through jenkins credentials

* quote

* fix snpe dead weights

* final ref

Co-authored-by: Harald Schafer <harald.the.engineer@gmail.com>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 1f2f9ea9c9dc37bdea9c6e32e4cb8f88ea0a34bf
2022-06-20 16:24:51 -07:00
Joost Wooning 38f6e2726b ui: skip texture frame copy (#24700)
* ui_blit working

* simpler and working

* more believable that it's real

* working on device

* build on pc

* use hardware pc

* reduce cpu usage

* yuv conversion to EGL

* move everything to cameraview

* some cleanup

* more cleanup

* init array

* init images with std::map

* dont destroy images

* do destroy images

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 1221aef233180a7d290ff813d2e2e53dbf87d586
2022-06-13 12:27:47 +02:00
Adeeb Shihadeh 3c48bc47b7 Move a bunch of stuff to system/ part 3 (#24829)
* move swaglog.py

* timezoned

* logmessaged

* version.py

* fix linter
old-commit-hash: 0fce5d90459b77bf2cfa70f55f322f0e1fb8d01c
2022-06-11 23:19:27 -07:00
ZwX1616 c73d4e5fc6 Revert fullframe DM model (#24812)
* Revert "fullframe DM: flip RHD yaw to use matching thresholds"

This reverts commit ce7daabc8847d18ba46e5d1879f5a6958d04ccc7.

* Revert "fullframe DM model (#24762)"

This reverts commit 817be81fb19004f4873881f6b29dcdfffbe7e3a8.

* revert cereal
old-commit-hash: c646eeee0ac54925db5afc51b95c5d869d6dba68
2022-06-10 16:16:46 -07:00
ZwX1616 02f0f39b52 fullframe DM model (#24762)
* get log

* simplify two nonsense

* not needed

* libyuv is a joke

* clean up

* try small

* fast but not bad

* working

* clean up driverview

* simplified

* thats mirrored

* smol

* tweak

* ref is screen

* w/ ee

* update camera model

* no if TICI

* start

* update pose thresh

* less cpu more dsp

* new libyuv

* new snpe

* add files

* test

* should be fast

* update out len

* trigger test

* use master snpe

* add cereal

* update cereal

* refactor parsing

* missing ;

* get

* wrong type

* test model

* use driver data

* 10829278-72fe-4283-a118-2cef959ce174/1550

* no pf

* adapt driverview

* ;

* rhd learner

* update libyuv buildi x64

* ad4337ea

* remove blink slack

* test

* no

* use toggle

* b16

* fix for nv12

* 5b02cff5 both

* update test

* update cereal

* update cereal

* update cereal

* v2 packets

* revert libyuv

* no /

* update snpemodel

* ;

* memcpy

* fix test

* use toggle in driverview

* update power

* update replay

* Revert "update replay"

This reverts commit 1d0979ca59dbc89bc5890656e9501e83f0556d50.

* update model ref

* halve cpu

* fake 8bit onnx runner

* same thresh as report

* cereal master

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: d6c07a6b158595c1ab10256dc6eee4fbdf902379
2022-06-08 20:13:46 -07:00
George Hotz 2a6ffaf71d nv12: encoderd avoids a full frame copy (#24519)
* rgb to nv12

* nv12 works (w memcpy)

* correct now

* no copy

* fix nv12 with fast debayer

* reverts of unused stuff

* ui use nv12

* comment out thumbnails for now

* rebase fix

* dm read nv12

* model read nv12

* fix ffmpeg encoder

* thumbnails from nv12

* replay to nv12

* python framereader support nv12

* remove hardcoded frame/buffer sizes

* fix build

* ffmpeg encoder fix buffers

* small cleanup

* reduce power usage test

* fix cpu usage test

* fix snapshot

* fix loggerd test

* bump cereal

Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: Joost Wooning <jwooning@gmail.com>
old-commit-hash: ea5b8cdfb10686c972d8d2bc1778e6e6567e45a9
2022-06-01 17:18:28 +02:00
Adeeb Shihadeh 1d9d8d874b controlsd cpu has crept up
old-commit-hash: 3771ccc6550dfe4f0797bb249354f3f52cbf53a3
2022-05-17 19:42:58 -07:00
George Hotz a053d070be encoderd: enable (#24492)
* enable encoderd

* correct enable line

* fix loggerd tests

* fix power draw and cpu tests

* correct cpu for encoderd

* fix a bug, video_writer is shared

* fix issue with not recording dcam

* add recording state

* wooo tests pass. encode id keeps counting

* core 3

* loggerd then encoderd

* stop loggerd first

* core 3 always online

* see the camera when we see encoder packet

* encoderd on small core uses 37%

* remove encoder logic from loggerd

* delete unit test that doesn't really make sense anymore

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 94b9972eb798408a3c412716b8d9eb8ddb9354bc
2022-05-13 17:56:02 -07:00
Joost Wooning da6d0d878a camerad: combine debayering and rgb_to_yuv opencl kernels (#24452)
* camerad: combine debayering and rgb_to_yuv opencl kernels

* fix border

* fix snapshot

* rename function

* update camerad cpu usage

* update camerad power draw

* vignetting equal to previously

* test other local worksize

* use less floats

* reduce amount of code

* move barrier back

* make faster

* fix corners

* cleanup

* cleanup

* allow more jitter on driverState timing

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 489fbb74b0f532c738cf8c06afe1a5f9ce1e1651
2022-05-13 16:49:31 +02:00
Willem Melching 7a855eff47 sanity check on debayer time in CI (#24453)
* check debayer time

* set actual threshold

* also print mean and max
old-commit-hash: 9ef17a877fa0cb4b0d9e7017c152dadbfb94a9aa
2022-05-06 17:27:54 +02:00
Willem Melching be08693d5c delay bz2 compression from logging to uploading (#24392)
* remove log_name

* log without compression

* fix tests

* remove extension for bootlog

* another test fix

* uploader compresses

* also compress in athena

* only compress qlog

* more generic check in do_upload

* fix bootlog compression

* lower loggerd cpu usage

* dont link against bz2

* set core affinity to little cluster

* handle old files
old-commit-hash: 77a6f3d034a7b17d70b750b9ea454310f4b8edf1
2022-05-03 14:09:17 +02:00
Willem Melching 2a5eae5a56 ui: combine OnroadHud into NvgWindow (#24369)
* ui: combine OnroadHUD and NVGWindow

* draw hud first

* cleanup

* removed commented line

* fix text rendering

* increase cpu usage
old-commit-hash: a3cfa444d37bacdac5278335ac7a49b6cb5b81f0
2022-04-29 10:55:44 -07:00
George Hotz 3a6a5485f2 camerad: less ioctls try 2 (#24371)
* premap the buffers

* memory manager

* free buffers properly, alignment seems okay

* update camerad CPU usage

* cam_sync_fd

* useless line, and use the define

* cheap prereqs for multistream

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: b7ddce8bacde6de2f708af0b70ea8a20d61396f2
2022-04-29 18:09:12 +02:00
George Hotz e7aac92b21 Revert "camerad: don't remap everything every time (#24334)" (#24370)
This reverts commit 30e9a8aab8337d6b5661f4acdb0f2cf8c1421504.
old-commit-hash: 5ddd2000b23ca3fc3c67a5a29331a28cffaa2a9e
2022-04-29 07:59:03 -07:00
George Hotz 0c2a527b3e camerad: don't remap everything every time (#24334)
* premap the buffers

* memory manager

* free buffers properly, alignment seems okay

* update camerad CPU usage

* cam_sync_fd

* useless line, and use the define

* cheap prereqs for multistream

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: fb7d84875bc993beaf75645a7e4b311704742f02
2022-04-28 11:32:32 -07:00
Joost Wooning 31f9e8af0f UI: remove memcpy on frame receive (#24318)
* UI: remove frame memcpy

* fix freezing

* fix onroad test
old-commit-hash: f84fdc86bbd8223f22158abfa37e368fa18bedf6
2022-04-25 13:45:55 -07:00