Commit Graph

74 Commits

Author SHA1 Message Date
ZwX1616 46840807fa up tici hevc bitrate (#20093)
* 2x tici bitrate

* update test

* clean up
old-commit-hash: e2044ca5a2fab66de9b341a5eea2a6c994a45572
2021-02-22 09:15:56 -08:00
Willem Melching a98a06c1f8 loggerd: clean exit on SIGPWR (#20100)
* loggerd: clean exit on SIGPRW

* no SIGPWR on macos
old-commit-hash: d3dfb47d0e8fef18171a393005da76c98e941419
2021-02-18 17:46:46 +01:00
Adeeb Shihadeh 05eb44115e cereal cleanup part 2 (#20092)
* car stuff

* thermal

* Revert "car stuff"

This reverts commit 77fd1c65ebd01abfa8493ae12c9e6b14f7ada976.

* panda state

* camera stuff

* start deg

* most is building

* builds

* planner + controls run

* fix up paramsd

* cleanup

* process replay passes

* fix webcam build

* camerad

* no more frame

* thermald

* ui

* paramsd

* camera replay

* fix long tests

* fix camerad tests

* maxSteeringAngle

* bump cereal

* more frame

* cereal master
old-commit-hash: 312b681a46b8153314a8420611b6479dd6f70dfc
2021-02-16 21:39:32 -08:00
Greg Hogan d59a13e22a adjust qcamera quality (#20066)
* better ts

* fix test
old-commit-hash: 1cd9105e96c37ef5365aa34aa52c7ede6afd0567
2021-02-11 17:55:00 -08:00
Dean Lee 6e63be3a01 loggerd: remove the segment variable from encoders (#20034)
old-commit-hash: 1fad5216eac27271387726a072827c134c68d98f
2021-02-07 17:48:46 -08:00
Dean Lee 33495e4368 loggerd: small cleanup (#19864)
old-commit-hash: 16e259cadf7da85f8faf072edd2b37dc1fc4f03c
2021-01-30 18:37:58 -08:00
Dean Lee da9b0e8baa remove cqueue, use class SafeQueue (#19774)
* class SafeQueue

* cleanup includes

* space

* add timeout

use try_poll

* add function empty() & size()

* class SafeQueue

* add timeout

use try_poll

* add function empty() & size()

* rebase master

* rebase master

* for loop

* fix bug
old-commit-hash: e6783f4d9f10a256a4c301eb1d1843d9e2a17ab6
2021-01-28 15:12:45 +01:00
Dean Lee b0552a1985 bootlog: fix dangling pointer problem in logger_build_boot (#19942)
* fix  dangling pointer problem

* logger_build_init_data() has same problem

* return kj::Array<capnp::byte>

* Revert "return kj::Array<capnp::byte>"

This reverts commit 4df4685bfcaba0c5400e2690440a74c32ff75afa.

* Empty commit,trigger Build

* fix each segment in a route having a different initial logMonoTime
old-commit-hash: 79e05965c403289dbe75622ac5a9970218163959
2021-01-28 13:34:07 +01:00
Adeeb Shihadeh a65cef0b31 loggerd: remove vipc arg from encode frame
old-commit-hash: 1ed77847fe3f53b14595bab8f1f47134fee03c9b
2021-01-23 17:11:36 -08:00
Adeeb Shihadeh cfdeda3393 OMX encoder stability (#19758)
* cleanup test first

* wait for other encoder threads

* fixes initial crash

* no print

* unused

* fix up tests

* need that

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: d4489fbf91588ea609041bc6bb2899c7de0a3c3c
2021-01-21 10:40:08 -08:00
Adeeb Shihadeh 5362097b37 fix loggerd after bootlog split (#19840)
* fix loggerd after bootlog split

* logger handles that

* unused

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 2e64049ea4996af6bcd6fc1ff9338f5e20a5b393
2021-01-19 14:27:19 -08:00
Dean Lee 57b1b4c456 loggerd: split bootlog to a separate program (#19831)
* bootlog

* blank lines

* move file_exists to util.h

* src = ['loggerd.cc']

* log_init_data

* Revert "src = ['loggerd.cc']"

This reverts commit 18a587023d75b3a3a54f1ceaf9cb31a51640a067.

* add bootlog to .gitignore

* use s->has_qlog instead of true

* add blank lines & remove extern C
old-commit-hash: f973c56a3695525442ac6c3e89c644b27cbeb384
2021-01-19 12:16:12 -08:00
Dean Lee 92c11baefb loggerd: make sure to print one statistics every 1000 times (#19803)
old-commit-hash: d085adb9ecd939467b2f7ac8db65aab8b906d250
2021-01-17 15:50:13 -08:00
Dean Lee 603a21c1f4 loggerd: do not LOGW twice when logger.part == 0 (#19795)
* fix LOGW

* space
old-commit-hash: caf87c25dd98a346d9024fe18507db6eaf7c584d
2021-01-16 18:34:11 -08:00
Willem Melching a04de5683e RecordFront remove ifdef (#19773)
old-commit-hash: 10790304c9882d726962e2b801c7810939b2c144
2021-01-15 13:21:39 -08:00
Adeeb Shihadeh 65a624db68 Loggerd for PC (#19730)
old-commit-hash: 92e4f0487315fc623f54a864ba489cf2102ad085
2021-01-12 16:28:22 -08:00
Adeeb Shihadeh 9909060b4d Video Encoder abstraction (#19729)
old-commit-hash: a1c7f19fe46fe79d84543a9388f4b131fc42051b
2021-01-12 00:03:31 -08:00
Adeeb Shihadeh 47cc09f413 loggerd: fix double encoder open (#19703)
* fix double encoder open/close

* simplify rotation

* clean up

* cleanup

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 87e8ef1fca00e35291414f05cc4a2a90237ba9f2
2021-01-11 19:48:50 -08:00
Dean Lee 99a831dd5c replace std::this_thread::sleep_for with util::sleep_fo (#19717)
old-commit-hash: 72bb55247cb82d9a1517b516dab535b9502864c4
2021-01-11 11:59:48 +01:00
Dean Lee 4c1919f41e merge utilpp.h into util.h (#19710)
old-commit-hash: 595830135bb79c8b23eb8339ae768ca7b6a822f8
2021-01-10 14:57:32 -08:00
Willem Melching 3f950832b9 VisionIPC 2.0 (#19641)
* Squashed vipc

* Update release files

* Remove else

* add visionipc to release files

* use poller in vipc receive

* opencl framework instead of lib on macos

* Fix camera webcam

* Fix opencl on mac in ui

* more webcam fixes

* typo in ui sconsfile

* Use cur_yuv_buf

* visionbuf c++ class

* Camera qcom was still using visionbuf_allocate

* Turn loggerd back on

* fix snapshot

* No build needed

* update test camerad

* no more release callback

* make encoder c++

* Revert "no more release callback"

This reverts commit e5707b07002fee665d0483d90713154efc2d70d4.

* fix exit handlers

* No need to check errno

* move release callback call

* s/VIPCBufExtra/VisionIpcBufExtra/g

* use non blocking connect

* ui use non blocking connect

* Lower condition variable wait time

* Snapshot cleanup

* bump cereal

* bump cereal
old-commit-hash: fb496c692a9ebdcda15069a8d4eb95734b587d68
2021-01-08 14:54:25 +01:00
Adeeb Shihadeh 1c2560352c loggerd cleanup (#19668)
old-commit-hash: 206d072bb4df0187b97c808f0a0478cbb9223976
2021-01-07 23:08:40 -08:00
Adeeb Shihadeh 0d895ad82a loggerd tests (#19671)
old-commit-hash: af81190cfcf96201f59b0461cc3fdd80cf8651a3
2021-01-06 19:18:35 -08:00
Adeeb Shihadeh 84255f7c0d fix race condition with encoder thread
old-commit-hash: e3d2f0c88cd04a2292ff4d90e74f38e147225d0c
2021-01-05 23:09:46 -08:00
Dean Lee 5e557ed96d common exit handler (#19661)
* common signal handle

* fix typo

* rename to ExitHandler

* remove include signal.h

* remove include csignal

* rename variable exit to v

* rebase master
old-commit-hash: 86fe2d1697531bebdf5d0d83609e91ed4006f54b
2021-01-05 20:19:53 -08:00
Adeeb Shihadeh 0fdc9af349 tici loggerd fixes (#19622)
* fix encoder exit when encoder is uninitialized

* cleanup

* more cleanup

* more cleanup

* little more

* ptr

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 54679cea585d1f65a6d8051cf338cb04f8a12319
2021-01-05 16:35:05 -08:00
Dean Lee bbfb751d69 Replace usleep with util::sleep_for (#19643)
* replace usleep with sleep_for

* sleep microseconds

* sleep nanoseconds

* Trigger Build
old-commit-hash: c1cf0882bd4e0fce5e1a581536f6a0e7afb640e6
2021-01-04 18:03:11 +01:00
Dean Lee f71bf83946 refactor qlog_counter (#19626)
old-commit-hash: 041fbbf7259a62e375d900f2eece309782b52411
2021-01-04 11:33:35 +01:00
Comma Device 4728ad22b0 add LOGW
old-commit-hash: 44bedaa73b12bd79e77f4ba15965ecff3566a6d9
2020-12-11 21:12:51 -08:00
Adeeb Shihadeh 9044cba60a remove raw logger (#2719)
* remove raw logger

* no raw_clips

* only remove raw clips

* cleanup
old-commit-hash: 56146d84ce43deb1afbe4b0b77438d1e9f8a4965
2020-12-08 15:23:06 -08:00
Willem Melching c790bb3c99 Set correct HW type in initData (#2685)
* set hw types

* dont use c++ filesystem
old-commit-hash: e7c182b0da097ab108c97da346d482b4f83b08c9
2020-12-03 17:27:12 +01:00
George Hotz 6b32f79ae6 New settings for governors, +30% memory bandwidth (#2590)
* new settings for governors, +30% memory bandwidth

* CPU waste is better

* warm up frame_drop

* optional CORE arg for rtshield

* back off priorities of processes not critical to driving

* if it doesn't drive, it's not realtime

* err, resource. this should have been included

* reverse order to not spike

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 917eff8c30895e85943ec0a8c735e91088dbda85
2020-11-20 19:25:12 -08:00
ZwX1616 deab0f86aa tici front/wide encodeIdx msgs (#2564)
* different msgs

* also add timestamps

* keep impatient log, remove the other

* meaningless
old-commit-hash: f244b7c7e156cd109be13a68ba1096dc2d25f3d0
2020-11-19 16:12:02 -08:00
ZwX1616 6b238ea78d remove duplicate enc_idx logging (#2562)
old-commit-hash: e113a1270292130ea3e7ef07a05b59aeb98c5ce7
2020-11-18 16:02:19 -08:00
ZwX1616 7f85b498be stop pc from spamming logs (#2544)
old-commit-hash: cf21720e1ae451286e6fd26fd6192d55914afa41
2020-11-13 16:26:30 -08:00
Adeeb Shihadeh d5990d0ef7 only qcom
old-commit-hash: d5a8444d6c9457bffbf929fe9314dfd210cf9e94
2020-11-12 16:19:28 -08:00
Adeeb Shihadeh ada81dda94 remove old loggerd priority
old-commit-hash: e88775a224502667be18bbedc655fa647ae83bd9
2020-11-08 15:44:04 -08:00
Adeeb Shihadeh 035ee027ff give loggerd min rt priority
old-commit-hash: 8f44e695835edbba79b913607d73f7735df060eb
2020-11-08 15:42:08 -08:00
Adeeb Shihadeh a4f4f1d828 Log last 1000 lines of tmux output in bootlog (#2149)
* log last 1000 lines of tmux output in bootlog

* add to bootlog

* fix tmux capture
old-commit-hash: 6b4957cba10985507c5ba2337ee08b6392f86ddb
2020-10-20 21:07:12 -07:00
Willem Melching 498ecbdf3c Params refactor, simplified (#2300)
* always c++

* Create C++ params class

* get works

* tests hang now

* passes tests

* cleanup string formatting

* handle interrupt in blocking read

* fix memory leak

* remove unused constructor

* Use delete_db_value directly

* Rename put -> write_db_value

* filename cleanup

* no semicolons in cython

* Update common/SConscript

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* add std::string version of delete_db_value

* This is handled

* cleanup encoding

* Add clear method to clear all

* add persistent params

* fix android build

* Should be called clear_all

* only import params when needed

* set params path on manager import

* recusrively create directories

* Fix function order

* cleanup mkdirp

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 2e182e5c574ea1468678b5fd8d0597e34ed5898d
2020-10-13 16:23:23 +02:00
Willem Melching a331861873 Remove czmq part 1 (#2332)
* remove czmq

* remove streaming mode from loggerd

* Add include for usleep
old-commit-hash: a4ccfcffe8247bf467bddfb0e6c5b3eb8851e21a
2020-10-13 16:01:07 +02:00
Willem Melching 5b91f74549 fix loggerd rotate (#2291)
old-commit-hash: b682ebc022959b86e12a106af7bb614737e78c77
2020-10-07 16:59:32 -07:00
ZwX1616 dc2470176b loggerd does not need to babysit this
old-commit-hash: e29fd900583b88f23883afd0a28e7ad06f0ff597
2020-10-06 18:46:22 -07:00
ZwX1616 6d3dc46b8f transient considerations (#2276)
old-commit-hash: 55351859a73f412fdd52b2166298f9ed354ce6c1
2020-10-05 15:41:17 -07:00
ZwX1616 db55c1cca3 Refactor loggerd rotations (#2247)
* loggerd:refactor rotate encoder

* change notify_all to notify_one

* finish

* cancelWait

* start front_encoder_thread on need

* rebase master to resolve conflict

* tici qcam works, but

* ifs are ugly

* synced rotate off frame ids

* only start counting frames after modeld alive

* typo

* fix some bugs

* never over rotate

* works

* missing space

* zero frame count tolerance

* lol

* add back omx race protection

* not need that

* not to confuse different locks

* playing with locks is playing with fire

* tici now has qcam

* size is overrated

* make cppcheck happy

* fall back if no camera

* warn

* missing condition

* first is freestyle

* no stream id before connecting

* wait for increment

* first will be imperfect

* wait is futile

* block frames when writing state

* just log write time

* exit loops when exit

* tici qcamera

* fixed

* add atomics

* incl

Co-authored-by: deanlee <deanlee3@gmail.com>
Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 2b974150c4478f6df69b7fbbc7037548e9e0bbbf
2020-10-03 07:56:16 -07:00
Dean Lee a7c8adcdbe read bool param with read_db_bool (#2205)
* read bool param with read_db_bool

* Update selfdrive/loggerd/loggerd.cc

Co-authored-by: Willem Melching <willem.melching@gmail.com>

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 0e5a5efffce15cc507d8104aceb58c132689d7c8
2020-09-21 18:17:35 +02:00
Dean Lee ef811e1105 use MessageBuilder::toBytes (#2167)
old-commit-hash: 272f60221c45cc543660a5e491cb800182c8b8f2
2020-09-14 01:17:00 -07:00
Dean Lee 7cee5aae63 more messagebuilder (#2162)
* more messagebuilder

* little more

* revert

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 9fa56b4eab62b5d793e6c6d714c9dbab47bb3f0a
2020-09-13 13:00:06 -07:00
Adeeb Shihadeh ac3422fc0f message builder (#2161)
* use custom MessageBuilder from cereal

* use MesageBuilder.toBytes

* bump cereal

* unused

* another one

* fix ui msg

Co-authored-by: deanlee <deanlee3@gmail.com>
old-commit-hash: 4d5733924a2fdd8a3bbaf5f48869ac744b983401
2020-09-12 21:48:15 -07:00
ZwX1616 d2fa5662b9 Fix loggerd not rotating encoder if dcamera upload disabled (#2133)
* should only count after the check

* include no dcam

* no need to copy

* run with both param

* independent idx

* not break test if no device

* remove unused

* EON D is half

* needs test for qcamera too

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 6a8cd6e054f53ba6ffdb708c6deaa2976c8e0867
2020-09-06 01:21:26 -07:00