Commit Graph

97 Commits

Author SHA1 Message Date
Willem Melching 4844f8196d remove loggerd todo about encodeIdx decimation
old-commit-hash: 377fe84948c069c3f00824c06e0ae40f2aa2616e
2021-09-08 12:16:16 -07:00
Willem Melching e49dd50f98 Disable encoder sync logic if only one rotate camera present (#22107)
* disable sync logic if only one rotate camera

* consistent brackets
old-commit-hash: 48035e9535ba362e382d01282a1475b4ace2778a
2021-09-01 23:08:06 -07:00
Willem Melching 60e7e09127 Ensure that first segment starts with all cameras on the same frameId (#22096)
* test that segment starts with the same frame id

* improve test

* add sync logic

* atomic max

* review comments
old-commit-hash: a93271a518b466cd83699acd8598a0361ee9a02b
2021-09-01 14:28:50 -07:00
Dean Lee ecf3ee7603 loggerd: create encoder threads from cameras_logged (#21875)
old-commit-hash: d9baaf7eb90f0815c4d635d33244975ad71876d2
2021-08-30 19:33:00 -07:00
Adeeb Shihadeh 277bd43b15 Revert "tici: give loggerd rt priority (#21503)"
This reverts commit 0a50cf851e79342cf3db01033bc91516c504cbea.

old-commit-hash: 54a4eeb0fccd92c3b2f872175cfedf136a1cfc71
2021-08-22 16:57:53 -07:00
Adeeb Shihadeh 5c1d1ebe76 tici: give loggerd rt priority (#21503)
* give loggerd rt priority

* assert

* little more

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 7e2752c878a9e8c38639e4caa234bcabb979db2e
2021-08-20 21:27:31 -07:00
Willem Melching ae4f3c98d5 refactor loggerd: trigger rotate in encoder thread (#21860)
* trigger rotate in eoncode thread

* rotate in time

* lgtm

* dcam trigger rotate on C3

* check trigger rotate field

* Use >=

* add rotator thread

* set cnt to 0

* test encodeIdx is increasing across segments

* test both segmentId and encodeId

* fix encodeIdx

* no thread needed

* add log for failed to encode

* stricter C3 test, dont check start encodeId on C2 dcam

* only update last_camera_seen_tms when considered for rotate

Co-authored-by: deanlee <deanlee3@gmail.com>
old-commit-hash: a39873872de5b2239e4b89119974e5aa961eba48
2021-08-06 11:10:33 +02:00
Willem Melching f8edcd64c4 loggerd: power failure print sync done
old-commit-hash: dd128f591689464801d98f8251416af7f5ea6909
2021-07-12 12:28:07 +02:00
Adeeb Shihadeh d31397b84b segment regen (#21148)
* start seg regen

* send vipc

* fix up some paths

* set fp

* fix no entries

* engages

* seperate camera procs

* send real frames

* regen test routes

* nice argparser

* fix valgrind test

* move that

* fix that
old-commit-hash: 4a1aec27efb48bdba1d267c86ef66c8a044c4986
2021-06-28 21:44:40 -07:00
Dean Lee 147b355dde add space after function name and if statement (#21225)
old-commit-hash: e4e669bb0fc1a919dfb38800099f8e3ad52346f1
2021-06-11 10:17:52 +02:00
Dean Lee f70a79b838 Use C++ header files instead of C header files. (#21192)
* use cstring instead of string.h

* use cstdio instead of stdio.h

* remove inttypes.h

* use cstdlib instead of stdlib.h

* use cstdint instead of stdint.h

* #include <cstddef>

* cstdlib

* use cmath

* remove stddef.h

* use cassert

* use csignal

* use ctime

* use cerror

* rebase master
old-commit-hash: c53cb5d570adb82bc454fcabab458d7e7f09738c
2021-06-08 13:46:22 -07:00
Willem Melching 80ec32bcf3 loggerd: put signal in end of route sentinel (#21025)
old-commit-hash: 6e22f16ddb03eaa030d5e6a16039c193808e7586
2021-05-25 17:34:40 +02:00
Dean Lee e333e4f189 Cleanup selfdrive/ includes (#20822)
* cleanup include path

* continue

* format includes

* fix testraw.cc

* remove include path from SConstruct

* regroup

* rebase master

* almost done

* apply review

* rename FileReader.xx to filereader.xx

* rename Unlogger.x->unlogger.x

* rename FrameReader.xx -> framereader.xx

* apply reviews

* ui.h

* continue

* fix framebuffer.cc build error:mv util.h up

* full path to msm_media_info

* fix qcom2 camerad

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 7222d0f20dc8edfe0d2f3417d1ce7c84fbd32805
2021-05-08 22:15:17 -07:00
Willem Melching 78bf4f5867 Replace ifdef with hw abstraction layer (#20843)
* Replace ifdefs with hardware abstraction layer (#20801)

* add type to class hadwareXXX

* replace ifdefs with hardware layer

* continue

* continue

* new function get_driver_view_transform

* full path to hw.h

* fix build error setup.cc

* apply review

* fix typo

* fix deprecated error:replace deprecated fromPath with new

* fix build error

* Fixes after ifdef clenaup (#20842)

* inheritance doesnt work with static

* fix debayer

* small cleanup

* Update selfdrive/camerad/cameras/camera_common.cc

* Update selfdrive/ui/qt/offroad/settings.cc

* Update selfdrive/common/modeldata.h

* flip conditions

* fix comment

Co-authored-by: Dean Lee <deanlee3@gmail.com>
old-commit-hash: ab319d4f54a53e1a0aa1c2c0d94d56a9acef8362
2021-05-06 14:39:05 +02:00
Willem Melching 39c18d4c5a Revert "Replace ifdefs with hardware abstraction layer (#20801)"
This reverts commit 9f2ad462f39f4c880f283b71bffbc9248a2b577d.

old-commit-hash: 3a95d3ccaae7168073410cd7d392a9564d9d45ba
2021-05-06 12:29:30 +02:00
Dean Lee e0282ced49 Replace ifdefs with hardware abstraction layer (#20801)
* add type to class hadwareXXX

* replace ifdefs with hardware layer

* continue

* continue

* new function get_driver_view_transform

* full path to hw.h

* fix build error setup.cc

* apply review

* fix typo

* fix deprecated error:replace deprecated fromPath with new

* fix build error
old-commit-hash: 757d2923d2bfcda620b252e21a348ac3f87f3a63
2021-05-06 11:41:46 +02:00
Adeeb Shihadeh 55a9ec8a93 set nice values for non RT processes (#20812)
* set nice values for non RT processes

* builds

* fix qcom build

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: ec414e2eb1e27eac04582ffbdc88f8022bfb34cc
2021-05-04 22:00:11 -07:00
Adeeb Shihadeh 532d19427c bump cereal
old-commit-hash: 8a280fbb8eb433fbfe0fc43254c9cbdaceedbab6
2021-05-03 20:47:11 -07:00
Adeeb Shihadeh 467811edf1 log encodeIdx packets in qlog (#20738)
old-commit-hash: 9813c0ddbdbd00716710a24c7edbdd509b66d9b7
2021-04-23 16:14:45 -07:00
Dean Lee 405df8b165 Params: python-like interface (#20506)
* rebase master

* delete outdated test_params.c

* putBool & more robust getBool

* putBool(SshEnabled)
old-commit-hash: 98e55996f67aaaf715c941d417ae4d3b0187f388
2021-03-30 12:54:59 +02:00
Willem Melching c64d818341 use class AlignedBuffer (#20388)
* use class AlignedBuffer from cereal (#20343)

* AlignedBuffer

* move AlignedBuffer to cereal/messaging.hpp

* rename function aligned to get

* use overloaded function AlignedBuffer:: get(Message *)

* use AlignedBuffer

Co-authored-by: Dean Lee <deanlee3@gmail.com>
old-commit-hash: 0a88304e8d51ef8dac881ac9bb16d5de11f184a3
2021-03-17 14:43:23 +01:00
Willem Melching d61654abc3 Revert "use class AlignedBuffer from cereal (#20343)"
This reverts commit df9e836779af0c145efc933b88bbc94f59f2b378.

old-commit-hash: e3ad952902ed38530b56b10f39dc67d7232fd28c
2021-03-16 20:21:03 +01:00
Dean Lee 4c02da3f0a use class AlignedBuffer from cereal (#20343)
* AlignedBuffer

* move AlignedBuffer to cereal/messaging.hpp

* rename function aligned to get

* use overloaded function AlignedBuffer:: get(Message *)
old-commit-hash: 7aa379e123aba70a4c36f95e69786a558892dc2d
2021-03-16 11:13:15 +01:00
ZwX1616 46840807fa up tici hevc bitrate (#20093)
* 2x tici bitrate

* update test

* clean up
old-commit-hash: e2044ca5a2fab66de9b341a5eea2a6c994a45572
2021-02-22 09:15:56 -08:00
Willem Melching a98a06c1f8 loggerd: clean exit on SIGPWR (#20100)
* loggerd: clean exit on SIGPRW

* no SIGPWR on macos
old-commit-hash: d3dfb47d0e8fef18171a393005da76c98e941419
2021-02-18 17:46:46 +01:00
Adeeb Shihadeh 05eb44115e cereal cleanup part 2 (#20092)
* car stuff

* thermal

* Revert "car stuff"

This reverts commit 77fd1c65ebd01abfa8493ae12c9e6b14f7ada976.

* panda state

* camera stuff

* start deg

* most is building

* builds

* planner + controls run

* fix up paramsd

* cleanup

* process replay passes

* fix webcam build

* camerad

* no more frame

* thermald

* ui

* paramsd

* camera replay

* fix long tests

* fix camerad tests

* maxSteeringAngle

* bump cereal

* more frame

* cereal master
old-commit-hash: 312b681a46b8153314a8420611b6479dd6f70dfc
2021-02-16 21:39:32 -08:00
Greg Hogan d59a13e22a adjust qcamera quality (#20066)
* better ts

* fix test
old-commit-hash: 1cd9105e96c37ef5365aa34aa52c7ede6afd0567
2021-02-11 17:55:00 -08:00
Dean Lee 6e63be3a01 loggerd: remove the segment variable from encoders (#20034)
old-commit-hash: 1fad5216eac27271387726a072827c134c68d98f
2021-02-07 17:48:46 -08:00
Dean Lee 33495e4368 loggerd: small cleanup (#19864)
old-commit-hash: 16e259cadf7da85f8faf072edd2b37dc1fc4f03c
2021-01-30 18:37:58 -08:00
Dean Lee da9b0e8baa remove cqueue, use class SafeQueue (#19774)
* class SafeQueue

* cleanup includes

* space

* add timeout

use try_poll

* add function empty() & size()

* class SafeQueue

* add timeout

use try_poll

* add function empty() & size()

* rebase master

* rebase master

* for loop

* fix bug
old-commit-hash: e6783f4d9f10a256a4c301eb1d1843d9e2a17ab6
2021-01-28 15:12:45 +01:00
Dean Lee b0552a1985 bootlog: fix dangling pointer problem in logger_build_boot (#19942)
* fix  dangling pointer problem

* logger_build_init_data() has same problem

* return kj::Array<capnp::byte>

* Revert "return kj::Array<capnp::byte>"

This reverts commit 4df4685bfcaba0c5400e2690440a74c32ff75afa.

* Empty commit,trigger Build

* fix each segment in a route having a different initial logMonoTime
old-commit-hash: 79e05965c403289dbe75622ac5a9970218163959
2021-01-28 13:34:07 +01:00
Adeeb Shihadeh a65cef0b31 loggerd: remove vipc arg from encode frame
old-commit-hash: 1ed77847fe3f53b14595bab8f1f47134fee03c9b
2021-01-23 17:11:36 -08:00
Adeeb Shihadeh cfdeda3393 OMX encoder stability (#19758)
* cleanup test first

* wait for other encoder threads

* fixes initial crash

* no print

* unused

* fix up tests

* need that

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: d4489fbf91588ea609041bc6bb2899c7de0a3c3c
2021-01-21 10:40:08 -08:00
Adeeb Shihadeh 5362097b37 fix loggerd after bootlog split (#19840)
* fix loggerd after bootlog split

* logger handles that

* unused

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 2e64049ea4996af6bcd6fc1ff9338f5e20a5b393
2021-01-19 14:27:19 -08:00
Dean Lee 57b1b4c456 loggerd: split bootlog to a separate program (#19831)
* bootlog

* blank lines

* move file_exists to util.h

* src = ['loggerd.cc']

* log_init_data

* Revert "src = ['loggerd.cc']"

This reverts commit 18a587023d75b3a3a54f1ceaf9cb31a51640a067.

* add bootlog to .gitignore

* use s->has_qlog instead of true

* add blank lines & remove extern C
old-commit-hash: f973c56a3695525442ac6c3e89c644b27cbeb384
2021-01-19 12:16:12 -08:00
Dean Lee 92c11baefb loggerd: make sure to print one statistics every 1000 times (#19803)
old-commit-hash: d085adb9ecd939467b2f7ac8db65aab8b906d250
2021-01-17 15:50:13 -08:00
Dean Lee 603a21c1f4 loggerd: do not LOGW twice when logger.part == 0 (#19795)
* fix LOGW

* space
old-commit-hash: caf87c25dd98a346d9024fe18507db6eaf7c584d
2021-01-16 18:34:11 -08:00
Willem Melching a04de5683e RecordFront remove ifdef (#19773)
old-commit-hash: 10790304c9882d726962e2b801c7810939b2c144
2021-01-15 13:21:39 -08:00
Adeeb Shihadeh 65a624db68 Loggerd for PC (#19730)
old-commit-hash: 92e4f0487315fc623f54a864ba489cf2102ad085
2021-01-12 16:28:22 -08:00
Adeeb Shihadeh 9909060b4d Video Encoder abstraction (#19729)
old-commit-hash: a1c7f19fe46fe79d84543a9388f4b131fc42051b
2021-01-12 00:03:31 -08:00
Adeeb Shihadeh 47cc09f413 loggerd: fix double encoder open (#19703)
* fix double encoder open/close

* simplify rotation

* clean up

* cleanup

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 87e8ef1fca00e35291414f05cc4a2a90237ba9f2
2021-01-11 19:48:50 -08:00
Dean Lee 99a831dd5c replace std::this_thread::sleep_for with util::sleep_fo (#19717)
old-commit-hash: 72bb55247cb82d9a1517b516dab535b9502864c4
2021-01-11 11:59:48 +01:00
Dean Lee 4c1919f41e merge utilpp.h into util.h (#19710)
old-commit-hash: 595830135bb79c8b23eb8339ae768ca7b6a822f8
2021-01-10 14:57:32 -08:00
Willem Melching 3f950832b9 VisionIPC 2.0 (#19641)
* Squashed vipc

* Update release files

* Remove else

* add visionipc to release files

* use poller in vipc receive

* opencl framework instead of lib on macos

* Fix camera webcam

* Fix opencl on mac in ui

* more webcam fixes

* typo in ui sconsfile

* Use cur_yuv_buf

* visionbuf c++ class

* Camera qcom was still using visionbuf_allocate

* Turn loggerd back on

* fix snapshot

* No build needed

* update test camerad

* no more release callback

* make encoder c++

* Revert "no more release callback"

This reverts commit e5707b07002fee665d0483d90713154efc2d70d4.

* fix exit handlers

* No need to check errno

* move release callback call

* s/VIPCBufExtra/VisionIpcBufExtra/g

* use non blocking connect

* ui use non blocking connect

* Lower condition variable wait time

* Snapshot cleanup

* bump cereal

* bump cereal
old-commit-hash: fb496c692a9ebdcda15069a8d4eb95734b587d68
2021-01-08 14:54:25 +01:00
Adeeb Shihadeh 1c2560352c loggerd cleanup (#19668)
old-commit-hash: 206d072bb4df0187b97c808f0a0478cbb9223976
2021-01-07 23:08:40 -08:00
Adeeb Shihadeh 0d895ad82a loggerd tests (#19671)
old-commit-hash: af81190cfcf96201f59b0461cc3fdd80cf8651a3
2021-01-06 19:18:35 -08:00
Adeeb Shihadeh 84255f7c0d fix race condition with encoder thread
old-commit-hash: e3d2f0c88cd04a2292ff4d90e74f38e147225d0c
2021-01-05 23:09:46 -08:00
Dean Lee 5e557ed96d common exit handler (#19661)
* common signal handle

* fix typo

* rename to ExitHandler

* remove include signal.h

* remove include csignal

* rename variable exit to v

* rebase master
old-commit-hash: 86fe2d1697531bebdf5d0d83609e91ed4006f54b
2021-01-05 20:19:53 -08:00
Adeeb Shihadeh 0fdc9af349 tici loggerd fixes (#19622)
* fix encoder exit when encoder is uninitialized

* cleanup

* more cleanup

* more cleanup

* little more

* ptr

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: 54679cea585d1f65a6d8051cf338cb04f8a12319
2021-01-05 16:35:05 -08:00
Dean Lee bbfb751d69 Replace usleep with util::sleep_for (#19643)
* replace usleep with sleep_for

* sleep microseconds

* sleep nanoseconds

* Trigger Build
old-commit-hash: c1cf0882bd4e0fce5e1a581536f6a0e7afb640e6
2021-01-04 18:03:11 +01:00