66ca3985c9
replay : move utility functions into separate file ( #22414 )
...
* move functions into util
* read bz2 into stream
* pre-decompress log in the download thread
* cleanup logreader
* cache sha256 path
* use readBZ2file in test_logger
* Revert "cache sha256 path"
This reverts commit 60459d3ea09a2c80f4560cf95b1ce7d6af59f06d.
* use macro
* use ostringstream
* cleanup readBZ2File
* move precise_nano_sleep into util
old-commit-hash: d28b98c60244e2bb9e32810e881ea445a912606c
2021-10-04 15:39:59 +02:00
0cf0485912
small typo
...
old-commit-hash: 3ccf712ac99ce8ef393d87ddd7241d1d823dd5a6
2021-09-24 10:23:41 +02:00
c0356ffe9b
add log docs
...
old-commit-hash: 0f8c6f130b5c9e023db136f64da1cbc1590a6994
2021-09-23 14:41:35 -07:00
d508125f35
Upload when on ethernet ( #22188 )
...
in addition to when on wifi
Co-authored-by: ntegan <nick@egan.gg >
old-commit-hash: 54b5972cf6f7220ba6af061c6dadc2dc80d813d0
2021-09-10 12:05:12 -07:00
4844f8196d
remove loggerd todo about encodeIdx decimation
...
old-commit-hash: 377fe84948c069c3f00824c06e0ae40f2aa2616e
2021-09-08 12:16:16 -07:00
33b378419a
loggerd: remove obsolete ethernetsniffer.py ( #22139 )
...
old-commit-hash: 8bca70878fbfeaa18ba7b0bcc17b1ba1baad1eb2
2021-09-06 12:11:19 -07:00
2dac83c02b
loggerd: remove obsolete testraw.cc ( #22138 )
...
old-commit-hash: 5a8ca8b449fb3418d31ca325fb38d393413d83b8
2021-09-06 12:10:12 -07:00
e49dd50f98
Disable encoder sync logic if only one rotate camera present ( #22107 )
...
* disable sync logic if only one rotate camera
* consistent brackets
old-commit-hash: 48035e9535ba362e382d01282a1475b4ace2778a
2021-09-01 23:08:06 -07:00
60e7e09127
Ensure that first segment starts with all cameras on the same frameId ( #22096 )
...
* test that segment starts with the same frame id
* improve test
* add sync logic
* atomic max
* review comments
old-commit-hash: a93271a518b466cd83699acd8598a0361ee9a02b
2021-09-01 14:28:50 -07:00
4c17c06799
Handle EINTR for all syscalls that can return it ( #21948 )
...
old-commit-hash: f02c8d0e2c04e45ceeea9f2fe9851319d724a637
2021-08-31 16:22:56 -07:00
ecf3ee7603
loggerd: create encoder threads from cameras_logged ( #21875 )
...
old-commit-hash: d9baaf7eb90f0815c4d635d33244975ad71876d2
2021-08-30 19:33:00 -07:00
0fac38e34f
LoggerState: test cases ( #21855 )
...
* test multiple threads writing to log
* fix typo
* use util::getenv
* check INIT_DATA and SENTINEL
* test END_OF_SEGMENT
* add comment
* test multiple threads logging and rotation
* cleanup
* update
* LoggerHandle:quick fix
* cleanup
* revert test_loggerd.py
* refactor test case
* check lock file
* check refcnt after close
* test_runner.cc
d
* int eixt_signal
old-commit-hash: 935cbd3139993eac84f7936dfdb191deb86114f1
2021-08-30 17:12:09 -07:00
6f92abc815
Less open file permissions ( #21922 )
...
* Less open file permissions
* add test back
* remove params test for permissions
* remove umask
* bump cereal
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
old-commit-hash: dddab597bcee0a103895509b7909743f97cbdf83
2021-08-28 18:25:05 -07:00
277bd43b15
Revert "tici: give loggerd rt priority ( #21503 )"
...
This reverts commit 0a50cf851e79342cf3db01033bc91516c504cbea.
old-commit-hash: 54a4eeb0fccd92c3b2f872175cfedf136a1cfc71
2021-08-22 16:57:53 -07:00
5c1d1ebe76
tici: give loggerd rt priority ( #21503 )
...
* give loggerd rt priority
* assert
* little more
Co-authored-by: Comma Device <device@comma.ai >
old-commit-hash: 7e2752c878a9e8c38639e4caa234bcabb979db2e
2021-08-20 21:27:31 -07:00
f65c7e7418
capnp:Text::Reader: use implicit conversion from string ( #21980 )
...
old-commit-hash: c6a34dd9f7ea1798a54883070eb548c17addbb12
2021-08-19 13:49:08 -07:00
7d09945de3
BZFile: handle EINTR on BZ2_bzWrite ( #21949 )
...
old-commit-hash: b66e8adbefc3c8a360917fb0b8b8023374a63320
2021-08-18 12:08:07 +02:00
aff7f0b1f3
enclose macro arguments in parentheses ( #21947 )
...
* macro argument should be enclosed in parentheses
* CL_CHECK
old-commit-hash: 4625098a7953308cc76c6c9b81d28e6bb89f671c
2021-08-18 10:56:37 +02:00
9b1a7a6f01
use same env variable for loggerd, deleter, and uploader
...
old-commit-hash: 1d4b19f739270bd6b075c7ea9b48e7460ab867c0
2021-08-07 18:58:11 -07:00
ae4f3c98d5
refactor loggerd: trigger rotate in encoder thread ( #21860 )
...
* trigger rotate in eoncode thread
* rotate in time
* lgtm
* dcam trigger rotate on C3
* check trigger rotate field
* Use >=
* add rotator thread
* set cnt to 0
* test encodeIdx is increasing across segments
* test both segmentId and encodeId
* fix encodeIdx
* no thread needed
* add log for failed to encode
* stricter C3 test, dont check start encodeId on C2 dcam
* only update last_camera_seen_tms when considered for rotate
Co-authored-by: deanlee <deanlee3@gmail.com >
old-commit-hash: a39873872de5b2239e4b89119974e5aa961eba48
2021-08-06 11:10:33 +02:00
94d534afea
hw.h: move Hardware-related paths to namespace Path ( #21826 )
...
* refactor getenv and path
* apply review
old-commit-hash: fefc70b4cab71a11b3c5ed1b8680606ee2013a48
2021-08-04 13:29:03 +02:00
17867a1122
loggerd: implement DONT_LOG flag ( #21832 )
...
* implement DONT_LOG flag
* better typing
old-commit-hash: 8354cfc53c023bfd20b7887c7ff4560fb9615b4f
2021-08-02 20:16:38 -07:00
db62739c00
fix loggerd test failure when camerad is slow to start
...
old-commit-hash: d748b44f48f6d8d4e2b1ce6195363bded06ba377
2021-08-02 09:10:29 -07:00
7fed9b0c0c
logger.cc/logger_build_init_data(): reuse params_map ( #21811 )
...
* faster log params
* Update selfdrive/loggerd/logger.cc
* fix build
Co-authored-by: Willem Melching <willem.melching@gmail.com >
old-commit-hash: fecdf16f6bd729dadf35053e4dcde39cae9cb73e
2021-08-02 11:21:12 +02:00
31ea9413bb
util/read_files_in_dir: return map by value ( #21815 )
...
old-commit-hash: 11ffbc693694780c612d9d449f49a2feabe8a0a2
2021-08-02 10:59:54 +02:00
dc0c4bd99b
debug msg for loggerd tests
...
old-commit-hash: 48652db706c7070bb336fc40be7acdc5c2a6e97a
2021-07-28 14:01:27 -07:00
14a441a314
publish uploader state ( #21580 )
...
* uploader state
* add time
* bump
* populate whole packet
* bump cereal
* revert
Co-authored-by: Comma Device <device@comma.ai >
old-commit-hash: 6b6903280719da6cf764baa9417766cf785c0101
2021-07-13 17:18:10 -07:00
f8edcd64c4
loggerd: power failure print sync done
...
old-commit-hash: dd128f591689464801d98f8251416af7f5ea6909
2021-07-12 12:28:07 +02:00
255dfffd7f
fix qlog decimation calculation in loggerd tests
...
old-commit-hash: d8411e7a62a8e3c3df9fe8a7406849b83e927a3d
2021-07-10 23:20:15 -07:00
a637623fa0
upload can only create ( #21513 )
...
old-commit-hash: d066b8f7e813894338b2747c74ad089968ff70e9
2021-07-07 18:28:06 -07:00
19bc1b7397
fast jenkins ( #21472 )
...
* speed up setup
* speedup onroad test
* .git doesn't like inplace
* tici2
* no inplace
* revert
* fix
* that one too
old-commit-hash: 0bfd994f73a73b321f0ac45e1f3f5d1e907e6962
2021-07-02 16:29:57 -07:00
d31397b84b
segment regen ( #21148 )
...
* start seg regen
* send vipc
* fix up some paths
* set fp
* fix no entries
* engages
* seperate camera procs
* send real frames
* regen test routes
* nice argparser
* fix valgrind test
* move that
* fix that
old-commit-hash: 4a1aec27efb48bdba1d267c86ef66c8a044c4986
2021-06-28 21:44:40 -07:00
147b355dde
add space after function name and if statement ( #21225 )
...
old-commit-hash: e4e669bb0fc1a919dfb38800099f8e3ad52346f1
2021-06-11 10:17:52 +02:00
f70a79b838
Use C++ header files instead of C header files. ( #21192 )
...
* use cstring instead of string.h
* use cstdio instead of stdio.h
* remove inttypes.h
* use cstdlib instead of stdlib.h
* use cstdint instead of stdint.h
* #include <cstddef>
* cstdlib
* use cmath
* remove stddef.h
* use cassert
* use csignal
* use ctime
* use cerror
* rebase master
old-commit-hash: c53cb5d570adb82bc454fcabab458d7e7f09738c
2021-06-08 13:46:22 -07:00
61d3b1f177
disable uploading raw by default ( #21128 )
...
old-commit-hash: c76c30fa2d37d471d065e908739c69f06b43ccfe
2021-06-03 15:24:30 -07:00
724e0f6e11
deleter.py: delete boot and crash folders last ( #21028 )
...
old-commit-hash: 129c760e4fad558bf3c5d03fb5fb8edfb76bfc8b
2021-06-01 14:08:08 -07:00
497472932a
Cleanup util.h ( #20849 )
...
* cleanup util.h
* fix build error:omx_encoder.cc:408: undefined reference to do_exit
* fix build error
* rebase master
* move helper functions back to util
* ExitHandleHelper->ExitHandlerHelper
* std::clamp
* struct ExitHandlerHelper to class
* rebase master
* cleanup
* restore ExitHandler
* prefer cassert
old-commit-hash: 65e0b1e699092355bfcb1f588a5a2ec949a34b77
2021-06-01 16:53:12 +02:00
80ec32bcf3
loggerd: put signal in end of route sentinel ( #21025 )
...
old-commit-hash: 6e22f16ddb03eaa030d5e6a16039c193808e7586
2021-05-25 17:34:40 +02:00
295d18ad11
log OS version in initData ( #20979 )
...
old-commit-hash: ec976b3b442a4df958c96857741c12f67de47efe
2021-05-20 13:00:34 -07:00
5609f32cee
Cleanup includes ( #20925 )
...
* remove #include <pthread.h>
* remove #include<stdbool.h> for cc files
* remove #include<iostream>
old-commit-hash: 0495426535490e7d8d503af35ace7a20dc70a7bb
2021-05-17 10:31:31 +02:00
f68f0403a6
bootlog: setup cloudlog on keywords ( #20898 )
...
* bootlog: setup cloudlog on keywords
* just log
old-commit-hash: 2bc9b97aba9224c2337110422d17be0e50009f0d
2021-05-13 23:02:08 -07:00
8b785f4744
store all files in /sys/fs/pstore in bootlog ( #20875 )
...
* store all files in /sys/fs/pstore in bootlog
* whitespace
* fix bootlog test
old-commit-hash: 4742f55749e59f565192589b318841f2133260ed
2021-05-12 11:15:54 +02:00
e333e4f189
Cleanup selfdrive/ includes ( #20822 )
...
* cleanup include path
* continue
* format includes
* fix testraw.cc
* remove include path from SConstruct
* regroup
* rebase master
* almost done
* apply review
* rename FileReader.xx to filereader.xx
* rename Unlogger.x->unlogger.x
* rename FrameReader.xx -> framereader.xx
* apply reviews
* ui.h
* continue
* fix framebuffer.cc build error:mv util.h up
* full path to msm_media_info
* fix qcom2 camerad
Co-authored-by: Comma Device <device@comma.ai >
old-commit-hash: 7222d0f20dc8edfe0d2f3417d1ce7c84fbd32805
2021-05-08 22:15:17 -07:00
78bf4f5867
Replace ifdef with hw abstraction layer ( #20843 )
...
* Replace ifdefs with hardware abstraction layer (#20801 )
* add type to class hadwareXXX
* replace ifdefs with hardware layer
* continue
* continue
* new function get_driver_view_transform
* full path to hw.h
* fix build error setup.cc
* apply review
* fix typo
* fix deprecated error:replace deprecated fromPath with new
* fix build error
* Fixes after ifdef clenaup (#20842 )
* inheritance doesnt work with static
* fix debayer
* small cleanup
* Update selfdrive/camerad/cameras/camera_common.cc
* Update selfdrive/ui/qt/offroad/settings.cc
* Update selfdrive/common/modeldata.h
* flip conditions
* fix comment
Co-authored-by: Dean Lee <deanlee3@gmail.com >
old-commit-hash: ab319d4f54a53e1a0aa1c2c0d94d56a9acef8362
2021-05-06 14:39:05 +02:00
39c18d4c5a
Revert "Replace ifdefs with hardware abstraction layer ( #20801 )"
...
This reverts commit 9f2ad462f39f4c880f283b71bffbc9248a2b577d.
old-commit-hash: 3a95d3ccaae7168073410cd7d392a9564d9d45ba
2021-05-06 12:29:30 +02:00
e0282ced49
Replace ifdefs with hardware abstraction layer ( #20801 )
...
* add type to class hadwareXXX
* replace ifdefs with hardware layer
* continue
* continue
* new function get_driver_view_transform
* full path to hw.h
* fix build error setup.cc
* apply review
* fix typo
* fix deprecated error:replace deprecated fromPath with new
* fix build error
old-commit-hash: 757d2923d2bfcda620b252e21a348ac3f87f3a63
2021-05-06 11:41:46 +02:00
55a9ec8a93
set nice values for non RT processes ( #20812 )
...
* set nice values for non RT processes
* builds
* fix qcom build
Co-authored-by: Comma Device <device@comma.ai >
old-commit-hash: ec414e2eb1e27eac04582ffbdc88f8022bfb34cc
2021-05-04 22:00:11 -07:00
b12a444bdd
Params: move keys from cython to cc ( #20814 )
...
* move keys from cython to cc
* consistency
* passes tests
* more consistency
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com >
old-commit-hash: 27d3f820bf4d34bbc799cfc7ce5f9e006f0fe774
2021-05-04 10:49:26 -07:00
532d19427c
bump cereal
...
old-commit-hash: 8a280fbb8eb433fbfe0fc43254c9cbdaceedbab6
2021-05-03 20:47:11 -07:00
467811edf1
log encodeIdx packets in qlog ( #20738 )
...
old-commit-hash: 9813c0ddbdbd00716710a24c7edbdd509b66d9b7
2021-04-23 16:14:45 -07:00
Dean Lee