Commit Graph

383 Commits

Author SHA1 Message Date
Greg Hogan f6a9445de8 tools: configure PYTHONPATH in pipenv (#23361)
* automatically set PYTHONPATH in pipenv

* remove other place this was set
old-commit-hash: 3e5a2730227603e06e2b0df657dd7a3e874a6bd1
2022-01-03 20:15:10 -08:00
Adeeb Shihadeh ba30137b2a MultiLogIterator: fix after adding sort_by_time
old-commit-hash: bbb47dc860f37ec6e34287d6696cb45e5637df74
2022-01-02 20:08:57 -08:00
Adeeb Shihadeh c036e64c86 MultiLogIterator: remove wraparound mode (#23360)
old-commit-hash: 92f194decc2bce39d6dd0dbabf39b2a9b1aa53e5
2022-01-02 15:16:44 -08:00
Adeeb Shihadeh 02f1866b61 CI: use ubuntu_setup.sh (#23349)
* CI: use ubuntu_setup.sh

* works?

* need to fix paths

* set paths

* no batman for now

* pyenv version

* rehash after install packages

* unify python install

* revert that

* fix pyenv path

* no pipenv

* flip that

* fix rehash

* skip that

* revert panda
old-commit-hash: 066e3e3626f56d8f86c120defe4181eaed0182f4
2022-01-02 14:47:16 -08:00
Greg Hogan 2f843c3023 LogReader: add arg to sort by time (#23346)
* logreader optional sort by time

* robust logreader sort by time option
old-commit-hash: 9992ea1ae82dd02199e7e04bbbb8af54728d6200
2022-01-02 11:56:53 -08:00
Greg Hogan e58562bcb6 plotjuggler: fix layout param (#23348)
old-commit-hash: 92b553be3ea0c4309961647a796dbdde3da5fdf6
2022-01-01 17:17:24 -08:00
Shane Smiskol 0c267f7685 PC: dynamically set PYTHONPATH from real openpilot path (#23322)
* dynamic PYTHONPATH setting based on actual openpilot location

* right above

* fix path

* absolute path all the time

* Revert "absolute path all the time"

This reverts commit c0bc2e08e76bd6c0abd36fa082ee00b4746e62dc.

* Update tools/openpilot_env.sh

Co-authored-by: Willem Melching <willem.melching@gmail.com>

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: fed7cfeef064b12f76b413298ffdf71fec1f537e
2021-12-31 19:34:08 -08:00
Adeeb Shihadeh 55e0fb4a55 fix setup scripts if git isn't installed
old-commit-hash: 7cd6a88638be390e0a7a13210e837afc36e1c18c
2021-12-31 19:29:38 -08:00
Adeeb Shihadeh 3b0d5834bd plotjuggler: add mac support (#23344)
* plotjuggler: add mac support

* fix test?

* update readme

* oops

* fix

* cleanup

* typo

* works

* little more

* fix test

* little faster
old-commit-hash: c26f294218a72e4a42d90b6560bde32e1a9cf5cb
2021-12-31 16:44:57 -08:00
Adeeb Shihadeh d710eed2d9 mac_setup: install git-lfs
old-commit-hash: 8fe9c0ef931a19be187fe8fceb3cf69e8864f80f
2021-12-31 10:08:34 -08:00
Ewout ter Hoeven f206ebd054 Pyupgrade 3.6: Update syntax with Python 3.6+ features (#23305)
Updated Python code with Python 3.6+ features:
- utf-8 encoding is now the default (PEP 3120)
- Replace list comprehensions by Generator Expressions (PEP 289)
- Replace yield loop by yield from (PEP 380)
- Remove the (object) subclass when defining a class
- Replace the IOError alias by OSError (PEP 3151)
- Define sets with curly braces {} instead of set()
- Remove "r" parameter from open function, which is default

Co-Authored-By: Adeeb Shihadeh <8762862+adeebshihadeh@users.noreply.github.com>
Co-Authored-By: GregorKikelj <96022003+GregorKikelj@users.noreply.github.com>

Co-authored-by: Adeeb Shihadeh <8762862+adeebshihadeh@users.noreply.github.com>
Co-authored-by: GregorKikelj <96022003+GregorKikelj@users.noreply.github.com>
old-commit-hash: 332f568a8241fba9459cb70c76840b9670e6993a
2021-12-24 11:18:39 -08:00
Ewout ter Hoeven a962365292 Convert format strings strings to f-strings (#23241)
* Convert all text strings to f-strings

Reformats all the text from the old "%-formatted" and .format(...) format to the newer f-string format, as defined in PEP 498. This requires Python 3.6+.

Flynt 0.69 was used to reformat the strings. 120 f-strings were created in 51 files.

F-strings are in general more readable, concise and performant. See also: https://www.python.org/dev/peps/pep-0498/#rationale

* revert pyextra changes

* revert ublox.py

Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 55390d273f36f49da3896e687ac5530f40c1d150
2021-12-16 14:58:17 +01:00
grekiki 9e4cc1f7ff Python: Replace more lists with generators (#23116)
* Replace lists with generators v2

* Replace set with {}

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Replace more set() with {}

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 6951b3271d1770297cb6bd53878463035ec0bf43
2021-12-03 22:57:19 -08:00
Adeeb Shihadeh 0827af77e5 MultiLogIterator: default wraparound to false
old-commit-hash: c8356d3b8f4ef822161af75087553506e5fb78df
2021-12-02 08:14:48 -08:00
Dean Lee 9b0fcaeb84 rename yuv streams (#23071)
* rename yuv streams

* bump cereal

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 348d2d2b0d169b0d181a51eb0e23b1f9b8fc6793
2021-11-29 18:14:59 -08:00
Adeeb Shihadeh 6c90a5d445 logreader: remove log path print
old-commit-hash: 01b99eae35906ba95c25c2498b19a53a0e8fc591
2021-11-29 13:44:20 -08:00
Adeeb Shihadeh 807e84d900 juggle: add demo flag and improve README
old-commit-hash: 920b751888a09192f055241c7db6cfdfc5f1bf57
2021-11-28 14:19:49 -08:00
Adeeb Shihadeh 973a48acef remove dead + duplicate python code
old-commit-hash: 08f9316b56ffe2c36a5d9c23d0b4df49903ad52a
2021-11-28 14:02:06 -08:00
Willem Melching 70e2e78f52 sim: improve carla performance (#23046)
old-commit-hash: a4ca8e4835949f5f8a5d6123142f9ffcb7e36245
2021-11-28 11:32:37 +01:00
Adeeb Shihadeh 94d30c6c5f camerad: remove camera frame stream (#23045)
* camerad: remove camera frame stream

* fix release files
old-commit-hash: 8160cf3c1b2726709db58219c33d1616b4a8acb5
2021-11-27 21:58:21 -08:00
jimw cf29eacca4 CARLA: send YUV and RGB over visionipc from bridge.py (#23012)
* CARLA: send YUV and RGB over visionipc

* CARLA: send YUV and RGB over visionipc-fix pipfile

* CARLA: send YUV and RGB over visionipc-Camerad class

* relock pipfile

* small bridge cleanup

* use tici camera resolution

* update vof

* HUD_SETTING has no counter

* no loggerd

Co-authored-by: jwolffe <wolffja@gmail.com>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: a58d272ae4afa11624220b9392295ad6659db1df
2021-11-26 16:58:25 +01:00
Adeeb Shihadeh 5aebf5466a can_replay: warning & clone cmd if jungle lib is missing
old-commit-hash: b8393f7271c3b1845e7ad49e35db8688c01770cc
2021-11-23 23:33:26 -08:00
Adeeb Shihadeh 4ffc570eb8 link to ctf in tools readme
old-commit-hash: a64169af26c905521e85e1a48d1cff0095f24d8a
2021-11-19 21:16:49 -08:00
Adeeb Shihadeh 2e40fdfb0f juggle: strip input
old-commit-hash: 80d0aaadf448d9f47a7da4779791566323e5de22
2021-11-18 14:56:01 -08:00
Willem Melching fd3140fd6f cleanup unused pip packages (#22947)
* cleanup unused pip packages

* fix linter
old-commit-hash: f1c77f97b934fac877230d9438fb4a15d1813c52
2021-11-17 16:23:03 +01:00
eFini 22ea8f17c2 macOS: Fix missing pip command issue. (#22924)
* Fixed missing pip command issue.

* add path to openpilot_env.sh for mac
old-commit-hash: a87190342bbe30aa4fd09c1f9586d9a7060e8b76
2021-11-17 11:23:05 +01:00
Adeeb Shihadeh c9b2b90681 ubuntu_setup.sh: add option to continue on unsupported os
old-commit-hash: 0674726cf4e0dfffc30d4596e2c650821b792588
2021-11-16 14:30:51 -08:00
qadmus 2e3bf355a1 plotjuggler: plotjuggler: tuning layout w/ cruise setpoint, use carControl.enable not carControl.active (#22908)
old-commit-hash: 5f2c7ad69f68857c0a160032fc4308927e38302e
2021-11-15 13:20:53 -08:00
qadmus 229d987f10 PlotJuggler: Tuning layout (#22902)
* PlotJuggler layout for lateral and longitudinal tuning

* update README and tuning PR template
old-commit-hash: 65d1b5147694934385ec2943c0b67cf0f971c597
2021-11-13 23:16:42 -08:00
Adeeb Shihadeh 17b51d3fd8 sim: fix CAN error and block loggerd
old-commit-hash: 45ced84acf9d0c8fcb5d37a9be82f81b5ff59479
2021-11-13 12:21:24 -08:00
Willem Melching c11eeb6c80 RobustLogReader that can recover corrupted bz2 files (#22835)
* LogReader with bzip2 recovery

* only rlogs

* add comment

* plotjuggler should also use robust logreader
old-commit-hash: 6d6f989b7f4f084ff2a1124aa4de05b90d7fc534
2021-11-10 16:41:00 +01:00
Adeeb Shihadeh 605c84634a tools/lib/route: expose raw file paths
old-commit-hash: ee33f8a8cd31dce6b6cfcab0dcd0c3c2d9f01595
2021-11-04 20:32:02 -07:00
Willem Melching 2dbecc8a15 tools/lib/auth.py: support github/apple login (#22766)
* tools/lib/auth.py: support github/apple login

* print some info about logged in user

* add docstring
old-commit-hash: 252f3c1c871909611d162596e163fd7e6b8541bb
2021-11-01 15:00:00 +01:00
Dean Lee 15ed1a50a3 replay: fixed the alignment issue when replaying from C3 qcamera (#22734)
* fix qcamera replay

* fix alignment in replay

* upscale yuv if needed

* remove space
old-commit-hash: 41e5e76596eed1b6391cb5770df2c628c3125023
2021-11-01 11:06:00 +01:00
lipniak 9fcb713e9c tools/setup: do not change global state (#22735)
* tools/setup: do not change global state

1. download packages in the venv
2. never change global python version

* update_requirements.sh: install to system if used by comma employees

* bump pip & pipenv versions

* no --upgrade

* run pre-commmit install in venv

* for consistency

Co-authored-by: predicate@bonzo <noreply@example.com>
Co-authored-by: Willem Melching <willem.melching@gmail.com>
old-commit-hash: 1d55f2f23e31dd64568d729ef33325cf229fdf51
2021-10-31 16:37:07 +01:00
lipniak dc816fc35c tools: add info on common issues (#22709)
* tools/README.md: add more information

1. Add info about OpenCL drivers
2. Add info about pipenv environment

* ubuntu_setup.sh: add clinfo

Adds the clinfo command so you can verify your OpenCL installation.

* tools/README.md: add info on GUI WSL
old-commit-hash: e68849cfc8e612eeadca316070e5f49464b98831
2021-10-29 11:19:43 +02:00
Willem Melching 67f41f32f1 Sphinx docs generation (#22697)
* add sphinx

* switch theme

* Experiment: sphinx docs generation updated (#22708)

* moved build to root gitignore, added .gitkeep

* Improved makefile doc build process

- Removed auto-generated docs from source control
- Moved apidoc.sh into Makefile
- Removed make.bat (can add back if Windows support desired)
- Added sphinx viewcode and markdown extensions
- Added feature to source /docs in build, so any .rst file in /docs will
  override the respective file during the build process
- Added feature to copy all markdown/rst files from source into /build/
  during build process so they can be easily referenced while writing
  docs (see examples in index.md)
- Wrote basic starter index.md file

TODO: Add new dependencies to Pipfile [dev-packages]

* Revert accidental modification to Pipfile

* fix command substitution

* exclude xx

* improve docs

* dont include all docs in release build

* Add dockerfile

* update title

* include normal readme

* build container in CI

* use buildkit

* add login

Co-authored-by: Chad Bailey <chadbailey904@gmail.com>
old-commit-hash: b816b5b6442c21e63a09108c70986eeedb0372b2
2021-10-28 15:14:37 +02:00
Andrew 1e04063b9b tools/setup: add missing package for plotjuggler (#22713)
old-commit-hash: 999b2ee5cc5af8f356a76b0cb240a3bfffa7b30c
2021-10-27 10:56:41 -07:00
Willem Melching 116ae68bdb do not run on import
old-commit-hash: 59accdd814398b884167c0f41dbf46dcccf0c29c
2021-10-26 14:49:51 +02:00
Adeeb Shihadeh fc4b12c05c sim: set fingerprint with environment variable (#22679)
old-commit-hash: e556d3d3d3bf6a0cdc588abbae57b256aace0351
2021-10-24 21:59:50 -07:00
lipniak d2d94f2fd4 ubuntu_setup.sh: add 21.10 support and change packages (#22628)
old-commit-hash: 38420a1bef9419fffe778ab737d69eb143337762
2021-10-22 15:45:20 -07:00
Adeeb Shihadeh 6b8ea0b86a tools/setup: install git-lfs from standard apt source
old-commit-hash: 76a87514975283722172c30d53e581c2f6815026
2021-10-19 22:37:08 -07:00
Minjie Xu 8120ce0a98 tools/setup: use OP_ROOT in cd (#22600)
old-commit-hash: a9672eabf490b2088fe32e2ef8e09e18ff41e1b1
2021-10-18 10:51:20 -07:00
FM 8eb8313509 Update README.md (#22586)
old-commit-hash: f6dd5dde5c299b495851dfef78cfbed925d62626
2021-10-17 14:57:58 +02:00
Adeeb Shihadeh 39099120a5 can_replay: use segments without an FCW
old-commit-hash: 7b5d915a6827be907c4abfc40afe5c287201674e
2021-10-16 15:00:07 -07:00
Dean Lee 09a378d1eb tools/ui.py: support playing qcamera (#22571)
old-commit-hash: f564eca51d72c00ba379fc7d891982bef4c92791
2021-10-16 11:32:24 -07:00
Adeeb Shihadeh 7011ab48af add note about WSL2
old-commit-hash: a6f44092cea23ccf350ef8e05389f0228ac3c05d
2021-10-14 15:02:36 -07:00
Adeeb Shihadeh b8215f213c update to python 3.8.10 (#22551)
* update to python 3.8.10

* update CI

* add note about update_requirements.py
old-commit-hash: 7386d4f6c3a434670a9c7b966dcf867f18fec048
2021-10-13 21:36:10 -07:00
jimw aaae6ac738 sim: send peripheralState message (#22541)
* controlsd: ignore peripheralState for Simulation

* controlsd: use fake peripheralState for Simulation

* controlsd: use fake peripheralState for Simulation

* controlsd: use fake peripheralState for Simulation

* Apply suggestions from code review

* sim: send peripheralState message

* sim: send peripheralState message

* sim: send peripheralState message

* sim: send peripheralState message

Co-authored-by: wolffja <wolffja@ubuntu20.04LTS>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 26c5e7b826cc04e301e3c8c50884582f05e27ceb
2021-10-13 17:16:56 -07:00
Adeeb Shihadeh da0873ef6a fix sub bullets
old-commit-hash: 37937a4aa69d8f4dc75d1cbfd3f2a6ba7e04f478
2021-10-13 13:31:40 -07:00