Commit Graph

26 Commits

Author SHA1 Message Date
Jason Wen f9952d7cb7 CI: Disable process_replay and remove fakedata (#651)
* CI: Disable process_replay

* remove fakedata

* don't bump panda yet
2025-03-08 23:30:44 -05:00
Jason Wen c13f159a77 Revert "models: retain SNPE runner support" (#529)
Revert "models: retain SNPE runner support (#522)"

This reverts commit f84d27c4ee.
2025-01-06 22:06:50 +00:00
Jason Wen f84d27c4ee models: retain SNPE runner support (#522)
* tinygrad with snpe

* force with snpe to validate

* fix path

* fix more paths

* Adjust modeld execution logic based on active model runner

Introduced a check to conditionally execute `modeld` based on the active model runner. Added support for distinguishing between SNPE and TinyGrad runners using new helper functions and updated `custom.capnp` definitions. This change optimizes process management by ensuring compatibility with the selected model runner.

* Refactor modeld process function checks.

Introduce `is_stock_model` to clarify logic and replace direct uses of `is_snpe_model` where the stock model condition is needed. Additionally, rename the duplicate "modeld" process in sunnyPilot to "modeld_snpe" for clarity and consistency.

* ignore tg

* fix process name

* ruff

* fix thneed paths

* mypy

* remove our own

* use upstream compile3

* fix thneed

* try this

* Revert "remove our own"

This reverts commit 1cf4f57502565c274628e185c66f1eb04c4d9bbe.

* try using compile2.py again

* add back symlink

* fix path

* more fix

* wrong path again

* Revert "wrong path again"

This reverts commit f5301c19d594defb23cda2604168bcb02c830f3e.

* update

* hardcode path to our submodule

* force path

* try this

* fix file name

* try this

* again

* Revert "again"

This reverts commit 17c8cd73768a2de5aaf2a34d202aa6f03d59d72d.

* Revert "try this"

This reverts commit 767f78bbcf17b08edbc20f283d10a1990bf4264f.

* Revert "fix file name"

This reverts commit 485eef68da981da571fe9a9ebf3aecdb95e5588c.

* Revert "try this"

This reverts commit 41fef87680cdda1ba8cbd7e5c59256e6c57010a0.

* Revert "force path"

This reverts commit 5c3b408937bff0f61b150971b328d127501c5bf0.

* Revert "hardcode path to our submodule"

This reverts commit 5ee1950b6f4fce73e7e73b6971b996a9989d0a93.

* Revert "update"

This reverts commit fb313bd7fbeb50111f3c4a11137b4cfd9cabc3fa.

* Reapply "wrong path again"

This reverts commit 309639aeb3575e20b215bbbcc27e48923ee95c87.

* Revert "wrong path again"

This reverts commit f5301c19d594defb23cda2604168bcb02c830f3e.

* Revert "more fix"

This reverts commit 23dd423e78e60bd6a0bd73e921bfba9a5aad88bd.

* Revert "fix path"

This reverts commit 75d338f2bda2dfa77044e33f4c6553390621b13b.

* Revert "add back symlink"

This reverts commit 9f71ad0b8ae2068e431c455af9d4f954d024eec7.

* Revert "try using compile2.py again"

This reverts commit 914117d2e1c6c4270f7bef1a5305847a1d7bab17.

* Reapply "remove our own"

This reverts commit b1996377b346658f2094cba9032a66230784cb3e.

* don't even compile anymore

* need it for default snpe model

* add to lfs

* bring onnx back for sim

* must add this back

* need this

---------

Co-authored-by: DevTekVE <devtekve@gmail.com>
2025-01-05 17:47:27 -05:00
DevTekVE 437663ff98 CI: Fix process replay to properly work with local routes (#469)
Updating test_processes.py to easily upload ref routes locally to git instead of azure
2024-12-11 10:22:45 +01:00
ZwX1616 876f192112 exec DM model with gpu (#33609)
* half

old-commit-hash: 9f72eca003d4637ca7fe847ebaf925c694fc2e84

* optimed

old-commit-hash: 6e36e2a12e09275ec21d1590012a92b05ca52ff5

* thneed

old-commit-hash: 419a06c09c0c767d828bcd1e118bc575898c343a

* exec

old-commit-hash: 0059c27ec11b076a37f65d604ed135ea6541b1a6

* runner

old-commit-hash: 34232ada94450ce541eaef546197fa219810a891

* runs but

old-commit-hash: 3db37c00b6a64908293b4de8d8b56e80308cd8f2

* it is 01

old-commit-hash: a160d81eb1a7e77abbef959b44f602610f68f665

* np

old-commit-hash: c1caff6ba648cc2c0094c71b2ea074f01c3c2dc8

* module url

old-commit-hash: 6f4902c4d384263a53e2c1d14d93b5ff864b6a5f

* new

old-commit-hash: 779ae79b1bc3df6374fb6663ac8592e107a6e504

* ds fast

* is this work

* corcention

* real timing

* no reg

* interim gather

* 0e4a9c7b

* fa69be01, and halve

* list

* cleanup

* slighly faster

* setprotlt

* expected

* replay ref

* more powar

* reluctantly

* bump tg

* 8

* less

* less

* bump tg

* better than exp

* closer

* cc

* see diff

* commits

* was right

* to 32 cast

* remove dlc file

* support both

* dspExecutionTime -> gpuExecutionTime

* ignore

* time ref

* ref commit

* last

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-09-26 16:40:44 -07:00
ZwX1616 ffb6e11f96 Revert "exec DM model with gpu" (#33604)
Revert "exec DM model with gpu (#33397)"

This reverts commit f79aca8e1e.
2024-09-19 20:55:11 -07:00
ZwX1616 f79aca8e1e exec DM model with gpu (#33397)
* half

old-commit-hash: 9f72eca003d4637ca7fe847ebaf925c694fc2e84

* optimed

old-commit-hash: 6e36e2a12e09275ec21d1590012a92b05ca52ff5

* thneed

old-commit-hash: 419a06c09c0c767d828bcd1e118bc575898c343a

* exec

old-commit-hash: 0059c27ec11b076a37f65d604ed135ea6541b1a6

* runner

old-commit-hash: 34232ada94450ce541eaef546197fa219810a891

* runs but

old-commit-hash: 3db37c00b6a64908293b4de8d8b56e80308cd8f2

* it is 01

old-commit-hash: a160d81eb1a7e77abbef959b44f602610f68f665

* np

old-commit-hash: c1caff6ba648cc2c0094c71b2ea074f01c3c2dc8

* module url

old-commit-hash: 6f4902c4d384263a53e2c1d14d93b5ff864b6a5f

* new

old-commit-hash: 779ae79b1bc3df6374fb6663ac8592e107a6e504

* ds fast

* is this work

* corcention

* real timing

* no reg

* interim gather

* 0e4a9c7b

* fa69be01, and halve

* list

* cleanup

* slighly faster

* setprotlt

* expected

* replay ref

* more powar

* reluctantly

* bump tg

* 8

* less

* less

* bump tg

* better than exp

* closer

* cc

* see diff

* commits

* was right

* to 32 cast

* remove dlc file

* support both

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-09-19 17:42:44 -07:00
Maxime Desroches 41408516f0 Cleanup lfs tracking (#33471)
* clean

* format

* Revert "format"

This reverts commit 461e2649f702c4d19c5c01e7ba654d137083118f.
2024-09-04 13:27:44 -07:00
Adeeb Shihadeh 12d2d861f2 Revert "Switch from json11 to nlohmann/json (#31093)"
This reverts commit 8fa1e8aa53defca264272a66531d639b3d569418.

old-commit-hash: 88757c12b3371a1ba5b3ebabc9e85faad0a19d56
2024-01-22 22:41:59 -08:00
mtribiere cb3a834067 Switch from json11 to nlohmann/json (#31093)
* Initial commit

* fix release/file_common

* Update common/swaglog.cc

* Swtiched serialize cc

* move to lfs

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: ee036482b8152f0e7650895c6f4bac5d4f00e00f
2024-01-22 22:35:47 -08:00
Adeeb Shihadeh e25712ddd2 stricter file size limits (#30839)
* move all pics to lfs

* wav and rest of so

* more to lfs

* ignore a few

* push that up
old-commit-hash: 1f9970ba3db588301f97716fa5f1e891e2324f38
2023-12-26 15:22:59 -08:00
Justin Newberry a0d7f9b2b1 Standardize line endings in repo (#30112)
use lf by default
old-commit-hash: 205cf1225863266853452c9668e53635115584b9
2023-09-30 17:05:43 -07:00
Adeeb Shihadeh e69eeb7344 move remaining big files into LFS (#30053)
old-commit-hash: e185e5ffcd165ee35e1bbd8c80631a89247a1dfc
2023-09-25 21:53:03 -07:00
Adeeb Shihadeh 84bd37edfb move fonts and training images into LFS (#30049)
old-commit-hash: f33874b0dc621217e8f57520769ef10f96b86c24
2023-09-25 20:06:44 -07:00
Adeeb Shihadeh 3472dda0e4 Revert "move big assets into LFS (#30030)"
This reverts commit 88ee47e90fa93979f9ca3a2c0c90ec6d3ccc4c62.

old-commit-hash: 8ecafa45a07b88cc33687506669f0a606f4dd0cf
2023-09-25 19:24:13 -07:00
Adeeb Shihadeh 66cec633f9 move big assets into LFS (#30030)
* move fonts

* move training
old-commit-hash: eb97ff8a668811bab0ca92594a1a1ebe60987f6e
2023-09-24 10:08:06 -07:00
Shane Smiskol 11492496fc test_models: run on route list (#26226)
* move to openpilot

* draft

* support internal urls

* not used

* update seg list

* regen segment list

* regen seg list

* regen

* regen

* regen

* no dirty segments

* regen seg list with no fuzzy or fixed fp

* regen segments with hda2 exception

* regen with added filters

* regen without bad dongle

* regen

* regenerate!

* regenerate, only OP enabled

* regen

* regenerate!

* regenerate!

* stash

* use SegmentName

* new route list

* add temp comment

* remove comment

* let's see if this works

* comment out other tests to speed up

* fix agent

* ?

* hmm

* oh whoops...

* add matrix

* fix

* how many levels do we need?

* fix values

* matrix can't be in parallel

* how about this

* try this

* Revert matrix

Revert "try this"

This reverts commit 8d0d91fd70c467c1fbb4e4e9aed511d15b2a30ef.

Revert "how about this"

This reverts commit a8e4fc53234824e77cbfb1e471277bc033e9dea1.

Revert "matrix can't be in parallel"

This reverts commit daaa6fcc3c75c74cbb90e97c565099a94123994c.

Revert "fix values"

This reverts commit df554b6a3371d124a574eb8d26bc51ef5b5b8fde.

Revert "how many levels do we need?"

This reverts commit 1a17320fa1c5e7220ef60e29981bbb3bb7da16c6.

Revert "fix"

This reverts commit e7eb6e404358fbd2eac3fea1901a8d30ea92d729.

Revert "add matrix"

This reverts commit a1b57e5725417d3c2f639f8edfc0c889b84b6753.

* use pytest instead! (5 jobs is ~150 mins)

* split lines, uncomment

* This Sienna seg has a fault SDSU that stopped forwarding/sending msgs

* picked a route with no PSCMStatus and no panda errors, recent routes are working

* this cadillac was dashcammed (no radar)

* opened an issue for this, it's 'expected' right now

* small clean up

* small clean up

* i don't think that worked

* is this needed?

* add to new PC tests

* cache

* draft

* Revert "draft"

This reverts commit 3b7f740dd4883118747300bc3687074c2d3c2116.

* probably should be function

* draft

* clean up

* add todo

* 600 random segments

* debug

* does this fix pythonpath issues?

fix

* try this

* mount?

* pytest again!

* no need for PYTHONPATH now

* Update Jenkinsfile

* ?

* convention

* clean up

* would be even more complex (have to unset ci which is class level)

* track

* is lfs pulled at all?

* ah no it's not
old-commit-hash: 70b1e9dd756cd2f6929cdf33dd1061a33f3b52b1
2023-08-10 00:45:23 -07:00
Greg Hogan 3cffc7c175 cleanup .gitattributes (#23503)
old-commit-hash: c214aee2d6257fc69c31577042f4b30596e704e0
2022-01-12 23:07:06 -08:00
Adeeb Shihadeh 9d25936fed cleanup old files from .gitattributes
old-commit-hash: 590023c8f16d9c5f14c5ec2839ad07edc9469acc
2021-10-06 16:58:59 -07:00
Adeeb Shihadeh 51c13aa552 APK purge (#20446)
* purge begins

* release files

* remove those

* no more android

* only qt

* text and spinner

* neos update script

* update sounds

* update cpu usage

* all done

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: e76c80ffa1b6167fd69465c66f31fbe475762330
2021-03-24 14:30:41 -07:00
grekiki 9518779d56 Qt training guide (#19953)
* initial commit

* background kind of works

* checkpoint

* temp

* add images

* all works

* remove some files

* rename

* enable restart

* remove first

* lfs try1

* refactor labels

* remove nonneeded code

* centered

* more centering

* don't hardcode the training version

Co-authored-by: Comma Device <device@comma.ai>
old-commit-hash: c5762456e13ff46bc517ab69c07d94d022cd800b
2021-01-29 17:54:00 +01:00
Willem Melching e0f2111061 Rebuild acado and add scons command to regenerate mpc (#19685)
* rebuild acado and add scons command to regenerate mpc

* update scons help
old-commit-hash: 7c43a60bda6c129c0c5a34cdb7fe74d8243729c5
2021-01-07 15:18:23 +01:00
Adeeb Shihadeh bc9891b651 external cleanup (#19647)
* remove external

* put back ffmpeg for now
old-commit-hash: 1669e4a5d1444c07c31400a23fc42d8f6cccc837
2021-01-04 14:17:14 -08:00
HaraldSchafer 008f37c749 Torch model (#2452)
* refactor draw model

* rebase master

* correct valid_len

* rename function

* rename variables

* white space

* rebase to master

* e16c13ac-927d-455e-ae0a-81b482a2c787

* start rewriting

* save proress

* compiles!

* oops

* many fixes

* seems to work

* fix desires

* finally cleaned

* wrong std for ll

* dont pulse none

* compiles!

* ready to test

* WIP does not compile

* compiles

* various fixes

* does something!

* full 3d

* not needed

* draw up to 100m

* fix segfault

* wrong sign

* fix flicker

* add road edges

* finish v2 packet

* Added pytorch supercombo

* fix rebase

* no more keras

* Hacky solution to the NCHW/NHWC incompatibility between SNPE and our frame data

* dont break dmonitoringd, final model 229e3ce1-7259-412b-85e6-cc646d70f1d8/430

* fix hack

* Revert "fix hack"

This reverts commit 5550fc01a7881d065a5eddbbb42dac55ef7ec36c.

* Removed axis permutation hack

* Folded padding layers into conv layers

* Removed the last pad layer from the dlc

* Revert "Removed the last pad layer from the dlc"

This reverts commit b85f24b9e1d04abf64e85901a7ff49e00d82020a.

* Revert "Folded padding layers into conv layers"

This reverts commit b8d1773e4e76dea481acebbfad6a6235fbb58463.

* vision model: 5034ac8b-5703-4a49-948b-11c064d10880/780  temporal model: 229e3ce1-7259-412b-85e6-cc646d70f1d8/430  with permute + pool opt

* fix ui drawing with clips

* ./compile_torch.py 5034ac8b-5703-4a49-948b-11c064d10880/780 dfcd2375-81d8-49df-95bf-1d2d6ad86010/450 with variable history length

* std::clamp

* not sure how this compiled before

* 2895ace6-a296-47ac-86e6-17ea800a74e5/550

* db090195-8810-42de-ab38-bb835d775d87/601

* 5m is very little

* onnx runner

* add onnxruntime to pipfile

* run in real time without using the whole CPU

* bump cereal;

* add stds

* set road edge opacity based on stddev

* don't access the model packet in paint

* convert mat.h to a c++ header file (#2499)

* update tests

* safety first

Co-authored-by: deanlee <deanlee3@gmail.com>
Co-authored-by: mitchell <mitchell@comma.ai>
Co-authored-by: Comma Device <device@comma.ai>
Co-authored-by: George Hotz <george@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
old-commit-hash: 08846b5c0ec3a5299c8cb73904da15a18d3aaccf
2020-11-11 20:31:46 -08:00
George Hotz 5fc734773e root directory hidden files
old-commit-hash: c8a04d25c9c13926bd08513d26b425cfeda39486
2020-01-17 10:25:50 -08:00
Vehicle Researcher 79ca8c9ec9 openpilot release
old-commit-hash: e94a30bec07e719c5a7b037ca1f4db8312702cce
2016-11-29 18:34:21 -08:00