Commit Graph

101 Commits

Author SHA1 Message Date
Adeeb Shihadeh a11b275333 Quick pass at making the system image smaller (#436)
* some savings

* ttf -> woff

* two weights is enough

* one weight
2025-01-23 20:43:59 -08:00
Adeeb Shihadeh 9573332851 Use system python 3.12 (#431)
* system python

* dev
2025-01-22 16:19:12 -08:00
Adeeb Shihadeh 6761665b4a there can only be one /tmp 2024-12-16 16:12:55 -08:00
Adeeb Shihadeh 68d829ad37 Fix NetworkManager crashes on 24.04 (#419)
* Fix NetworkManager crashes on 24.04

* rm that
2024-12-16 15:51:13 -08:00
Mauricio Alvarez Leon d71ef11041 Revert "add some debugging python packages" (#415)
This reverts commit fbe1f0078b.
2024-12-12 10:52:02 -08:00
Adeeb Shihadeh fbe1f0078b add some debugging python packages 2024-12-05 11:29:55 -08:00
kyle-basis f383312e2b Fix typo in Dockerfile.agnos (#413) 2024-12-03 21:49:19 -08:00
Adeeb Shihadeh e917919964 fix netplan perms 2024-11-19 13:54:11 -08:00
Mauricio Alvarez Leon 453fc50ba9 build_system: fix uv 5.1 error and 3.12 pkgconfig error (#403)
* build_system: fix uv 5.1 error and 3.12 pkgconfig error

* remove mention of uv_bin and .cargo

* Update userspace/openpilot_python_dependencies.sh

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-11-13 09:57:24 -08:00
Adeeb Shihadeh deab0e9c9d move home overlay off /tmp 2024-10-30 19:21:08 -07:00
Adeeb Shihadeh b73cebf33e fix home.mount race (#397)
* move home mount

* fix that [upload]

* fix that [upload]
2024-10-30 18:28:13 -07:00
Adeeb Shihadeh bdae3242d4 update netplan config 2024-10-25 13:10:04 -07:00
Adeeb Shihadeh 94fb9317ee compile bytecode for python packages (#389)
* compile bytecode for python packages

* bump up size

* lil bigger
2024-10-24 15:09:13 -07:00
Adeeb Shihadeh fbad598ae6 Revert "Install rep and ren (#381)", hangs build on my machine
This reverts commit f2aef1d91b.
2024-10-11 20:24:40 -07:00
Adeeb Shihadeh 7eaa033080 camera: setup ICP (#384) 2024-09-27 14:14:23 -07:00
Andrei Radulescu 8f08295f77 fix fstab warning (#382)
* fix fstab warning

* [upload]
2024-09-19 10:32:12 -07:00
Robin Reckmann f2aef1d91b Install rep and ren (#381) 2024-09-19 10:31:40 -07:00
Andrei Radulescu 999a7c1180 add missing python dev dependencies (#376)
* add openpilot[dev]

* replace uv pip with uv sync (again)

* [upload]
2024-09-18 10:31:39 -07:00
Robin Reckmann f83aafb9f5 Remove PyQt5 (#375) 2024-09-16 16:16:17 -07:00
Robin Reckmann 4834f3496b Use ccache to speed up compilation (#342) 2024-09-12 09:27:48 -07:00
Robin Reckmann f856a66bfc Build independent packages first (#354)
* Move package compilation to separate dockerfile

* Add tag

* Revert "Add tag"

This reverts commit 6ed675b5db.

* Export packages from compiler docker

* Add packages folder to gitignore

* Add newline at EOF

* Keep cleaning apt

* Minimize compiler image

* Keep compilation in main dockerfile

* Revert some more

* Remove wip part for now

* Move build requirements installation to build scripts

* Remove newlines

* lint

* Compile and package modemmanager

* Disable unrelated modems

* Add runtime dependencies

* [Upload]

* Add missing package to fix networking

* Move package install to mm for now
2024-09-11 13:36:48 -07:00
Andrei Radulescu 2ee1c06a71 remove unused gcc-arm-none-eabi architectures & bins (#346)
* remove unused gcc-arm-none-eabi architectures & bins

* [upload]
2024-09-06 10:47:51 -07:00
Andrei Radulescu 1b506cf44b don't use uv sync for system environment (#341)
* don't use uv sync for system environment
https://docs.astral.sh/uv/concepts/projects/#configuring-the-project-environment-path

* [upload]

* no workspace maybe

* removed openpilot[dev] and created agnos[dev] instead
[upload]

* actually don't install extras now [upload]
2024-09-05 11:27:58 -07:00
Andrei Radulescu 30500eee39 Split out openpilot and agnos python dependencies (#265)
* make openpilot a dependency of agnos

* cleaner curls [upload]

* adding required dbus-python and pyopencl [upload]

* check in openpilot pyproject.toml and uv.lock

* ignore openpilot uv.lock

* remove allow-direct-references

* codespell: ignore openpilot python deps folder

* use a uv workspace instead
https://docs.astral.sh/uv/concepts/workspaces/

* codespell: ignore uv folder

* uv lock in sync

* agnos optional deps are never installed

* uv temp fix for dbus-python error

* uv agnos virtual

* update openpilot pyproject.toml

* also install openpilot testing

* sourcing is needed [upload]

* [upload]

* update openpilot uv.lock

* fix wrong env for uv sync

* added openpilot[testing]

* openpilot uv.lock is now workspace uv.lock

* [upload]

* no more uv.lock download

* new uv.lock

* openpilot[dev] + uv lock --upgrade

* [upload]

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-09-04 13:16:40 -07:00
coder351 503688baf1 pyenv to uv based python and venv (#303)
* switch pyenv to uv

* resolve issues

* remove uv upgrade

* switch to uv

* remove comment

* remove python version

* remove python3.12-dev

* remove empty line

* use python3.pc

* test github workflow

* switch to pyqt-5 + use uv python for pkgconfig

* remove references to pyenv

* add python2

* [upload]

* resolve docker warnings

* [upload]

* setup uv to use /usr/local

* use uv to install pyqt5

* use uv to install pip

* use --seed to setup pip

* test build using --no-deps

* test build pyqt5 using pyproject.toml

* revert pyqt5 from pyproject.toml

* [upload]

* use PyQt5 wheel

* revert duplicate openpilot_dependencies.sh installed in agnos-base

* add sudo

* revert dev deps purge

* remove openpilot_dependencies.sh from agnos-base

* add -y to apt-get

* add pyproject opencl dep

* add gcc-arm-none-eabi dep

* test removing dev dependencies

* test removing dev dependencies

* test purge using noninteractive

* test autoremove dependencies

* revert autoremove

* add pip to handle pip install

* add new line

* rebuild

* use uv python 3.12.3

* test github runner

* revert github runner

* rebuild

* set pc path to python 3.12

* rebuild pyqt5 in Docker

* test rebuild pyqt5

* rebuild pyqt5

* rebuild pyqt5

* test build pyqt5 wheel

* resolve venv

* test rebuild pyqt5 wheel

* resolve build error

* use pip to build wheel

* use prebuilt pyqt5 wheel

* move dbus-python deps

* resolve PR comments

* test remove dbus-python deps

* remove dbus-python deps

* remove pyqt5 pre-built wheel

* test uv python venv

* add quotes

* add shims

* rebuild

* remove XDG_DATA_HOME

* rebuild

* add uv shim

* chmod +x uv

* set UV_NO_CACHE=1

* remove trailing whitespace

* resolve uv device issues

* rebuild
2024-09-03 13:38:22 -07:00
Andrei Radulescu 396d8e19a4 build_system: fail when ubuntu base is updated (#332)
* fetch latest ubuntu-base image and error on download failed

* Dockerfile ubuntu base is now an argument

* revert fetch latest ubuntu-base image

* ubuntu base checksum

* print only the link to releases when download/checksum fails

* simpler checksum
2024-09-02 11:50:58 -07:00
Robin Reckmann 99f3469a83 Hang up console before serial-getty start (#326) 2024-08-26 22:03:02 -07:00
Adeeb Shihadeh 9f8dc1b54e add back pyenv rehash 2024-08-19 18:23:55 -07:00
Robin Reckmann 388c799932 Build PyQt5 wheel in parallel (#302)
* Build PyQt5 wheel

* Use valid whl name

* Move openpilot_python_dependencies to earlier to avoid duplication
2024-08-14 00:14:22 -07:00
Andrei Radulescu 4a924daa5a Ubuntu 24.04 (#262)
* Ubuntu 24.04 (#188)

* separate out qtwayland5 compilation

* ubuntu 22.04

* temp build system image

* remove bionic deps

* temp packages update

* update armhf packages

* back to libstdc++6

* replaced remove dqt5-default meta package with actual depss

* fix for build libqmi crashing with /usr/bin/env: 'python': No such file or directory

* mapbox-gl-native gcc11 fix

* openpilot_dependencies.sh change

* ubuntu-base 24.04 daily current

* apt install meson because PEP 668

* temp g++-11 for mapbox-gl-native

* bump capnproto to 1.0.2

* temp build only agnos-compiler-mapbox-gl-native

* Fixes for compiling mapbox-gl-native

* Fixes for compiling ffmpeg

* Build main system image again

* pyopencl from git since no 2023.1.5 release since https://github.com/inducer/pyopencl/issues/705

* Try to fix checkinstall - no success

* apt capnproto & ffmpeg since can't figure out issue with checkinstall

* Commented removed services disable

* Ubuntu 24.04 currently has arm-none-eabi/12.2.1 but just use wildcard to go to first folder

* pyclean is missing ?!

* ubuntu-latest in tests workflow

* Updated README

* Reverted internal/package_ota.py changes

* rebuilt kernel

* poetry.lock update

* Simplified build_system pipeline

* headers for capnproto

* Fix typo

* Fix for checkinstall

* Reverted apt capnproto & ffmpeg

* Some cleaning in Dockerfile

* 24.04 libwayland-client

* libffi6:armhf deb file

* Updated qtwayland

* Revert "libffi6:armhf deb file"

This reverts commit bb9cb5da95.

* libffi.so.6.0.4

* qt5-qmake qtbase5-dev qtbase5-dev-tools already in qt5-default

* Removed qtwayland old files

* checkinstall temp fix

* QStandardPaths: wrong permissions on runtime directory /var/tmp/weston, 0770 instead of 0700

* temp permissions fix makes loading build spinner show

* temp build optimization

* 24.04 new libs

* build kernel don't use tools on aarch64/arm64

* updated boot image and ko files

* cleaning

* switch to release 24.04

* wip - downgrade qt and libwayland

* polkitd-pkla package to support polkit *.pkla

* fixed issue with old qt needing libssl 1.1.1f

* remove /.dockerenv file

* more cleaning

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Ubuntu 24.04 branch fixes (#235)

* bump version

* /lib64 is now UsrMerged

* latest pip poetry; poetry.lock update

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* revert README

* [upload]

* disable failing nvmf-autoconnect.service

* disable failing networking.service

* [upload]

* no replacement for ondemand.service

* snapd.service is in snapd package we don't install

* nfs is using rpc-pipefs-generator now, when used

* checkinstall is still not fixed so remove TODO

* updated comment about usr merged lib64

* added checkinstall bug link

* removed not used libffi.so.6 and libwayland-client.so.0

* cleaned compile-qtwayland5.sh and removed 5.15 patch

* removed unused qt-comma 5.15 deb

* cleaned up custom debs for qt and libwayland and added a README

* fixed typo [upload]

* change version

* build-libwayland-deb.sh

* build-qt-deb.sh

* cleaned README

* [upload]

* fix libdl.so qtwayland build [upload]

* rebuild debs

* update libdl path [upload]

* added missing systemd-resolved

* ping capability

* disable some systemd services

* etc/resolv.conf link should not be needed

* Revert "etc/resolv.conf link should not be needed"

This reverts commit b627615a9e.

* Revert "ping capability"

This reverts commit 812ca357cf.

* set ping capability outside of container

* disable systemd services: console-setup and sfsconfig

Co-authored-by: Robin Reckmann <robin.reckmann@gmail.com>

* disabled more systemd services

* bump version [upload]

* update version

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Robin Reckmann <robin.reckmann@gmail.com>
2024-08-13 16:46:55 -07:00
Andrei Radulescu 7f7a7a7f82 fixed build and push full release in CI (#305)
* fixed ci workflows

* don't push ota-staging.json and system-skip-chunks-*.img.xz

* add back permissions

* updated raw links

* fixed missing if

* switch to gitlab

* VERSION
2024-08-12 14:33:10 -07:00
Robin Reckmann 6d886f2357 Error on Dockerfile warnings (#298) 2024-08-11 15:13:18 -07:00
Robin Reckmann f2571c76fb Replace apt-get with apt-fast (#285)
* Replace apt-get with apt-fast

* Some more apt-get replacements
2024-08-06 10:57:52 -07:00
Robin Reckmann 8465bfc6c7 Fix SecretsUsedInArgOrEnv warning (#283) 2024-08-06 06:56:47 -07:00
Robin Reckmann c017d6fba0 Fix InvalidBaseImagePlatform warning on aarch64 (#284) 2024-08-06 06:56:13 -07:00
Robin Reckmann 360675b935 Fix FromAsCasing warning (#277)
Address FromAsCasing warning
2024-07-31 06:56:02 -07:00
Andrei Radulescu 48ea05d6db uv pip install in a separate tmp folder (#257)
* move uv pip install in separate tmp folder

* [upload]
2024-07-25 12:59:33 -07:00
Andrei Radulescu 0ea00d5175 Reduce memory usage when building system (#244)
switch from -j40 to -j$(nproc)
2024-07-15 11:57:57 -07:00
Hoang Bui 3edbe65228 Remove remaining mapboxgl stuff (#243)
rm that
2024-07-15 08:01:28 -07:00
Adeeb Shihadeh df5a34a5bf remove mapbox-gl-native (#210) 2024-07-14 11:16:08 -07:00
pantew869 6e94867233 Switch from poetry to uv (#238)
* switch to uv from poetry

* delete poetry.lock

* add uv.lock, required-python, and switch to hatch as in openpilot

* add uv.lock, required-python, and switch to hatch as in openpilot

* update pyproject.toml and copy uv.lock to the docker image

* return opencl

* update uv.lock

* fix precommit

* use two spaces
2024-07-14 07:29:18 -07:00
Adeeb Shihadeh 53a681a2df bump version 2024-05-06 19:45:45 -07:00
Adeeb Shihadeh 0a49bceca2 Revert "update wifi tuning"
This reverts commit 94705b089c.
2024-05-05 17:46:05 -07:00
Adeeb Shihadeh 94705b089c update wifi tuning 2024-05-03 16:24:45 -07:00
Adeeb Shihadeh 1af0cde16e bump version to 10 2024-04-29 14:07:39 -07:00
Adeeb Shihadeh c529cfc46c fix double myhostname 2024-02-23 16:14:59 -08:00
Adeeb Shihadeh 0380c50571 bump version to 9.7 2024-02-23 14:55:52 -08:00
Adeeb Shihadeh ed605866a6 setup myhostname 2024-02-16 21:34:01 -08:00
Adeeb Shihadeh 3bc2e30890 bump version to 9.6 2024-02-07 15:54:58 -08:00
Adeeb Shihadeh 4a1ec4755e add back mapbox-gl-native for now, it's linked to a bunch of stuff 2024-02-07 15:30:22 -08:00