Commit Graph

382 Commits

Author SHA1 Message Date
Robin Reckmann f2aef1d91b Install rep and ren (#381) 2024-09-19 10:31:40 -07:00
Robbe Derks 0a4f4568c4 B01 wlan config (#377)
fix 5GHz
2024-09-18 23:01:01 +02:00
Andrei Radulescu 999a7c1180 add missing python dev dependencies (#376)
* add openpilot[dev]

* replace uv pip with uv sync (again)

* [upload]
2024-09-18 10:31:39 -07:00
Robin Reckmann f83aafb9f5 Remove PyQt5 (#375) 2024-09-16 16:16:17 -07:00
Adeeb Shihadeh f8408e4911 this abl is uploaded 2024-09-16 09:57:57 -07:00
Andrei Radulescu f58ae1b2c6 op alias (#368) 2024-09-16 09:55:29 -07:00
Andrei Radulescu 47e89b059f clear /data/tmp on boot (#371)
* clear /data/tmp on boot

* rm -rf /data/tmp
2024-09-16 09:54:48 -07:00
Andrei Radulescu a45d1a1a90 replace chrony with timesyncd (#369)
* add systemd-timesyncd

* remove chrony

* [upload]
2024-09-16 09:53:21 -07:00
Robin Reckmann 8759b3a563 Fix build on amd64 systems (#372) 2024-09-16 09:44:58 -07:00
Andrei Radulescu 147dce2e8f remove system-skip-chunks alt image (#367) 2024-09-13 07:51:18 -07:00
Adeeb Shihadeh 2f659e47b2 ABL without fastboot (#365) 2024-09-12 14:08:23 -07:00
Robin Reckmann 4834f3496b Use ccache to speed up compilation (#342) 2024-09-12 09:27:48 -07:00
Andrei Radulescu f79fe4550a Include AGNOS version in motd header (#350)
* include AGNOS version in motd header

* nicer version

* [upload]
2024-09-12 08:36:29 -07:00
Robin Reckmann f856a66bfc Build independent packages first (#354)
* Move package compilation to separate dockerfile

* Add tag

* Revert "Add tag"

This reverts commit 6ed675b5db.

* Export packages from compiler docker

* Add packages folder to gitignore

* Add newline at EOF

* Keep cleaning apt

* Minimize compiler image

* Keep compilation in main dockerfile

* Revert some more

* Remove wip part for now

* Move build requirements installation to build scripts

* Remove newlines

* lint

* Compile and package modemmanager

* Disable unrelated modems

* Add runtime dependencies

* [Upload]

* Add missing package to fix networking

* Move package install to mm for now
2024-09-11 13:36:48 -07:00
Andrei Radulescu 4457f9b27f Add missing evdev, smbus2 and inputs (#361)
* add evdev & smbus2; sync openpilot

* update uv.lock

* [upload]

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-09-11 13:31:51 -07:00
Andrei Radulescu 675fe11371 Smaller image size (#355)
* 3.7G

* [upload]

* 3700M

* 3800M

* 3900M

* 4000M

* [upload]

* dynamic ROOTFS_IMAGE_SIZE [upload]

* 10% instead [upload]

* 15% ?! [upload]

* revert dynamic size [upload]
2024-09-11 13:31:26 -07:00
Andrei Radulescu 2ee1c06a71 remove unused gcc-arm-none-eabi architectures & bins (#346)
* remove unused gcc-arm-none-eabi architectures & bins

* [upload]
2024-09-06 10:47:51 -07:00
Andrei Radulescu 20f1652918 display stats in CI step (#349) 2024-09-06 09:48:43 -07:00
Andrei Radulescu 13cd823813 Nicer version for CI builds (#351)
* correct GIT_HASH in CI

* nicer version

* [upload]
2024-09-06 09:48:21 -07:00
Andrei Radulescu 1b506cf44b don't use uv sync for system environment (#341)
* don't use uv sync for system environment
https://docs.astral.sh/uv/concepts/projects/#configuring-the-project-environment-path

* [upload]

* no workspace maybe

* removed openpilot[dev] and created agnos[dev] instead
[upload]

* actually don't install extras now [upload]
2024-09-05 11:27:58 -07:00
Robin Reckmann 27a408db56 Ignore .DS_Store files (#343) 2024-09-05 07:31:05 -07:00
Andrei Radulescu 30500eee39 Split out openpilot and agnos python dependencies (#265)
* make openpilot a dependency of agnos

* cleaner curls [upload]

* adding required dbus-python and pyopencl [upload]

* check in openpilot pyproject.toml and uv.lock

* ignore openpilot uv.lock

* remove allow-direct-references

* codespell: ignore openpilot python deps folder

* use a uv workspace instead
https://docs.astral.sh/uv/concepts/workspaces/

* codespell: ignore uv folder

* uv lock in sync

* agnos optional deps are never installed

* uv temp fix for dbus-python error

* uv agnos virtual

* update openpilot pyproject.toml

* also install openpilot testing

* sourcing is needed [upload]

* [upload]

* update openpilot uv.lock

* fix wrong env for uv sync

* added openpilot[testing]

* openpilot uv.lock is now workspace uv.lock

* [upload]

* no more uv.lock download

* new uv.lock

* openpilot[dev] + uv lock --upgrade

* [upload]

---------

Co-authored-by: Comma Device <device@comma.ai>
2024-09-04 13:16:40 -07:00
Maxime Desroches bd393f2843 add pytest-asyncio python package (#340)
add pytest-asyncio
2024-09-04 08:01:28 -07:00
Andrei Radulescu 4e04bbc343 agnos rootfs statistics in CI (#291)
* agnos rootfs statistics in CI

* rebuild

* wip

* minimal stats

* agnos stats in PR comment

* just the folders

* just stats

* raw image is now just image

* fix printing stats when no [upload]

* this is nicer [upload]
2024-09-03 21:35:40 -07:00
Robin Reckmann e45702b5b6 Use shasum for macOS compatibility (#336) 2024-09-03 14:00:35 -07:00
coder351 503688baf1 pyenv to uv based python and venv (#303)
* switch pyenv to uv

* resolve issues

* remove uv upgrade

* switch to uv

* remove comment

* remove python version

* remove python3.12-dev

* remove empty line

* use python3.pc

* test github workflow

* switch to pyqt-5 + use uv python for pkgconfig

* remove references to pyenv

* add python2

* [upload]

* resolve docker warnings

* [upload]

* setup uv to use /usr/local

* use uv to install pyqt5

* use uv to install pip

* use --seed to setup pip

* test build using --no-deps

* test build pyqt5 using pyproject.toml

* revert pyqt5 from pyproject.toml

* [upload]

* use PyQt5 wheel

* revert duplicate openpilot_dependencies.sh installed in agnos-base

* add sudo

* revert dev deps purge

* remove openpilot_dependencies.sh from agnos-base

* add -y to apt-get

* add pyproject opencl dep

* add gcc-arm-none-eabi dep

* test removing dev dependencies

* test removing dev dependencies

* test purge using noninteractive

* test autoremove dependencies

* revert autoremove

* add pip to handle pip install

* add new line

* rebuild

* use uv python 3.12.3

* test github runner

* revert github runner

* rebuild

* set pc path to python 3.12

* rebuild pyqt5 in Docker

* test rebuild pyqt5

* rebuild pyqt5

* rebuild pyqt5

* test build pyqt5 wheel

* resolve venv

* test rebuild pyqt5 wheel

* resolve build error

* use pip to build wheel

* use prebuilt pyqt5 wheel

* move dbus-python deps

* resolve PR comments

* test remove dbus-python deps

* remove dbus-python deps

* remove pyqt5 pre-built wheel

* test uv python venv

* add quotes

* add shims

* rebuild

* remove XDG_DATA_HOME

* rebuild

* add uv shim

* chmod +x uv

* set UV_NO_CACHE=1

* remove trailing whitespace

* resolve uv device issues

* rebuild
2024-09-03 13:38:22 -07:00
Adeeb Shihadeh 82f4a070b7 24.04 is merged! 2024-09-02 15:31:36 -07:00
Andrei Radulescu 396d8e19a4 build_system: fail when ubuntu base is updated (#332)
* fetch latest ubuntu-base image and error on download failed

* Dockerfile ubuntu base is now an argument

* revert fetch latest ubuntu-base image

* ubuntu base checksum

* print only the link to releases when download/checksum fails

* simpler checksum
2024-09-02 11:50:58 -07:00
Robbe Derks e31ce23f8d also copy over sound kernel modules 2024-09-02 15:24:10 +02:00
Robbe Derks fd9992c337 Default to buildkit (#331)
* use buildkit to skip adding context

* also build system with buildkit
2024-09-02 13:33:10 +02:00
Shane Smiskol 7a30caa1fd kill: send SIGTERM first (#228)
* send sigterm first

* restart should be kill still

* be explicit
2024-08-31 10:34:46 -07:00
Andrei Radulescu 915ff5eb09 update bash scripts to #!/usr/bin/env bash (#268)
* update bash shebang for better compatibility including macOS

* re-build
2024-08-31 10:34:25 -07:00
Adeeb Shihadeh 0fcdc43248 ensure home overlay is setup with local-fs.target (#328) 2024-08-27 11:40:02 -07:00
Robin Reckmann 99f3469a83 Hang up console before serial-getty start (#326) 2024-08-26 22:03:02 -07:00
Adeeb Shihadeh 8f23a40e81 update binary 2024-08-23 13:20:24 -07:00
Adeeb Shihadeh 7020d829da use USB vendor ID for modem upness 2024-08-22 15:57:36 -07:00
Adeeb Shihadeh 2e03eabbfe flash_all.sh: download from firmware.json 2024-08-21 11:57:30 -07:00
Adeeb Shihadeh c90c718a23 setup firmware.json packaging 2024-08-21 11:31:24 -07:00
Adeeb Shihadeh 472b90c2d4 install ppp 2024-08-20 21:10:05 -07:00
Adeeb Shihadeh 49c68541eb download from manifest (#322) 2024-08-20 20:08:49 -07:00
Adeeb Shihadeh 9f8dc1b54e add back pyenv rehash 2024-08-19 18:23:55 -07:00
Andrei Radulescu 37a76e0950 image creation cleanup (#317)
* cleaning

* remove resize2fs shrinking

* [upload]

* updated ROOTFS_IMAGE_SIZE comment about resize2fs -M
2024-08-19 13:17:48 -07:00
Andrei Radulescu bdb9394d62 Ship non-sparse system image in OTA (#275)
* removed system-skip-chunks image

* removed sparsed system.img

* clean github workflow

* copy image to output

* fake system-skip-chunks [upload]

* sparse key must exist otherwise KeyError: 'sparse' in openpilot

* reduce image size to 5G otherwise MemoryError: Unable to allocate output buffer. in openpilot

* [upload]

* Revert "fake system-skip-chunks"

This reverts commit bcd11e7e32.

* recreate 10G image [upload]

* resize2fs

* resize2fs shrink image

* revert skip-chunks image

* cleanup

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-08-18 12:55:18 -07:00
Adeeb Shihadeh a8df3e3f3c Update TESTING.md 2024-08-15 19:07:54 -07:00
Adeeb Shihadeh 72ac3dc200 cleanup lte.sh 2024-08-15 15:54:48 -07:00
Andrei Radulescu efde194a5b ci: update VERSION to commit hash for pull requests (#311)
* update VERSION to commit hash for pull requests

* [upload]

* keep version in title
2024-08-14 11:45:55 -07:00
Robin Reckmann 388c799932 Build PyQt5 wheel in parallel (#302)
* Build PyQt5 wheel

* Use valid whl name

* Move openpilot_python_dependencies to earlier to avoid duplication
2024-08-14 00:14:22 -07:00
Andrei Radulescu 4a924daa5a Ubuntu 24.04 (#262)
* Ubuntu 24.04 (#188)

* separate out qtwayland5 compilation

* ubuntu 22.04

* temp build system image

* remove bionic deps

* temp packages update

* update armhf packages

* back to libstdc++6

* replaced remove dqt5-default meta package with actual depss

* fix for build libqmi crashing with /usr/bin/env: 'python': No such file or directory

* mapbox-gl-native gcc11 fix

* openpilot_dependencies.sh change

* ubuntu-base 24.04 daily current

* apt install meson because PEP 668

* temp g++-11 for mapbox-gl-native

* bump capnproto to 1.0.2

* temp build only agnos-compiler-mapbox-gl-native

* Fixes for compiling mapbox-gl-native

* Fixes for compiling ffmpeg

* Build main system image again

* pyopencl from git since no 2023.1.5 release since https://github.com/inducer/pyopencl/issues/705

* Try to fix checkinstall - no success

* apt capnproto & ffmpeg since can't figure out issue with checkinstall

* Commented removed services disable

* Ubuntu 24.04 currently has arm-none-eabi/12.2.1 but just use wildcard to go to first folder

* pyclean is missing ?!

* ubuntu-latest in tests workflow

* Updated README

* Reverted internal/package_ota.py changes

* rebuilt kernel

* poetry.lock update

* Simplified build_system pipeline

* headers for capnproto

* Fix typo

* Fix for checkinstall

* Reverted apt capnproto & ffmpeg

* Some cleaning in Dockerfile

* 24.04 libwayland-client

* libffi6:armhf deb file

* Updated qtwayland

* Revert "libffi6:armhf deb file"

This reverts commit bb9cb5da95.

* libffi.so.6.0.4

* qt5-qmake qtbase5-dev qtbase5-dev-tools already in qt5-default

* Removed qtwayland old files

* checkinstall temp fix

* QStandardPaths: wrong permissions on runtime directory /var/tmp/weston, 0770 instead of 0700

* temp permissions fix makes loading build spinner show

* temp build optimization

* 24.04 new libs

* build kernel don't use tools on aarch64/arm64

* updated boot image and ko files

* cleaning

* switch to release 24.04

* wip - downgrade qt and libwayland

* polkitd-pkla package to support polkit *.pkla

* fixed issue with old qt needing libssl 1.1.1f

* remove /.dockerenv file

* more cleaning

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Ubuntu 24.04 branch fixes (#235)

* bump version

* /lib64 is now UsrMerged

* latest pip poetry; poetry.lock update

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* revert README

* [upload]

* disable failing nvmf-autoconnect.service

* disable failing networking.service

* [upload]

* no replacement for ondemand.service

* snapd.service is in snapd package we don't install

* nfs is using rpc-pipefs-generator now, when used

* checkinstall is still not fixed so remove TODO

* updated comment about usr merged lib64

* added checkinstall bug link

* removed not used libffi.so.6 and libwayland-client.so.0

* cleaned compile-qtwayland5.sh and removed 5.15 patch

* removed unused qt-comma 5.15 deb

* cleaned up custom debs for qt and libwayland and added a README

* fixed typo [upload]

* change version

* build-libwayland-deb.sh

* build-qt-deb.sh

* cleaned README

* [upload]

* fix libdl.so qtwayland build [upload]

* rebuild debs

* update libdl path [upload]

* added missing systemd-resolved

* ping capability

* disable some systemd services

* etc/resolv.conf link should not be needed

* Revert "etc/resolv.conf link should not be needed"

This reverts commit b627615a9e.

* Revert "ping capability"

This reverts commit 812ca357cf.

* set ping capability outside of container

* disable systemd services: console-setup and sfsconfig

Co-authored-by: Robin Reckmann <robin.reckmann@gmail.com>

* disabled more systemd services

* bump version [upload]

* update version

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Robin Reckmann <robin.reckmann@gmail.com>
2024-08-13 16:46:55 -07:00
Andrei Radulescu cd181f2a3d fixed gitlab ci-artifacts branch (#307) 2024-08-12 15:26:53 -07:00
Andrei Radulescu 7f7a7a7f82 fixed build and push full release in CI (#305)
* fixed ci workflows

* don't push ota-staging.json and system-skip-chunks-*.img.xz

* add back permissions

* updated raw links

* fixed missing if

* switch to gitlab

* VERSION
2024-08-12 14:33:10 -07:00