Commit Graph

353 Commits

Author SHA1 Message Date
Robbe Derks fd9992c337 Default to buildkit (#331)
* use buildkit to skip adding context

* also build system with buildkit
2024-09-02 13:33:10 +02:00
Shane Smiskol 7a30caa1fd kill: send SIGTERM first (#228)
* send sigterm first

* restart should be kill still

* be explicit
2024-08-31 10:34:46 -07:00
Andrei Radulescu 915ff5eb09 update bash scripts to #!/usr/bin/env bash (#268)
* update bash shebang for better compatibility including macOS

* re-build
2024-08-31 10:34:25 -07:00
Adeeb Shihadeh 0fcdc43248 ensure home overlay is setup with local-fs.target (#328) 2024-08-27 11:40:02 -07:00
Robin Reckmann 99f3469a83 Hang up console before serial-getty start (#326) 2024-08-26 22:03:02 -07:00
Adeeb Shihadeh 8f23a40e81 update binary 2024-08-23 13:20:24 -07:00
Adeeb Shihadeh 7020d829da use USB vendor ID for modem upness 2024-08-22 15:57:36 -07:00
Adeeb Shihadeh 2e03eabbfe flash_all.sh: download from firmware.json 2024-08-21 11:57:30 -07:00
Adeeb Shihadeh c90c718a23 setup firmware.json packaging 2024-08-21 11:31:24 -07:00
Adeeb Shihadeh 472b90c2d4 install ppp 2024-08-20 21:10:05 -07:00
Adeeb Shihadeh 49c68541eb download from manifest (#322) 2024-08-20 20:08:49 -07:00
Adeeb Shihadeh 9f8dc1b54e add back pyenv rehash 2024-08-19 18:23:55 -07:00
Andrei Radulescu 37a76e0950 image creation cleanup (#317)
* cleaning

* remove resize2fs shrinking

* [upload]

* updated ROOTFS_IMAGE_SIZE comment about resize2fs -M
2024-08-19 13:17:48 -07:00
Andrei Radulescu bdb9394d62 Ship non-sparse system image in OTA (#275)
* removed system-skip-chunks image

* removed sparsed system.img

* clean github workflow

* copy image to output

* fake system-skip-chunks [upload]

* sparse key must exist otherwise KeyError: 'sparse' in openpilot

* reduce image size to 5G otherwise MemoryError: Unable to allocate output buffer. in openpilot

* [upload]

* Revert "fake system-skip-chunks"

This reverts commit bcd11e7e32.

* recreate 10G image [upload]

* resize2fs

* resize2fs shrink image

* revert skip-chunks image

* cleanup

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-08-18 12:55:18 -07:00
Adeeb Shihadeh a8df3e3f3c Update TESTING.md 2024-08-15 19:07:54 -07:00
Adeeb Shihadeh 72ac3dc200 cleanup lte.sh 2024-08-15 15:54:48 -07:00
Andrei Radulescu efde194a5b ci: update VERSION to commit hash for pull requests (#311)
* update VERSION to commit hash for pull requests

* [upload]

* keep version in title
2024-08-14 11:45:55 -07:00
Robin Reckmann 388c799932 Build PyQt5 wheel in parallel (#302)
* Build PyQt5 wheel

* Use valid whl name

* Move openpilot_python_dependencies to earlier to avoid duplication
2024-08-14 00:14:22 -07:00
Andrei Radulescu 4a924daa5a Ubuntu 24.04 (#262)
* Ubuntu 24.04 (#188)

* separate out qtwayland5 compilation

* ubuntu 22.04

* temp build system image

* remove bionic deps

* temp packages update

* update armhf packages

* back to libstdc++6

* replaced remove dqt5-default meta package with actual depss

* fix for build libqmi crashing with /usr/bin/env: 'python': No such file or directory

* mapbox-gl-native gcc11 fix

* openpilot_dependencies.sh change

* ubuntu-base 24.04 daily current

* apt install meson because PEP 668

* temp g++-11 for mapbox-gl-native

* bump capnproto to 1.0.2

* temp build only agnos-compiler-mapbox-gl-native

* Fixes for compiling mapbox-gl-native

* Fixes for compiling ffmpeg

* Build main system image again

* pyopencl from git since no 2023.1.5 release since https://github.com/inducer/pyopencl/issues/705

* Try to fix checkinstall - no success

* apt capnproto & ffmpeg since can't figure out issue with checkinstall

* Commented removed services disable

* Ubuntu 24.04 currently has arm-none-eabi/12.2.1 but just use wildcard to go to first folder

* pyclean is missing ?!

* ubuntu-latest in tests workflow

* Updated README

* Reverted internal/package_ota.py changes

* rebuilt kernel

* poetry.lock update

* Simplified build_system pipeline

* headers for capnproto

* Fix typo

* Fix for checkinstall

* Reverted apt capnproto & ffmpeg

* Some cleaning in Dockerfile

* 24.04 libwayland-client

* libffi6:armhf deb file

* Updated qtwayland

* Revert "libffi6:armhf deb file"

This reverts commit bb9cb5da95.

* libffi.so.6.0.4

* qt5-qmake qtbase5-dev qtbase5-dev-tools already in qt5-default

* Removed qtwayland old files

* checkinstall temp fix

* QStandardPaths: wrong permissions on runtime directory /var/tmp/weston, 0770 instead of 0700

* temp permissions fix makes loading build spinner show

* temp build optimization

* 24.04 new libs

* build kernel don't use tools on aarch64/arm64

* updated boot image and ko files

* cleaning

* switch to release 24.04

* wip - downgrade qt and libwayland

* polkitd-pkla package to support polkit *.pkla

* fixed issue with old qt needing libssl 1.1.1f

* remove /.dockerenv file

* more cleaning

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* Ubuntu 24.04 branch fixes (#235)

* bump version

* /lib64 is now UsrMerged

* latest pip poetry; poetry.lock update

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>

* revert README

* [upload]

* disable failing nvmf-autoconnect.service

* disable failing networking.service

* [upload]

* no replacement for ondemand.service

* snapd.service is in snapd package we don't install

* nfs is using rpc-pipefs-generator now, when used

* checkinstall is still not fixed so remove TODO

* updated comment about usr merged lib64

* added checkinstall bug link

* removed not used libffi.so.6 and libwayland-client.so.0

* cleaned compile-qtwayland5.sh and removed 5.15 patch

* removed unused qt-comma 5.15 deb

* cleaned up custom debs for qt and libwayland and added a README

* fixed typo [upload]

* change version

* build-libwayland-deb.sh

* build-qt-deb.sh

* cleaned README

* [upload]

* fix libdl.so qtwayland build [upload]

* rebuild debs

* update libdl path [upload]

* added missing systemd-resolved

* ping capability

* disable some systemd services

* etc/resolv.conf link should not be needed

* Revert "etc/resolv.conf link should not be needed"

This reverts commit b627615a9e.

* Revert "ping capability"

This reverts commit 812ca357cf.

* set ping capability outside of container

* disable systemd services: console-setup and sfsconfig

Co-authored-by: Robin Reckmann <robin.reckmann@gmail.com>

* disabled more systemd services

* bump version [upload]

* update version

---------

Co-authored-by: Justin Newberry <justin@comma.ai>
Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
Co-authored-by: Robin Reckmann <robin.reckmann@gmail.com>
2024-08-13 16:46:55 -07:00
Andrei Radulescu cd181f2a3d fixed gitlab ci-artifacts branch (#307) 2024-08-12 15:26:53 -07:00
Andrei Radulescu 7f7a7a7f82 fixed build and push full release in CI (#305)
* fixed ci workflows

* don't push ota-staging.json and system-skip-chunks-*.img.xz

* add back permissions

* updated raw links

* fixed missing if

* switch to gitlab

* VERSION
2024-08-12 14:33:10 -07:00
Andrei Radulescu f125aee12f build and push full release in CI on [upload] (#288)
* push to ci-artifacts and pr comment ifs [upload]

* [upload]

* update permissions

* [upload]

* splitted build and push-and-upload workflows

* [upload]
2024-08-11 16:24:18 -07:00
Robin Reckmann 6d886f2357 Error on Dockerfile warnings (#298) 2024-08-11 15:13:18 -07:00
Robin Reckmann ba34182d5d Point pip3 to shimd pip (#294) 2024-08-08 17:09:47 -07:00
Andrei Radulescu b33ebce21d package_ota: fix path for raw image (#292) 2024-08-08 10:28:11 -07:00
Andrei Radulescu 2c6b35d6e1 package_ota: remove converting sparse to raw (#289)
* package_ota: don't convert sparse image to raw if raw images already exists

* don't convert anymore
2024-08-07 16:34:42 -07:00
Andrei Radulescu b040fcd2a9 build and push full release in CI to commaai/ci-artifacts (#287)
* package_ota.py & upload to commaai/ci-artifacts

* fix simg2img incorrectly using shell=True [upload]

* fix output path

* [upload]

* Apply suggestions from code review

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-08-07 14:24:59 -07:00
Robin Reckmann f2571c76fb Replace apt-get with apt-fast (#285)
* Replace apt-get with apt-fast

* Some more apt-get replacements
2024-08-06 10:57:52 -07:00
Robin Reckmann 8465bfc6c7 Fix SecretsUsedInArgOrEnv warning (#283) 2024-08-06 06:56:47 -07:00
Robin Reckmann c017d6fba0 Fix InvalidBaseImagePlatform warning on aarch64 (#284) 2024-08-06 06:56:13 -07:00
Robin Reckmann 360675b935 Fix FromAsCasing warning (#277)
Address FromAsCasing warning
2024-07-31 06:56:02 -07:00
Andrei Radulescu e85baea994 update flash scripts to always flash active slot (#264)
* update flash scripts

* flash active slot

* more descriptive ending message
2024-07-30 10:51:47 -07:00
Andrei Radulescu 372633b7ba also checkout submodules (#274)
* also checkout submodules

* [upload]
2024-07-30 10:32:22 -07:00
Adeeb Shihadeh c59455d3f8 no internal (#271)
* no internal

* Update README.md

* testing

* rm private submodules

* do this the normal way now

* rm agnos-firmware

* add size

* fix mac

* files
2024-07-28 14:34:28 -07:00
Adeeb Shihadeh fd385808dc cleanup ABL building (#270) 2024-07-28 13:29:13 -07:00
Andrei Radulescu 54d68a5df9 support cursor server (vscode fork) (#267)
support for cursor server (vscode fork)
2024-07-28 10:41:09 -07:00
martinl f2498d1f4b Update README.md (#269)
Add note about flash.comma.ai
2024-07-28 10:27:20 -07:00
Andrei Radulescu 0262fe77c4 fix typo in README (#266)
fixed typo in README
2024-07-26 10:13:39 -07:00
Andrei Radulescu 48ea05d6db uv pip install in a separate tmp folder (#257)
* move uv pip install in separate tmp folder

* [upload]
2024-07-25 12:59:33 -07:00
Andrei Radulescu 8cddf8a52e CI: update get commit message (#258)
* updated & tested get commit message

* test
2024-07-25 12:58:40 -07:00
Adeeb Shihadeh 0480a88722 works on anything now 2024-07-25 10:49:59 -07:00
Andrei Radulescu e5fae93540 Build kernel in docker (#247)
* build kernel in container

* remove ci deps

* cleaning

* more cleaning

* even more cleaning

* README.md update for masOS Case-sensitive required volume

* README.md more info about macOS

* README.md more info about macOS

* README.md more info about macOS - M-series vs Intel

* README.md more info about macOS - M-series vs Intel

* extract_tools should install and pull lfs no matter the ARCH

* raise attention on macOS Case-sensitive volume

* --privileged not needed in build_kernel.sh

* remove docker and git checks

* set -e

* always build image

* updated host user in container

* also works with sudo/root

* removed deps in ci since they are not needed anymore

* agnos-meta-builder

* show macOS support only if current path is not on a Case-sensitive APFS volume

* more succint

* just exit

* fixing caching issues

* cache kernel out

* cleaning

* debug out

* ccache-action no needed anymore

* debug

* rebuild

* remove out cache

* revert ccache action

* create-symlink not needed since it's building in the container

* simpler ccache key name

* cleaning

* rebuild

* git ignore .ccache

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-07-25 10:47:56 -07:00
Parsa Nobahari 95ef1a6c81 updating setup-python@v4 to v5 in tests.yaml (#256) 2024-07-24 09:41:20 -07:00
Andrei Radulescu f379fde57f Fixed edl capstone issue on M-series macs (#254)
fixed edl capstone issue on M-series macs
2024-07-23 13:52:41 -07:00
robin-reckmann 81e84a3561 Fix image creation docker workflow in host ubuntu (#252)
* Fix image creation docker workflow in host ubuntu

* Fix missing user variable

* Only add new non-root users
2024-07-21 16:08:38 -07:00
Andrei Radulescu 8612508955 CI: add system build (#251)
* incremental caching

* increase timeout to 40min; remove if: cache-hits

* rm that

* simplified to have one kernel cache

* [upload] tag for upload-artifact

* [upload] test

* custom key/restore for ccache

* removed if in get commit message

* timeout to 60min

* multiline support in LAST_COMMIT_MESSAGE

* Update .github/workflows/build.yaml

---------

Co-authored-by: Adeeb Shihadeh <adeebshihadeh@gmail.com>
2024-07-21 16:07:32 -07:00
robin-reckmann 4b70df393f Fix python dependencies (#250)
* Enable pyopencl and downgrade numpy

* Add future-fstrings as dependency

* Add comments

* Rewrite comment for clarity
2024-07-18 17:12:15 -07:00
Adeeb Shihadeh 655369095c Revert "switch pyenv to uv (#248)"
This reverts commit 7d1a421b60.
2024-07-18 13:32:51 -07:00
Andrei Radulescu d977eb6f22 Fix build system in docker on macOS (#249)
* build system in docker

* removed docker and git checks

* set -e

* no comments in Dockerfile.sparsify

* always build agnos-mount

* require Docker v23.0 and remove deprecated DOCKER_BUILDKIT=1 and DOCKER_CLI_EXPERIMENTAL=enabled

* move docker exec to helpers
2024-07-18 13:22:29 -07:00
coder351 7d1a421b60 switch pyenv to uv (#248)
* switch pyenv to uv

* resolve issues

* remove uv upgrade
2024-07-18 11:46:21 -07:00