Commit Graph

14286 Commits

Author SHA1 Message Date
Jason Wen 69abbd94ec Merge branch 'SP-147-sync-priv-2024' into master-dev-c3
# Conflicts:
#	CHANGELOGS.md
#	panda
#	release/files_common
2024-06-12 16:08:20 -04:00
Jason Wen 436bc369c1 Update CHANGELOGS.md 2024-06-12 14:28:56 -04:00
Jason Wen 229dccd428 GitLab Pipelines: Add script for syncing LFS between comma and sunnypilot
This commit adds a new script, 'sync-lfs.sh'. This script assists by syncing the git large file storage (LFS) system. It backs up the current LFS configuration, uses the comma-separated configuration for operations like fetch and pull, and then restores the original configuration before pushing to the origin's main branch.
2024-06-12 14:28:31 -04:00
Jason Wen 211ff21af0 Merge branch 'master' into SP-147-sync-priv-2024
# Conflicts:
#	common/api/__init__.py
#	panda
#	release/build_release.sh
#	release/files_common
#	selfdrive/car/card.py
#	selfdrive/car/toyota/carcontroller.py
#	selfdrive/controls/controlsd.py
#	selfdrive/controls/radard.py
#	selfdrive/ui/qt/api.cc
#	selfdrive/ui/qt/maps/map.cc
#	selfdrive/ui/ui.cc
#	system/athena/manage_athenad.py
#	system/athena/manage_sunnylinkd.py
#	system/athena/sunnylinkd.py
#	system/manager/gitlab_runner.sh
#	system/manager/manager.py
#	system/manager/mapd_installer.py
#	system/manager/process_config.py
#	system/manager/sunnylink.py
#	system/sentry.py
2024-06-12 14:28:20 -04:00
DevTekVE 0e7ad5918e Merge branch 'refs/heads/SP-147-sync-priv-2024' into master-dev-c3 2024-06-11 22:11:52 +02:00
DevTekVE a2ad9cb6a4 adding back the readme 2024-06-11 22:11:35 +02:00
DevTekVE eb93ee7b3b Merge remote-tracking branch 'origin/master-dev-c3' into master-dev-c3 2024-06-11 22:03:59 +02:00
DevTekVE a2b3fd432c Merge branch 'refs/heads/SP-147-sync-priv-2024' into master-dev-c3
# Conflicts:
#	.gitlab-ci.yml
2024-06-11 21:53:02 +02:00
DevTekVE dde55447d5 Update method for copying release files in CI
The method to copy release files in the continuous integration pipeline has been changed. Instead of using a complex cp command, we are now simply using a Python script with rsync, which provides cleaner and more readable code. The old method is still present but commented out for history or possible future use.
2024-06-11 21:50:22 +02:00
Jason Wen 90628c6e0f Add monitoring/helpers.py 2024-06-11 21:49:29 +02:00
DevTekVE 6c87faefdf Move mapd_manager.py to system directory
The mapd_manager.py file has been relocated from the selfdrive directory to the system directory. This change in location reflects the file hierarchy restructuring and improves the organization of the codebase.
2024-06-11 21:49:29 +02:00
DevTekVE 1f5c04f80e Update release files copy command in CI pipeline
The `.gitlab-ci.yml` file has been updated to directly use copy command instead of the output from release_files.py script, which was previously used in the pipeline. This change is implemented for security reasons - to validate the output and prevent exposure of unnecessary files. Warning outputs are also efficiently managed now, with the use of grep command.
2024-06-11 21:49:29 +02:00
DevTekVE 556e2f55a0 Update rsync flag in GitLab CI configuration
This change updates the rsync command in the GitLab CI configuration file (.gitlab-ci.yml) from '-av' to '-avm'. This introduces a more efficient synchronization by reducing the amount of file metadata transferred.
2024-06-11 21:27:01 +02:00
DevTekVE 0f94403092 Optimize scons command and update release_files script
The scons command in the GitLab CI file now includes the --minimal flag to boost performance by reducing unnecessary operations. In the release_files script, a redundant exclusion pattern has been removed, simplifying file matching.
2024-06-11 21:00:30 +02:00
DevTekVE d21a6126ac Update file whitelists and blacklists in release_files.py
The file blacklists and whitelists in release_files.py have been thoroughly updated to reflect changes in project structure and requirements. This includes additions to the sunnypilot_blacklist, such as "system/manager/gitlab_runner.sh" and "README.md", among others. The sunnypilot_whitelist has also been
2024-06-11 20:48:55 +02:00
Jason Wen 57b5dbf31f Merge branch 'SP-147-sync-priv-2024' into master-dev-c3 2024-06-11 12:31:45 -04:00
Jason Wen 38a40b4db0 Add monitoring/helpers.py 2024-06-11 12:17:28 -04:00
DevTekVE 99ace8f1b5 Merge branch 'refs/heads/SP-147-sync-priv-2024' into master-dev-c3 2024-06-11 15:58:03 +02:00
DevTekVE 2babfe790d Move mapd_manager.py to system directory
The mapd_manager.py file has been relocated from the selfdrive directory to the system directory. This change in location reflects the file hierarchy restructuring and improves the organization of the codebase.
2024-06-11 15:53:59 +02:00
DevTekVE 725768783f Update release files copy command in CI pipeline
The `.gitlab-ci.yml` file has been updated to directly use copy command instead of the output from release_files.py script, which was previously used in the pipeline. This change is implemented for security reasons - to validate the output and prevent exposure of unnecessary files. Warning outputs are also efficiently managed now, with the use of grep command.
2024-06-11 15:47:38 +02:00
DevTekVE 55cee14105 more cleanup adjustment 2024-06-11 15:45:14 +02:00
DevTekVE 649aef3cc1 more cleanup adjustment 2024-06-11 15:32:09 +02:00
DevTekVE f264b49c7e more cleanup adjustment 2024-06-11 15:26:04 +02:00
DevTekVE 86242fa57f more cleanup adjustment 2024-06-11 14:56:15 +02:00
DevTekVE 489ab0efe3 more cleanup 2024-06-11 14:29:08 +02:00
DevTekVE a8bc3d30ca Update release files and remove unnecessary tests
This commit significantly updates the list of release files, adding several new ones and removing numerous others. In addition, a large number of test files deemed unnecessary have been removed. This is part of a broader effort to optimize the codebase and improve efficiency.
2024-06-11 14:27:33 +02:00
DevTekVE 06ea74d954 Merge branch 'refs/heads/SP-147-sync-priv-2024' into master-dev-c3 2024-06-11 12:57:47 +02:00
DevTekVE 135eb2f17b Remove unused files from release
The Docker-related files, SECURITY.md, codecov.yml, conftest.py, poetry.lock and .clang-tidy were removed from the release_files.py. This cleanup was made to ensure the release contains only the necessary files, reducing potential clutter and confusion.
2024-06-11 12:56:26 +02:00
DevTekVE 7a51cfcd13 Add numerous files to release_files.py
This commit majorly expands the list of files to be tracked in release_files.py. The additions range from Dockerfile configurations, README documents, test files, builder scripts and many more. This might enhance the overall tracking and versioning capability for a wider scope of files across the project.
2024-06-11 12:37:41 +02:00
DevTekVE 6a6f5f4860 Add various files to release_files.py
The commit adds a list of files related to GitLab CI, Docker, code formatting, and security guidelines to the release_files.py. These additions will provide more control and configuration for the release process.
2024-06-11 12:24:22 +02:00
DevTekVE 9f269722ab Merge branch 'refs/heads/SP-147-sync-priv-2024' into master-dev-c3 2024-06-11 12:08:32 +02:00
DevTekVE d9170548c9 Add new entries to sunnypilot_blacklist
Two new entries have been added to the sunnypilot_blacklist array in the release_files.py script. This now includes ".run/" and "release/ci/scons_cache/".
2024-06-11 12:07:59 +02:00
DevTekVE 472948cf62 Merge branch 'refs/heads/SP-147-sync-priv-2024' into master-dev-c3 2024-06-11 11:59:58 +02:00
DevTekVE de4cefdc1e Update import paths in athena files
The changes here correct a misalignment in the import paths in the sunnylinkd.py and manage_sunnylinkd.py files. These updates ensure that system.athena modules are accurately referenced, which is critical for the function of these scripts.
2024-06-11 11:59:46 +02:00
DevTekVE 702643188c Updating panda to point to the proper branch for dev-c3 2024-06-11 10:49:35 +02:00
DevTekVE a42398646b Merge branch 'refs/heads/SP-147-sync-priv-2024' into master-dev-c3-snapshot
# Conflicts:
#	CHANGELOGS.md
#	panda
2024-06-11 10:45:58 +02:00
DevTekVE 7ae27b6970 Merge remote-tracking branch 'refs/remotes/origin/master-priv' into master-dev-c3-snapshot
# Conflicts:
#	selfdrive/athena/sunnylinkd.py
2024-06-11 10:44:31 +02:00
DevTekVE ba3475a02c Add 'sunnylink_uploader.py' to temporary blacklist
We are temporarily blacklisting 'sunnylink_uploader.py' by adding it under 'sunnypilot_blacklist' in 'release/release_files.py' until it's ready for widespread roll-out. Alongside, the existing path in 'system/manager/process_config.py' has been updated to reflect the correct location of 'sunnylink_uploader.py'. This will ensure the processes are correctly managed based on its existence.
2024-06-11 09:33:27 +02:00
DevTekVE e0110198bf Merge branch 'refs/heads/master-priv' into SP-147-sync-priv-2024
# Conflicts:
#	system/manager/process_config.py
2024-06-11 09:25:59 +02:00
DevTekVE 1004730750 [sunnylink] Add sunnylink_uploader to process_config and implement uploader 2024-06-11 07:21:45 +00:00
DevTekVE 2b0dbb4e8e [sunnylink] Swaglogs to cloudwatch Enable log_handler in sunnylinkd.py 2024-06-11 07:19:54 +00:00
DevTekVE 5030860ab8 [sunnylink] Bugfixes like sidebar & improved logging for error troubleshoot 2024-06-11 06:52:11 +00:00
Jason Wen 899b5a6e33 Update CHANGELOGS.md 2024-06-10 21:34:20 -04:00
Jason Wen 7484d75205 GitLab Pipelines: Add script for syncing LFS between comma and sunnypilot
This commit adds a new script, 'sync-lfs.sh'. This script assists by syncing the git large file storage (LFS) system. It backs up the current LFS configuration, uses the comma-separated configuration for operations like fetch and pull, and then restores the original configuration before pushing to the origin's main branch.
2024-06-10 21:24:35 -04:00
Jason Wen e36dbe97b5 Merge branch 'master' into SP-147-sync-priv-2024
# Conflicts:
#	common/api/__init__.py
#	panda
#	release/build_release.sh
#	release/files_common
#	selfdrive/car/card.py
#	selfdrive/car/toyota/carcontroller.py
#	selfdrive/controls/controlsd.py
#	selfdrive/controls/radard.py
#	selfdrive/ui/qt/api.cc
#	selfdrive/ui/qt/maps/map.cc
#	selfdrive/ui/ui.cc
#	system/athena/manage_athenad.py
#	system/athena/manage_sunnylinkd.py
#	system/athena/sunnylinkd.py
#	system/manager/gitlab_runner.sh
#	system/manager/manager.py
#	system/manager/mapd_installer.py
#	system/manager/process_config.py
#	system/manager/sunnylink.py
#	system/sentry.py
2024-06-10 21:24:23 -04:00
DevTekVE d79f0082eb Merge branch 'refs/heads/master-priv-log-sunnylink-error' into master-dev-c3
# Conflicts:
#	selfdrive/athena/sunnylinkd.py
2024-06-10 11:21:19 +02:00
DevTekVE 922a0f91ba Merge branch 'refs/heads/swaglog-to-cloudwatch' into master-dev-c3 2024-06-10 11:19:58 +02:00
DevTekVE a7699c280f Change log level from info to debug in sunnylinkd.py
The logging level for 'pong' and 'ping' messages in sunnylinkd.py has been changed from 'info' to 'debug'. This adjustment will help reduce the level of verbosity in the logs and focus more on significant events.
2024-06-10 11:14:35 +02:00
DevTekVE 12841b7bb4 Update sunnylinkd.py to improve logging and connection timeout
The commit enhances the logging in the selfdrive/athena/sunnylinkd.py by adding an info statement when the handle_long_poll function starts. It also modifies the create_connection function call, removing the fixed 30 seconds timeout, providing more flexibility for connection time.
2024-06-10 09:40:08 +02:00
DevTekVE 6d8348ccf0 Change error logging to event logging in athenad.py
The logging for an invalid JSON RPC request in athenad.py has been changed from an error log to an event log. The event log still records the request as an error, improving clarity of error handling in the system.
2024-06-10 09:39:32 +02:00