mirror of
https://github.com/firestar5683/StarPilot.git
synced 2026-10-28 00:53:45 +08:00
firestar5683
22a8575199
Keep official openpilot ancestry and dependency licenses. Store resources directly in Git, remove LFS setup requirements, and leave the downloadable big model outside the source tree.
62 lines
1.5 KiB
Markdown
62 lines
1.5 KiB
Markdown
# TinyGPU
|
|
|
|
TinyGPU app lets you use AMD and NVIDIA GPUs on macOS over USB4/Thunderbolt with tinygrad.
|
|
|
|
## Requirements
|
|
|
|
- macOS (13.0+)
|
|
- USB4/Thunderbolt port
|
|
- A supported GPU (AMD RDNA3+ or NVIDIA Ampere+)
|
|
|
|
## Setup
|
|
|
|
### 1. Connect your GPU
|
|
|
|
Plug the supported GPU into your Mac over USB4/Thunderbolt.
|
|
|
|
### 2. Initiate the driver install
|
|
|
|
> **Note:** If tinygrad is cloned but not installed, run commands with `PYTHONPATH=.`
|
|
|
|
```bash
|
|
curl -fsSL https://raw.githubusercontent.com/tinygrad/tinygrad/master/extra/setup_tinygpu_osx.sh | sh
|
|
```
|
|
|
|
This downloads TinyGPU.app and triggers a system prompt to install the driver extension.
|
|
|
|
### 3. Enable the driver
|
|
|
|
You should see a system prompt: **"TinyGPU" would like to use a new driver extension**. Click **Open System Settings** and toggle TinyGPU on.
|
|
|
|
If you missed the prompt, go to **System Settings > General > Login Items & Extensions > Driver Extensions** and toggle TinyGPU on.
|
|
|
|
### 4. Compiler Setup
|
|
|
|
#### AMD
|
|
|
|
```bash
|
|
curl -fsSL https://raw.githubusercontent.com/tinygrad/tinygrad/master/extra/setup_hipcomgr_osx.sh | sh
|
|
```
|
|
|
|
#### NV
|
|
|
|
Install [Docker Desktop](https://www.docker.com/products/docker-desktop/) if you don't have it.
|
|
|
|
```bash
|
|
curl -fsSL https://raw.githubusercontent.com/tinygrad/tinygrad/master/extra/setup_nvcc_osx.sh | sh
|
|
```
|
|
|
|
Make sure `~/.local/bin` is on your `PATH`:
|
|
|
|
```bash
|
|
export PATH="$HOME/.local/bin:$PATH"
|
|
```
|
|
|
|
### 5. Use it!
|
|
|
|
```bash
|
|
DEV={AMD|NV} python3 -m tinygrad.llm
|
|
```
|
|
|
|
**Note:** Use `JITBEAM=2` to search for faster kernels (one-time search cost, results cached).
|