George Hotz 8294d105a7 Update the spec in spec.py to match the current state (#16132) ...

* start work on specv2

* more spec

* more spec

* fix amd emulator

* more spec

* more

* fix test_uop_graph

* move those

* spec=2

* skip those questionable tests

* ptx fix

* more spec=2

* store

* allow custom function in tensor

* spec 2

* fix beam search for tensor cores

* delete the old specs

* fix import

2026-05-11 20:07:47 -07:00

..

mlperf_bert

remove all run_schedule from tests (#15846)

2026-04-21 12:02:10 +03:00

mlperf_resnet

remove tfa dependency: use keras.optimizers.Lamb and tf.raw_ops for LARS (#13555)

2025-12-03 17:48:27 -05:00

mlperf_retinanet

RetinaNet losses (#9536)

2025-03-21 15:52:54 -04:00

mlperf_stable_diffusion

specify renderer in DEV, <dev>_<ren>=1 is deprecated (#15551)

2026-03-31 18:35:14 -04:00

mlperf_unet3d

[MLPerf] UNet3D dataloader (#4343)

2024-04-28 22:34:18 -04:00

openpilot

fix failed threefry (#10646)

2025-06-05 17:17:42 -07:00

process_replay

jit: precompile (#15848)

2026-04-23 00:23:32 +03:00

sglang_llama

refactor test/external/external_llama_eval.py (#10567)

2025-06-23 10:43:20 -07:00

external_benchmark_am.py

clean: becnhmark -> benchmark (#10620)

2025-06-03 19:28:18 -07:00

external_benchmark_bert_matmuls.py

ShapeTracker.real_strides -> is_expanded [pr] (#12579)

2025-10-09 22:52:45 -04:00

external_benchmark_bert_softmax.py

move tests to test/backend (#14691)

2026-02-12 11:09:44 +08:00

external_benchmark_disk_raw.py

ci: add h machines (#11416)

2025-07-29 19:21:51 +03:00

external_benchmark_hip_compile.py

ops_gpu -> ops_cl (#12103)

2025-09-10 15:15:48 -04:00

external_benchmark_keccak.py

Tensor.keccak("sha3_256") (#7186)

2025-06-06 15:24:05 -07:00

external_benchmark_kernel_launch.py

cleanup tests, bump caches (#11746)

2025-08-19 21:21:07 -07:00

external_benchmark_llama_schedule.py

DEV is ContextVar, setting Device.DEFAULT is deprecated (#15508)

2026-03-30 17:10:49 -04:00

external_benchmark_multitensor_allreduce.py

all2all (#13902)

2025-12-31 16:38:32 +03:00

external_benchmark_op_conv.py

remove CompiledRunner (#15970)

2026-04-29 22:45:48 +03:00

external_benchmark_pyrender.py

rename BUFFERIZE to STAGE (#16125)

2026-05-10 09:26:46 -07:00

external_benchmark_resnet.py

remove all run_schedule from tests (#15846)

2026-04-21 12:02:10 +03:00

external_benchmark_schedule.py

Update the spec in spec.py to match the current state (#16132)

2026-05-11 20:07:47 -07:00

external_cl_half_max.py

ops_gpu -> ops_cl (#12103)

2025-09-10 15:15:48 -04:00

external_fuzz_ampt.py

Fix/hcqfuzz harnesss bug (#10923)

2025-06-23 11:22:30 +03:00

external_fuzz_beam_timeout_recovery.py

am: use per pipe reset for gfx11+ (#16006)

2026-05-01 12:56:43 +03:00

external_fuzz_hcq_mp.py

system: fix flock on pcidevs (#13123)

2025-11-06 19:02:13 +08:00

external_fuzz_hcq_signals.py

hcqfuzz: init (#10049)

2025-04-25 23:19:21 +03:00

external_fuzz_qcom_cpu_cache.py

qcom: sync cpu cache when from_blob (#14518)

2026-02-03 21:51:03 +03:00

external_fuzz_sdma_warm_start.py

am: reset sdma to start from 0 (#15109)

2026-03-03 18:14:46 +03:00

external_fuzz_tlsf.py

Fix/hcqfuzz harnesss bug (#10923)

2025-06-23 11:22:30 +03:00

external_gpu_fail_osx.py

ops_gpu -> ops_cl (#12103)

2025-09-10 15:15:48 -04:00

external_jit_failure.py

fix jit realize issue (#3258)

2024-01-26 18:27:35 -08:00

external_llm_eval.py

llm is the only app (#15779)

2026-04-17 10:44:48 +08:00

external_metal_compile_fail.py

Use MTLCompiler directly (v2) (#7920)

2024-12-04 16:36:48 +08:00

external_model_benchmark.py

DEV is ContextVar, setting Device.DEFAULT is deprecated (#15508)

2026-03-30 17:10:49 -04:00

external_multi_gpu.py

deprecate <dev>=1 in favor of DEV=<dev> (#15467)

2026-03-26 03:48:03 -04:00

external_nhwc_conv.py

add fun with nhwc convs

2025-10-28 17:12:22 +08:00

external_openpilot_image_warp.py

openpilot warp (#13283)

2025-11-14 13:55:32 -08:00

external_osx_profiling.py

ops_gpu -> ops_cl (#12103)

2025-09-10 15:15:48 -04:00

external_test_am_fault_recovery.py

MOCKGPU interfaces (#15796)

2026-04-17 21:56:29 -04:00

external_test_am.py

am: large allocs aligned to 2mb to use 2mb pages (#15609)

2026-04-05 18:01:31 +03:00

external_test_amd.py

move schedule into schedule (#15736)

2026-04-15 11:03:25 +08:00

external_test_datasets.py

skip test TestKiTS19Dataset::test_training_set (#10936)

2025-06-23 14:27:24 -04:00

external_test_dev_var.py

deprecate <dev>=1 in favor of DEV=<dev> (#15467)

2026-03-26 03:48:03 -04:00

external_test_example.py

remove REMOTE=1 (#13722)

2025-12-16 15:58:10 -04:00

external_test_gpu_crash.py

deprecate <dev>=1 in favor of DEV=<dev> (#15467)

2026-03-26 03:48:03 -04:00

external_test_hcq_open.py

test hcq open with pytest (#13124)

2025-11-06 20:09:51 +08:00

external_test_hcq.py

get_runner -> get_runtime (#15967)

2026-04-29 18:29:49 +03:00

external_test_hip_compile.py

move schedule into schedule (#15736)

2026-04-15 11:03:25 +08:00

external_test_hive_reset.py

mi350 hive_reset am repro (#15014)

2026-02-25 21:30:18 +03:00

external_test_image.py

ops_gpu -> ops_cl (#12103)

2025-09-10 15:15:48 -04:00

external_test_jit_on_models.py

Pulled CLIP and UNet into Seperate Files (#5253)

2024-07-01 22:33:01 -04:00

external_test_keccak.py

Tensor.keccak("sha3_256") (#7186)

2025-06-06 15:24:05 -07:00

external_test_llama3_ff.py

work to make GEMV fast (#5824)

2024-07-30 17:41:40 -07:00

external_test_llama3_layer.py

DEV has arch (#15577)

2026-04-03 19:17:19 -04:00

external_test_lm_head.py

isolate the 134ms kernel in train_gpt2.py (#4773)

2024-05-29 17:26:24 -04:00

external_test_losses.py

RetinaNet losses (#9536)

2025-03-21 15:52:54 -04:00

external_test_mamba.py

mark slow tests as slow instead of as CI (#13736)

2025-12-17 10:29:57 -04:00

external_test_metrics.py

log_perplexity metrics (#10912)

2025-06-21 10:44:47 -04:00

external_test_mnist_data_select.py

add quick external data select test

2024-03-02 05:38:32 -08:00

external_test_onnx_backend.py

more onnx ops (#14104)

2026-01-12 09:11:13 -05:00

external_test_onnx_ops.py

raise if Tensor._buffer is called during jit (#14114)

2026-01-22 17:30:18 -05:00

external_test_onnx_runner.py

Revert "onnx: deduplicate simple proto parsers" (#16148)

2026-05-11 21:45:17 -04:00

external_test_opt.py

remove linear_to_schedule from tests (#15912)

2026-04-24 20:02:10 +03:00

external_test_optim.py

remove tfa dependency: use keras.optimizers.Lamb and tf.raw_ops for LARS (#13555)

2025-12-03 17:48:27 -05:00

external_test_process_count.py

add external_test_process_count

2025-12-02 17:26:30 -08:00

external_test_schedule_scaling.py

remove schedule batch 4 (#15927)

2026-04-25 12:36:55 +03:00

external_test_simple_tokenizer.py

llm is the only app (#15779)

2026-04-17 10:44:48 +08:00

external_test_speed_llama.py

hcq2 to extra (#16126)

2026-05-11 17:17:30 +03:00

external_test_speed_theoretical.py

test flops (and allow wide ALU in UOps) [run_process_replay] (#5749)

2024-07-26 21:07:28 -07:00

external_test_tlsf.py

factor out generic MemoryManager (#10910)

2025-06-21 16:18:33 +03:00

external_test_usb_asm24.py

usbgpu: 10 steps in benchmark to hit cache (#10273)

2025-05-13 17:06:50 +03:00

external_test_whisper_librispeech.py

names shadowing builtins (#5179)

2024-06-27 08:15:01 -04:00

external_test_yolov8.py

More yolo processing in tinygrad (#9928)

2025-04-24 16:21:46 -04:00

external_uop_gc.py

get_runner -> get_runtime (#15967)

2026-04-29 18:29:49 +03:00

fuzz_fast_idiv.py

DEV has arch (#15577)

2026-04-03 19:17:19 -04:00

fuzz_graph.py

remove old schedule (#15930)

2026-04-25 16:46:36 +03:00

fuzz_kfd.py

hcq: hcqbuf in copy (#15595)

2026-04-03 22:47:36 +03:00

fuzz_shape_ops.py

mark slow tests as slow instead of as CI (#13736)

2025-12-17 10:29:57 -04:00

fuzz_symbolic_symbolic_div.py

Ops.IDIV -> Ops.CDIV, Ops.MOD -> Ops.CMOD (#16093)

2026-05-07 23:18:15 -04:00

fuzz_symbolic.py

use FLOORDIV and FLOORMOD (#16048)

2026-05-05 18:32:54 -04:00

speed_v_theoretical.py

lower nv test_gemm_4096 target (#13107)

2025-11-05 11:05:16 -05:00