leopf b6d9b276bb GGUF support (#7046) ...

* basic loader, untested

* testing

* remove utils import in test

* q8_0

* q4_1

* end to end testing

* minor cleanup

* fix casting

* moved to state

* move tests

* move dequant to fn

* fix lint elif

* remove gguf from extra

* fix dict union

* q6_k simpler

* naming and spacing

* gpt2-gguf example

* cleanup

* move gguf example

* minor cleanup

---------

Co-authored-by: George Hotz <72895+geohot@users.noreply.github.com>

2024-10-21 16:15:34 +08:00

..

conversation_data

Whisper + LLAMA + VITS (#2332)

2023-12-02 15:03:46 -08:00

llm.c

remove graph [pr] (#7085)

2024-10-16 11:40:07 +08:00

mlperf

tinytqdm write support (#6359)

2024-10-16 14:51:41 -04:00

openpilot

move memory_planner to memory.py [pr] (#7079)

2024-10-16 10:04:35 +08:00

other_mnist

beautiful_mnist in torch

2024-07-14 11:09:58 -07:00

rl

more beautiful_cartpole with exposed hparams

2024-01-07 17:41:09 -08:00

sovits_helpers

move dtypes to dtype.py (#2964)

2024-01-01 14:58:48 -08:00

tinychat

bring tinychat more inline with tinyos' version (#5358)

2024-07-10 13:13:52 -07:00

vgg7_helpers

move to new cached fetch (#2493)

2023-11-28 17:36:55 -08:00

webgl/yolov8

webgl backend in extra (#3041)

2024-01-08 09:29:13 -08:00

webgpu/stable_diffusion

s/lazydata.realized/lazydata.base.realized/g (#2914)

2023-12-22 14:45:13 -05:00

__init__.py

failing llama test

2023-03-11 16:28:10 -08:00

beautiful_cartpole.py

tinytqdm.set_description and tinytrange (#5101)

2024-06-22 14:45:06 -04:00

beautiful_cifar.py

Fix mypy examples/beautiful_*.py (#6978)

2024-10-10 11:34:29 -04:00

beautiful_mnist_multigpu.py

Fix mypy examples/beautiful_*.py (#6978)

2024-10-10 11:34:29 -04:00

beautiful_mnist.py

added beautiful fashion mnist and example (#6961)

2024-10-10 12:01:07 +08:00

coder.py

apply the same fix_bf16 in llama and coder (#3789)

2024-03-17 21:25:24 -04:00

compile_efficientnet.py

webgl backend in extra (#3041)

2024-01-08 09:29:13 -08:00

compile_tensorflow.py

fix various examples (#4691)

2024-05-22 20:43:21 -04:00

conversation.py

fix conversation.py quantize (#4663)

2024-05-20 17:36:37 -04:00

efficientnet.py

remove clang program header (#4422)

2024-05-04 08:38:01 -07:00

flux1_seed0.png

Flux.1 (#6334)

2024-09-24 10:08:04 +08:00

flux1.py

Flux.1 (#6334)

2024-09-24 10:08:04 +08:00

gpt2.py

GGUF support (#7046)

2024-10-21 16:15:34 +08:00

handcode_opt.py

changes from the big graph branch [pr] (#7160)

2024-10-19 16:22:37 +03:00

hlb_cifar10.py

add cifar to datasets.py (#6210)

2024-08-20 11:42:49 -07:00

index.html

Enable Multi-Output Export (#2179)

2023-10-30 18:42:26 -07:00

llama3.py

feat: small things from default_threefry (#6708)

2024-09-24 17:00:47 +08:00

llama.py

shard kvcache (#5830)

2024-07-30 20:29:54 -07:00

mamba.py

prev speed improvements (#5252)

2024-07-03 09:06:01 -07:00

mask_rcnn.py

change Tensor.stack to method (#4719)

2024-05-24 17:04:19 -04:00

mixtral.py

tinytqdm.set_description and tinytrange (#5101)

2024-06-22 14:45:06 -04:00

mnist_gan.py

tinytqdm.set_description and tinytrange (#5101)

2024-06-22 14:45:06 -04:00

openelm.py

nn.RMSNorm (#5272)

2024-07-02 21:39:01 -04:00

sdv2.py

Stable Diffusion v2 Inference (#5283)

2024-07-03 22:47:10 -04:00

sdxl_seed0.png

default threefry (#6116)

2024-09-25 17:45:13 +08:00

sdxl.py

Sharded SDXL Inference (#6328)

2024-09-21 01:26:43 -04:00

serious_mnist.py

move state to nn/state (#1619)

2023-08-22 07:36:24 -07:00

simple_conv_bn.py

fix various examples (#4691)

2024-05-22 20:43:21 -04:00

so_vits_svc.py

change Tensor.stack to method (#4719)

2024-05-24 17:04:19 -04:00

stable_diffusion_seed0.png

default threefry (#6116)

2024-09-25 17:45:13 +08:00

stable_diffusion.py

hotfix: bump stable diffusion val distance

2024-09-26 11:15:29 +08:00

stunning_mnist.py

stunning_mnist [run_process_replay] (#6828)

2024-10-01 15:00:48 +08:00

train_efficientnet.py

tinytqdm.set_description and tinytrange (#5101)

2024-06-22 14:45:06 -04:00

train_resnet.py

move things, clean up extra (#2292)

2023-11-13 20:18:40 -08:00

transformer.py

fix onehot and jit in examples/transformer (#3073)

2024-01-10 02:22:41 -05:00

vgg7.py

waifu2x vgg7: testcase, auto-RGBA->RGB, function to grab pretrained models, training "fix" (#2117)

2023-10-19 22:07:15 -07:00

vit.py

move to new cached fetch (#2493)

2023-11-28 17:36:55 -08:00

vits.py

docs: showcase remove mnist_gan and add conversation.py (#4757)

2024-05-28 11:09:26 -04:00

whisper.py

enable whisper batch for long sequences (#6458)

2024-09-17 00:42:10 -04:00

yolov3.py

Update yolov3.py (#2680)

2023-12-08 12:59:38 -08:00

yolov8-onnx.py

[ready] Replacing os with pathlib (#1708)

2023-08-30 10:41:08 -07:00

yolov8.py

fix yolov8 example (#5003)

2024-06-16 20:47:29 -04:00