Files
tinygrad/extra
geohotstan 0bed9b6cd2 benchmark huggingface onnx models (#8493)
* add ability to ORT=1

* test_vs_ort

* useless f

* actually have benchmark take in modelproto for more flexibility in huggingface stuff

* ok runs

* good

* oops fix benchmark_onnx __main__

* 224 as default

* add ORT=1 option to huggingface_onnx

* use Tensor to get_input

* add abilty to do single onnx model testing

* better names

* merge properly...

* copy in onnx_helpers

* better

* decent script

* need to add debug tool first

* new limit usage

* why did narrowing_error come back..

* pretty decent

* revert validate change

* more ops bug fixes

* revert unnecessary changes

* fix InstanceNorm too

* remove op from O4

* minimize diff

* address old feedback

* unsure of this, just revert

* remove that assert

* working attention

* to_python_const Attention

* cant init from np constant so just do this

* final

* fix bug in attention

* attention clean ups

* add hard TODOs and REPOPATH and TRUNCATE envvar

* fix input_ids default value

* final

* fix scatter

* cleaner _prepare_quantize

* use new attention and tempfile for huggingface script

* more stats

* update

* remove outdated code

* big refactor to something usable by CI

* booooooom

* clean up

* update to using yaml as env var input

* add dry run

* try

* valid pad

* use argparser and fix gather bug

* ignore all yaml

* tiny bit more polish

* woah ignoring all yaml was not right

* typo

* decouple huggingface_onnx_run debug run with huggingface_onnx_download

* bug fix for downloading single model

* WOOOO ok much better

* oops argparse 'required' is an invalid argument for positionals

* oops argparse 'required' is an invalid argument for positionals

* add assert

* fix types

---------

Co-authored-by: chenyu <chenyu@fastmail.com>
2025-03-12 20:13:12 -04:00
..
2023-11-13 20:18:40 -08:00
2025-03-04 20:44:09 +03:00
2024-11-03 11:26:10 +08:00
2025-02-20 18:03:09 -05:00
2025-02-04 09:45:04 +08:00
2025-03-10 16:05:30 -04:00
2024-01-26 18:27:49 -08:00
2025-03-10 13:46:33 +08:00
2024-09-20 11:28:01 +08:00
2025-03-11 13:19:56 +08:00
2025-03-03 23:07:30 +03:00
2024-01-01 14:58:48 -08:00
2025-02-20 19:20:01 +08:00
2023-12-07 17:07:05 -08:00
2025-03-09 20:01:42 -04:00
2024-01-19 23:34:30 -05:00
2025-02-13 12:26:15 +08:00
2023-11-30 17:07:16 -08:00
2024-09-25 18:31:03 +08:00