I want to see if some presets and custom modifications work well in benchmarks, but running HellaSwag or MMLU looks too complicated for me, and it takes 10+ hours to upload 20GBs of data.
I assume there isn’t a convenient webui for chumps to run benchmarks with (apart from ooba perplexity, which I assume isn’t the same thing?). Any advise?
I would also be interested in this! Especially if we could create new custom evals and load them in.