- 15 Posts
- 13 Comments
2 days? Bro if they said November and haven’t released it by now, it’s not two days.
How much would that be in H100s or H200s?
is this q*? https://arxiv.org/abs/2311.15648
ninjasaid13Bto
LocalLLaMA@poweruser.forum•Hugging Face Removes Singing AI Models of Xi Jinping But Not of BidenEnglish
1·3 years agonote : HF reportedly block in china
iirc China has their own version of huggingface. Modelscope?
What’s so special about Q*
ninjasaid13Bto
LocalLLaMA@poweruser.forum•Training LLMs to follow procedure for Math gives an accuracy of 98.5%English
1·3 years agowhat about the 2.5%?
Been using lmql since guidance appeared to be abandoned
what do you mean abandoned? it seems to be getting updates for some time now.
ninjasaid13Bto
LocalLLaMA@poweruser.forum•NVidia H200 achieves nearly 12,000 tokens/sec on Llama2-13B with TensorRT-LLMEnglish
1·3 years agoH200? Theres a new accelerator?
ninjasaid13Bto
LocalLLaMA@poweruser.forum•GitHub - S-LoRA/S-LoRA: S-LoRA: Serving Thousands of Concurrent LoRA AdaptersEnglish
1·3 years agoHas anyone tested this?
ninjasaid13Bto
LocalLLaMA@poweruser.forum•Why not test all models for training on the test data with Min-K% Prob?English
1·3 years agoIt’s all a rabbit hole of time wasting, imho. People judge x or y model on how well it works for their use cases.
Well people don’t want to be falsely advertised on the capabilities of the model, if it’s only good on certain use cases, then just say it.
ninjasaid13OPBto
LocalLLaMA@poweruser.forum•Google Brain cofounder says Big Tech companies are lying about the risks of AI wiping out humanity because they want to dominate the marketEnglish
1·3 years agoSocialism = public monopoly (the state, or a private monopoly)
How is a private monopoly a public monopoly?
ninjasaid13OPBto
LocalLLaMA@poweruser.forum•RedPajama Data V2 has been released with 30 Trillion tokens of dataEnglish
1·3 years agohere’s the github page: https://github.com/togethercomputer/RedPajama-Data open-source with 30 Trillion tokens of Data.


Not just private but closed access.