- 1 Post
- 25 Comments
SlimxshadyxBto
LocalLLaMA@poweruser.forum•RWKV v5 7b, Fully Open-Source, 60% trained, approaching Mistral 7b in abilities or surpassing it.English
1·2 年前You are right but I think a big part of Open source is being able to modify it however you like.
You can’t really modify anything here except for fine tuning without the og dataset
SlimxshadyxBtoStartups@indiehackers.space•Fellow startup founders, are pitch decks still in PowerPoint, or have we moved on?English
1·2 年前I’m more partial to the origami bird transition myself
SlimxshadyxBto
LocalLLaMA@poweruser.forum•I’m extremely confused about system requirements. Some people are worried about ram and others about vram. I have 64gb of ram and 12gb vram. What size of model can I run?English
1·2 年前In general, you have two options:
Running the model on your graphics card, or running it using your CPU.
On your graphics card, you put the model in your VRAM, and your graphics card does the processing.
If you use your CPU, you put the model in your normal RAM and the cpu does all the processing.
The graphics card will be faster, but graphics cards are more expensive.
You can even mix the two if you can’t fit your model in your VRAM, where you put as much as possible on your VRAM and whatever left over on RAM and CPU. But this won’t be as fast as running it fully on your graphics card.
Mac has a different kind of architecture where it’s a mix of the two, and can be incredibly fast, but I haven’t used it so can’t speak too much on it.
u/faldore
Does this mean Dolphin2 coming? I’m hoping so! I love the current dolphin models
Dolphin man please!
Doesn’t this method free up context?
SlimxshadyxBto
LocalLLaMA@poweruser.forum•Run an openAI powered startup. What’s the best alternative to got 3.5 with function calling that I can run in the cloud?English
1·2 年前How do you know the start up isn’t providing value? Isn’t the whole point of making ai is to integrate it with other software/stuff?
Ai can be much more powerful than a chatbot
SlimxshadyxBto
LocalLLaMA@poweruser.forum•Orca 2: Teaching Small Language Models How to ReasonEnglish
1·2 年前Wow! Exciting! Are these uncensored models or does the training data include refusals? Does anyone know? What was orca 1?
SlimxshadyxBto
LocalLLaMA@poweruser.forum•667 of OpenAI's 770 employees have threaten to quit. Microsoft says they all have jobs at Microsoft if they want them.English
1·2 年前Satya already made the announcement that Sam is joining Microsoft, so it’s pretty much impossible for OpenAI board to reinstate Sam as ceo.
The board can resign but they won’t get Sam back, so I think at this point OpenAI is going to crumble and Microsoft will take in everyone
SlimxshadyxBtoMachine Learning@academy.garden•[N] Sam Altman and Greg Brockman, together with colleagues, will join Microsoft to lead new advanced AI research teamEnglish
1·2 年前It is way too early to say nobody will switch off Chat GPT.
And all of the points you made are managerial points, which they just brought the management team from OAI in.
Especially with all this being in the news, many people believe that the company face is the driving force between product quality, and now that face is in Microsoft
Microsoft has been working with OAI on integrating GPT into products, and there has probably been a lot of technical knowledge spread back and forth.
Now Microsoft has the leadership team from OAI, as well as whatever information OAI wasn’t sharing with Microsoft before, and they can probably start transitioning away from their reliance on OAI.
I think they mean that you will have a collection of slides you can use as templates, background images, font colours, etc. built up because you use the same tools over time.
SlimxshadyxBtoStartups@indiehackers.space•OpenAI Drama - Altman vs Board and Startup Lessons Learned?English
1·2 年前It’s a really good write-up, but isn’t all that a bit much when we don’t even know why the board fired Sam? They had some sort of reasoning and it could’ve been completely justified, no?
It can also be exactly what he is saying, but do we have any actual source of information that confirms that?
SlimxshadyxBtoStartups@indiehackers.space•OpenAI Drama - Altman vs Board and Startup Lessons Learned?English
1·2 年前Because training a language model like GPT 4 is incredibly expensive
SlimxshadyxBto
LocalLLaMA@poweruser.forum•Details emerge of surprise board coup that ousted CEO Sam Altman at OpenAI (Microsoft CEO Nadella "furious"; OpenAI President and three senior researchers resign)English
1·2 年前Could you link me for some more info on that?
SlimxshadyxBto
LocalLLaMA@poweruser.forum•Introducing Tess: Tess-M with 200K Context LengthEnglish
1·2 年前I’m not sure why he is being very vague with this model. He said it’s fine tuned to be better at instruct? I think
SlimxshadyxBto
LocalLLaMA@poweruser.forum•Details emerge of surprise board coup that ousted CEO Sam Altman at OpenAI (Microsoft CEO Nadella "furious"; OpenAI President and three senior researchers resign)English
1·2 年前Wow, Greg giving the breakdown of what happened was nice. Very sudden even internally.
I thought this might have been brewing over a week or so and it seems like it was, since Dev Day.
1-2% with no pay is extremely low. That’s something you should get as a hired developer for a start up while being paid a salary.
Those models can’t be accessed, they say it’s “too dangerous to be released”