You are right but I think a big part of Open source is being able to modify it however you like.
You can’t really modify anything here except for fine tuning without the og dataset
I’m more partial to the origami bird transition myself
In general, you have two options:
Running the model on your graphics card, or running it using your CPU.
On your graphics card, you put the model in your VRAM, and your graphics card does the processing.
If you use your CPU, you put the model in your normal RAM and the cpu does all the processing.
The graphics card will be faster, but graphics cards are more expensive.
You can even mix the two if you can’t fit your model in your VRAM, where you put as much as possible on your VRAM and whatever left over on RAM and CPU. But this won’t be as fast as running it fully on your graphics card.
Mac has a different kind of architecture where it’s a mix of the two, and can be incredibly fast, but I haven’t used it so can’t speak too much on it.
u/faldore
Does this mean Dolphin2 coming? I’m hoping so! I love the current dolphin models
Dolphin man please!
Doesn’t this method free up context?
How do you know the start up isn’t providing value? Isn’t the whole point of making ai is to integrate it with other software/stuff?
Ai can be much more powerful than a chatbot
Wow! Exciting! Are these uncensored models or does the training data include refusals? Does anyone know? What was orca 1?
Satya already made the announcement that Sam is joining Microsoft, so it’s pretty much impossible for OpenAI board to reinstate Sam as ceo.
The board can resign but they won’t get Sam back, so I think at this point OpenAI is going to crumble and Microsoft will take in everyone
It is way too early to say nobody will switch off Chat GPT.
And all of the points you made are managerial points, which they just brought the management team from OAI in.
Especially with all this being in the news, many people believe that the company face is the driving force between product quality, and now that face is in Microsoft
Microsoft has been working with OAI on integrating GPT into products, and there has probably been a lot of technical knowledge spread back and forth.
Now Microsoft has the leadership team from OAI, as well as whatever information OAI wasn’t sharing with Microsoft before, and they can probably start transitioning away from their reliance on OAI.
I think they mean that you will have a collection of slides you can use as templates, background images, font colours, etc. built up because you use the same tools over time.
It’s a really good write-up, but isn’t all that a bit much when we don’t even know why the board fired Sam? They had some sort of reasoning and it could’ve been completely justified, no?
It can also be exactly what he is saying, but do we have any actual source of information that confirms that?
Because training a language model like GPT 4 is incredibly expensive
Could you link me for some more info on that?
I’m not sure why he is being very vague with this model. He said it’s fine tuned to be better at instruct? I think
Wow, Greg giving the breakdown of what happened was nice. Very sudden even internally.
I thought this might have been brewing over a week or so and it seems like it was, since Dev Day.
1-2% with no pay is extremely low. That’s something you should get as a hired developer for a start up while being paid a salary.
Those models can’t be accessed, they say it’s “too dangerous to be released”