is there a way to get a zero knowledge model that only knows how to chat. and from there fine tune it with specialized knowledge? and do this on consumer hardware (mac M1/16 gig) or free colab hardware?
i want to do this so as to prevent the model from hallucinating outside of the domain knowledge it is fed…like passing in a textbook and it only knows how to answer questions from it
Also what can you do with the latest m3 max with 128gb ram , can anyone put it in to context by comparing it