Hi, would the mac be a good machine for having lots of smal models in memory - ready for action - like whisper, an llm, tts, llava and use em sequentially or maybe max two in paralell? (in respect to the 400gbit bandwidth limitation) i d like to make a powerful agent, like a brain with many brainparts responsible for specific stuff

  • a_beautiful_rhindB
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    I think those run on metal so you’re good. Haven’t seen any performance numbers from the M3 though. It’s a lot of coin to spend on something sight unseen.