Has anyone explored Intel’s new model yet? It’s a 7B model trained on Slim Orca, which is currently the top 7B model on the HF open LLM leaderboard.

I’ve found other 7B models to be surprisingly helpful, especially for annotation/data extraction tasks, so I’m curious if it’s worth replacing teknium/OpenHermes-2.5-Mistral-7B with this model.

  • No-Link-2778B
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    It’s data is public, but OpenHermes-2.5 dataset is gated and not accessible.