Alien Top
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
AdamDhahabiB to LocalLLaMA@poweruser.forumEnglish · 2 年前

RAG - Vectara's Hallucination leaderboard

message-square
message-square
5
link
fedilink
1
message-square

RAG - Vectara's Hallucination leaderboard

AdamDhahabiB to LocalLLaMA@poweruser.forumEnglish · 2 年前
message-square
5
link
fedilink

Vectara’s Hallucination Evaluation Model and leaderboard was launched last week. I notice Mistral having a hallucination rate of 9.4% compared to 5.6% for Llama2. Any thoughts?

https://preview.redd.it/sj0akn15tszb1.png?width=1118&format=png&auto=webp&s=ca9ec766f592a8748bf95a8ad2ef81483c2270bd

Source: https://github.com/vectara/hallucination-leaderboard

  • Wonderful_Ad_5134B
    link
    fedilink
    arrow-up
    1
    ·
    2 年前

    “llama2 7b > llama2 13b”

    lol

LocalLLaMA@poweruser.forum

localllama@poweruser.forum

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@poweruser.forum

Community to discuss about Llama, the family of large language models created by Meta AI.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 4 users / day
  • 4 users / week
  • 4 users / month
  • 7 users / 6 months
  • 3 local subscribers
  • 11 subscribers
  • 1.03K Posts
  • 5.96K Comments
  • Modlog
  • mods:
  • communick@poweruser.forum
  • BE: 0.19.11
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org