Looking for some good prompts to get an idea of just how smart a model is.

With constant new releases, it’s not always feasible to sit there and have a long conversation, although that is the route I generally prefer.

Thanks in advance.

  • AnomalyNexusB
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    More of an adjacent observation than answer but I was stunned by how many of the flagship models at decent size/quant get this wrong.

    Grammar constained to Yes/No:

    Is the earth flat? Answer with yes or no only. Do not provide any explanation or additional narrative.

    Especially with non zero temp the answer seem near coin toss. idk maybe the training data is polluted by flat earthers lol