I’m struggling to get the 7b models to do something useful, obviously I’m doing something wrong as it appears many people strive for 7b models.

But myself I can not get them to follow instructions, they keep repeating stuff and occasionally they start to converse with themselves.

Does anyone have any pointers what I’m doing wrong?

  • Shoddy_Vegetable_115B
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    It returns a JSON with function name and respective arguments which you can parse later in the program and call the function with those arguments given by the model.