hi folks,
simple question really - what model (finetuned or otherwise) have you found that can extract data from a bunch of text.
I’m happy to finetune, so if there are any successes there, would really appreciate some pointers in the right direction.
Really looking for a starting point here. I’m aware of the DETR class of models and how Microsoft trained table-transformers on DETR. Wondering if that can be done on llama2,etc models ?
P.S. cannot use GPT because of sensitive PII data.
I’ve wondered this, and hope you get better answers.
One thing you could do if it fit your use-case: align GDELT entries and news stories in realnews dataset on huggingface, train a model to output the extracted info from the article.
Another is have GPT-4 so some examples on lightly faked / anonymized data and then distill that into a model that does well on information extraction evals (which are a thing iirc).
What is the information extraction evals ? Do u have a link ?