kennysongB to Machine Learning@academy.gardenEnglish · 2 years ago[P] LangCheck: a multi-lingual toolkit to evaluate LLM applicationsplus-squaremessage-squaremessage-square0linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-square[P] LangCheck: a multi-lingual toolkit to evaluate LLM applicationsplus-squarekennysongB to Machine Learning@academy.gardenEnglish · 2 years agomessage-square0linkfedilink
minus-squarekennysongBtoMachine Learning@academy.garden•[D] How do you deal with LLM observability? What tools do you guys use?linkfedilinkEnglisharrow-up1·2 years agoIf you’re open to using an open source library, you can use LangCheck to monitor and visualize text quality metrics in production. For example, you can compute & plot toxicity of users prompts and LLM responses from your logs. (A very simple example here.) (Disclaimer: I’m one of the contributors of LangCheck) linkfedilink
If you’re open to using an open source library, you can use LangCheck to monitor and visualize text quality metrics in production.
For example, you can compute & plot toxicity of users prompts and LLM responses from your logs. (A very simple example here.)
(Disclaimer: I’m one of the contributors of LangCheck)