UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

We compared LangChain, Fixie, and Marvin

This project employs LLaMA-Index and OpenAI-Evals frameworks to assess the performance of Large Language Models (LLMs) in accurately answering multiple-choice questions related to the European Regulation on Strong Customer Authentication (SCA) for electronic payments.