Berlin Buzzwords 2024

Cracking the Code: Deciphering Evaluation Essentials for RAG
2024-06-11 , Maschinenhaus

Explore RAG systems: Understand evaluation criteria, tools, and frameworks.
Discover essential components and compare them with existing frameworks.
Gain insights for enhanced control in your path toward RAG optimization.


Join us for an enlightening exploration into the world of Retrieval Augmented Generation (RAG) systems, where we uncover the intricacies of evaluation criteria and demystify the role of existing tools and frameworks.
In this presentation, we'll dissect the essential components necessary for robust RAG evaluation, contrasting them with the offerings of current frameworks.
From semantic understanding to content coherence, we'll highlight what truly matters in the evaluation process, empowering you to make informed decisions in the ever-evolving landscape of RAG systems.

Atita Arora is a seasoned and esteemed professional in information retrieval systems and has decoded complex business challenges, pioneering innovative information retrieval solutions in her 15-year journey as a Solution Architect / Relevance strategist / Individual Contributor.
She has a robust background from her impactful contributions as a committer in various information retrieval projects.
She has a keen interest in making tech innovations accessible and implementable to solve real-world problems.
She is currently immersed in researching about evaluating RAGs while navigating the world of vectors and LLMs, seeking to uncover insights that can enhance their practical applications and effectiveness.