Leanne Tan

Project Kaleidoscope: Contextual, Human-Aligned Evaluation for Real-World AI Applications

Leanne Tan, Rohan Jaggi, Shaun Khoo, Roy Ka-Wei Lee

Evaluations (Evals) are a deployment bottleneck for real-world AI applications: public benchmarks rarely match a team's users, context, or policies, and human review is often tedious to scale. Motivated by our work with AI applications in the public sector, this project addresses…Read more