Building Polaris: A Data Discovery and Metadata Management Agent
In a world drowning in data, finding the right dataset is a persistent challenge. Our data team solved this by building Polaris, a custom agent designed to automate data discovery and metadata management. In this talk, we'll walk you through how we built this powerful tool, from the automations involved to our practical use of LLMs. Join us to learn how a homegrown system can solve a real-world problem and the valuable lessons we learned along the way.
