Scaling Support of Dagster OSS with LLM's and RAGs | Pedram Navid

Previously streamed live at MDS Fest

Scaling Support of Dagster OSS with LLM's and RAGs, a talk by Pedram Navid, Head of Data Engineering, Dagster Labs

Talk Description

Dagster is an open-source data orchestration framework that has seen rapid adoption over the past few years, and with that adoption have come increased support questions. To help scale as we grow and unblock users' questions, we've created an LLM Support Bot that works. In this talk, we'll discuss the challenges of supporting open-source software, best practices for dealing with support questions, and how we prototyped and built a support bot to help deal with our users' questions.