Ted Kwartler, DataRobot & Arvind Thinagarajan, USA Today Network | Google Cloud Next 2023
summary
DataRobot and USA Today Network describe an approach that ties LLM selection to measurable outcomes: evaluation across 140+ LLMs, monitoring for toxicity, cost and truthfulness, and returning a confidence score with source citations. DataRobot plugs into Vertex AI, PaLM/Med‑PaLM and BitQuery, automates lifecycle steps for hundreds of models, enables human‑in‑the‑loop editing, and shows early wins like audio patient‑note summarization that increases clinician throughput.
AI-written summary · about
