A DP Framework for Gaining Insights into AI Chatbot Use
summary
Urania converts millions of raw chatbot logs into DP-safe summaries and trends, claiming end-to-end ε,δ DP guarantees by privatizing cluster centers and keyword counts rather than raw inputs. Pipeline uses LLM prompts for facet extraction, Gecko embeddings for semantic vectors, a differentially private clustering step, DP partition selection and histogram summarization, and LLM-based cluster naming. It runs distributed on Apache Beam + TPUs to process millions of examples in under a day and matches useful insight quality against a non-private Clio-like baseline.
AI-written summary · about
chapters (8)
- 0:00Urania framework intro
- 1:38Logs to insights with Urania
- 3:23Urania workflow steps
- 6:15Urania real-world apps
- 7:18Scaling Urania to millions
- 8:22Preprocessing and clustering challenges
- 10:10Evaluating Urania quality
- 11:15Urania future directions
related talks
33mStargazing into AI Usage with Differential Privacy
59mMaking the most of artificial and human intelligence for data science
58mAI-Enhanced Big Data: Integrating Private LLMs and Vector Databases
31mMachine Learning-Enabled Chatbots
38mAI-Powered Conversational Interfaces
01h 22mWho needs ChatGPT? Rock solid AI pipelines with Hugging Face and Kedro
50mExplainable AI Analysis & Visualization: Applications from Brain Computer Interfaces to ChatGPT
32mPrivate Insights into AI Use
