Sinfonier: How I turned my grandmother into a data analyst
summary
Sinfonier turns non-developers into real‑time pipeline builders by letting analysts draw a topology that the system converts to an XML, builds with Maven and deploys to an Apache Storm cluster, no code required. It uses a visual topology canvas with spouts/bolts/drains, a single JSON tuple model, and a VM to test custom bolt code. Demos include RSS → MongoDB ingestion, Sodan feeds to a live dashboard, Google Alerts WordPress version checks, and a Twitter → graph DB pipeline; some demos run cleanly, one live graph test fails intermittently.
AI-written summary · about
chapters (9)
- 0:00Introduction to Sinfonier
- 3:43How Sinfonier works
- 8:07Live demo with Jackie
- 13:31Creating models in Sinfonier
- 18:34Security use case with Sodan
- 23:17Real-time camera monitoring
- 27:05Google Alerts integration
- 30:41Twitter to graph database demo
- 37:13Call to join the community
related talks
47mBuilding Modern Data Streaming Apps with Open Source
27mStream, Store, Visualize: Fast-Track Real-Time Analytics the OSS Way
42mPrinciples and Patterns for Streaming Data Analysis
42m"Distributed stream processing in Ruby"
39mCodeless Pipelines With Pulsar and Flink
44mDemocratizing data with an internal data pipeline platform
25mOnly SQL: Empower data analysts end-to-end with Flink SQL
31mBuilding Real-time Pipelines with FLaNK: A Case Study with Transit Data