Versatility and Functionality of ApacheDrill
summary
Apache Drill is an open-source ANSI SQL query engine that Datadistillr uses to avoid ETL overhead and query CSV, Parquet, JSON, S3/GCS and databases directly. Concrete wins: custom UDF phone normalization standardizes messy numbers for ML, a UDF geolocate-by-area-code adds country/city granularity (best for US/Canada/UK), and GIS functions ST_Point/ST_Distance let users convert coordinates (even ISS lat/long) to points and return nearby charities or airports. It supports API plugins, exports result sets, scales with heap allocation, and sometimes struggles with highly malformed schemas.
AI-written summary · about
chapters (10)
- 0:00Introduction to Apache Drill
- 3:19What is Apache Drill
- 5:29Why use Apache Drill
- 7:17Querying and analyzing data
- 9:04Supported file types
- 11:30Use cases with UDFs
- 16:44GIS functionality demo
- 19:32Joining different data formats
- 21:19Should you use Apache Drill
- 23:46Q&A session
related talks
36mWhat and Why and How: Apache Drill 1.0 #bbuzz
25mA quack of all trades: DuckDB, a versatile analytical database to keep in your toolkit
32mSome Like It Hot
44mNonrelational SQL
01h 04mQuery Optimization and Acceleration at Dremio
01h 04mWhere We’re Going, We Don’t Need Rows: Columnar Data Connectivity with Apache Arrow ADBC
19mDatabases using R The latest
45mDruid: Powering Interactive Data Applications at Scale