Big-Data Processing of Social Media User Data in AlibabaCloud MaxCompute
summary
Demonstrates combining heterogeneous user data for 700 million accounts from 15 sources, including AliExpress customer internal data and external social‑network account data. Uses Alibaba MaxCompute for big‑data processing and shows that the same code can run with minimal changes on Apache Hive.
AI-written summary · about
chapters (11)
- 0:00Introduction
- 4:21MaxCompute in Alibaba Cloud
- 7:56Four data processing stages
- 10:00Profile data normalization
- 18:08Normalization pipeline
- 23:07User identification methods
- 26:39Connected components algorithm
- 30:10Merge issues and solutions
- 36:54Data merging strategies
- 43:20Results and applications
- 47:21Q&A
related talks
20mData Technology Enabled AI Solutions
48mFrom (Big) Data Mess to Data as an Innovation Enabler
01h 04mOnline Advertising: Hybrid Approach to Large-Scale Data Analysis
34mData at scale: How to deal with small challenges when they become massive
12mBig Impact from Big Data
05mHadoop in 5 Minutes or Less
57mBig Data: Threat or Opportunity?
01h 06mYahoo!, Big Data, and Microsoft BI: Bigger and Better Together