How we replicate and localize 100,000 repositories nearly every day 🕺🏼
summary
Describes a system built to replicate and localize around 100,000 GitHub repositories nearly every day, targeting Chinese-hosted repositories for use in Russia. Covers the pipeline for daily replication of hundreds-to-thousands of repos and associated materials, plus automated and manual translation steps (including handling slang) required to serve localized content.
AI-written summary · about
chapters (7)
- 0:00Introduction
- 5:46Why GitLI and Chinese open source
- 10:18Repository transfer prototypes
- 16:38Localization and entity translation
- 21:36Platform scaling
- 27:09Optimization and results
- 37:24Q&A
related talks
40mHow we replicate and localize 100000 repositories almost daily 🕺🏼
22mHow We Migrated Thousands of Repositories to SaaS With Developer Experience
31mGitHub as a self-sustaining product for large-scale environments
01h 06mHow GitHub delivers GitHub using GitHub
43mTop Ten Worst Repositories to host on GitHub
14mGitHub's Data Story: Open Source at the Home for Open Source
16mHow We Moved to a Monorepo
26mBuilding an enterprise git repository (the hard bits!)