Decentralized Routing For a Sharded Application On Service Mesh

on YouTube ↗34m

" summary

Intuit moves shard routing out of a central API gateway into the client Envoy sidecar by calling an external lookup service (plus a distributed cache) from a WASM Envoy HTTP filter that rewrites outbound hosts to the shard DNS. A new routing policy CRD is authored by service owners and Admiral translates it into per-cluster EnvoyFilters; demo routes company IDs in the 7k/8k/9k ranges to the correct shards. TinyGo/WASM limits force an external cache and prebuilt proxy binary, but latency is acceptable after caching and CPU impact is small.

AI-written summary · about

" chapters (11)

1. 0:00Start
2. 1:29Intuit Scale
3. 3:57Service Mesh at Intuit
4. 5:49What is a sharded application?
5. 7:18Sharded Routing - MESH
6. 8:17Sharded Routing - Goals
7. 9:47Sharded Routing-Existing solutions
8. 11:53Sharded Routing - Approach
9. 13:29Dynamic Routing in Intuit
10. 15:07Challenges
11. 17:07Demo Setup

" related talks

• 28mEnvoy at SquareMichael Puncel, Snow Petteren · EnvoyCon 2018
• 29mThe rise of Layer 7, microservices, and the proxy war...Flynn · DevOpsDays Boston 2018
• 33mUsing Envoy for data aware traffic routing in Azure Service FabricVaclav Turecek · EnvoyCon 2018
• 24mMulticluster Service MeshAdam Sayah · ServiceMeshCon Europe 2021
• 43mService Mesh and the future of networkingIgnasi Barrera · Software Crafters Barcelona 2019
• 23mA Simplified Service Mesh With gRPCSrini Polavarapu · gRPC Conf 2020
• 39mAPI Gateway to Service Mesh: Navigating a Changing LandscapeZhamak Dehghani · NDC London 2018
• 53mService Mesh: What, Why, And How?Flynn · DevOpsDays Boston 2017