Art Baudo Amazon EC2 | HPE Discover 2024
summary
AWS announces U7i instances with 32 terabytes of memory for SAP HANA and other massive in-memory workloads, pairs Sapphire Rapids, Genoa and Graviton-based R8G preview chips with NVIDIA GPUs plus Tranium and Inferentia accelerators, and reports customers clustering up to 10,000 GPUs for LLM training. Tools include SageMaker, Bedrock, S3 encryption and Nitro networking; migration path is mostly lift-and-shift with AMIs or CPU conversions, letting enterprises rent massive, pay‑per‑use capacity for episodic large trainings and high‑memory databases.
AI-written summary · about
