~/talk

Kimberly Leyenaar, Broadcom, and Steen Graham, Scalers AI | SC23

Talkat SC23 2023 · 2023-11-12..11-17· [networking]
links:none on file
links:none on file
slides:none on file

Broadcom and Scalers AI describe running inference on 70B Llama models and fine-tuning Llama 2 on a PubMed corpus of tens of millions of records in a heterogeneous, distributed cluster (H100s, A100s, Dell PowerEdge variants, Broadcom Ethernet). Fine-tuning completes in days once the cluster is ready, but building the cluster (data ingest, munging, storage IOPS, networking) takes far longer. They demonstrate GPUDirect to bypass CPU bottlenecks, publish sample code, and outline scale lessons for a 500,000-node cluster.

AI-written summary · about

  1. 0:00Introduction to HPC
  2. 1:27Defining modern infrastructure
  3. 4:51Enterprise AI implementation
  4. 9:29Hardware and networking
  5. 14:11Overcoming deployment hurdles
~/search
type to search 6,518 conferences, 143,918 speakers and 192,133 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
← →
on a talk: 5 seconds back / forward
0–9
on a talk: jump to 0%–90% of the recording
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.