Back to news

AI · Article

SlipStream Speeds Up Flash Memory for GPU AI Models Using Smart Prefetching

Semiconductor Engineering ·

At a glance

Researchers from Georgia Tech, NVIDIA Research, and Stanford University published a paper called SlipStream. It is a way to make High-Bandwidth Flash (HBF) work well as memory for GPU systems running large language models. Flash memory can hold much more data than DRAM-based memory, but it responds much more slowly.

Key points

Why it matters

Large AI models need more memory than GPUs can hold, so making cheaper, larger flash memory fast enough could lower the cost of running them.

Original source

Reducing High-Bandwidth Flash Latency In GPU Systems (Georgia Tech, Nvidia, Stanford)

Semiconductor Engineering · Nov 17, 08:52 KST

Read on Semiconductor Engineering ↗

AI summarized the original article. Check the original for accuracy. Copyright belongs to Semiconductor Engineering.

AI