On the SC24 supercomputing convention held in November in Atlanta, Hafþór Júlíus Björnsson (the actor who performed the Mountain in “Sport of Thrones”), dead-lifted a customized barbell weighed down by 453 kilograms (1,000 kilos) of solid-state drives (SSDs). The info saved in these drives totaled simply over 280 petabytes.
“With out query, that is probably the most knowledge lifted by a human in historical past,” says Andy Higginbotham, senior director of enterprise improvement at Phison Electronics. Excessive-performance knowledge platform Vdura orchestrated the record-breaking raise in collaboration with Phison.
Behind this publicity stunt is an actual pattern: To feed AI’s insatiable knowledge urge for food, reminiscence drives are getting bigger, endlessly. Phison not too long ago introduced the most important SSD reminiscence drive to this point, storing 128 terabytes of information, and piled tons of of them into Björnsson’s barbell. Inside a number of weeks, Solidigm introduced its personal 123-TB drive. Samsung and Western Digital additionally not too long ago began carrying related merchandise.
The shift towards extra AI workloads in knowledge facilities has led to very power-hungry chips, principally GPUs. Because the total energy use in a knowledge heart goes up, individuals are in search of methods to make use of much less energy wherever doable. On the identical time, giant language fashions and different AI fashions require ever rising quantities of reminiscence.
“You may see the place storage necessities are going,” says Roger Corell, senior director of AI and management advertising and marketing at Solidigm. “You take a look at a big language mannequin only a couple years in the past, you had a half a petabyte per rack or decrease. And now there’s giant language fashions that pair with between three and three and a half petabytes per rack. Storage effectivity to allow continued scaling of AI infrastructure is actually, actually vital.”
Crucially, this new crop of solid-state drives takes up the identical space in a computing rackand energy finances as their roughly 32-TB and 64-TB predecessors—though they’re barely taller—which means they are often swapped into knowledge facilities for a simple win.
3 Methods to Enhance SSD Capability
“There’s three sorts of vectors you may innovate on to drive up capability per SSD,” says Corell. “One is the bits per cell, after which two is what number of cells are you able to pack in a single layer, and what number of layers are you able to stack of those reminiscence cells.”
The variety of bits per cell is actually what number of totally different values may be saved in a single NAND flash floating-gate transistor. These transistors are packed onto a layer with ever-increasing densities. Including extra layers does make the system taller, however, Corell says, peak isn’t a limiting think about knowledge facilities as we speak, so there’s room to increase.
Solidigm was already making 4-bit-per-cell units, so it innovated by packing extra cells per layer to go from the 60-TB mannequin to its 122-TB system, primarily through the use of the smallest out there NAND know-how and decreasing the scale of non-NAND parts. Phison went from 3-bit to 4-bit NAND cells, enhancing alongside all three vectors to go from its 32 TB to its 128-TB drive.
Going to a better variety of bits per cell makes the write occasions considerably slower, however that is nonetheless a win in loads of purposes, says Allyn Malventano, senior supervisor of technical advertising and marketing at Phison.
Sustaining the identical energy draw as smaller units is a nice balancing act. “The drive builders are at all times going to must do to determine, okay, if we configure it this explicit manner, possibly we are able to get some increased efficiency, but when we do this, it’s going to take some extra energy with a view to do this proper,” Malventano says. “So there’s principally a tuning operation that goes on for any explicit capability.”
The demand for higher-capacity reminiscence drives isn’t slowing down, both. “It’s by no means going to cease. There’s at all times going to be extra demand for bigger SSDs,” Higginbotham says. Solidigm’s Corell predicts there shall be petabyte SSDs in the marketplace earlier than the last decade is completed.
From Your Web site Articles
Associated Articles Across the Net