Electronics

DRAM Manufacturer Stock Prices Dip Over Google TurboQuant Announcement

DRAM Manufacturer Stock Prices Dip Over Google TurboQuant Announcement

Stock prices of DRAM manufacturers dipped by as much as 19% over the past 5 days, over the March 24 announcement of Google TurboQuant, a new technology that Google claims will reduce the memory footprint of AI models by a factor of 6, and inference speeds by a factor of 8. As of this writing, Micron Technology (NASDAQ: MU) dipped 19.5% over the last 5 days. Over in Korea, SK Hynix saw its stock price drop by 6%, while Samsung Electronics saw a dip by 5%.

TurboQuant is an advanced quantization algorithm developed by Google that delivers massive data compression for LLMs and vector search engines. It effectively tackles memory bottlenecks in the key-value cache and accelerates similarity lookups without sacrificing model accuracy. TurboQuant achieves this efficiency by combining two novel techniques: PolarQuant, which simplifies data geometry using polar coordinates to eliminate traditional memory overhead, and Quantized Johnson-Lindenstrauss (QJL), a 1-bit mathematical error-checker. Capable of compressing the key-value cache to just 3 bits without requiring fine-tuning, TurboQuant enables up to 8x faster runtimes on GPUs, establishing a new standard for AI efficiency.

Leave a Reply

Your email address will not be published. Required fields are marked *