chips

Analog in-memory Computing Attention Mechanism for Fast and Energy-efficient Large Language Models

by

A Nature paper describes an innovative analog in-memory computing (IMC) architecture tailored for the attention mechanism in large language models (LLMs). They want to drastically reduce latency and energy consumption during inference. The design leverages gain-cell crossbar arrays—capacitor-based memory devices made from oxide semiconductor field-effect transistors (IGZO or ITO)—to store key (K) and value (V) …

Read more

Expert Jon Twigge and Brian Wang on SURVIVING A FASTER and HARDER AI Future, Part 1

by

Technology experts Brian Wang and Jon Twigge discuss the fast arriving future of AI. The acceleration of AI technology has already started happening. It is the shocking speed of development and the speed of change which will make adapting and surviving harder. Speed of change is everything. XAI and Tesla have more speed. Physical change …

Read more

China Will Achieve 5 Nanometer Chips

by

China’s main chipmaker, SMIC, has put together new semiconductor production lines in Shanghai, to mass-produce Huawei designed smartphone chips with a 5 nanometer lithographic process. In August 2023, Huawei surprised the industry and analysts with a 7 nanometer processor for its Mate 60 Pro premium smartphone launched. The phone helped it to increase shipments in …

Read more

Now China SMIC and Intel Are Both at 7 Nanometer Chips

by

China leading chip company SMIC and Intel are both making 7-nanometer chips. China was always behind TSMC, Samsung and the leading semiconductor chip companies. Intel was the long chip technology leader for decades with the smallest dimensions in the most advanced chips but Intel fell behind badly in the last five to ten years. Semiconductors …

Read more