I did a video with Brighter with Herbert, Herbert Ong. I explained why the chart from last year showing Tesla going to 100 Exaflops of compute in October 2024 is out of date. Elon Musk said that both XAI and Tesla had over 30,000 H100 chip equivalents. Nvidia H100 chips each have petaflops of compute. …
Jensen Huang described how the $1 trillion in current data centers will see another $2 trillion of AI accelerated data centers added over the next few years. Brad Gerstner, Altimeter Capital, describes the impact of adding those AI data centers on energy and computer chips. Brian WangBrian Wang is a Futurist Thought Leader and a …
The number of Nvidia H100 and other Nvidia chips that an AI company represents the AI compute resources of that company. Elon indicated that a recent chart showing Meta leading on the GPU count and Tesla trailing at 10,000 G100 GPUs. Microsoft and OpenAI would also have higher GPU counts. It is unclear why Microsoft …
Nvidia and other AI related companies have had a surge in profits and share prices. Are we in an AI Bubble or the early stages of the AI transformation? My video has a broader perspective on this. Below is a start at looking at the current details. There is additional information from the Stanford AI …
Tesla indicated in August, 2023 they were activating 10,000 Nvidia H100 cluster and over 200 Petabytes of hot cache (NVMe) storage. This memory is used to train the FSD AI on the massive amount of video driving data. Elon Musk posted yesterday that Tesla FSD training is no longer compute constrained. Tesla has likely activated …
Last August, former Tesla AI engineer Tim Zaman posted on X that a Tesla AI cluster, built using 10,000 of Nvidia’s H100 chips, was ready to go live. Musk said a post on X in January that while a Dojo supercomputer cost $500 million to build, Tesla will spend more than that on Nvidia hardware …
Nvidia has increased compute power faster than Moore’s law for the past 8 years. Nvidia plans to launch new chips every 6 months for several years. The pace of their innovation is increasing. The Nvidia Blackwell GPU is not just a chip it is an entire system weighing 1.5 tons. A 32000 GPU data center …
The NVIDIA Blackwell platform was announced today. It will run real-time generative AI on trillion-parameter large language models at up to 25x less cost and energy consumption than the H100. The Blackwell GPU architecture has six transformative technologies for accelerated computing, which will help unlock breakthroughs in data processing, engineering simulation, electronic design automation, computer-aided …
Nvidia has made a software, AI and hardware platform to make developing humanoid robots far faster and easier. They have software to help with the testing, learning and development. Brian WangBrian Wang is a Futurist Thought Leader and a popular Science blogger with 1 million readers per month. His blog Nextbigfuture.com is ranked #1 Science …
The All in Podcast had a discussion and debate about the AI decade. They compare the current AI infrastructure boom with the internet boom. The current situation is less of a bubble because Nvidia is not getting that large a multiple off its real earnings. They are certain that the current build out phase will …
TSMC’s (Taiwan Semiconductor) 2.5D advanced packaging CoWoS (Chip on wafer and wafer on substrate) technology is currently the primary technology used for AI chips. The production capacity of CoWoS packaging technology is a major bottleneck in AI chip output and will stay as a problem for AI chip supply in 2024. Nvidia H100 (AI chips) …