Snapshot of the Race for More AI Compute

The number of Nvidia H100 and other Nvidia chips that an AI company represents the AI compute resources of that company. Elon indicated that a recent chart showing Meta leading on the GPU count and Tesla trailing at 10,000 G100 GPUs. Microsoft and OpenAI would also have higher GPU counts. It is unclear why Microsoft …

Read more

AI LLM Has Trillion Dollar Use Case By Increasing Computer Programming Productivity

Devin is an AI that was used on the SWE-bench, a challenging benchmark that asks agents to resolve real-world GitHub issues found in open source projects like Django and scikit-learn. Devin correctly resolves 13.86% of the issues end-to-end, far exceeding the previous state-of-the-art of 1.96%. Even when given the exact files to edit, the best …

Read more

XAI Grok 1.5 is Close to GPT4

Grok-1.5 is XAI latest model capable of long context understanding and advanced reasoning. Grok-1.5 will be available to our early testers and existing Grok users on the š¯•¸ platform in the coming days. Grok 1.5 will be close to GPT4 capability. Grok 2 is in training and reportedly better than GPT4 and Claude 3. One …

Read more

XAI and X Will Release Grok 2 Next Week and It is Claimed to Surpass GPT4 and Claude 3

Elon says Grok 2 should exceed current AI on all metrics. Grok 2 is in training now. Should be available on š¯•¸ next week. Grok 2 should exceed current AI on all metrics. In training now. https://t.co/s7rVxvK8mZ ā€” Elon Musk (@elonmusk) March 29, 2024 Here are the specs for Claude 3 from Anthropic and GPT4 …

Read more

Starting the Era of 1-bit LLMs – With Microsoft Research

BitNet is paving the way for a new era of 1-bit Large Language Models (LLMs). In this work, we introduce a 1-bit LLM variant, namely BitNet b1.58, in which every single parameter (or weight) of the LLM is ternary {-1, 0, 1}. It matches the full-precision (i.e., FP16 or BF16) Transformer LLM with the same …

Read more

AI Can Now Forget Copyrighted and Other Material

Researchers at The University of Texas at Austin have developed what they believe is the first machine unlearning method applied to image-based generative AI. This method offers the ability to look under the hood and actively block and remove any violent images or copyrighted works without losing the rest of the information in the model. …

Read more

Can AI Solve Science ? Stephen Wolfram

Stephen Wolfram’s conclusions: 00:49 Won’t AI Eventually Be Able to Do Everything? AI cannot solve science but it can contribute to speeding up science Science was transformed by math centuries ago. What can we expect AI to be able or unable to do for science? 5:01 The Hard Limit of Computational Irreducibility This constrains what …

Read more

Worldā€™s Fastest AI Chip with 4 Trillion Transistors

Cerebras Systems has doubled its existing world record of fastest AI chip with the introduction of the Wafer Scale Engine 3. The WSE-3 delivers twice the performance of the previous record-holder, the Cerebras WSE-2, at the same power draw and for the same price. Purpose built for training the industryā€™s largest AI models, the 5nm-based, …

Read more

Rise of AI : What is the Timeline and Impact for AI Becoming AGI

Will AI surpass human intelligence to reach AGI (artificial general intelligence) ? I discuss the rapid advancements in AI, tackle whether you should fear it, and discuss its impact on our jobs and the world. Brian WangBrian Wang is a Futurist Thought Leader and a popular Science blogger with 1 million readers per month. His …

Read more