Meta Llama 3 70B Open Source Model Beats Claude 3 Sonnet

Llama 3 is Meta’s latest generation of models that has state-of-the art performance and efficiency for openly available LLMs. Meta AI is available online for free. The small 7B model beats Mistral 7B and Gemma 7B. The 70B beats Claude 3 Sonnet (closed source Anthropic model) and competes against Gemini Pro 1.5 (closed source model …

Read more

Tesla’s Hidden Compute Power

I did a video with Brighter with Herbert, Herbert Ong. I explained why the chart from last year showing Tesla going to 100 Exaflops of compute in October 2024 is out of date. Elon Musk said that both XAI and Tesla had over 30,000 H100 chip equivalents. Nvidia H100 chips each have petaflops of compute. …

Read more

Anthropic Claude 3 is Sometimes Better than OpenAI GPT4 Turbo

The various Claude 3 models are ranking very closely to the OpenAI GPT 4 AI models. Claude is able to understand images. I uploaded the picture of a SpaceX Starship refueling in space. Claude Sonnet described its understanding as follows. The image depicts two futuristic-looking spacecraft or rockets in space, seemingly in orbit around the …

Read more

Tesla Unveils the Robotaxi on August 8 during an ongoing FSD Ramp. What is known and unknown?

Tesla is unveiling the Robotax on August 8, 2024 there is an ongoing ramp of the FSD (full self driving) software. What do we no know and not know about this rapidly changing situation? This is all happening as Tesla’s sales growth is “between two growth waves”. Tesla has cut over 10% of its staff …

Read more

Who wins AI? How do they Make Money? Will Voice Be the Main Interaction to AI?

Microsoft is doing very well by buying OpenAI. OpenAI is making money now. AI Models are becoming commoditized. In the long run, there seems to be a race to the bottom on pricing. Open Source AI models like Meta could be used to become the Platform. All of the development happens on your platform. If …

Read more

What Features are Needed for FSD as FSD 12.3.4 is Starting to Release

There are about six major capabilities that Tesla still needs to add to FSD based upon capability checklists. Most of the capabilities will need refinement so that they are performed well every time. The six capabilities are recognize hand signals, drive in reverse, avoid pot holes and low road obstacles, don’t drive in the blind …

Read more

Snapshot of the Race for More AI Compute

The number of Nvidia H100 and other Nvidia chips that an AI company represents the AI compute resources of that company. Elon indicated that a recent chart showing Meta leading on the GPU count and Tesla trailing at 10,000 G100 GPUs. Microsoft and OpenAI would also have higher GPU counts. It is unclear why Microsoft …

Read more

AI LLM Has Trillion Dollar Use Case By Increasing Computer Programming Productivity

Devin is an AI that was used on the SWE-bench, a challenging benchmark that asks agents to resolve real-world GitHub issues found in open source projects like Django and scikit-learn. Devin correctly resolves 13.86% of the issues end-to-end, far exceeding the previous state-of-the-art of 1.96%. Even when given the exact files to edit, the best …

Read more