Ate-a-Pi has a weird claim that Mark Zuckerberg does not believe in AI compute scaling delivering better performance. There is also a claim about energy constraints for data centers and AI chips maximizing on performance per watt. Zuckerberg says that the exponential curves are still scaling. He says no ones how long that scaling continues. …
Llama 3 is Meta’s latest generation of models that has state-of-the art performance and efficiency for openly available LLMs. Meta AI is available online for free. The small 7B model beats Mistral 7B and Gemma 7B. The 70B beats Claude 3 Sonnet (closed source Anthropic model) and competes against Gemini Pro 1.5 (closed source model …
Meta is working on adding latent space planning/search to large language model AI. 1️⃣H-GAP (https://arxiv.org/abs/2312.02682) 2️⃣Diffusion World Model (https://arxiv.org/abs/2402.03570) 3️⃣TAP (https://arxiv.org/abs/2208.10291) 4️⃣LaMCTS (https://arxiv.org/abs/2007.00708) 5️⃣LaP3 (https://arxiv.org/abs/2106.10544) 6️⃣LaSynth (https://arxiv.org/abs/2107.00101) 7️⃣LaMOO (https://arxiv.org/abs/2110.03173) Rumored OpenAI Q* Is Optimization in Abstract Representation Space The innovation in Q* lies in its optimization process, conducted not within the space of possible text …
META CEO Mark Zuckerberg announced on Instagram that META is dumping more than $10 billion into the computing infrastructure to develop AGI. AGI is AI that can match or surpass humans across a range of cognitively demanding tasks. Meta’s two AI research efforts are brought closer together to support the long-term goals of building general …
Meta CEO, Mark Zuckerberg, is saying that the LLAMA 3 large language model will be providing open source AGI. Zuckerberg feels that people will wear glasses to hold their connection to AGI. Glasses will provide the video and audio connection from people to AGI. Mark joins OpenAI Sam Altman as promising AGI will here very …
Mark Zuckerberg plans on acquiring 350,000 Nvidia H100 GPUs to help Meta build a next-generation AI that possesses human-like intelligence. Zuckerberg mentioned the figure today as he announced his company’s long-term effort to develop an artificial general intelligence (AGI), or an AI that can learn and be used to perform a variety of tasks. By …
2023 has been a relatively good year for the benchmark S&P 500 and growth stock-fueled Nasdaq Composite. The S&P 500 is widely viewed as the best benchmark of Wall Street’s health. It’s a market cap-weighted index comprised of 500 generally profitable, time-tested companies, a few of which have multiple classes of shares. All told, the …
HuggingFace has rankings of the best large langauge models based upon the votes of over 70,000 users. OpenAIS GPT-4 is still number one and is followed by three versions of Anthropics Claude. Fifth is GPT3.5 Turbo and then the first Open Source model in the list Vicuna-33B. Seventh is Meta’s LLAMA2 70b Chat. The HuggingfAce …
Llama 2 is a collection of pretrained and fine-tuned large language models (LLMs) ranging in scale from 7 billion to 70 billion parameters. Meta fine-tuned LLMs, called Llama 2-Chat, are optimized for dialogue use cases. The models outperform open-source chat models on most benchmarks they tested, and based on their human evaluations for helpfulness and …
Apple today unveiled Apple Vision Pro, a revolutionary spatial computer that is their answer to Meta Oculus. Apple Vision Pro can transform any space into a personal movie theater with a screen that feels 100 feet wide and an advanced Spatial Audio system. Users can watch movies and TV shows, or enjoy stunning three-dimensional movies. …
Yann LeCun is VP & Chief AI Scientist at Meta and Silver Professor at NYU affiliated with the Courant Institute of Mathematical Sciences & the Center for Data Science. After a postdoc in Toronto he joined AT&T Bell Labs in 1988, and AT&T Labs in 1996 as Head of Image Processing Research. He joined NYU …