Language models are increasingly being deployed for general problem solving across a wide range of tasks, but are still confined to token-level, left-to-right decision-making processes during inference. This means they can fall short in tasks that require exploration, strategic lookahead, or where initial decisions play a pivotal role. Deepmind researchers introduce a new framework for …
Google released a Large Language Model PaLM 2 which is competitive with OpenAI’s GPT 4. Google also announced they are already training Gemini which is a GPT 5 competitor. Gemeni likely use TPU v5 chips. Benchmarks for PaLM-2 beats GPT 4. They use SmartGPT-like techniques to boost performance. PaLM 2 beats even Google Translate, due …
Google’s CEO has announced that Google will be an AI first company. They are adding generative AI to all of their products including search, maps, gmail and workspace. Google announces Palm-2 which powers an improved BARD as a new GPT-4 competitors. Palm-2 is integrated into 25 Google products. BARD can handle over 20 programming languages. …
Emergent capabilities are abilities that are not present in smaller models but are present in larger models. This is discussed in the video below by Jason Wei, a Google AI researcher. I had a prior article that discussed the summary from Alan Thompson on what capabilities emerged at what point for the large language models. …
There are six major AI projects in the race beyond 2 trillion parameter models. There is OpenAI, Anthropic, Google/Deepmind, Meta, a UK government project and a stealth project. It takes $1-2 billion per year of resources to be in the game. There is $1 billion needed for hardware and that hardware will need to be …
Microsoft Satya Nadella and Jared Spataro focused on how AI will power a whole new way of working for everyone. Word, Excel, Powerpoint and other microsoft software will create first drafts of documents which can be based upon the users previous style. CoPilot can convert Word documents into Powerpoint and Powerpoint into Word. CoPilot can …
Alphabet’s Waymo , self-driving company, has laid off 8% (209 employees) of its workforce. The layoffs — mostly engineering roles — are part of a broader organizational restructure. Brian WangBrian Wang is a Futurist Thought Leader and a popular Science blogger with 1 million readers per month. His blog Nextbigfuture.com is ranked #1 Science News …
Google has a quantum computing goal of encoding a logical qubit on 1000 physical ones with an error rate of 0.0001% and they have achieved a 3% error rate using 17 qubits. The scaling or error reduction must be 20 times better. Using a 72-qubit chip, the Google team encoded a single logical qubit in …
Microsoft Bing has about 3.2% of the overall global search engine market but has 8-9% of the desktop search market. It took Google about two years after getting to scale to pass Yahoo in 2002 as the top search engine. Microsoft Bing already has some global scale. It will take about 500% growth on the …
ChatGPT is a large language model AI that is making big waves. The NY Times reports that Google declared a code Red emergency in 2022 to respond to ChatGPT. ChatGPT with Microsoft support is something that could enable the Microsoft Bing search engine to surpass Google search. The new AI Wars are the next stage …
Fortune and others are reporting that Microsoft will close a $10 billion investment deal into the artificial intelligence startup before the end of this month. This is discussed in the All-in-Pod cast. The deal will have a unique structure in that Microsoft will get 49% of the company but 75% of future profits. Chamath is …