Geoffrey Hinton is the godfather of modern neural network AI which is the basis of Large Language Models like Palm-2 and GPT-4. He said : if you look at these large language models they have about a trillion connections and things like OpenAI’s GPT-4 know much more than we do they have sort of Common …
Vicuna is a new, powerful model based on LLaMa, and trained with GPT-4. Vicuna boasts “90%* quality of OpenAI ChatGPT and Google Bard”. This is unseen quality and performance, all on your computer and offline. Oobabooga is a UI for running Large Language Models for Vicuna and many other models like LLaMA, llama.cpp, GPT-J, Pythia, …
There are six major AI projects in the race beyond 2 trillion parameter models. There is OpenAI, Anthropic, Google/Deepmind, Meta, a UK government project and a stealth project. It takes $1-2 billion per year of resources to be in the game. There is $1 billion needed for hardware and that hardware will need to be …
There is work to mitigate, detect and prevent the hallucinated bad results from Generative AI like ChatGPT. One current general research challenge in NLP is to establish a means of identifying hallucinated texts without the need to entirely redesign new NLP (AI) models that incorporate, define and authenticate facts as discrete entities. Authenticating all facts …
Ben Goertzel is a cognitive scientist, artificial intelligence researcher, CEO and founder of SingularityNET, leader of the OpenCog Foundation, and the AGI Society, and chair of Humanity+. He helped popularize the term ‘artificial general intelligence’. Goertzel was the Chief Scientist of Hanson Robotics, the company that created Sophia the Robot. He was a Director of …
I was wrong to believe in 2020 that it would be very hard for a small group to create a system for increasing programmer productivity and iterating on the improvement of productivity-boosting software and hardware. Generative AI and Copilot are boosting programmer productivity. Improving programmers with AI and improving AI with AI is the heart …
Stephen McAleese, at Less Wrong, used scaling rules and formulas to try to predict the performance of GPT-4. He underpredicted the capabilities of GPT-4. However, he was not widely wrong. GPT-4 came out earlier than he expected and had better performance than expected. Multi-task Language Understanding on MMLU was better than expected. GPT-4 can work …
Google has opened access to Bard which is an early experiment that lets you collaborate with generative AI. This is part of Google’s answer to Chatgpt. Bard is powered by a research large language model (LLM), specifically a lightweight and optimized version of LaMDA, and will be updated with newer, more capable models over time. …
Microsoft Satya Nadella and Jared Spataro focused on how AI will power a whole new way of working for everyone. Word, Excel, Powerpoint and other microsoft software will create first drafts of documents which can be based upon the users previous style. CoPilot can convert Word documents into Powerpoint and Powerpoint into Word. CoPilot can …
GPT4 and Google’s unreleased Palm system are getting IQ scores above the average human in IQ tests and tests that correlate to IQ. GMAT scores and other tests have been mapped to IQ and the high IQ societies accept a range of tests that GPT4 has taken. Brian WangBrian Wang is a Futurist Thought Leader …
The three main ingredients leading to predictable improvements in AI performance are training data, computation, and improved algorithms. In the mid-2010s, some AI researchers noticed that larger AI systems were consistently smarter, and so they theorized that the most important ingredient in AI performance might be the total budget for AI training computation. When this …