AI Can Now Forget Copyrighted and Other Material

Researchers at The University of Texas at Austin have developed what they believe is the first machine unlearning method applied to image-based generative AI. This method offers the ability to look under the hood and actively block and remove any violent images or copyrighted works without losing the rest of the information in the model. …

Read more

Oracle is Focused on Generative AI, a New Supercomputer and a Cybertruck Police Car

Oracle CEO Larry Ellison described using Oracle using Tesla Cybertruck as a next-generation police car. He says it will be very safe, very fast and it already has all of the cameras and screens that Oracle’s software needs. The details will be disclosed when the Cybertruck is fully revealed. Oracle has created emergency vehicles and …

Read more

Google Announces Palm-2 and BARD as a New GPT-4 Competitors at Google IO 2023

Google’s CEO has announced that Google will be an AI first company. They are adding generative AI to all of their products including search, maps, gmail and workspace. Google announces Palm-2 which powers an improved BARD as a new GPT-4 competitors. Palm-2 is integrated into 25 Google products. BARD can handle over 20 programming languages. …

Read more

Scaling Transformer to Output Over 2 Million Words With RMT

Recurrent Memory Transformer retains information across up to 2 million tokens (words). Applying Transformers to long texts does not necessarily require large amounts of memory. By employing a recurrent approach and memory, the quadratic complexity can be reduced to linear. The models trained on sufficiently large inputs can extrapolate their abilities to texts orders of …

Read more

Evaluating Large Language Models

ChatGPT, GPT-4 are Large Language Models (LLM). There are four major aspects of LLMs pre-training, adaptation tuning, utilization, and capacity evaluation. Here is one of the new summaries of the available resources for developing LLMs and issues for future directions. Chain-of-Thought (CoT) is an improved prompting strategy to boost the performance of LLMs on complex …

Read more

Fear the AI Who Has Practiced Next Word Guessing 10 Trillion Times

Martial Art Legence and Philosopher, Bruce Lee, famously said, I fear not the man who has practiced 10,000 kicks once, but I fear the man who has practiced one kick 10,000 times. Many now fear the AI, ChatGPT-4. ChatGPT grew from the original task of guessing the next word in a sentence, but it has …

Read more

Top Trending Hashtag on Twitter is #AutoGPT Which is Part of Accelerating AGI Everywhere

AutoGPT is part of a wave of multi-step ChatGPT systems that can handle more complicated tasks and planning. AutoGPT is the top trending hashtag on Twitter and the most active in Github. Planning, memory and scaling were the main things missing from making ChatGPT-4 into an AGI. These are primitive AGI but rapid improvement will …

Read more

ChatGPT AI Projected to Impact Over 300 Million Jobs and World GDP

Goldman Sachs has an analysis that ChatGPT and other generative AI could spark a productivity boom that could automate 25% of jobs in North America and Europe and raise annual global GDP by 7% over a 10-year period. The new AI could lift productivity growth by 1.5 percentage points over a 10-year period. This is …

Read more

Six Big AI Projects in the Race Beyond 2 Trillion Parameters

There are six major AI projects in the race beyond 2 trillion parameter models. There is OpenAI, Anthropic, Google/Deepmind, Meta, a UK government project and a stealth project. It takes $1-2 billion per year of resources to be in the game. There is $1 billion needed for hardware and that hardware will need to be …

Read more

Open Source Vicuna Claims 90% Quality VS GPT-4

Vicuna-13B, an open-source chatbot trained by fine-tuning LLaMA on user-shared conversations collected from ShareGPT. Preliminary evaluation using GPT-4 as a judge shows Vicuna-13B achieves more than 90%* quality of OpenAI ChatGPT and Google Bard while outperforming other models like LLaMA and Stanford Alpaca in more than 90%* of cases. The cost of training Vicuna-13B is …

Read more