Jensen Predicts AI Inference Will Be 1 Billion Times Larger

Nvidia says that machine learning and agents will take over computer programming.

Jensen says distributed AI inference will have to work in order to meet the demand for inference.

AI inference will reflect upon getting the answer 10,000 times. Chain of reasoning and reflection and other intensification of compute for the answers.

This will make AI inference 1 billion times larger than it is today. (55 minutes in the interview).

Inference is using the trained AI models to give answers.

I have forecasted the distributed AI computing based upon Tesla products.