CPUs vastly slowed in performance scaling around 1997-2004.
You can see it with the lines showing flat clock speeds and performance per clock. However, you already knew it from the lack of real performance improvement in laptops and desktop computers.
GPUs kept to Moore’s law in terms of performance improvement.
Google went beyond Moore’s law performance improvement by using custom ASICs
Google Tensor flow processors are on average 15x to 30x faster in executing Google’s regular machine learning workloads than a standard GPU/CPU combination (Intel Haswell processors and Nvidia K80 GPUs). The TPUs also offer 30x to 80x higher TeraOps/Watt (and with using faster memory in the future, those numbers will probably increase).
Google says it started looking into how it could use GPUs, FPGAs and custom ASICS (which is essentially what the TPUs are) in its data centers back in 2006.
For compute heavy applications and businesses, custom ASICS (or minimally GPUs) are needed to be competitive.
Wang is a prolific business-oriented writer of emerging and disruptive technologies. He is known for insightful articles that combine business and technical analysis that catches the attention of the general public and is also useful for those in the industries. He is the sole author and writer of nextbigfuture.com
, the top online science blog. He is also involved in angel investing and raising funds for breakthrough technology startup companies.
He gave the recent keynote presentation at Monte Jade event with a talk entitled the Future for You. He gave an annual update on molecular nanotechnology at Singularity University on nanotechnology, gave a TEDX talk on energy, and advises USC ASTE 527 (advanced space projects program). He has been interviewed for radio, professional organizations. podcasts and corporate events. He was recently interviewed by the radio program Steel on Steel on satellites and high altitude balloons that will track all movement in many parts of the USA.
He fundraises for various high impact technology companies and has worked in computer technology, insurance, healthcare and with corporate finance.
He has substantial familiarity with a broad range of breakthrough technologies like age reversal and antiaging, quantum computers, artificial intelligence, ocean tech, agtech, nuclear fission, advanced nuclear fission, space propulsion, satellites, imaging, molecular nanotechnology, biotechnology, medicine, blockchain, crypto and many other areas.