Personal AI Servers

NVIDIA released a new petaflop AI computer DGX Spark (aka DIGITS). There is an ASUS version using the same Nvidia chip and board. These compete with Apple and other third parties for personal AI developer systems. The Apple M3 Ultra can scale to 512 GB per unit, offering vastly more total memory (up to 2.56 …

Read more

META Custom AI Inference Chips MTIA for a META AI Personal Assistant

META CEO Mark Zuckerberg predicts that 2025 is the year that an AI assistant will serve over one billion users and he thinks META will be company that provides that AI assistant. In 2023, Meta revealed they have AI inference accelerators that they are designing in-house specifically for Meta’s AI workloads. Deep learning recommendation models …

Read more

Interactive AI Agents that Make Decisions and Take Actions

Arxiv – The development of artificial intelligence systems is transitioning from creating static, task-specific models to dynamic, agent-based systems capable of performing well in a wide range of applications. Microsoft researchers propose an Interactive Agent Foundation Model that uses a novel multi-task agent training paradigm for training AI agents across a wide range of domains, …

Read more