What Comes After the GPU? | Qi Jin (EVP, Software, Cerebras)

Listen to full episode:

Summary: Anant and Ed are joined by Qi Jin (EVP at Cerebras) to explore the latest trends in AI hardware, inference systems, and organizational strategies for tech companies navigating rapid technological change. They discuss the impact of new chip architectures, the evolution of inference workloads, and how organizations can adapt to a fast-changing AI landscape.

Chapters:

00:00 Introduction and episode overview

01:40 Recent developments in SaaS and no-code platforms

04:03 The impact of AI transformation on SaaS companies

06:19 Organizational change and startup pivots in AI era

09:10 Introducing guest Qi Jin and Cerebrus hardware innovations

11:43 Deep dive into Cerebrus chip architecture and inference hardware

16:37 The future of multi-architecture AI hardware systems

22:24 Software strategies for heterogeneous AI hardware

30:05 Hardware constraints, supply chain, and manufacturing challenges

37:45 The evolving landscape of AI hardware and software integration

44:45 Organizational agility and managing change in tech companies

55:18 Closing thoughts and future topics

Sound Bites:

"Inference is becoming the new foundational unit of compute"

"The future of workloads is a multi-architectural world"