Dataflow Computing for AI Inference

Kunle Olukotun explains reconfigurable dataflow architectures for AI inference. The discussion examines mapping computation onto model dataflow graphs, reducing memory-bandwidth bottlenecks, serving multiple models and switching between them efficiently. It also considers dynamic hardware architectures and using AI agents to develop compilers.