Quantization

…and mixed-precision arithmetic, quantization and parallel GPU computation enable larger models and deployment on constrained devices, while introducing questions about error, stability and performance. Researchers from theoretical and applied communities will compare methods for stable training and efficient inference and identify directions for further work. The programme brings together expertise in numerical analysis, machine learning and hardware-aware computation. The in-person wor

…mixture-of-experts models, quantization, reinforcement-learning efficiency and speculative decoding. The conversation also covers distributed training across data centres, sparse autoencoders, the constraints on open-source interpretability research, and the relationship between open models and compute availability. Hosted by Ravid Shwartz Ziv and Allen Roush; th

…an associated spin chain, with quantization considered as a further direction.