Sequential Decision Making
Sequential Decision Making
Samuel Kaski
i) ELIAS - European Lighthouse of AI for Sustainability: Join the team in the Sustainable Materials Innovation Hub led by Mike Shaver and the Centre for AI Fundamentals to transform the interface between AI and sustainability. The role involves using sustainability inputs to direct outcomes. ii) UKRI Turing AI World-Leading Fellowship: The role involves developing new principles and methods for Advanced User Modelling, sequential decision making, and Automatic Experimental Design, with and without a Human-in-the-Loop. iii) UKRI AI hub in Generative Models: The role involves developing principles and tools for generative models technology. iv) PhD student positions in the UKRI AI CDT in Decision Making for Complex Systems: Projects include 'Human-in-the-loop generative models for experimental design' and 'Learning theory and methods for novel types of distributional shifts'.
Samuel Kaski
Thinking about the next position for your research career? I am hiring postdocs in my machine learning research group both in Helsinki, Finland and Manchester, UK. We develop new machine learning methods and study machine learning principles. Keywords include: probabilistic modelling, Bayesian inference, simulation-based inference, multi-agent RL and collaborative AI, sequential decision making and experimental design, active learning, human-in-the-loop learning and user modelling, privacy-preserving learning, Bayesian deep learning, generative models. We also solve problems of other fields with the methods – and use those problems as test benches when developing the methods. We have excellent collaborators in drug design, synthetic biology and biodesign, personalized medicine, cognitive science and human-computer interaction.
Samuel Kaski
Thinking about the next position for your research career? I am hiring postdocs in my machine learning research group both in Helsinki, Finland and Manchester, UK. We develop new machine learning methods and study machine learning principles. Keywords include: probabilistic modelling, Bayesian inference, simulation-based inference, multi-agent RL and collaborative AI, sequential decision making and experimental design, active learning, human-in-the-loop learning and user modelling, privacy-preserving learning, Bayesian deep learning, generative models. We also solve problems of other fields with the methods – and use those problems as test benches when developing the methods. We have excellent collaborators in drug design, synthetic biology and biodesign, personalized medicine, cognitive science and human-computer interaction.
Generative models for video games (rescheduled)
Developing agents capable of modeling complex environments and human behaviors within them is a key goal of artificial intelligence research. Progress towards this goal has exciting potential for applications in video games, from new tools that empower game developers to realize new creative visions, to enabling new kinds of immersive player experiences. This talk focuses on recent advances of my team at Microsoft Research towards scalable machine learning architectures that effectively capture human gameplay data. In the first part of my talk, I will focus on diffusion models as generative models of human behavior. Previously shown to have impressive image generation capabilities, I present insights that unlock applications to imitation learning for sequential decision making. In the second part of my talk, I discuss a recent project taking ideas from language modeling to build a generative sequence model of an Xbox game.
Generative models for video games
Developing agents capable of modeling complex environments and human behaviors within them is a key goal of artificial intelligence research. Progress towards this goal has exciting potential for applications in video games, from new tools that empower game developers to realize new creative visions, to enabling new kinds of immersive player experiences. This talk focuses on recent advances of my team at Microsoft Research towards scalable machine learning architectures that effectively capture human gameplay data. In the first part of my talk, I will focus on diffusion models as generative models of human behavior. Previously shown to have impressive image generation capabilities, I present insights that unlock applications to imitation learning for sequential decision making. In the second part of my talk, I discuss a recent project taking ideas from language modeling to build a generative sequence model of an Xbox game.