Alexey Skrynnik

PhD, Research Scientist at AIRI

profile-image.jpg

Moscow, Russia

As a Research Scientist with a PhD in Computer Science, my expertise centers on Artificial Intelligence and Machine Learning, particularly in the realms of applied Reinforcement Learning (RL) and Multi-Agent Systems. My work includes developing advanced RL algorithms and exploring the synergy between Planning and Learning. Notably, I’ve developed several state-of-the-art methods for decentralized multi-agent pathfinding, including Follower, MATS-LP, Switcher, and the POGEMA environment for evaluating these methods.

My contributions to hierarchical RL, particularly within embodied environments such as Minecraft, were highlighted by the ForgER approach that secured first place in the NeurIPS 2019 MineRL Diamond competition.

Furthermore, I’ve been leading efforts to combine Natural Language Processing (NLP) with RL to improve language-driven task solving, highlighted by my role in directing the RL track of the IGLU competition at NeurIPS 2021/2022.

News

Jan 18, 2024 I’m thrilled to announce that two of my submissions to AAAI 2024 have been accepted. The paper titled “Learning to Follow: Lifelong Multi-agent Pathfinding with Decentralized Replanning” will be presented as an oral presentation, and the paper “Decentralized Monte Carlo Tree Search for Partially Observable Multi-agent Pathfinding” will be showcased in a poster session.

Selected publications

  1. Learn to follow: Decentralized lifelong multi-agent pathfinding via planning and learning
    Alexey Skrynnik ,  Anton Andreychuk ,  Maria Nesterova , and 2 more authors
    In Proceedings of the AAAI Conference on Artificial Intelligence , 2024
  2. Decentralized Monte Carlo Tree Search for Partially Observable Multi-Agent Pathfinding
    Alexey Skrynnik ,  Anton Andreychuk ,  Konstantin Yakovlev , and 1 more author
    In Proceedings of the AAAI Conference on Artificial Intelligence , 2024
  3. When to Switch: Planning and Learning for Partially Observable Multi-Agent Pathfinding
    Alexey Skrynnik ,  Anton Andreychuk ,  Konstantin Yakovlev , and 1 more author
    IEEE Transactions on Neural Networks and Learning Systems, 2023
  4. Interactive Grounded Language Understanding in a Collaborative Environment: Retrospective on Iglu 2022 Competition
    Julia Kiseleva ,  Alexey Skrynnik ,  Artem Zholus , and 8 more authors
    In NeurIPS 2022 Competition Track , 2023
  5. Pathfinding in stochastic environments: learning vs planning
    Alexey Skrynnik ,  Anton Andreychuk ,  Konstantin Yakovlev , and 1 more author
    PeerJ Computer Science, 2022
  6. Interactive grounded language understanding in a collaborative environment: Iglu 2021
    Julia Kiseleva ,  Ziming Li ,  Mohammad Aliannejadi , and 8 more authors
    In NeurIPS 2021 Competitions and Demonstrations Track , 2022
  7. Hybrid policy learning for multi-agent pathfinding
    Alexey Skrynnik ,  Alexandra Yakovleva ,  Vasilii Davydov , and 2 more authors
    IEEE Access, 2021
  8. Forgetful experience replay in hierarchical reinforcement learning from expert demonstrations
    Alexey Skrynnik ,  Aleksey Staroverov ,  Ermek Aitygulov , and 3 more authors
    Knowledge-Based Systems, 2021
  9. Hierarchical deep q-network from imperfect demonstrations in minecraft
    Alexey Skrynnik ,  Aleksey Staroverov ,  Ermek Aitygulov , and 3 more authors
    Cognitive Systems Research, 2021