Education

Students I supervised and other teaching activities.

Lectures

In September 2024, I will give the first lesson on AI planning at TU Delft, in the new course ‘Probabilistic AI & Reasoning’. You can find the slides here and the lecture notes here.


Thesis supervision

I am/was involved in several theses as the daily supervisor.

MSc theses

Replanning in advance for train scheduling (2025)

replanning
AI planning
train dispatching
ProRail
Refactoring for AI planning (2025)

refactoring
program synthesis
AI planning
train dispatching
forgetting
inductive logic programming
Using PDDL models to solve TUSS: How to model TUSS as an Automated Planning problem and solve it

Nazariy Lonyuk (2024)

Due to the increased demand for train travel, train operators are considering increasing their rolling stock. Before achieving this, they must enhance the capacity of their shunting yards. This is attempted by improving methodologies for solving the Train Unit Shunting and Servicing (TUSS) problem. To address the TUSS problem, a planner determines routes on shunting yards for trains, ensuring they visit designated service tracks before parking in a configuration that facilitates a smooth departure. TUSS is a well-studied problem, and various approaches have been proposed. The first approach capable of solving real-world, complete TUSS instances is a local search method introduced by van den Broek et al. In this thesis, we explore an alternative approach using PDDL models. PDDL is the standard language for describing Automated Planning problems. Automated Planning is a well-established field within artificial intelligence, and new, improved algorithms are continually developed to solve PDDL models for problems similar to TUSS. In this thesis, we design a detailed model in PDDL and propose several methods to simplify the model so that planning algorithms perform more efficiently compared to the detailed model. When solving simplified models, a post-processing routine is employed to generate detailed shunting plans. The performance of several model-independent PDDL planners was analysed, and the best-performing planner was identified as Temporal FastDownward. By analysing plans obtained from experiments, we identified areas for improvement. Based on this knowledge, we developed a new TUSS-specific planner called Train Order Preserving Search (TOPS). TOPS employs a search algorithm with effective pruning of symmetrical states and a custom heuristic that guides the search towards states where the order of trains aligns with the departure order. TOPS significantly outperformed Temporal FastDownward in these experiments.

train shunting
TUSP
AI planning
PDDL
heuristics
Inferring Robust Plans with a Rail Network Simulator

Reuben Gardos Reid (2023)

Over 700 trains in the Netherlands are used daily for passenger transportation. Train operations involve tasks like parking, recombination, cleaning, and maintenance, which take place in shunting yards. The train unit shunting problem (TUSP) is a complex planning problem made more difficult by uncertainties such as delays. Most existing approaches overlook these disturbances and the approaches that consider them incorporate heuristics to enhance the robustness of their solutions to disturbances. This thesis proposes an alternative approach: utilizing probabilistic programming to turn an existing planning algorithm and simulator into a generative model of the TUSP. The model introduces disturbances without the need to modify the planning algorithm or simulator. Through two types of inference, we infer a distribution of robust solutions for the TUSP. Empirical results demonstrate the effectiveness of our approach for inferring robust plans in small-scale scenarios.

train shunting
TUSP
robustness
probabilistic programming
inference

BSc theses

Learning patterns in train position data (2024)

Given a set of GPS locations of trains in a railway hub, we want to be able to reconstruct the original plan of which this data is the realization. The goal of the project is to automatically detect patterns that can help in creating new plans. Each of the sub-projects uses a different aspect of the problem to focus the pattern detection on.

train shunting
TUSP
GPS locations
classification
Landmarks in planning (2024)

Landmarks in AI planning give the must-reach intermediate goals and have provided significant reductions in planning time. Different algorithms have been developed for extracting landmarks from problem files and using them in a planner. The goal of the project is to implement these different algorithm in the SymbolicPlanners library in Julia to allow for easier use of these landmark algorithms in future research. Each of the sub-projects implements a different landmark algorithm.

AI planning
Classical planning
Landmarks
SymbolicPlanners.jl
Comparing planners for railway planning (2023)

AI planning can formally define real-world planning problems, like the train unit shunting problem. An initial PDDL model for this problem is provided and the is extended to be more realistic. The goal of the project is to compare previously developed planners on their performance for the new problem definition. Each of the sub-projects focuses on a different aspect of the problem to include.

train shunting
TUSP
PDDL
planning