Education
Students I supervised and other teaching activities.
Lectures
In September 2024, I will give the first lesson on AI planning at TU Delft, in the new course ‘Probabilistic AI & Reasoning’. You can find the slides here and the lecture notes here.
Thesis supervision
I am/was involved in several theses as the daily supervisor.
MSc theses
AI planning for the Train Unit Shunting Problem (2024)
Inferring Robust Plans with a Rail Network Simulator
Reuben Gardos Reid (2023)
Over 700 trains in the Netherlands are used daily for passenger transportation. Train operations involve tasks like parking, recombination, cleaning, and maintenance, which take place in shunting yards. The train unit shunting problem (TUSP) is a complex planning problem made more difficult by uncertainties such as delays. Most existing approaches overlook these disturbances and the approaches that consider them incorporate heuristics to enhance the robustness of their solutions to disturbances. This thesis proposes an alternative approach: utilizing probabilistic programming to turn an existing planning algorithm and simulator into a generative model of the TUSP. The model introduces disturbances without the need to modify the planning algorithm or simulator. Through two types of inference, we infer a distribution of robust solutions for the TUSP. Empirical results demonstrate the effectiveness of our approach for inferring robust plans in small-scale scenarios.
Over 700 trains in the Netherlands are used daily for passenger transportation. Train operations involve tasks like parking, recombination, cleaning, and maintenance, which take place in shunting yards. The train unit shunting problem (TUSP) is a complex planning problem made more difficult by uncertainties such as delays. Most existing approaches overlook these disturbances and the approaches that consider them incorporate heuristics to enhance the robustness of their solutions to disturbances. This thesis proposes an alternative approach: utilizing probabilistic programming to turn an existing planning algorithm and simulator into a generative model of the TUSP. The model introduces disturbances without the need to modify the planning algorithm or simulator. Through two types of inference, we infer a distribution of robust solutions for the TUSP. Empirical results demonstrate the effectiveness of our approach for inferring robust plans in small-scale scenarios.
BSc theses
Learning patterns in train position data (2024)
Given a set of GPS locations of trains in a railway hub, we want to be able to reconstruct the original plan of which this data is the realization. The goal of the project is to automatically detect patterns that can help in creating new plans. Each of the sub-projects uses a different aspect of the problem to focus the pattern detection on.
- Classifying locations by identifying station specific patterns
- Examining Manual Solutions of the Train Unit Shunting Problem to find Train Type Patterns
- Detecting Patterns in Train Position Data of Trains in Shunting Yards
- Automatic Detection of Whether a Solution of the Train Unit Shunting Problem (TUSP) is a Week or a Weekend Day
- Analysis of Shunting Yard Usage and Train Unit Clustering
Landmarks in planning (2024)
Landmarks in AI planning give the must-reach intermediate goals and have provided significant reductions in planning time. Different algorithms have been developed for extracting landmarks from problem files and using them in a planner. The goal of the project is to implement these different algorithm in the SymbolicPlanners library in Julia to allow for easier use of these landmark algorithms in future research. Each of the sub-projects implements a different landmark algorithm.
- Exploring the effectivity of AND/OR landmark extraction on modern planning domains
- Landmarks in Planning: Using landmarks as Intermediary Goals or as a Pseudo-Heuristic
- Re-evaluating the Full Landmark Extraction Algorithm: A Performance Analysis of FULL
- Reproducing the concept of ordered landmarks in planning: The effect of ordered landmarks on plan length in forward search
- Extending SymbolicPlanners with forward propagation landmark extraction
Comparing planners for railway planning (2023)
AI planning can formally define real-world planning problems, like the train unit shunting problem. An initial PDDL model for this problem is provided and the is extended to be more realistic. The goal of the project is to compare previously developed planners on their performance for the new problem definition. Each of the sub-projects focuses on a different aspect of the problem to include.
- Mixed-direction train shunting with numerical planning: Approach to support train departures at any time during the shunting plan
- Comparing planners for rail planning in PDDL: How multiple shunting yard layouts can be created in PDDL to replicate real-world scenarios
- Utilizing General Planners to Solve the Train Unit Shunting Problem Extended with Servicing
- Optimizing the PDDL domain of TUSP to improve planner performance: Modifying the domain to improve planner execution time, plan quality, and problem solvability
- Dealing with conflicting trains: Effectively avoiding and resolving conflicts during shunting