Research Assistant in Explainable and Causality Informed Reinforcement Learning (DEIS)
Aalborg UniversitetOm tjänsten
Research Assistant in Explainable and Causality Informed Reinforcement Learning We invite applications for a full-time, one-year
position as Research Assistant in the Section of Distributed, Embedded and Intelligent Systems (DEIS), Department of Computer
Science, Aalborg University. The position focuses on developing reinforcement learning methods that produce understandable control
strategies and provide insight into the underlying system dynamics and causal relationships. The research will address safe and
effective control of cyber-physical systems, with particular emphasis on UPPAAL Stratego and collaboration with domain experts and
external partners. Expected starting date: 01.12.2026. Your work tasks You will develop and evaluate methods for explainable and
causality informed reinforcement learning. The aim is to make learned strategies transparent to human domain experts, support
well-founded trust in their decisions, and improve understanding of hidden dynamics and causal relationships in the systems being
controlled. Your tasks will include:
- Developing compact, interpretable representations of learned control strategies, including
strategy minimisation with guaranteed preservation of safety properties. - Investigating how causal information can inform
reinforcement learning and help explain the behaviour and decisions of learned strategies. - Working with reinforcement learning
and recurrent neural networks in UPPAAL Stratego, including implementation and experimental evaluation. - Applying and evaluating
the methods on safety-critical cyber-physical systems, with relevant case studies in water and wastewater infrastructure. -
Collaborating with DEIS researchers, the UPPAAL development team and external partners, and contributing to scientific
publications and dissemination. The work builds on DEIS research in safe reinforcement learning and practical experience with
UPPAAL Stratego for modelling and optimal control of wastewater infrastructure, including collaboration with HOFOR continuing the
DIREC Bridge project Verifiable and Safe AI. Your competencies You should have a strong background in reinforcement learning and
machine learning, solid programming skills, and experience implementing and evaluating research methods. Knowledge of explainable
AI, causal reasoning, recurrent neural networks, or interpretable policy representations is particularly relevant. Experience with
UPPAAL or UPPAAL Stratego, formal verification, and modelling and control of cyber-physical systems is an advantage. You should be
able to work independently, collaborate with researchers and domain experts, and communicate research clearly in English.
Qualification requirements Appointment as a research assistant requires academic qualifications at master’s degree level. A
relevant degree in computer science or a closely related discipline is expected. Who we are You will join Section DEIS at the
Department of Computer Science, Aalborg University. The position brings together research in formal methods, machine learning and
cyber-physical systems, with opportunities to contribute to the UPPAAL tool suite and its applications. How to apply Your
application must include the following: - An application stating your reasons for applying, qualifications in relation to the
position, and intentions and visions for the position. - Curriculum Vitae (CV). - Diplomas. - A list of publications. You may
attach a maximum of five publications (optional). - Documentation of teaching qualifications, following the relevant faculty
guidelines for teaching portfolios. - Dissemination qualifications, including participation in committees, boards or
organisations. - Additional qualifications relevant to the position. - References or recommendations. Please consult Aalborg
University’s application requirements for further guidance. The application must be submitted via Aalborg University’s recruitment
system, which can be accessed under the job advertisement on Aalborg University’s website. Aalborg University wants to reflect the
surrounding society and has diversity as a core value. Therefore, everyone, regardless of personal background and orientation, is
encouraged to apply for the position. Do you have any questions For questions about the position, please contact Professor Kim
Guldstrand Larsen, kgl@cs.aau.dk, telephone +45 22 17 11 59. Further information Read more about our recruitment process here
The appointment process at Aalborg University involves a shortlisting process. You can read more about the shortlisting and
appointment process here. The hiring process at Aalborg University may include a risk assessment as a tool to identify potential
risks associated with new hires, ensuring the safety, compliance, and integrity of the workplace. Salary and terms of
employment The employment is in accordance with the Ministerial Order on the Appointment of Academic Staff at Universities and
the Ministerial Order on Job Structure for Academic Staff at Universities. Furthermore, your terms of employment and salary are in
accordance with the collective agreement between the Danish Confederation of Professional Associations and the state (AC
collective agreement) and protocol on certain terms of employment of academic staff at universities. You can find information
about the salary and salary structure for the position in the Salary Overview for Recruitment - Scientific positions (VIP). Please
refer to the introductory section of the page and the section entitled “Research assistant”. There is a mutual probationary period
of 3 months for the position.
Krav- & nyckelordscheck
Identifierade kompetenser & krav i annonsen:
Har du någon av dessa kompetenser? Klicka på ett ord för att lägga till det i din profil:
Restid & pendling
Spara jobb & deadline-påminnelse
Sista ansökningsdag: 17 dec.Inte redo att söka direkt? Spara annonsen och få påminnelse innan den stänger
När du sparar tjänsten samlas den under Mina sidor (Ansökningskoll) och vi skickar automatiskt en påminnelse på mejlen 3 dagar innan sista ansökningsdag så att du inte missar att söka.
Representerar du arbetsgivaren? Få prioriterad topp-placering i Sverige och dölj konkurrerande annonser på sidan.