This research theme focuses on the fundamental question: how does an AI agent decide and learn on how to act? More precisely, in Theme H2 (WP4), the AI agent is learning how the world works, and it reasons on it to better understand its properties. The present theme V1 aims at empowering the agent with the ability of deliberating autonomously (i.e., without human intervention) how to act in the world. That is reasoning on the effects of its actions, learning from past experiences (or simulation of experiences), as well as monitoring the actual outcome of its actions, learning possibly unexpected outcomes, and again reasoning and learning how to deal with such new outcomes. Crucially, empowering an AI agent with the ability to self-deliberate its own behavior and act autonomously, carries significant risks and therefore we must be able to balance such power with safety. This means that the autonomy of the agent must be guarded by human guided specifications and oversight, to make it verifiable and comprehensible in human terms and ultimately trustworthy.

Contact: Giuseppe De Giacomo (