Labels:
human-machine-teaming
SNOW

Description

The purpose of DASH is to allow humans to efficiently tell an AI-based system what to do without having to spell out all details, and without losing meaningful human control over that system.

Delegation has been recognized as a crucial notion within the context of human-machine teaming. It allows a delegator to set an agenda either broadly or specifically, but leaves some authority to the subordinate to decide exactly how to achieve the commands supplied by the delegator. Research has made significant progress on a wide range of issues that are essential for enabling humans to delegate tasks to machines, such as developing appropriate levels of trust, allowing the human to have situation awareness of a diverse range of aspects of the work domain, and characterizing different levels of automation between human delegator and the machine.

Recent developments in artificial intelligence and robotics have significantly in-creased the application possibilities of delegation, yet raised new challenges as well:

Meaningful human control.

As AI becomes ever more capable, it is applied to an increasingly wide range of problems, including ethically sensitive ones such as medical diagnosis, balancing driving speed and safety, and warfighting. There is general consensus that the delegation of task execution, responsibility, and accountability from humans to machines is not without limits. The human must always remain in control of ethically sensitive decisions. Designing delegation that safeguards this is one of present time’s profound challenges.

Distributed delegation.

AI is hardly used by one user, nor does it take place at one particular moment. For example, an organization might set behavioral constraints to a system during deployment, while an operator commands the AI system to pursue a certain goal during operation. Both of these instructions determine the AI system’s behavior. Furthermore, the machine may also act as a delegator, e.g. for delegating sub-tasks to other machines or even back to humans (as is the case when humans and ma-chines work together as equal teammates). Most current delegation systems assume a one to one relation between delegator and subordinate. To be future proof, these mechanisms should be extended to enable various forms of delegation that are distributed in time and source of the command. The most advanced form of delegation in a Human-agent teams also allows machines to delegate tasks to humans, leading to complex delegation chains.

The challenges of distributed delegation and meaningful human control are closely related. The DASH project aims at confronting these challenges by iteratively designing, prototyping and evaluating a uniform delegation system (called DASH) for controlling AI-based systems such as robots and information agents.

Contact

  • Jurriaan van Diggelen, Sr Research Scientist, TNO, e-mail: Jurriaan.vandiggelen@tno.nl
  • Jasper van der Waa, Research Scientist, TNO, e-mail: jasper.vanderwaa@tno.nl