Oversight Design for AI-Enabled Decision Making

What counts as a ๐—ฑ๐—ฒ๐—ฐ๐—ถ๐˜€๐—ถ๐—ผ๐—ป, really? From the strict sense in ๐—ฎ๐—ฑ๐—บ๐—ถ๐—ป๐—ถ๐˜€๐˜๐—ฟ๐—ฎ๐˜๐—ถ๐˜ƒ๐—ฒ ๐—น๐—ฎ๐˜„โ€”where a decision formally alters someoneโ€™s rights or entitlementsโ€”to the everyday sense where almost everything, from selecting a movie to choosing a candidate, feels like a decision. Yet across these very different contexts, the underlying anatomy looks surprisingly similar.

In CSIRO’s Data61 new preprint (link in the comment), ๐™Š๐™ซ๐™š๐™ง๐™จ๐™ž๐™œ๐™๐™ฉ ๐˜ฟ๐™š๐™จ๐™ž๐™œ๐™ฃ ๐™›๐™ค๐™ง ๐˜ผ๐™„-๐™€๐™ฃ๐™–๐™—๐™ก๐™š๐™™ ๐˜ฟ๐™š๐™˜๐™ž๐™จ๐™ž๐™ค๐™ฃ ๐™ˆ๐™–๐™ ๐™ž๐™ฃ๐™œ ๐™ž๐™ฃ ๐™‚๐™ค๐™ซ๐™š๐™ง๐™ฃ๐™ข๐™š๐™ฃ๐™ฉ ๐™Ž๐™š๐™ง๐™ซ๐™ž๐™˜๐™š๐™จ, we unpack this shared decision stack: fact-finding, rule application, deliberation, discretion, and formalisation. Each stage represents a distinct kind of role in decision-making and therefore a distinct opportunity (and limit) for AI to assist.

Our approach applies our recent framework on meaningful human oversight to this stack: distinguishing between doing and overseeing, between AI assistance and human accountability, and between algorithmic outputs and what law calls the โ€œstate of mindโ€ of a specified officer or delegate.

Even where AI can โ€œdoโ€ most of the work under human oversight, the discretion and formalisation of a decision usually remain with a natural person โ€” though AI can still perform independent double-checks.

Weโ€™re exploring how this layered view can make humanโ€“AI decision design more transparent and defensible across contexts.

If youโ€™re interested in designing and testing the effectiveness of AIโ€™s doing and human’s overseeing roles across your decision stack, weโ€™d love to collaborate.


About Me


About me – According to AI

Director/Head of CSIRO’s Data61
Conjoint Professor, CSE UNSW

For other roles, see LinkedIn & Professional activities.

If you’d like to invite me to give a talk, please see here & email liming.zhu@data61.csiro.au

Featured Posts