Designing Human Oversight

Double-header day on my favourite topic โ€” ๐—ฑ๐—ฒ๐˜€๐—ถ๐—ด๐—ป๐—ถ๐—ป๐—ด ๐—ต๐˜‚๐—บ๐—ฎ๐—ป ๐—ผ๐˜ƒ๐—ฒ๐—ฟ๐˜€๐—ถ๐—ด๐—ต๐˜.
โ€ข Remote presentation at the Symposium on Responsible AI in Public Administration (organised by the wonderful Jason Grant Allen, bringing together law and AI experts in the same room in Singapore)
โ€ข Fireside chat with Rasika Mohan at the AI Governance Summit

Thereโ€™s a joke in the AI community:ย ๐™ฉ๐™๐™š ๐™ข๐™ค๐™ข๐™š๐™ฃ๐™ฉ ๐™ฎ๐™ค๐™ช ๐™›๐™ช๐™ก๐™ก๐™ฎ ๐™ช๐™ฃ๐™™๐™š๐™ง๐™จ๐™ฉ๐™–๐™ฃ๐™™ ๐™๐™ค๐™ฌ ๐™–๐™ฃ ๐˜ผ๐™„ ๐™ฌ๐™ค๐™ง๐™ ๐™จ, ๐™ž๐™ฉโ€™๐™จ ๐™ฃ๐™ค ๐™ก๐™ค๐™ฃ๐™œ๐™š๐™ง ๐˜ผ๐™„ โ€” ๐™Ÿ๐™ช๐™จ๐™ฉ ๐™—๐™ค๐™ง๐™ž๐™ฃ๐™œ ๐™–๐™ช๐™ฉ๐™ค๐™ข๐™–๐™ฉ๐™ž๐™ค๐™ฃ. If you can fully understand how an agent comes up with a plan or an answer, and you have complete control over how it operates, itโ€™s no longer really an autonomous agent โ€” itโ€™s automation.

๐—›๐—ฒ๐—ฟ๐—ฒโ€™๐˜€ ๐˜๐—ต๐—ฒ ๐—ผ๐˜…๐˜†๐—บ๐—ผ๐—ฟ๐—ผ๐—ป ๐—ถ๐—ป ๐—ด๐—ผ๐˜ƒ๐—ฒ๐—ฟ๐—ป๐—ถ๐—ป๐—ด ๐—ฎ๐—ด๐—ฒ๐—ป๐˜๐—ถ๐—ฐ ๐—”๐—œ:
Governance demands transparency and control, while true agentic AI involves human giving up some understanding and control.

Many oversight mechanisms try, with mixed success, to force understanding and control back into an agent, effectively turning it into automation. That doesnโ€™t work.

๐—ง๐—ต๐—ฒ๐—ป ๐˜๐—ต๐—ฒ ๐—ต๐—ฎ๐—ฟ๐—ฑ๐—ฒ๐—ฟ ๐—ฐ๐—ต๐—ฎ๐—น๐—น๐—ฒ๐—ป๐—ด๐—ฒ:ย ๐˜„๐—ต๐—ฎ๐˜ ๐—ถ๐—ณ ๐˜†๐—ผ๐˜‚๐—ฟ ๐—”๐—œ ๐—ฎ๐—ด๐—ฒ๐—ป๐˜ ๐—ถ๐˜€ ๐˜€๐—บ๐—ฎ๐—ฟ๐˜๐—ฒ๐—ฟ ๐˜๐—ต๐—ฎ๐—ป ๐˜†๐—ผ๐˜‚?
Many oversight mechanisms often assume the oversight role is to catch mistakes. But great leaders manage people far smarter than themselves every day. Oversight here is rarely about catching errors, but it can still be deeply meaningful, just in different ways.

Thatโ€™s why this line of work at CSIRO’s Data61 excites me the most. The future of oversight is not about hoping the AI slips up so you still have a job. Itโ€™s about adding value without being smarter than AI โ€” using tools, scaling yourself, growing your understanding, and shaping outcomes. Thatโ€™s the real human productivity edge.

Stay tuned.


About Me


About me – According to AI

Director/Head of CSIRO’s Data61
Conjoint Professor, CSE UNSW

For other roles, see LinkedIn & Professional activities.

If you’d like to invite me to give a talk, please see here & email liming.zhu@data61.csiro.au

Featured Posts