Problem Solving Through Human-AI Preference-Based Cooperation

Abstract

While there is a widespread belief that artificial general intelligence (AGI) – or even superhuman AI – is imminent, complex problems in expert domains are far from being solved. We argue that such problems require human-AI cooperation and that the current state of the art in generative AI is unable to play the role of a reliable partner due to a multitude of shortcomings, including difficulty in keeping track of a complex solution artifact (e.g., a software program), limited support for versatile human preference expression and lack of adapting to human preference in an interactive setting. To address these challenges, we propose HAI-Co2, a novel human-AI co-construction framework.We take first steps towards a formalization of HAI-Co2 and discuss the difficult open research problems that it faces.

Cite

@article{dutta2025problem,
  slug = {haico2},
  title = {Problem {{Solving Through Human-AI Preference-Based Cooperation}}},
  author = {Dutta, Subhabrata and Kaufmann, Timo and Glava{\v s}, Goran and Habernal, Ivan and Kersting, Kristian and Kreuter, Frauke and Mezini, Mira and Gurevych, Iryna and H{\"u}llermeier, Eyke and Sch{\"u}tze, Hinrich},
  year = {2025},
  journal = {Computational Linguistics},
  pages = {1--35},
  doi = {10.1162/coli.a.19}
}