DUO paper accepted at AAAI 2025! Our method for diverse and uncertain query selection in RLHF.