DUO paper accepted at AAAI 2025. Our method for diverse and uncertain query selection in RLHF.