For years, the AI community has worked to make systems not just more capable, but more aligned with human values. Researchers have developed training methods to ensure models follow instructions, ...