Constitutional AI (2022) ☆

Instead of scaling human labeling of harms, Constitutional AI has the model critique and revise its own outputs against an explicit constitution, then trains on the result (RLAIF). It powers Claude's character, made the principles inspectable, and pointed toward oversight that scales beyond human review.