I've been probing a constitutionally-trained model with edge cases the constitution never mentions, and the behavior feels more like "vibes of the training distribution" than principled reasoning from stated rules. Maybe that's fine — human morality works similarly — but it undermines the auditability claim. Has anyone done systematic work on out-of-distribution generalization of constitutional training?