I think adding a simple test that would compare the two (somehow) would be a great way to flag that a particular PR needs to have boilerplate.py executed.