If a finch changes into another finch, at what point do the other finches say "yo you need to turn in your?

It happens about the same time the light colored finches start demanding that the dark colored finches stick to their side of the island :)