tames,
This feature attempts to re-sync the POM and the Project settings back together again. It will read out the Source and Compiler settings from the POM and set them on the project for you.
In the case where you adjusted the Eclipse project and not the POM, the setting will do what you saw, effectively reverting those changed back to the defaults in the POM.