Upper semi-continuous decompositions