In this article we present CoSC, a collaborative framework for joint segmentation and classification. The framework is guided by and aware of the quality of each segment at every stage; it allows the consideration of both homogeneity based criteria as well as implicit semantic criteria to extract the objects belonging to a given thematic class. Our experiments show that CoSC manages to reach good classification results while remarkably improving the segmentation results.