Relation between shape representation and segmentation is discussed to make an argument that they cannot be handled separately. Parameters that influence the selection of a particular shape representation scheme are identified and a control structure is proposed that employs shape models of different types and granularities in a coarse to fine strategy. The necessity of using different shape models is demonstrated by comparing object boundaries of volumetric models with actual occluding boundaries of objects in range images.