This paper presents an approach to the task of locating a group of buildings based solely on their relative spatial relationships. This situation can occur in the problem of conflation of a hand or machine drafted map to a satellite image or in matching of two images taken under different viewing conditions (the correspondence problem). Of importance to us is the general text-to-sketch problem where a sketch of building locations must be matched to actual satellite imagery. Information about the nature of these relative positions is captured by the histograms of forces. In this paper, we consider a modified genetic algorithm that allows us to search for a specific group of buildings within a large geospatial database using the histograms of forces in the matching process. A novel mutation operator is introduced to adapt the standard GA to this environment.