[Andrew]

If I understand you correctly, you should be able to click on the background and drag to lasso a selection. (Hold down Option while doing this to limit selection to objects completely enclosed in the selection rectangle.) Then of course command-click to de-select anything that you didn't intend to select. Perhaps I'm misinterpreting your question?