Garden Boors?

You told me in your comments on 'Blue Gardens', that especially in Australia, Ipomoea is a wicked weed .(See also Rosemary's lovely post http://wherefivevalleysmeet.blogspot.de/2013/09/unloved-and-unwanted.html) 
Now I read in Barbara Damrosch's 'Garden Primer' - a no-nonsense book - about the Perennial Pea - under a headline I don't like very much: "Perennials That Spread". She writes: 
'Perennial Pea. Lathyrus lotifolius. The flowers are handsome and long-blooming clusters in shades of pink, lavender and white.' 
The following sentence has a somewhat threatening undertone, which pleases me even less: 
"Its evils are described on page 145.' 
Fluttering I leaf through: 
' But if someone offers you Lathyrus lotifolius (...) say "Thanks but no thanks.: it does not just crowd other plants - it obliterates them. Once perennial sweet pea is established, you will never get all of its roped roots of your garden.' 
THAT Gertrude J. hasn't told me. She praises the white Perennial Pea (see above), which she planted in a very tricky procedure under the delphinium that - once it has withered - makes a sort of climbing aid. Of course I had imitated that immediately, but the slugs munched away the delphiniums, and the perennial pea disappeared after two years. 
But pink coloured ones climb behind my realization of Vita Sackeville-West's Sweet Briar Hedge. Should I now cry "Thanks but no thanks!" Or is that too late, and my garden is doomed and utterly infiltrated by roped roots? 
And that is not the only garden plague - on page 145 I find quite a lot of my other darlings which had filled me with gardener's pride and joy because they were so vigorous. Till now... 
As there are: 
The evening primrose. The bushy aster. (At least I hadn't bought scarlet monarda, because I never liked her). I tried to remove 'Bouncing Bet', saponaria officinalis, without success, as three pale pink clusters of flowers in a bed show. Damrosch cautions against coneflowered rudbeckia - though I love her heart- warming yellow in autumn. But why does she not speak about sunchoke (Helianthus tuberosus), also called Jerusalem artichoke? That is really VERY vigorous. When I bought it in a garden center, a customer warned me, but I thought: "Oh, that's good - the more the merrier." Now I saw at the farmers' market as a last resort that you can eat the tubers, but I still hesitate. 
But let's go on with Barbar Damrosch's list of plants, which I now secretly call 'boors in the garden'. There is 'campanula rapunculoides'. The 'Ribbon Grass', which the English call fanciful 'Gardener's Garter'. It is this pretty light-green-blue grass with the white stripe. Of course I have that too, though it gets less and less. And of course Centrantus ruber, which by now foams all around the house. Viola odorata - oh yes, that's true... And - because I don't own it, I am pleased by the combative spirit of 'The Confederate Violet':
"It will march through your garden faster than Robert E. Lee." says Barbara. 
Here his troops haven't arrived. 
Not yet.