Would you add flowers (which may have seeds)

I was told not to add old tomatoes as part of kitchen scraps because they have seeds and you could end up sprouting tomato plants all over the place. Does that hold true for any other plant? There are a lot of annuals like daisies that are dying now, should I avoid those plants in the compost bin?