Make sure you're really seeing multiple versions of the same application. There are usually at least two folders with each version.
If you are pushing out updates, and the user is installing them, and you're not doing a lot of uninstall/reinstalling, it should be able to keep up with it. We sometimes see multiple versions when we're doing a lot lf uninstall/reinstall/updates in a row.
Have you considered pushing the app as a required update and seeing if it clears the older versions?
RobinDotNet
Click here to visit my ClickOnce blog!Microsoft MVP, Client App Dev