I've painted countless sets of wheels and unless you are using an abrasive cleaner or something harsh to rub them with you will not have any issues. Just prime them properly and set. Humidity is also a very important factor in painting.
About 4 years ago, I painted the passengers side alloy wheels to see how long it lasted. All's I done was Widex 'em down, let 'em dry & shoot it with black spraypaint.
Still holding.