Just spray them off with medicated soap, that won't hurt the lady bugs. I also lightly rub with my fingers when I spray them, do it a few days in a row and you are good. Also, be careful fertilizing when the weather is cool, aphids love those new little leaves coming out to quickly.