Try directly rubbing a calming moisturizer on your nipples and breasts. Skin that is dry or irritated responds better to creams and ointments. Even women who have chapped nipples will use lanolin. Shea butter, cocoa butter, olive oil, and jojoba oil are all suitable ingredients.