Skin irritation can occur when nasal pillows are not inserted properly. Try rotating the barrel that holds the nasal pillow inserts to a more comfortable angled position. After best positioning, if a leak occurs at the nostril opening, consider sizing up.
You can also try using a nasal saline gel to prevent rubbing or soreness from your mask. These over-the-counter products can be purchased at most pharmacies.