Off topic: Question for regular swimmers vs chlorine

Hi, I've been swimming daily past weeks & I look like I've aged 10 years in the face to my horror. At first I couldn't work it out then I wondered could it be the chlorine. I googled & yes, it strips your skin of natural oils. A tight rubber cap stops damage to hair good enough for me, but for the face? Will vaseline do the job before you dive in, followed by good moisturiser when you get out? Cheers for any constructive replies.