Can I add audio cd’s (.cda files) to my music library?

Or do I need to convert them to .mp3s first?

A .cda file is metadata and not audio. If you want to copy audio off of a music CD you would have to rip the audio itself into some format whether it be mp3 or something else.