In a word, no, unfortunately.

Here’s a list of the main European airport-city connections; the asterisked ones are not covered by the pass and will need to be bought separately: https://www.eurail.com/en/get-inspired/trains-europe/useful-train-information/airport-train-station-connections

Suburban rail is sometimes covered by the pass (most notably it covers every S-Bahn network in Germany), but unfortunately it isn’t in France, so you’ll have to buy a separate ticket for the RER.