Troop, my wife and I went to Paris a few years ago during the same time of year that you are going. It rained some, but it didn't ruin the trip.
d'Orsay - d'effinitely!
We rented a car and drove out to Mont St. Michel. It is incredible to see. You can walk to the top and take a tour...