The drivers side panel will most definitely NOT come out easy. It was probably the most frustrating thing I have ever done on the bird, and I've done it ALL!! The right side (PAX side) pops right out. Go figure.
AC does not affect these particular panels, nor does it make the job any easier. Yes, the leaves and other debris would pile up just as non-AC cars do. Good news is, once you clear it out it'll be good for many years.
Bad news is you might find LIVING things amongst the leaves, twigs and advertisement flyers (stuck to the windshield back in the 70's and blown or rained down into the vent). I mean there could be very large spiders, mutant spore growths, 64-legged worms that thought they had been long forgotten, tick-like carnivores that haven't seen the light of day since 1968....etc.
Ain't this project exciting!!??
'68 428 HO M3 Monster, 4-on-the-floor! Need I say more?