Yup, you can remove them, but you do need a wet cover of some sort
Just make sure the Inspector doesn't see them removed after inspection
The guy around here checks for them & remembers what he has inspected
He has commented on a few pre-existing things at my house as he has inspected the work I have done
One was an electric permit to reside the house due to the meter
Another was the kitchen - which will be rewired when it is renovated
But I had the meter installed on 3/4" plywood tro avoid any need to move it
Harder to see on a screened porch
They do make recessed outlets with in use covers
They should have been used on the porch