These lights were installed a little over a year ago, and it looks like they put some kind of glue that has not stayed (you can see the clear glue there) and the "hole" at the top a little exposed. Do you think this should be fixed? I can pull up the light and cover the hole. Should I remove the glue and apply caulk? I recently bought some silicone caulk for something else and I wonder if I should apply this?
I don't like to use silicone anywhere on painted surfaces. It is hard to remove and can't be painted over. Use a siliconized latex such as DAP. Realign the fixture and tighten hardware, it should stay put. A bead of caulk on top/sides helps keep out moisture.