Ayuh,.... It oughta dry out by itself in a few days or weeks, once ya stop the water,.....
I'd probably take it apart, 'n start over,....
Clean, 'n dry the hole as best ya can with paper towels or what not,....
Caulk the top with a poly-vinylsulfide caulk, assemble, 'n tighten it in, Good, 'n Tight,....
Once the caulk sets up, it oughta be Good to Go,....
Bein' a Boater, I'd use Dupont 5200, or 4200,....