Led lights turning on and off

Just my first set of led dimmable bulbs. I wanted to replace my cfls in my ceiling fan. The fans are about 4 years old and work off a leviton dimmable switch that controls the light and the fan. The fan has two bulbs in it. When I replace both the bulbs flicker on and off in an alternating fashion. When I replace one of the LEDs with the CFL they work fine. If I have one bulb in it will flash without a second bulb in there. Did I basically buy bulbs that can't work with this dimmer switch and fan?