For some reason on my server none of them work, it just pulls them back down to the ground like flying is disabled... but on my console it says its enabled? is there a plugin that overrides all that and just turns flying on?
There are plugins that prevent flying. If flying was disabled on the server, you'd get kicked, not pulled to the ground.
Silly answer; did you provide fuel (Klein stars, redstone, glowstone dust or eu load)? If you try to fly without them you drop out of the sky.
Do you use Towny ?, Towny has a anti cheat mode for speed and double jump disable this in the config. That is what fixed this issue on our server.