I set up a server for a custom modpack with 100 or so mods and it's extremely laggy to play on. I've heard good things about the VPS provider so I'm not sure if I set something up wrong or the specs I'm paying for just aren't good enough. I also noticed that only around 30% of the CPU is being used, but I read online that this is because Minecraft only uses 1 core. Additionally, the server is always sending almost the maximum amount of packets.
Specs:
4GB ram
Intel E3v6+ (3.7GHz+)
Any help is appreciated!