Tekkit 3.1.2 Server hangs "randomly". No players, but console works

[DaddyMac1075]

I've been trying to figure out what is causing our family public tekkit server to "hang". I don't say crash, since everything seems to be working EXCEPT players cannot connect. The console seems to react to all commands, the TPS is high, and the processor utilization isn't extremely high.

The tekkit server is the only thing running in this VM with 10GB RAM and access to all 8 Xeon cores in my Dell Poweredge Server. It's not a pile of junk desktop computer that I'm hoping to make a server out of - it really is commercial grade server hardware.

Still, some plugins work which is why we see the hourly, "Sending money earned messages." "List" works, "gc" works, etc. To restart the server, "stop" works... but the restarter plugin doesn't seem to be working during these cases. (I type "rsset 0" and it fails to restart). The DynMap web interface even works during these times, however, the world time at the top keeps resetting. Example: 20:46, 20:47, 20:48, 20:46... I see it going in a loop as if the world time is stuck. We also see groups of "Reached end of stream" messages when the server is not working correctly, presumably when players try to connect. A few days ago, I wrote a script to watch for 5 of these in a row, and auto-type "stop" on the console to help restart the server for times when the timing works. However, yesterday, not even "stop" on the console worked.

Below, there is a list a snippet from the console, output from "top" and a list of plugins within the log.

07:50:55 [iNFO] Sending serverside check to: loganmarkbunkers

07:56:49 [iNFO] Reached end of stream

07:57:35 [iNFO] Connection reset

07:57:35 [iNFO] loganmarkbunkers lost connection: disconnect.quitting

07:57:35 [iNFO] [MCBans] loganmarkbunkers has disconnected!

07:58:13 [iNFO] Reached end of stream

08:00:46 [iNFO] n;;10;0;n;0;

08:00:46 [iNFO] Creating empty config: /home/tekkit/plugins/Essentials/userdata/

maxilosxxx.yml

08:00:46 [iNFO] maxilosXXX [/1.2.3.4.5:55064] logged in with entity id 4863 at ([

world1] 332.5, 117.62000000476837, 427.5)

08:00:46 [iNFO] [mcjobs] Unable to load maxilosXXX.dat...  Creating file!

08:00:49 [iNFO] Sending serverside check to: maxilosXXX

08:01:11 [iNFO] [PLAYER_COMMAND] maxilosXXX: /tppos 304 55 431 0

08:01:51 [iNFO] [PLAYER_COMMAND] maxilosXXX: /tppos 329 60 411 120

08:02:19 [iNFO] [PLAYER_COMMAND] maxilosXXX: /tppos 352 66 432 180

08:04:40 [iNFO] [PLAYER_COMMAND] maxilosXXX: /tppos 328 86 432 -180 3

08:05:38 [iNFO] [PLAYER_COMMAND] maxilosXXX: /money

08:07:44 [iNFO] [PLAYER_COMMAND] maxilosXXX: /f help

08:09:50 [iNFO] [PLAYER_COMMAND] maxilosXXX: /sethome

08:09:57 [iNFO] Sending serverside check to: maxilosXXX

08:11:52 [iNFO] Reached end of stream

08:16:04 [iNFO] [PLAYER_COMMAND] maxilosXXX: /sethome

08:17:16 [iNFO] Sending serverside check to: maxilosXXX

08:18:24 [iNFO] [PLAYER_COMMAND] maxilosXXX: /money

08:20:35 [iNFO] maxilosXXX lost connection: disconnect.quitting

08:20:35 [iNFO] Connection reset

08:20:35 [iNFO] [MCBans] maxilosXXX has disconnected!

08:24:25 [iNFO] Sending money earned messages.

08:26:52 [iNFO] Reached end of stream

08:41:50 [iNFO] Reached end of stream

>list

08:54:19 [iNFO] There are 0 out of maximum 50 players online.

08:54:19 [iNFO] Connected players:

08:56:52 [iNFO] Reached end of stream

09:03:50 [iNFO] /1.2.3.4.5:36265 lost connection

09:07:13 [iNFO] /1.2.3.4.5:43547 lost connection

09:11:49 [iNFO] Reached end of stream

09:24:25 [iNFO] Sending money earned messages.

09:26:53 [iNFO] Reached end of stream

09:41:52 [iNFO] Reached end of stream

09:56:54 [iNFO] Reached end of stream

>list

10:07:55 [iNFO] There are 0 out of maximum 50 players online.

10:07:55 [iNFO] Connected players: 

>gc

10:08:24 [iNFO] Current TPS = 20.0

10:08:24 [iNFO] Maximum memory: 8,189 MB

10:08:24 [iNFO] Allocated memory: 8,189 MB

10:08:24 [iNFO] Free memory: 5,871 MB

10:08:24 [iNFO] World "world1": 315chunks,409entities

10:08:24 [iNFO] World "world1_the_end": 625chunks,0entities

10:08:24 [iNFO] Nether "world1_nether": 59chunks,14entities

>plugins                                                                             

10:12:17 [iNFO] Plugins (69): mod_WirelessRedstoneAddons, mod_BuildCraftEnergy, mod_R

edPowerWiring, mod_BuildCraftCore, mcjobs, mod_ImmibisCore, Vault, Restarter, mod_Bui

ldCraftFactory, mod_NetherOres, TreeAssist, dynmap, LightVote, mod_EE, mod_TubeStuff,

 Announcer, mod_CCTurtle, Curseban, CFBanner, mod_WirelessRedstoneRedPower, mod_IC2Nu

clearControl, Votifier, mod_ccSensors, MobDisguise, mod_CompactSolars, mod_WirelessRe

dstoneCore, mod_IC2_ChargingBench, mod_IronChest, mod_MinecraftForge, WorldEdit, mod_

RedPowerControl, PermissionsEx, LogBlock, mod_IC2, mod_RedPowerMachine, mod_BuildCraf

tBuilders, LWC, mod_RedPowerLighting, WorldGuard, mod_RedPowerWorld, mod_ComputerCraf

t, mod_BuildCraftTransport, mod_NotEnoughItems, mod_PowerConverters, mod_AdditionalPi

pes, mod_Railcraft, mod_IC2AdvancedMachines, mcbans, mod_RedPowerCore, mod_RedPowerLo

gic, Modifyworld, mod_ModularForceFieldSystem, GriefPrevention, tekkitrestrict, mod_E

nderStorage, Essentials, mod_CodeChickenCore, Balkon's WeaponMod, WorldBorder, Comman

dSigns, Enjin Minecraft Plugin, Dynmap-GriefPrevention, Dynmap-WorldGuard, Essentials

Chat, EssentialsSpawn, Dynmap-Essentials, EssentialsGeoIP, Factions, Dynmap-Factions 

top - 10:08:50 up 15:35,  2 users,  load average: 1.37, 1.29, 1.17

Tasks: 120 total,  1 running, 119 sleeping,  0 stopped,  0 zombie

Cpu(s): 19.4%us,  0.7%sy,  0.0%ni, 78.8%id,  0.1%wa,  0.0%hi,  0.0%si,  1.0%st

Mem:  10502440k total,  8440756k used,  2061684k free,  456928k buffers

Swap:  2097148k total,        0k used,  2097148k free,  2925612k cached

 

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND                                           

18649 luke-tek  20  0 13.2g 3.6g  14m S  119 35.6 182:47.04 java                                               

21435 luke-tek  20  0 17336 1252  912 R    2  0.0  0:00.01 top                                               

    1 root      20  0 24332 2308 1348 S    0  0.0  0:01.62 init                                               

    2 root      20  0    0    0    0 S    0  0.0  0:00.09 kthreadd      

I would appreciate any pointers to determine why the server is hanging and seemingly random times. Thank you for looking!