I'm not sure if this will help at all, but there seems to be random memory devouring spikes due to conflicting mods and my solution was maybe some arguments that prevent this from happening. Or at least try to minimize the performance loss.
-XX:+DisableExplicitGC