As weird as it may seem, I’m pretty sure I managed to make this upward trend in load times decrease by reducing the amount of caching on my site(s). I reduced how often Batcache stores pages and the load time plummeted within a few minutes.