Early Universe Chaos Fueled Black Hole Growth