To infinity and beyond! Accelerating the search for the first stars and galaxies