The shape of recurring pasts