“All games of perfect information have an optimal value function, v(s), which determines the outcome of the game, from every board position or state s, under perfect play by all players.”