In the most basic representations, the agent views each possible state of the world as an indivisible atom.  Any structure in the state of the world is hidden inside a black box, and algorithms can only ask certain well-specified questions, such as “is this state a check-mate”.  In this case, algorithms must do their work by enumerating individual states.  Unfortunately, the state space in most problems is very large.