A decision problem where the optimal action depends on history, not just the current observation, because the present state is ambiguous.