Among all states on the algebra of non-commutative polynomials, we characterize the ones that have monic orthogonal polynomials. The characterizations involve recursion relations, Hankel-type determinants, and a representation as a joint distribution of operators on a Fock space. 2008 American Mathematical Society.