state-density ratio

The article delves into the study of off-policy evaluation (OPE) in environments with complex observations, aiming to develop estimators that can avoid exponential dependence on the horizon. The authors explore…