Whoa, this is cool! Is it only for discrete state spaces?
I only ever learned it for those, there may be an extension I'm not sure.