marmote
by marmote (Organization)
marmote is a library for working with Markov chains. It features tools for constructing models and analyzing them. marmote comes with powerful new methods for computing distributions of Markov chains, and a library for solving Markov Decision Processes.