Reinforcement learning is the branch of machine learning concerned with sequential decision making problems. A few interesting libraries exist for applying classical methods (such as Q-learning), including REnforce and rurel. However, implementations of state-of-art learning algorithms are currently limited to rsrl to the best of our knowledge.