This repository contains the implementation of the TD-Regularized Actor-Critic Methods. LQR and single/double pendulum experiments are implemented in Matlab. PPO experiments are implemented in Tensorflow. TRPO experiments are implemented in PyTorch.