Videos of trained agents in fetch and stack and gfootball environments can be found here: https://sites.google.com/view/stickymittens