Robert Downey Jr. reportedly walks away from Christopher Nolan’s latest epic to suit up for the Avengers once again.