Approach: Supervised only by the game of chess. Plays the game realizes that it is bad at it. Tries to improve. Realizes that it's way of improvement is also bad. Learns everything because it knows it is bad at everything.
Notes:
Muzero all the way.