In fact, the core part of DeepMind's go AI 'AlphaGo' and the evolved version 'AlphaZero' has been quietly open sourced
Developed by AI development company DeepMind, the core part of Go AI ' AlphaGo ', which became a hot topic by defeating a top human Go player , and ' AlphaZero ', an evolved AI that can learn all board games. , In fact, it is pointed out that it is quietly open sourced on GitHub.
Do you know that DeepMind has actually open-sourced the heart of AlphaGo & AlphaZero?
— Jim Fan (@DrJimFan) February 14, 2023
It's hidden in an unassuming repo called “mctx”: https://t.co/GpNtwH9BxA
It provides JAX-native Monte Carlo Tree Search (MCTS) that runs on batches of inputs, in parallel, and blazing fast.
???? pic.twitter.com/nscU17HCUV
NVIDIA's AI researcher Jim Fan claims that 'the core part of AlphaGo and AlphaZero' is ' Mctx ', a library with a JAX native implementation published by DeepMind on GitHub. Mctx provides a JAX-native Monte Carlo tree search that runs in parallel and at lightning speed on the input, allowing the algorithm to operate on a parameterized learning environment model, taking full advantage of the accelerator.
GitHub - deepmind/mctx: Monte Carlo tree search in JAX
https://github.com/deepmind/mctx
Monte Carlo tree search is a heuristic algorithm that constructs a search tree based on random simulation results and produces an answer that is close to the correct answer to some extent in a short period of time.
Monte Carlo tree search is useful for deriving the best move in turn-based games such as Go and chess, Fan said, ``This is definitely the most complicated component of AlphaGo, and it is even more important to make it efficient. ' said.
MCTS is a search algorithm that solves for the best move in turn-based games by selecting → expanding → simulating → updating the nodes in a strategy tree.
— Jim Fan (@DrJimFan) February 14, 2023
It is arguably the most complex component of AlphaGo - and making it efficient is even more nontrivial.
2/ pic.twitter.com/t8bdInouxZ
DeepMind's Mctx library supports not only AlphaGo, but also AlphaZero, which supports board games other than Go such as shogi and chess, and MuZero , which allows you to get a high score in games such as 'Pac-Man' even if you don't know the rules. It is said that
DeepMind's mctx library powers not just AlphaGo, but also AlphaZero (plays Go, Chess, and Shogi from scratch) and MuZero (AlphaZero + also solving Atari games).
— Jim Fan (@DrJimFan) February 14, 2023
AlphaZero: https://t.co/LVENeLcJvy
MuZero: https://t.co/FS6FfBKLA3
3/
Related Posts:
in Software, Posted by log1h_ik