For the complete documentation index, see llms.txt. This page is also available as Markdown.
📚Algorithm Taxonomy
Algorithm Family Tree
Deep RL algorithms can be classified into a family tree based on their methods / functions they learn, such as the one shown below.
Source: Foundations of Deep Reinforcement Learning, Graesser & Keng.
Algorithms often extends an existing one by modifying or adding components. Most model-free algorithms are descended from SARSA and REINFORCE. The figure below shows some of the algorithms in SLM Lab, and their relationships.
Source: Foundations of Deep Reinforcement Learning, Graesser & Keng.
Naturally, implementations can be consistent with this theoretical taxonomy by using class inheritance and modular components. This is precisely what SLM Lab does.
