|
|
|
<br>DeepSeek-R1 is based on DeepSeek-V3, a mixture of experts (MoE) design recently open-sourced by [DeepSeek](https://www.wtfbellingham.com). This base design is fine-tuned using Group [Relative Policy](https://ixoye.do) Optimization (GRPO), a reasoning-oriented variation of RL. The research study group also performed understanding distillation from DeepSeek-R1 to [open-source Qwen](https://tv.goftesh.com) and Llama models and launched numerous versions of each |