mally的技术笔记

AIGC相关
长文
细碎大模型知识
论文阅读
- 论文阅读
- Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert
- Scaling Relationship on Learning Mathematical Reasoning with Large Language Models
- switch transfomer 论文
- RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learning
- Mixture of Experts Explained
- Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert
  - Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert
  - 背景知识

长文

子页面列表

目录

MoE梳理
Tokenization分词
VERL框架看GRPO过程