Security & practice
THE NOTEBOOK
Keep exploring.
Ideas accumulate. The threads continue here.
02 / THE NOTEBOOK20
Latest notes.
Security & practice
Algorithms & data structures
Reading & reflections
paper report
什么是混合专家模型? 混合专家模型是一种基于Transformer架构的模型,所以需要先了解Transformer架构 下图详细的展示了transformer架构 混合专家模型主要由两个关键部分组成: * 稀疏 MoE 层: 这些层代替了传统 Tra
14 min readRead note
Computer systems
Algorithms & data structures
Algorithms & data structures
Algorithms & data structures
Algorithms & data structures
Algorithms & data structures
03 / ABOUT ME
About this space
Nothing happens by accident. Some paths just take a few more turns.
This is doovvv’s personal notebook: questions from studying, discoveries from practice, and a little room for ideas still taking shape.
Computer ScienceAlgorithmsAI & Systems
Get to know me