# learn_candle

**Repository Path**: sharpglasses/learn_candle

## Basic Information

- **Project Name**: learn_candle
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: main
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2026-03-22
- **Last Updated**: 2026-03-22

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

#### candle学习记录
* chapter2：训练第一个网络
* chapter3: 逐步搭建语言模型
* chapter4：ViT + ConvNeXt
* moe: 学习笔记链接：[https://jhqxxx.github.io/moe.html](https://jhqxxx.github.io/moe.html)

##### 参考来源
* LLMs-from-scratch：https://github.com/rasbt/LLMs-from-scratch/
* Llama: https://zhuanlan.zhihu.com/p/636784644
* transformer: https://arxiv.org/pdf/1706.03762
* ConvNeXt: https://arxiv.org/pdf/2201.03545
* ViT: https://arxiv.org/pdf/2010.11929

##### 配套讲解视频
* B站主页：[https://space.bilibili.com/3546939448625894](https://space.bilibili.com/3546939448625894)