feat: add scripts for fetching and training educational corpus

- Implemented `fetch_corpus.py` to scrape Chinese educational content from Wikipedia, covering subjects like Chinese, Math, English, Chemistry, Politics, History, Geography, Physics, and Biology.
- Developed `fetch_corpus_incremental.py` for incremental fetching of missing entries, with automatic retries for rate limiting and support for resuming interrupted downloads.
- Created `train_chat.py` for training a dialogue model, including corpus cleaning, vocabulary management, and staged training with adaptive learning rates.
This commit is contained in:
2026-07-07 17:42:24 +08:00
parent d5affe4458
commit 81f6fd58e0
96 changed files with 53920 additions and 17 deletions

View File

@@ -0,0 +1,30 @@
# 人教版PEP三年级英语上册(2024秋版)
- **来源站点**http://www.dzkbw.com
- **电子课本网目录**http://www.dzkbw.com/books/rjb/yingyu/pep3s_2024/
## 目录与官方阅读链接
| 页码 | 章节 | 电子课本网 | 智慧教育平台 |
|------|------|------------|--------------|
| 007 | Unit1 Making friends | [查看](http://www.dzkbw.com/books/rjb/yingyu/pep3s_2024/007.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=b3c7d0d5-d148-f4c3-ed2a-ebef1e651fe6&catalogType=tchMaterial&subCatalog=tchMaterial&page=007) |
| 019 | Unit2 Different families | [查看](http://www.dzkbw.com/books/rjb/yingyu/pep3s_2024/019.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=b3c7d0d5-d148-f4c3-ed2a-ebef1e651fe6&catalogType=tchMaterial&subCatalog=tchMaterial&page=019) |
| 031 | Unit3 Amazing animals | [查看](http://www.dzkbw.com/books/rjb/yingyu/pep3s_2024/031.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=b3c7d0d5-d148-f4c3-ed2a-ebef1e651fe6&catalogType=tchMaterial&subCatalog=tchMaterial&page=031) |
| 043 | Unit4 Plants around us | [查看](http://www.dzkbw.com/books/rjb/yingyu/pep3s_2024/043.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=b3c7d0d5-d148-f4c3-ed2a-ebef1e651fe6&catalogType=tchMaterial&subCatalog=tchMaterial&page=043) |
| 055 | Unit5 The colourful world | [查看](http://www.dzkbw.com/books/rjb/yingyu/pep3s_2024/055.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=b3c7d0d5-d148-f4c3-ed2a-ebef1e651fe6&catalogType=tchMaterial&subCatalog=tchMaterial&page=055) |
| 067 | Unit6 Useful numbers | [查看](http://www.dzkbw.com/books/rjb/yingyu/pep3s_2024/067.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=b3c7d0d5-d148-f4c3-ed2a-ebef1e651fe6&catalogType=tchMaterial&subCatalog=tchMaterial&page=067) |
| 079 | Revision Being a good guest | [查看](http://www.dzkbw.com/books/rjb/yingyu/pep3s_2024/079.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=b3c7d0d5-d148-f4c3-ed2a-ebef1e651fe6&catalogType=tchMaterial&subCatalog=tchMaterial&page=079) |
| 083 | Appendix l Songs | [查看](http://www.dzkbw.com/books/rjb/yingyu/pep3s_2024/083.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=b3c7d0d5-d148-f4c3-ed2a-ebef1e651fe6&catalogType=tchMaterial&subCatalog=tchMaterial&page=083) |
| 085 | Appendix 2 Chants in "Letters and sounds" | [查看](http://www.dzkbw.com/books/rjb/yingyu/pep3s_2024/085.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=b3c7d0d5-d148-f4c3-ed2a-ebef1e651fe6&catalogType=tchMaterial&subCatalog=tchMaterial&page=085) |
| 088 | Appendix 3 Words in each unit | [查看](http://www.dzkbw.com/books/rjb/yingyu/pep3s_2024/088.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=b3c7d0d5-d148-f4c3-ed2a-ebef1e651fe6&catalogType=tchMaterial&subCatalog=tchMaterial&page=088) |
| 091 | Appendix 4 Vocabulary | [查看](http://www.dzkbw.com/books/rjb/yingyu/pep3s_2024/091.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=b3c7d0d5-d148-f4c3-ed2a-ebef1e651fe6&catalogType=tchMaterial&subCatalog=tchMaterial&page=091) |
| 094 | Appendix 5 Useful expressions | [查看](http://www.dzkbw.com/books/rjb/yingyu/pep3s_2024/094.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=b3c7d0d5-d148-f4c3-ed2a-ebef1e651fe6&catalogType=tchMaterial&subCatalog=tchMaterial&page=094) |
| 096 | Appendix 6 The alphabet | [查看](http://www.dzkbw.com/books/rjb/yingyu/pep3s_2024/096.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=b3c7d0d5-d148-f4c3-ed2a-ebef1e651fe6&catalogType=tchMaterial&subCatalog=tchMaterial&page=096) |
## 网络补充资料
### Unit1 Making friends
- 未找到结果
### Unit2 Different families
- 未找到结果