feat: add scripts for fetching and training educational corpus

- Implemented `fetch_corpus.py` to scrape Chinese educational content from Wikipedia, covering subjects like Chinese, Math, English, Chemistry, Politics, History, Geography, Physics, and Biology.
- Developed `fetch_corpus_incremental.py` for incremental fetching of missing entries, with automatic retries for rate limiting and support for resuming interrupted downloads.
- Created `train_chat.py` for training a dialogue model, including corpus cleaning, vocabulary management, and staged training with adaptive learning rates.
This commit is contained in:
2026-07-07 17:42:24 +08:00
parent d5affe4458
commit 81f6fd58e0
96 changed files with 53920 additions and 17 deletions

View File

@@ -0,0 +1,28 @@
# 人教版七年级日语全一册(2024秋版)
- **来源站点**http://www.dzkbw.com
- **电子课本网目录**http://www.dzkbw.com/books/rjb/riyu/q7_2024/
## 目录与官方阅读链接
| 页码 | 章节 | 电子课本网 | 智慧教育平台 |
|------|------|------------|--------------|
| 001 | 入门单元 初识日语 | [查看](http://www.dzkbw.com/books/rjb/riyu/q7_2024/001.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=2b2b93de-48d9-742d-4409-7e3aedc90a59&catalogType=tchMaterial&subCatalog=tchMaterial&page=001) |
| 002 | 第一单元 学校生活 | [查看](http://www.dzkbw.com/books/rjb/riyu/q7_2024/002.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=2b2b93de-48d9-742d-4409-7e3aedc90a59&catalogType=tchMaterial&subCatalog=tchMaterial&page=002) |
| 003 | 第二单元 休闲活动 | [查看](http://www.dzkbw.com/books/rjb/riyu/q7_2024/003.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=2b2b93de-48d9-742d-4409-7e3aedc90a59&catalogType=tchMaterial&subCatalog=tchMaterial&page=003) |
| 004 | 第三单元 感知社会 | [查看](http://www.dzkbw.com/books/rjb/riyu/q7_2024/004.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=2b2b93de-48d9-742d-4409-7e3aedc90a59&catalogType=tchMaterial&subCatalog=tchMaterial&page=004) |
| 005 | 第四单元 健康成长 | [查看](http://www.dzkbw.com/books/rjb/riyu/q7_2024/005.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=2b2b93de-48d9-742d-4409-7e3aedc90a59&catalogType=tchMaterial&subCatalog=tchMaterial&page=005) |
| 006 | 附录 | [查看](http://www.dzkbw.com/books/rjb/riyu/q7_2024/006.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=2b2b93de-48d9-742d-4409-7e3aedc90a59&catalogType=tchMaterial&subCatalog=tchMaterial&page=006) |
| 007 | 录音文字资料 | [查看](http://www.dzkbw.com/books/rjb/riyu/q7_2024/007.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=2b2b93de-48d9-742d-4409-7e3aedc90a59&catalogType=tchMaterial&subCatalog=tchMaterial&page=007) |
| 008 | 词汇表 | [查看](http://www.dzkbw.com/books/rjb/riyu/q7_2024/008.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=2b2b93de-48d9-742d-4409-7e3aedc90a59&catalogType=tchMaterial&subCatalog=tchMaterial&page=008) |
| 009 | 交际用语 | [查看](http://www.dzkbw.com/books/rjb/riyu/q7_2024/009.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=2b2b93de-48d9-742d-4409-7e3aedc90a59&catalogType=tchMaterial&subCatalog=tchMaterial&page=009) |
| 010 | 语法项目 | [查看](http://www.dzkbw.com/books/rjb/riyu/q7_2024/010.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=2b2b93de-48d9-742d-4409-7e3aedc90a59&catalogType=tchMaterial&subCatalog=tchMaterial&page=010) |
| 011 | 学习评价量规样表 | [查看](http://www.dzkbw.com/books/rjb/riyu/q7_2024/011.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=2b2b93de-48d9-742d-4409-7e3aedc90a59&catalogType=tchMaterial&subCatalog=tchMaterial&page=011) |
## 网络补充资料
### 入门单元 初识日语
- 未找到结果
### 第一单元 学校生活
- 未找到结果