pulsareon/JspaceAI
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: add scripts for fetching and training educational corpus

Browse Source 
- Implemented `fetch_corpus.py` to scrape Chinese educational content from Wikipedia, covering subjects like Chinese, Math, English, Chemistry, Politics, History, Geography, Physics, and Biology.
- Developed `fetch_corpus_incremental.py` for incremental fetching of missing entries, with automatic retries for rate limiting and support for resuming interrupted downloads.
- Created `train_chat.py` for training a dialogue model, including corpus cleaning, vocabulary management, and staged training with adaptive learning rates.
This commit is contained in:
XiuchengWu
2026-07-07 17:42:24 +08:00
parent d5affe4458
commit 81f6fd58e0
96 changed files with 53920 additions and 17 deletions
Download Patch File Download Diff File Expand all files Collapse all files

25
corpus/义务教育教材/初中/七年级/德语/外研版电子课本_外研版七年级德语必修C1(2024秋版).md Normal file
View File

@@ -0,0 +1,25 @@
# 外研版七年级德语必修C1(2024秋版)
- **来源站点**：http://www.dzkbw.com
- **电子课本网目录**：http://www.dzkbw.com/books/waiyan/deyu/7s_2024/
## 目录与官方阅读链接
| 页码 | 章节 | 电子课本网 | 智慧教育平台 |
|------|------|------------|--------------|
| 001 | 1 Guten Tag! | [查看](http://www.dzkbw.com/books/waiyan/deyu/7s_2024/001.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=c34faed1-4deb-053a-1cd1-6d569471969b&catalogType=tchMaterial&subCatalog=tchMaterial&page=001) |
| 002 | 2 Wie geht's? | [查看](http://www.dzkbw.com/books/waiyan/deyu/7s_2024/002.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=c34faed1-4deb-053a-1cd1-6d569471969b&catalogType=tchMaterial&subCatalog=tchMaterial&page=002) |
| 003 | 3 Woher kommst du? | [查看](http://www.dzkbw.com/books/waiyan/deyu/7s_2024/003.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=c34faed1-4deb-053a-1cd1-6d569471969b&catalogType=tchMaterial&subCatalog=tchMaterial&page=003) |
| 004 | 4 Ich liebe meine Familie. | [查看](http://www.dzkbw.com/books/waiyan/deyu/7s_2024/004.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=c34faed1-4deb-053a-1cd1-6d569471969b&catalogType=tchMaterial&subCatalog=tchMaterial&page=004) |
| 005 | 5 Wie alt bist du? | [查看](http://www.dzkbw.com/books/waiyan/deyu/7s_2024/005.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=c34faed1-4deb-053a-1cd1-6d569471969b&catalogType=tchMaterial&subCatalog=tchMaterial&page=005) |
| 006 | 6 Magst du Mathe? | [查看](http://www.dzkbw.com/books/waiyan/deyu/7s_2024/006.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=c34faed1-4deb-053a-1cd1-6d569471969b&catalogType=tchMaterial&subCatalog=tchMaterial&page=006) |
| 007 | 7 Okay,den nehme ich | [查看](http://www.dzkbw.com/books/waiyan/deyu/7s_2024/007.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=c34faed1-4deb-053a-1cd1-6d569471969b&catalogType=tchMaterial&subCatalog=tchMaterial&page=007) |
| 008 | 8 Was gibt's? | [查看](http://www.dzkbw.com/books/waiyan/deyu/7s_2024/008.htm) | [官方阅读](https://basic.smartedu.cn/tchMaterial/detail?contentType=assets_document&contentId=c34faed1-4deb-053a-1cd1-6d569471969b&catalogType=tchMaterial&subCatalog=tchMaterial&page=008) |
## 网络补充资料
### 1 Guten Tag!
- 未找到结果
### 2 Wie geht's?
- 未找到结果