InternLM/InternBootcamp
1
0
Fork 0
mirror of https://github.com/InternLM/InternBootcamp.git synced 2026-04-19 12:58:04 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

refactor(data_pipeline): optimize data generation pipeline; add multiple preset configurations for data generation

Browse source
This commit is contained in:
chenyongkang 2025-08-26 18:40:21 +08:00
parent 1a8477c8d8
commit 8d493b35a0
2160 changed files with 69199 additions and 154 deletions
Download patch file Download diff file Expand all files Collapse all files

55
examples/pipelines/all_configs/Cspysyndrome2_train.json Normal file
View file

@ -0,0 +1,55 @@
[
{
"min_words": 3,
"max_words": 5,
"word_pool": [
"Hello",
"World",
"Python",
"Code",
"Spy",
"Cipher",
"Hacker",
"Secret",
"Message",
"Encode"
],
"extra_words": 2,
"max_word_length": 8
},
{
"min_words": 3,
"max_words": 4,
"word_pool": [
"Hi",
"Bye",
"Yes",
"No",
"Hello",
"World",
"Python",
"Code",
"Spy"
],
"extra_words": 2,
"max_word_length": 7
},
{
"min_words": 4,
"max_words": 6,
"word_pool": [
"Apple",
"Banana",
"Cherry",
"Hello",
"World",
"Test",
"Example",
"Python",
"Code",
"Spy"
],
"extra_words": 3,
"max_word_length": 9
}
]