Activity
Merge branch 'main' of github.com:chenyangMl/llama2.c-zh
Merge branch 'main' of github.com:chenyangMl/llama2.c-zh
mv all task processing script to dataProcess
mv all task processing script to dataProcess
update readme to add example, how to train tokenizer from scrath
update readme to add example, how to train tokenizer from scrath
add a demo, train_tokenizer_from_scrath
add a demo, train_tokenizer_from_scrath