Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create dataset loader for SCH #707

Open
SamuelCahyawijaya opened this issue Jul 30, 2024 · 0 comments
Open

Create dataset loader for SCH #707

SamuelCahyawijaya opened this issue Jul 30, 2024 · 0 comments

Comments

@SamuelCahyawijaya
Copy link
Collaborator

Dataloader name: sch/sch.py
DataCatalogue: http://seacrowd.github.io/seacrowd-catalogue/card.html?sch

Dataset sch
Description This is the first publicly available corpus of Hmong [ISO 639-3: mww, hmj], a minority language of China, Vietnam, Laos, Thailand, and various countries in Europe, America, and Australia. The corpus has been scraped from a long-running Usenet newsgroup called soc.culture.hmong and consists of approximately 12 million tokens. This corpus (called SCH) is also the first substantial corpus to be annotated for elaborate expressions, a kind of four-part coordinate construction that is common and important in the languages of mainland Southeast Asia.
Subsets -
Languages hnj
Tasks Language Modeling
License Creative Commons Zero v1.0 Universal (cc0-1.0)
Homepage https://github.com/dmort27/sch-corpus/
HF URL -
Paper URL https://aclanthology.org/2022.lrec-1.533
@SamuelCahyawijaya SamuelCahyawijaya converted this from a draft issue Jul 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: No status
Development

No branches or pull requests

1 participant