Search results

k

Status: Open.

#82 In EleutherAI/dps;

· NguyenNhoTrung opened on Jun 18, 2024

dedup_job java.lang.UnsatisfiedLinkError

Status: Open.

#81 In EleutherAI/dps;

· syedhasnainrazashah opened on Apr 1, 2024

[ja] <code>.filter</code> is used instead of <code>.map</code> for non-filter methods

Status: Open.

#74 In EleutherAI/dps;

· mrorii opened on Jul 14, 2023

Chiese dedup memory error

Status: Open.

#65 In EleutherAI/dps;

· hyeinhyun opened on Apr 29, 2023

[ja] refactor MinHashLSH-based near deduplication method

Status: Open.

#62 In EleutherAI/dps;

· fujiki-1emon opened on Apr 19, 2023

Refactor RDD process to Dataframe process

enhancementNew feature or requestNew feature or request

Status: Open.

#57 In EleutherAI/dps;

· Taekyoon opened on Apr 3, 2023

Need to add ignore null or empty text during korean text process

bugSomething isn't workingSomething isn't working

Status: Open.

#56 In EleutherAI/dps;

· Taekyoon opened on Apr 1, 2023

[ja] spam word filter

Status: Open.

#51 In EleutherAI/dps;

· fujiki-1emon opened on Mar 13, 2023

[ja] replace Japanese PII

Status: Open.

#49 In EleutherAI/dps;

· fujiki-1emon opened on Mar 13, 2023

Add scripts to run hadoop cluster

enhancementNew feature or requestNew feature or request

Status: Open.

#20 In EleutherAI/dps;

· Taekyoon opened on May 24, 2022

Add build news paper dataset as long text data form

add job

Status: Open.

#9 In EleutherAI/dps;

· Taekyoon opened on Apr 24, 2022