Skip to content

Need to add ignore null or empty text during korean text process #56

@Taekyoon

Description

@Taekyoon

Agenda

  • Some raw datasets can have empty or null text.
  • Using filter method in RDD or DF, text like "" need to be ignored during this process.

How to solve this problem?

  • Add filter method after load the data
  • Add condition if the text data is null or empty in filter method

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions