Baked in custom regex and deny-lists recognizer.

[Khuntawee]

I think there might be something wrong with my syntax or something because it doesn't seem to be working.
here's default_recognizer.yaml

supported_languages:
  - en
  - th

global_regex_flags: 26

recognizers:
  - name: CreditCardRecognizer
    type: predefined
    supported_languages:
      - language: en
        context: [credit, card, visa, mastercard, cc, amex, discover, jcb, diners, maestro, instapayment]
      - language: th
        context: [บัตรเครดิต, บัตร, วีซ่า, มาสเตอร์การ์ด]

  - name: CryptoRecognizer
    type: predefined

  - name: DateRecognizer
    type: predefined

  - name: EmailRecognizer
    type: predefined

  - name: IbanRecognizer
    type: predefined

  - name: IpRecognizer
    type: predefined

  - name: MacAddressRecognizer
    type: predefined

  - name: MedicalLicenseRecognizer
    type: predefined

  #- name: PhoneRecognizer
  #  type: predefined

  - name: PhoneRecognizer
    type: predefined
    supported_languages:
      - language: en
      - language: th
        context: [โทร, มือถือ, โทรศัพท์, ติดต่อ, เบอร์]
    supported_regions:
      - TH
      - US
      - UK
      - DE
      - FR
      - IL
      - IN
      - CA
      - BR

  - name: UrlRecognizer
    type: predefined

  - name: UsBankRecognizer
    type: predefined

  - name: UsLicenseRecognizer
    type: predefined

  - name: UsItinRecognizer
    type: predefined

  - name: UsPassportRecognizer
    type: predefined

  - name: UsSsnRecognizer
    type: predefined

  - name: NhsRecognizer
    type: predefined

  - name: SpacyRecognizer
    type: predefined

  - name: ThTninRecognizer
    type: predefined

  - name: PyThaiNLPRecognizer
    type: predefined

  - name: ThBankAccountRecognizer
    supported_language: th
    patterns:
      - name: thai_bank_account_dashed
        regex: '\\b\\d{3}-\\d-\\d{5}-\\d\\b'
        score: 0.6

      - name: thai_bank_account_plain
        regex: '\\b\\d{10}\\b'
        score: 0.3

    context:
      - บัญชีธนาคาร
      - บัญชี
      - ธนาคาร
      - รับเงิน
      - โอนเงิน
      - เลขบัญชี

    supported_entity: TH_BANK_ACCOUNT

  - name: "Religion recognizer"
    supported_language: "en"
    supported_entity: "RELIGION"

    context:
      - religion
      - belief
      - faith
      - worship
      - church
      - mosque
      - temple
      - pray

    deny_list:
      - Buddhist
      - Christian
      - Muslim
      - Hindu
      - Jewish
      - Catholic
      - Protestant
      - Sikh
      - Atheist

  - name: "Religion recognizer TH"
    supported_language: "th"
    supported_entity: "RELIGION"

    context:
      - ศาสนา
      - ความเชื่อ
      - วัด
      - มัสยิด
      - โบสถ์
      - สวดมนต์
      - นับถือ

    deny_list:
      - พุทธ
      - คริสต์
      - อิสลาม
      - มุสลิม
      - ฮินดู
      - ยิว
      - ซิกข์
      - ไม่นับถือศาสนา

  - name: "Gender recognizer"
    supported_language: "en"
    supported_entity: "GENDER"

    context:
      - gender
      - sex
      - identify
      - orientation
      - pronouns

    deny_list:
      - male
      - female
      - transgender
      - non-binary
      - intersex
      - genderqueer

  - name: "Gender recognizer TH"
    supported_language: "th"
    supported_entity: "GENDER"

    context:
      - เพศ
      - เพศสภาพ
      - อัตลักษณ์
      - สรรพนาม

    deny_list:
      - ชาย
      - หญิง
      - กะเทย
      - เพศที่สาม
      - ทอม
      - ดี้
      - เกย์
      - เลสเบี้ยน

Separated issue, but how do I remove ORGANIZATION entity? I added it to labels_to_ignore but it still detects here and there.

[omri374]

Hi, could you please share a reproducible example? which inputs are you passing and what output / errors are you getting?

[omri374]

On your second question, you define it in the labels_to_ignore section:
https://github.com/microsoft/presidio/blob/a890bd5e565f8a5fd1c3ab1ab5ed7bd6e24ff970/presidio-analyzer/presidio_analyzer/conf/spacy.yaml#L26