Skip to content

Unicode issue #15

Open
Open
@visch

Description

@visch
2022-07-15T07:30:16.759125Z [info     ]   File "D:\AutoIDM\Job\.meltano\loaders\target-csv\venv\lib\site-packages\target_csv.py", line 97, in persist_messages cmd_type=elb consumer=True name=target-csv producer=False stdio=stderr string_id=target-csv
2022-07-15T07:30:16.764525Z [info     ]     writer.writerow(simplejson.loads(r)) cmd_type=elb consumer=True name=target-csv producer=False stdio=stderr string_id=target-csv
2022-07-15T07:30:16.770989Z [info     ]   File "C:\Python39\lib\csv.py", line 154, in writerow cmd_type=elb consumer=True name=target-csv producer=False stdio=stderr string_id=target-csv
2022-07-15T07:30:16.775307Z [info     ]     return self.writer.writerow(self._dict_to_list(rowdict)) cmd_type=elb consumer=True name=target-csv producer=False stdio=stderr string_id=target-csv
2022-07-15T07:30:16.779057Z [info     ]   File "C:\Python39\lib\encodings\cp1252.py", line 19, in encode cmd_type=elb consumer=True name=target-csv producer=False stdio=stderr string_id=target-csv
2022-07-15T07:30:16.783375Z [info     ]     return codecs.charmap_encode(input,self.errors,encoding_table)[0] cmd_type=elb consumer=True name=target-csv producer=False stdio=stderr string_id=target-csv
2022-07-15T07:30:16.794802Z [info     ] UnicodeEncodeError: 'charmap' codec can't encode character '\u0117' in position 83: character maps to <undefined> cmd_type=elb consumer=True name=target-csv producer=False stdio=stderr string_id=target-csv

Fixed by with open(filename, 'a', newline='', encoding='utf-8')

For some reason setting PYTHONIOENCODING="utf-8" doesn't work

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions