Skip to content

CSV Format Error in Exported SIGRID Files #2

Description

@rilshok

The exported files by tile in the index contain a CSV format error.

According to the RFC 4180, each line in a CSV file should be separated by a delimiter and end with a newline characters, without an extra delimiter at the end. For example:

field_name,field_name,field_name CRLF
aaa,bbb,ccc CRLF
zzz,yyy,xxx CRLF

However, the CSV files contained in the published zip archives have two comma characters at the end of each record.

For example, the file SIGRID_x_80_90_y_20_30_1000m_1_subgrid_1.csv from the archive SIGRID_x_80_90_y_20_30_1000m_1_subgrid.csv.zip looks like this:

"CE_ID","yCoordinate","xCoordinate","grid_1_SIGRID_x_80_90_y_20_30",..,"grid_100_SIGRID_x_80_90_y_20_30"
"6631_10281","25.419368","88.808","true",..,"false",,
"6631_10282","25.419368","88.7980544","true",..,"false",,
"6631_10283","25.419368","88.7881152","true",..,"false",,
..

This error causes issues with deserializing the tables, such as when using the pandas.read_csv function in Python.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions