Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Incorporate Flatterer for Frictionless DP #759

Open
CecSve opened this issue Oct 11, 2024 · 1 comment
Open

Incorporate Flatterer for Frictionless DP #759

CecSve opened this issue Oct 11, 2024 · 1 comment

Comments

@CecSve
Copy link

CecSve commented Oct 11, 2024

It might be worthwhile to explore whether Flatterer could be a useful tool for rgbif?

With Flatterer you can:

  • easily convert JSON to flat relational data such as CSV, XLSX, Database Tables, Pandas Dataframes and Parquet;
  • convert JSON into data packages, so you can use Frictionless data to convert into any database format;
  • create a data dictionary that contains metadata about the conversion, including fields contained in the dataset, to help you understand the data you are looking at;
  • create a new table for each one-to-many relationship, alongside _link fields that help to join the data together.
@jhnwllr
Copy link
Collaborator

jhnwllr commented Oct 16, 2024

rgbif already does a fairly good job of giving back flat tables using jsonlite.

https://github.com/jeroen/jsonlite

I think that flatter could perhaps be more useful for pygbif, where we don't give back flat tables.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants