Skip to content
This repository has been archived by the owner on Jan 4, 2023. It is now read-only.

Show number of instances created or updated within a batch #668

Open
MiskoG opened this issue Oct 12, 2021 · 2 comments
Open

Show number of instances created or updated within a batch #668

MiskoG opened this issue Oct 12, 2021 · 2 comments

Comments

@MiskoG
Copy link

MiskoG commented Oct 12, 2021

CleanShot 2021-10-12 at 17 27 52@2x

The idea here is to give more details about what really happened during the ETL.

I suggest to show this instead :
[batch length] | [number of ressources or mappings processed] | [number of instances created] | [number of instances updated]

For example
2 minutes 32 seconds | 5 FHIR mappings | 2 864 instances created | 21 031 instances updated

@simonvadee As discussed, do you confirm we do already have everything needed in DB ?
@nriss @elsiehoffet-94 What do you think of this as a first step ? I was also thinking about showing more details on a mapping-level (for example Patient : 1k instances created and 0 instance updated)

@MiskoG MiskoG added the ETL label Oct 12, 2021
@MiskoG MiskoG changed the title [ETL] Show number of instances created or updated Show number of instances created or updated within a batch Oct 12, 2021
@simonvadee
Copy link
Contributor

@simonvadee As discussed, do you confirm we do already have everything needed in DB ?

Well not exactly in the database but in redis yes: we have the number of extracted and loaded instances per resource

@MiskoG
Copy link
Author

MiskoG commented Oct 25, 2021

@Klochette We were talking with @Jasopaum to add some more details for the user.
While @Jasopaum is working on the backend, maybe you can already take care of the front ?

We expect the following

  • When a batch is status = success, we can click on it in order to collapse (as it did before in order to see the errors 😄 )
  • We want to show an array with several info per mapping about what happened during the ETL batch
    [ mapping name - label ] [ number of instances created ] [ number of instances updated ]

For instance
Patient | 12 021 created | 67 updated
Observation - Tumor Pathology Event | 128 063 created | 2 156 updated

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants