You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
drop currently is translated into a Projection which is based on meta, so if some partition don't have some of those columns then you will run into KeyErrors, this can potentially be problematic.
A potential workaround is to create it's own Expression class and let it inherit from Projection so that it is taken into account in all optimisations, I have to think a little bit more about this if this is really a good idea
The text was updated successfully, but these errors were encountered:
see
test_drop_meta_mismatch
in dask/daskdrop currently is translated into a Projection which is based on meta, so if some partition don't have some of those columns then you will run into KeyErrors, this can potentially be problematic.
A potential workaround is to create it's own Expression class and let it inherit from Projection so that it is taken into account in all optimisations, I have to think a little bit more about this if this is really a good idea
The text was updated successfully, but these errors were encountered: