-
Notifications
You must be signed in to change notification settings - Fork 310
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[OPIK-622] Remove deprecated dataset item fields #1003
[OPIK-622] Remove deprecated dataset item fields #1003
Conversation
…mn-named-input-with-non-dictionary-type-values
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
For the implementation part, we should keep removing a few more related things that become unused.
Please review the tests carefully. Filtering might still be legitimate on those fields, but as dynamic fields within data
. Also, tests related to the migration or the deprecated fields might go away entirely. But please double check that my guidance and assumptions here are correct.
apps/opik-backend/src/main/java/com/comet/opik/api/validate/DatasetItemInputValidator.java
Outdated
Show resolved
Hide resolved
apps/opik-backend/src/test/java/com/comet/opik/api/resources/v1/priv/DatasetsResourceTest.java
Outdated
Show resolved
Hide resolved
apps/opik-backend/src/test/java/com/comet/opik/api/resources/v1/priv/DatasetsResourceTest.java
Outdated
Show resolved
Hide resolved
apps/opik-backend/src/test/java/com/comet/opik/api/resources/v1/priv/DatasetsResourceTest.java
Show resolved
Hide resolved
apps/opik-backend/src/test/java/com/comet/opik/api/resources/v1/priv/DatasetsResourceTest.java
Show resolved
Hide resolved
apps/opik-backend/src/test/java/com/comet/opik/api/resources/v1/priv/DatasetsResourceTest.java
Show resolved
Hide resolved
columns.add(Column.builder().name("input").types(Set.of(ColumnType.OBJECT)).filterFieldPrefix("data").build()); | ||
columns.add(Column.builder().name("expected_output").types(Set.of(ColumnType.OBJECT)).filterFieldPrefix("data") | ||
.build()); | ||
columns.add( | ||
Column.builder().name("metadata").types(Set.of(ColumnType.OBJECT)).filterFieldPrefix("data").build()); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Probably the whole addDeprecatedFields
doesn't make sense anymore, as we're removing the deprecated fields entirely.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It's still needed, since we are using it mainly to get expected columns. Renamed for readability.
apps/opik-backend/src/main/java/com/comet/opik/domain/DatasetItemResultMapper.java
Show resolved
Hide resolved
…mn-named-input-with-non-dictionary-type-values
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM from the technical perspective. Make sure you finish the investigation on the data usage that was discussed prior to deploy. Hold the merge if needed.
Details
Remove deprecated dataset item fields
Testing
Covered by existing integration tests