✏️ Added 23 new model properties and harden JSON extraction [#15] - #16
✏️ Added 23 new model properties and harden JSON extraction [#15]#16MikeACedric wants to merge 3 commits into
Conversation
…, tolerant/bracket-aware value splitting
…e title & paper deduplication check
There was a problem hiding this comment.
dear @MikeACedric , thank you for this PR and the examples. Very helpful to get an idea about how the model is doing. I picked one use case https://orkg.org/papers/R1911271 and circled some extraction anomalies below. Might it be possible to define stricter criteria around the extraction for properties?
Examples
When on visits the property link for pretraining corpus https://orkg.org/properties/P41655 you actually see that it has a description. It is best even for new properties added to give them a description. This you can do by visiting the property link directly and then click the plus against description and enter the text there. This description should be written in a way that makes clear which kind of values the property supports. So it is a way to disambiguate similar named properties.
To handle unmeaningful extractions as in 1 as well as 2 and 3 below, as discussed in the meeting yesterday, aside from heuristics I am wondering if a semantic final screening pass can be applied for the values extracted before they are confirmed as valid values. This semantic pass could be based on the description of the property.
|
I've found another issue with this automated check of resources from the ORKG. Same paper https://orkg.org/papers/R1911271 Note the
It expands as follows.
Basically this is then not the right resource to be added as a value here. Maybe when you query against the API with the label |
|
Runs on Sandbox with the two fixes mentioned above: |


Summary
New properties
multimodal). 23 new properties are now integrated end-to-end — schema, prompt
(
<Conditional-Fields>), few-shot examples (GLM-5 / Kimi K2 / Phi-4). Examples:activated_parameters,attention_mechanism,moe_configuration,reasoning_mode,rl_algorithm,benchmark_result,vision_encoder,base_model.JSON response robustness
number_of_attention_heads: 64) — coerced to string.,vs;separators — comma fields split on both;;fields stay;-only.()/[]/{}don't fragment values.Example Runs (Sandbox)
Example Runs (Live)
Related Issue:
[#15]