Skip to content

Commit 837f9b1

Browse files
authored
Update README.md
1 parent 487f4c7 commit 837f9b1

File tree

1 file changed

+23
-1
lines changed

1 file changed

+23
-1
lines changed

baselines/EMNLP2019/README.md

Lines changed: 23 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,9 +15,31 @@ Run on a single document:
1515

1616
`echo "Butler W. Lampson (born December 23, 1943) is an American computer scientist contributing to the development and implementation of distributed, personal computing. He is a Technical Fellow at Microsoft and an Adjunct Professor at MIT." | python run.py`
1717

18+
output
19+
```
20+
Butler W. Lampson| DATE_OF_BIRTH(0.99) December 23, 1943|
21+
Butler W. Lampson|http://www.wikidata.org/entity/Q92644 NATIONALITY(0.88) American|http://www.wikidata.org/entity/Q30
22+
Microsoft|http://www.wikidata.org/entity/Q2283 CEO(0.63) He|http://www.wikidata.org/entity/Q92644
23+
He|http://www.wikidata.org/entity/Q92644 EMPLOYEE_OR_MEMBER_OF(0.88) Microsoft|http://www.wikidata.org/entity/Q2283
24+
He|http://www.wikidata.org/entity/Q92644 EMPLOYEE_OR_MEMBER_OF(0.93) MIT|http://www.wikidata.org/entity/Q49108
25+
He| DATE_OF_BIRTH(1.00) December 23, 1943|
26+
He|http://www.wikidata.org/entity/Q92644 NATIONALITY(0.86) American|http://www.wikidata.org/entity/Q30
27+
Butler W. Lampson|http://www.wikidata.org/entity/Q92644 EMPLOYEE_OR_MEMBER_OF(0.56) Microsoft|http://www.wikidata.org/entity/Q2283
28+
Butler W. Lampson|http://www.wikidata.org/entity/Q92644 EMPLOYEE_OR_MEMBER_OF(0.69) MIT|http://www.wikidata.org/entity/Q49108
29+
```
30+
1831
## Evaluating
1932

20-
python evaluate.py [test or dev]
33+
`python evaluate.py [test or dev]`
34+
35+
This creates the analysis files in `tmp` and when run on `dev` prints the results. To preserve the integrity of the results, we have released the test set without annotations. See https://github.com/diffbot/knowledge-net#adding-a-system-to-the-leaderboard for more details.
36+
37+
With the pretrained baseline 5 model you should get similar to the following on the dev set
38+
```
39+
span_overlap 0.718 0.691 0.704
40+
span_exact 0.620 0.599 0.609
41+
uri 0.557 0.472 0.511
42+
```
2143

2244
## Training
2345

0 commit comments

Comments
 (0)