Merge pull request #51 from lexibank/fetch-wordlist

source update

Author: FredericBlum

README.md

@@ -31,8 +31,8 @@ work in progress
 ![Glottolog: 97%](https://img.shields.io/badge/Glottolog-97%25-green.svg "Glottolog: 97%")
 ![Concepticon: 100%](https://img.shields.io/badge/Concepticon-100%25-brightgreen.svg "Concepticon: 100%")
 ![Source: 100%](https://img.shields.io/badge/Source-100%25-brightgreen.svg "Source: 100%")
-![BIPA: 99%](https://img.shields.io/badge/BIPA-99%25-brightgreen.svg "BIPA: 99%")
-![CLTS SoundClass: 99%](https://img.shields.io/badge/CLTS%20SoundClass-99%25-brightgreen.svg "CLTS SoundClass: 99%")
+![BIPA: 98%](https://img.shields.io/badge/BIPA-98%25-green.svg "BIPA: 98%")
+![CLTS SoundClass: 98%](https://img.shields.io/badge/CLTS%20SoundClass-98%25-green.svg "CLTS SoundClass: 98%")
 
 - **Varieties:** 35 (linked to 34 different Glottocodes)
 - **Concepts:** 200 (linked to 200 different Concepticon concept sets)
@@ -42,9 +42,9 @@ work in progress
 - **Cognacy:** 4,804 cognates in 3,282 cognate sets (2,554 singletons)
 - **Cognate Diversity:** 0.67
 - **Invalid lexemes:** 0
-- **Tokens:** 27,168
-- **Segments:** 130 (1 BIPA errors, 1 CLTS sound class errors, 129 CLTS modified)
-- **Inventory size (avg):** 26.31
+- **Tokens:** 27,431
+- **Segments:** 149 (3 BIPA errors, 3 CLTS sound class errors, 146 CLTS modified)
+- **Inventory size (avg):** 27.91
 
 # Contributors
 

TRANSCRIPTION.md

@@ -5,68 +5,68 @@
 
 | Segment | Occurrence | BIPA | CLTS SoundClass |
 |:----------|-------------:|:-------|:------------------|
-| a | 4228 | ✓ | ✓ |
-| i | 2542 | ✓ | ✓ |
-| n | 1977 | ✓ | ✓ |
-| o | 1478 | ✓ | ✓ |
-| e | 1470 | ✓ | ✓ |
-| u | 1407 | ✓ | ✓ |
-| k | 1306 | ✓ | ✓ |
-| t | 1055 | ✓ | ✓ |
-| m | 989 | ✓ | ✓ |
-| h | 863 | ✓ | ✓ |
+| a | 4172 | ✓ | ✓ |
+| i | 2457 | ✓ | ✓ |
+| n | 1973 | ✓ | ✓ |
+| o | 1465 | ✓ | ✓ |
+| e | 1461 | ✓ | ✓ |
+| u | 1380 | ✓ | ✓ |
+| k | 1281 | ✓ | ✓ |
+| t | 1060 | ✓ | ✓ |
+| m | 988 | ✓ | ✓ |
+| + | 910 | ✓ | ✓ |
+| h | 859 | ✓ | ✓ |
 | ʔ | 799 | ✓ | ✓ |
-| ɨ | 711 | ✓ | ✓ |
-| p | 622 | ✓ | ✓ |
-| + | 516 | ✓ | ✓ |
-| s | 488 | ✓ | ✓ |
+| ɨ | 700 | ✓ | ✓ |
+| p | 623 | ✓ | ✓ |
+| s | 487 | ✓ | ✓ |
 | d | 485 | ✓ | ✓ |
-| ɯ | 476 | ✓ | ✓ |
+| ɯ | 457 | ✓ | ✓ |
 | ɾ | 438 | ✓ | ✓ |
 | r | 364 | ✓ | ✓ |
 | w | 358 | ✓ | ✓ |
-| j | 336 | ✓ | ✓ |
+| j | 333 | ✓ | ✓ |
 | tʃ | 317 | ✓ | ✓ |
-| aː | 274 | ✓ | ✓ |
+| aː | 286 | ✓ | ✓ |
 | b | 266 | ✓ | ✓ |
-| g | 243 | ✓ | ✓ |
-| ts | 242 | ✓ | ✓ |
-| ɲ | 216 | ✓ | ✓ |
-| iː | 142 | ✓ | ✓ |
-| l | 141 | ✓ | ✓ |
-| ʃ | 136 | ✓ | ✓ |
+| g | 242 | ✓ | ✓ |
+| ts | 240 | ✓ | ✓ |
+| ɲ | 215 | ✓ | ✓ |
+| iː | 158 | ✓ | ✓ |
+| l | 140 | ✓ | ✓ |
+| ʃ | 137 | ✓ | ✓ |
 | dʒ | 133 | ✓ | ✓ |
+| oː | 108 | ✓ | ✓ |
 | ɸ | 105 | ✓ | ✓ |
-| oː | 104 | ✓ | ✓ |
 | ʊ | 98 | ✓ | ✓ |
-| ə | 95 | ✓ | ✓ |
 | β | 95 | ✓ | ✓ |
-| ɛ | 90 | ✓ | ✓ |
+| ə | 94 | ✓ | ✓ |
+| ai | 85 | ✓ | ✓ |
 | ʎ | 83 | ✓ | ✓ |
+| ɛ | 82 | ✓ | ✓ |
 | æ | 76 | ✓ | ✓ |
 | ŋ | 73 | ✓ | ✓ |
 | x | 67 | ✓ | ✓ |
-| ai | 65 | ✓ | ✓ |
+| aɯ | 66 | ✓ | ✓ |
+| kʷ | 65 | ✓ | ✓ |
 | tʲ | 65 | ✓ | ✓ |
-| aɯ | 59 | ✓ | ✓ |
-| uː | 53 | ✓ | ✓ |
-| ɨː | 52 | ✓ | ✓ |
-| kʷ | 43 | ✓ | ✓ |
+| ɨː | 63 | ✓ | ✓ |
+| uː | 56 | ✓ | ✓ |
 | kʰ | 39 | ✓ | ✓ |
+| ɯː | 39 | ✓ | ✓ |
+| ui | 38 | ✓ | ✓ |
 | θ | 38 | ✓ | ✓ |
 | ð | 36 | ✓ | ✓ |
-| ɯː | 34 | ✓ | ✓ |
 | tsʰ | 33 | ✓ | ✓ |
 | au | 31 | ✓ | ✓ |
 | dz | 31 | ✓ | ✓ |
 | ˀk | 29 | ✓ | ✓ |
 | ʂ | 28 | ✓ | ✓ |
-| ui | 27 | ✓ | ✓ |
 | n̥ | 26 | ✓ | ✓ |
+| eː | 24 | ✓ | ✓ |
 | ɗ | 24 | ✓ | ✓ |
 | ɻ | 23 | ✓ | ✓ |
 | pʰ | 22 | ✓ | ✓ |
-| eː | 21 | ✓ | ✓ |
 | c | 20 | ✓ | ✓ |
 | v | 19 | ✓ | ✓ |
 | ei | 18 | ✓ | ✓ |
@@ -80,20 +80,19 @@
 | a̤ | 14 | ✓ | ✓ |
 | td | 14 | ✓ | ✓ |
 | tɕ | 14 | ✓ | ✓ |
-| ua | 14 | ✓ | ✓ |
 | pʲ | 12 | ✓ | ✓ |
 | ç | 12 | ✓ | ✓ |
-| hʲ | 10 | ✓ | ✓ |
+| hʲ | 11 | ✓ | ✓ |
 | kʰʲ | 9 | ✓ | ✓ |
+| kʲ | 9 | ✓ | ✓ |
 | tʂ | 9 | ✓ | ✓ |
 | tʰʲ | 9 | ✓ | ✓ |
+| ia | 8 | ✓ | ✓ |
 | i̤ | 8 | ✓ | ✓ |
 | tʃʰ | 8 | ✓ | ✓ |
-| uɨ | 8 | ✓ | ✓ |
 | ɨi | 8 | ✓ | ✓ |
 | dʑ | 7 | ✓ | ✓ |
 | f | 7 | ✓ | ✓ |
-| kʲ | 7 | ✓ | ✓ |
 | kˀ | 7 | ✓ | ✓ |
 | mʲ | 7 | ✓ | ✓ |
 | pˀ | 7 | ✓ | ✓ |
@@ -105,38 +104,58 @@
 | mʷ | 6 | ✓ | ✓ |
 | ɨ̤ | 6 | ✓ | ✓ |
 | ˀr | 6 | ✓ | ✓ |
+| iu | 5 | ✓ | ✓ |
 | oʊ | 5 | ✓ | ✓ |
-| ɯɯ | 5 | ✓ | ✓ |
 | ɰ | 5 | ✓ | ✓ |
 | ɹ | 5 | ✓ | ✓ |
 | ɽ | 5 | ✓ | ✓ |
 | ʊː | 5 | ✓ | ✓ |
 | fʷ | 4 | ✓ | ✓ |
+| ɛː | 4 | ✓ | ✓ |
+| ɯɯ | 4 | ✓ | ✓ |
 | ʒ | 4 | ✓ | ✓ |
+| io | 3 | ✓ | ✓ |
+| ua | 3 | ✓ | ✓ |
 | ɣ | 3 | ✓ | ✓ |
 | ʀ | 3 | ✓ | ✓ |
-| <<_>> | 2 | ? | ? |
 | aɪ | 2 | ✓ | ✓ |
 | e̤ | 2 | ✓ | ✓ |
+| oa | 2 | ✓ | ✓ |
 | pʷ | 2 | ✓ | ✓ |
-| uɨː | 2 | ✓ | ✓ |
+| uai | 2 | ? | ? |
 | əɨ | 2 | ✓ | ✓ |
+| ɯe | 2 | ✓ | ✓ |
 | ɾʲ | 2 | ✓ | ✓ |
 | ʔʲ | 2 | ✓ | ✓ |
 | βʲ | 2 | ✓ | ✓ |
+| !g/ʔ | 1 | ✓ | ✓ |
+| !h/n | 1 | ✓ | ✓ |
+| !hi/hʲ | 1 | ✓ | ✓ |
+| !hu/w | 1 | ✓ | ✓ |
+| !k/s | 1 | ✓ | ✓ |
+| !n/h | 1 | ✓ | ✓ |
+| !nn/n | 1 | ✓ | ✓ |
+| !s/k | 1 | ✓ | ✓ |
+| !u/w | 1 | ✓ | ✓ |
+| aəi | 1 | ? | ? |
+| aɯi | 1 | ? | ? |
 | aʊ | 1 | ✓ | ✓ |
 | dʷ | 1 | ✓ | ✓ |
+| ea | 1 | ✓ | ✓ |
 | eˀ | 1 | ✓ | ✓ |
 | q | 1 | ✓ | ✓ |
+| uɨ | 1 | ✓ | ✓ |
+| uɯ | 1 | ✓ | ✓ |
 | á | 1 | ✓ | ✓ |
 | ɦ | 1 | ✓ | ✓ |
 | ɨa | 1 | ✓ | ✓ |
 | ɪ | 1 | ✓ | ✓ |
 | ʎʷ | 1 | ✓ | ✓ |
 | ʝ | 1 | ✓ | ✓ |
+| ʲɲ | 1 | ✓ | ✓ |
 | ∼ | 1 | ✓ | ✓ |
 
-(130 rows)
+(149 rows)
 
 
 
@@ -152,10 +171,12 @@
 ## Words with invalid segments (up to 100 only)
 
 | ID | LANGUAGE | CONCEPT | FORM | SEGMENTS |
-|:---------------------------|:-----------|:--------------|:--------------|:---------------------------------------|
-| Chayahuita-118_righthand-1 | Chayahuita | 118_righthand | inʃinan_kɨɾan | i n ʃ i n a n <s> <<_>> </s> k ɨ ɾ a n |
-| Chayahuita-49_fire-1 | Chayahuita | 49_fire | pɨn_panka | p ɨ n <s> <<_>> </s> p a n k a |
+|:---------------------------------------------|:-------------|:------------------------------|:-------|:-------------------|
+| WitotoMinica-41_tofalldropratherthantopple-1 | WitotoMinica | 41_tofalldropratherthantopple | baəíde | b <s> aəi </s> d e |
+| WitotoMinica-41_tofalldropratherthantopple-2 | WitotoMinica | 41_tofalldropratherthantopple | uáide | <s> uai </s> d e |
+| WitotoMurui-41_tofalldropratherthantopple-1 | WitotoMurui | 41_tofalldropratherthantopple | uaide | <s> uai </s> d e |
+| WitotoNipode-41_tofalldropratherthantopple-1 | WitotoNipode | 41_tofalldropratherthantopple | baɯíde | b <s> aɯi </s> d e |
 
-(2 rows)
+(4 rows)