languages: Can I teach Olivia to understand another languages?

[asxcandrew]

No description provided.

[hugolgst]

Not yet because the stemmer is in English

[hugolgst]

Related to #83
Work in progress

[izturn]

Does it support Chinese?

[hugolgst]

Not yet.

[izturn]

in the plan?

[hugolgst]

I do not speak Chinese but if someone wants to translate it that would be great!

[izturn]

how to do it ? any tutorial?

[hugolgst]

I'm currently writing it

[hugolgst]

Meanwhile, you can look at files in res/locales I have commented a few lines about translations.
The website translations are needed too, I didn't write anything about that yet.

[hugolgst]

Hello @doutuiya ,
The document is (finally) available here.
Sorry for the delay.

[izturn]

@hugolgst thx :D

[izturn]

but, the snowball doesn't support Chinese :(

[hugolgst]

If we implement a Chinese stemmer, do you think it will work as well as in English?
Due to the difference of grammar etc..

[izturn]

tbh, i dont' know, but there are somethings, i like to share:
1.the Chinese is the most used language in the world.
2. the golang developers in China is very much, maybe the no1 in the world.
3. the top n companies in China used golang to develop their products, likes Alibaba, Tencent, BaiDu, ByteDance etc.
4. there are some stemmers that support Chinese, likes: gojieba, gse

so, i think, we can give it a try.

[hugolgst]

Sure thing, adding Chinese would be great!
Would you like to do it, and by the way would you like some help for adding a Chinese stemmer?
If it works for you I will create an issue for that.

[izturn]

thx, if there is a tutorial for "how to implement it ", i can give a try.

[hugolgst]

There is a page of the documentation that explains how to do it.

https://docs.olivia-ai.org/translations.html

[izturn]

the document says "first of all make sure that the stemmer(snowball) supports it", but I can't find the Chinese in the list, so can i follow this doucment ?

[hugolgst]

So yeah you can, however the stemmer won’t work that’s why I asked you if you wanted me to implement the stemmer for you

[izturn]

sorry, i misunderstand you, yes i want the stemmer

[hugolgst]

Okay, I will create a branch and add the Chinese stemmer and then you would be able to fork the project and work on this branch. I keep you updated.

[hugolgst]

Chinese has stopwords too, is that right?

[hugolgst]

I began to work on it in the language/chinese branch. Let me know if it does not works for you.

[izturn]

yes, Chinese has stopwords

[hugolgst]

Keep me updated and don't hesitate if you have any questions :)

[koji]

Hi @hugolgst,
Would you like to have Japanese?
If so, could you do what you did for doutuiya to me?

[hugolgst]

For sure!
Please open a PR and allow edits from the maintainers, I will work on that

[leeningli]

yes, Chinese has stopwords

你已经在language/chinese分支开发了吗？@doutuiya

[Deng-Xian-Sheng]

I checked language/chinese , but it not progress
I don't think it is necessary to waste energy on languages (after all, there are so many languages in the world)
Translation software will help us solve everything

I try to help develop Chinese problems
I am an excellent programmer. I take advantage of my National Day holiday (China's founding day, October 1 holiday)
This robot is a bit silly. I don't know whether it has realized the memory function
However, it is a happy thing to let the mother tongue scroll on the console

Needless to say, do it

[Deng-Xian-Sheng]

I have finished it. It now supports Chinese, but it still needs to be optimized; Please check the pull request

[Deng-Xian-Sheng]

为什么还不合并？？

[Deng-Xian-Sheng]

Why don't you merge??

[Deng-Xian-Sheng]

:-(

[Deng-Xian-Sheng]

yes, Chinese has stopwords

你已经在language/chinese分支开发了吗？@doutuiya

I'm done. You can take a look at the pull request.