Amharic - አማርኛ (am-et) language support

[yosiasz]

Greetings

How do you I go about creating a new space language pack? Would like to contribute if possible.

Thanks!

[svlandeg]

Hi!

We're always happy to receive community contributions for languages that we don't speak ourselves. You can consult https://spacy.io/usage/adding-languages for more background information on how language data is structured in spaCy.

In this thread, you can find more on the different ways you can contribute. For an entirely new language, it would probably be best to focus on correct tokenization first.

[yosiasz]

Would have been nice if there was a lightweight language template. barrier to entry is high

[yosiasz]

@svlandeg forked, created some basic Amharic language bits. What are next steps to testing it?

[svlandeg]

Did you check the guidelines at https://spacy.io/usage/adding-languages#testing ?

[yosiasz]

@svlandeg Awesome! tests pass for Amharic. Now my question is about punctuations. Both Amharic and Tigrinya use their own unique punctuations. Do I add these in ./spacy/lang/char_classes

_punct = (
    r"… …… , : ; \! \? ¿ ؟ ¡ \( \) \[ \] \{ \} < > _ # \* & 。 ？ ！ ， 、 ； ： ～ · । ، ۔ ؛ ٪"
)

or elsewhere in the language's own punctuation file?

Thanks for the guidance!

[yosiasz]

@svlandeg never mind, I did the following

_list_punct = LIST_PUNCT + "፡ ። ፣ ፤ ፥ ፦ ፧".strip().split()

[tewodrosm]

hey, I am adding Amharic language in spacy locally following your guide Spacy Documentation , how I can contribute to the project. thanks in advance

[yosiasz]

@tewodrosm Any progress on this? I am not seeing Amharic in the spaCy language space. thanks!

[yosiasz]

this is something interesting

https://arxiv.org/pdf/1710.00923.pdf

[tewodrosm]

thanks for sharing yosiasz.

[yosiasz]

@tewodrosm I have a pull request up. https://github.com/explosion/spaCy/pull/6583/commits in case you are interested.