Language Classification for Swahili in Python

I want to do some simple language classification in Swahili. What is the easiest and best way to do this?

About Swahili - Swahili is a very agglutinative language so what would be many tokens in english is often one token in Swahili. A single verb can have thousands of possible variants depending on prefix or suffix. I have managed to piece together a parser which cam capture the verb lemmas.

My Use Case - I want to have a simple binary classification on pieces od text that are 20-100 words, but also would like to do category classification of text with 10 or so targets. I could train the data but hope to get results after like 50 datapoints per class.

Solutions? - I was thinking SVM or naive bayes based on simple token recognition together with TD-IDF? Should I do more? Any easy low hanging fruits? Is there easy stuff i can use in Spacy or NLTK packages? HELP!

Posted Jun 17, 2021, 10:00 PM UTC

133
Loading comments…