20/06/2019 - Bigger Corpus Released

Want more data in Russian? 33 billion words available at Omnia Russica

Taiga corpus + Aranea + Wikipedia + Common Crawl altogether

22/02/2019 - ULMFit on Taiga available

Universal language model for Russian - see on github!

10/11/2018 - Corpus Download now open!

Taiga corpus is now open for downloading!

09/11/2018 - Vector Model Release

Spark in me releases a Fasttext model, trained on random mix of Russian Wikipedia, Taiga and Common Crawl

Download link

Params Standard params - (3,6) n-grams + vector dimensionality is 300.

Usage:

import fastText as ft
ft_model_big = ft.load_model('model')

And then just refer to https://github.com/facebookresearch/fastText/blob/master/python/fastText/FastText.py

14/08/2018 - Corpus update - Fake news dataset

We have added fake news dataset in our corpus collection: 150k tokens from panorama.pub (Russian fake news site, analogous to Onion) - tagged and added to “News” segment.

Other news sources can be considered a “reliable news” class in case of binary classification task.

20/06/2018 - Vector Model Release

Thanks to Andrey Kutuzov - a skipgram model for Taiga is now available at RusVectores project page

On RusVectores page you can also find online semantic similarity calculator on different models, including Taiga

21/04/2018 - Taiga on Universal Dependencies site

Taiga subcorpus with manual annotation is now presented on universaldependencies.org (Russian)

Subcorpus repository

All credits go to Olga Lyashevskaya and students