multilinguality

Here are 16 public repositories matching this topic...

csebuetnlp / xl-sum

This repository contains the code, data, and models of the paper titled "XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languages" published in Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021.

multilingual machine-learning deep-learning dataset text-summarization abstractive-text-summarization abstractive-summarization text-summarisation low-resource-languages multilinguality summarization-corpora summarization-dataset multilingual-text-summarization text-summarization-dataset text-summarization-model low-resource-summarization low-resource-text-summarizarion multilingual-summarization

Updated
Python

Babelscape / wikineural

Star

Data and evaluation code for the paper WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER (EMNLP 2021).

natural-language-processing dataset named-entity-recognition multilinguality

Updated
Python

kbatsuren / CogNet

Star

CogNet: a large-scale, high-quality cognate database for 338 languages, 1.07M words, and 8.1 million cognates

wordnet corpus-linguistics language-resources cognate bilingual-lexicon-extraction low-resource-languages cross-lingual-simialrity multilinguality cross-lingual-transfer bilingual-lexicon-induction

Updated

AIRI-Institute / Probing_framework

Star

Framework for probing tasks

natural-language-processing transformers universal-dependencies probing multilinguality

Updated
Python

openlanguagedata / awesome-new-languages-in-machine-translation

Star

A list of initiatives for adding new languages to opensource machine translation models

awesome translation machine-translation languages awesome-list awesome-lists multilinguality

Updated

khuangaf / CONCRETE

Star

Official implementation of "CONCRETE: Improving Cross-lingual Fact Checking with Cross-lingual Retrieval" (COLING'22)

retrieval fact-checking low-resource-languages multilinguality cross-lingual-transfer

Updated
Python

dair-iitd / DSRE

Star

Resources for the paper "PARE: A Simple and Strong Baseline for Monolingual and Multilingual Distantly Supervised Relation Extraction"

relation-extraction distant-supervision multilinguality

Updated
Python

yifan-h / Multilingual_Space

Star

Source Code for "Adapters for Enhanced Modeling of Multilingual Knowledge and Text"

multilinguality knowledge-enhancement language-model-adapter

Updated
Python

Babelscape / CroCoAlign

Star

A Cross-Lingual, Context-Aware and Fully-Neural Sentence Alignment System for Long Texts.

nlp machine-translation sentence-embeddings sentence-alignment bilingual-corpora multilinguality embeddings-similarity

Updated
Python

cisnlp / TransliCo

Star

TransliCo: A Contrastive Learning Framework to Address the Script Barrier in Multilingual Pretrained Language Models

transliteration multilinguality crosslingual-transfer script-barrier

Updated
Python

Babelscape / ID10M

Star

Data and code for the paper "ID10M: Idiom Identification in 10 Languages" (NAACL 2022).

nlp machine-learning pytorch dataset multiword-expressions figurative-language multilinguality idiomatic-expressions token-classification

Updated
Python

phkhanhtrinh23 / Multilingual_Text_to_SQL

Star

Multilingual_Text_to_SQL is a data repo for multilingual Text-to-SQL research: it bundles database schemas (BigQuery, Snowflake, SQLite) and JSONL question sets across eight languages (en, de, es, fr, ja, pt, vi, zh) for training/evaluation.

text-to-sql multilinguality