Dataset Summary

This is the Bangla translated version of the CommonsenseQA dataset. The dataset was translated using a new method called Expressive Semantic Translation (EST). This method combines both Google Machine Translation and LLM-based rewriting of the translation to enhance the expressiveness and semantic accuracy of the translated content.

Dataset Structure

Data instances

Defaults

An example of a 'train' looks as follows:

{
 "question_stem": "অনেক অগ্নি নির্বাপক যন্ত্র থাকার সম্ভাবনা কোথায়?",
 "choices": {
 "text": [
 "গ্যারেজ",
 "হাসপাতাল",
 "নৌকা",
 "গৃহ",
 "পুতুল ঘর"
 ],
 "label": [
 "A",
 "B",
 "C",
 "D",
 "E"
 ]
 },
 "answerKey": "B"
}

Data Fields

The data fields are the same among all splits.

default

• id (str): Unique ID.
• question: a string feature.
• question_concept (str): ConceptNet concept associated to the question.
• choices: a dictionary feature containing:
  • label: a string feature.
  • text: a string feature.
• answerKey: a string feature.

Data Split

Dataset Creation

Curation Rationale

Source Data

Initial Data Collection and Normalization

Who are the source language producers?

Annotations

Annotation process

Who are the annotators?

Personal and Sensitive Information

Considerations for Using the Data

Social Impact of Dataset

Discussion of Biases

Other Known Limitations

Additional Information

Dataset Curators

Licensing Information

The dataset is licensed under the MIT License.

Citation Information

Contributions

5 items • Updated Apr 13 • 1