Fusion-In-Decoder Base on Natural Questions

This trained model is based on the Fusion-In-Decoder model, and trained on the Natural Questions dataset.

Model Details

Model is based on Fusion-In-Decoder, which in turn is based on the t5-large checkpoint as the base model. For training, we utilized text retrieval for each query, which provides a collection of relevant passages for it.

We note that the passages were retrieved using a corpus based on Wikipedia.

Evaluation

See model performance on Evaluation Results tab on the right side.