A spell-checked version of the SNLI development and test sets


The SNLI dataset is not immune to human errors, specifically, misspelled words. In our NAACL-2018 paper, we demonstrated that misspelling is the main reason for some of the observed out-of-vocabulary words. We used Microsoft Office spell checker to correct various out-of-vocabulary words that occur due to misspelling in the development and test sets of the SNLI corpus. As a result, 83 and 112 samples from the development and test sets were changed respectively. Table 1 shows some erroneous sentences from the SNLI test set along with their corrected equivalents.

Here we are releasing the spell-checked version of the SNLI development and test sets. If you use this version of the SNLI corpus, please cite our work. Please note that - as the dataset is prepared using a third-party software, we do not guarantee the correctness of the provided data. If you need the datasets in the original SNLI format, please contact: sadid.hasan@philips.com




Original Sentence Corrected Sentence
Froends ride in an open top vehicle together. Friends ride in an open top vehicle together.
A middle easten store. A middle eastern store.
A woman is looking at a phtographer A woman is looking at a photographer
The mother and daughter are fighitn. The mother and daughter are fighting.
A woman escapes a from a hostile enviroment A woman escapes a from a hostile environment
Two daschunds play with a red ball Two dachshunds play with a red ball
a singer wearing a jacker performs on stage a singer wearing a jacket performs on stage
There is a sculture There is a sculpture
Taking a neverending break Taking a never ending break
The woman has sounds emanting from her mouth. The woman has sounds emanating from her mouth.
the lady is shpping the lady is shopping
A Bugatti and a Lambourgini compete in a road race. A Bugatti and a Lamborghini compete in a road race.
Table 1: Examples of original misspelled sentences in the SNLI test set along with their corrected versions. Erroneous and corrected words are shown in bold.