top of page
Download Dataset

Where on a river can you hold a cup upright to catch water on a sunny day?

👍 waterfall, 👎 bridge, 👎 valley , 👎 pebble, 👎 mountain 

Where can I stand on a river to see water falling without getting wet?

👎 waterfall, 👍 bridge, 👎 valley, 👎 stream, 👎 bottom

I’m crossing the river, my feet are wet but my body is dry, where am I?

👎 waterfall, 👎 bridge, 👍 valley, 👎 bank, 👎 island

Rand Split (official split)

News

11/04/2019: We won NAACL19 best resource paper!.

Question Answering Challenge Targeting Commonsense Knowledge 

CommonsenseQA is a new multiple-choice question answering dataset that requires different types of commonsense knowledge to predict the correct answers . It contains 12,102 questions with one correct answer and four distractor answers.  The dataset is provided in two major training/validation/testing set splits: "Random split" which is the main evaluation split, and "Question token split", see paper for details.

Where would I not want a fox?

👍 hen house, 👎 england, 👎 mountains,

 👎 english hunt, 👎 california

Why do people read gossip magazines? 👍 entertained, 👎 get information, 👎 learn,

👎 improve know how, 👎 lawyer told to

  • Test results may be evaluated once every two weeks.

  • To be added to the leaderboard, we request a paper or short anonymous report of how you achieved this result, to help the community learn and reproduce your work.

  • At this point we will not be accepting submissions that make use of ConceptNet to the leaderboard. See * for an explanation. 

  • Please send predictions in OpenBookQA format according to the Eval Script to [email protected] and [email protected]

  • If you find this data helpful in your work, please cite this paper.

What do all humans want to experience in their own home?

👍 feel comfortable, 👎 work hard, 👎 fall in love, 👎 lay eggs, 👎 live forever

 2021, Alon Talmor

 Tel-Aviv University Natural Language Processing Group

bottom of page