privacy_policy_qa

Given a question and a clause from a privacy policy, determine if the clause contains enough information to answer the question.

---

Source: Privacy Q&A Corpus

License: MIT

Size (samples): 10992

Legal reasoning type: Interpretation

Task type: Binary classification

Task description

This is a binary classification task in which the LLM is provided with a question (e.g., “do you publish my data”) and a clause from a privacy policy. The LLM must determine if the clause contains an answer to the question, and classify the question-clause pair as Relevant or Irrelevant.

Task construction

This task was constructed from the test split of the PrivacyQA dataset. Please see the original paper for more details.

Citation information

If you use this dataset, we ask that you also cite to the source of the data as well.

@article{ravichander2019question,
  title={Question answering for privacy policies: Combining computational and legal perspectives},
  author={Ravichander, Abhilasha and Black, Alan W and Wilson, Shomir and Norton, Thomas and Sadeh, Norman},
  journal={arXiv preprint arXiv:1911.00841},
  year={2019}
}