Ethics, Privacy & Validity Checklist for Knowledge Mining

Use this checklist before analyzing text data, running topic models, or sharing interview notes.

  • Define allowed inputs: List the specific data sources you will use (interview notes, ticket text, exports). Avoid collecting full email boxes or entire chat histories unless strictly necessary and authorized.
  • Obtain informed consent: Confirm interviewees understand how their responses will be used. Where consent is refused, anonymize or exclude the data.
  • Identify sensitive fields: Mark any mention of personal health, financial data, or confidential contracts and remove them from AI processing unless legal/compliance review allows it.
  • Limit AI inputs: Use sampled, de‑identified text for topic discovery. Document how prompts were crafted and who validated the outputs.
  • Record provenance: Keep a log of where data came from, who processed it, and which scripts or tools were used.
  • Validate findings with humans: Treat AI clusters or suggested topics as hypotheses and ask practitioners to verify before action.
  • Access control: Restrict raw data and interview notes to a small team and a named data steward.
  • Retention policy: Decide how long interview notes and any processed outputs will be retained and secure deletion procedures.
  • Escalation path: Identify who to contact if legal, compliance, or a participant raises a concern.
  • Bias check: Assess whether the interview sample systematically excludes important voices (e.g., frontline staff, remote locations) and adjust sample accordingly.

Discussion

Comments and conversation will live here.