The Growing Analyst

Tools

Data quality checker

Check a CSV file before you analyse it. In a few seconds you see what needs fixing, why it matters and how to fix it. The file is read by your browser and never leaves your computer.

What it checks

  • Structure: rows with too many or too few fields, and missing or repeated column names.
  • Duplicates: rows that are exact copies, and ID columns that repeat.
  • Missing values: empty cells, and text such as NA, N/A or null that tools read as real values.
  • Labels: the same value written several ways, such as Yes, YES and “ yes ”.
  • Dates: mixed formats, day and month in different orders, impossible dates and placeholders such as 1900-01-01.
  • Numbers: text in a number column, values far outside the rest, and codes such as 999.

What it cannot check

Whether the values are true. A clean file can still be wrong, so compare a few totals with the source before you report. Rules that need knowledge of your programme, such as “an antenatal visit for a male patient”, need a check of their own: my book shows how to build one in Power Query.

It works best on files up to a few hundred thousand rows. Nothing is stored or sent anywhere: close the page and it is gone.