Exploratory Data Analysis

noun

say it: “ek-SPLOR-uh-tor-ee DAY-tuh uh-NAL-uh-sis” /ɪkˈsplɔrəˌtɔri ˈdeɪtə əˈnæləsɪs/

Looking through a new set of data to learn its size, contents, gaps and odd values before using it to answer questions.

What is exploratory data analysis?

Exploratory data analysis, often shortened to EDA, is looking around a new dataset to learn what's in it before answering a question with it: how many rows it has, what its columns hold, where the gaps are and which values look odd. It's the notes you take for yourself; the report comes after.

classes = pd.read_csv("classes.csv")
print(classes.shape)         # (588, 8): rows and columns
classes.info()               # each column's type and how many values are there
print(classes.isna().sum())  # the missing values in each column

In a sentence

  • “She spent the first hour on exploratory data analysis before writing any finding.”
  • “Exploratory data analysis showed the attendance column had blanks.”

Level: Journeyman · More Python terms at this level

Updated