Data 3-6 String and Date Formatting

Pandas: Parsing Dates and formatting strings

Challenge 3-6-1.py

Let’s Build your first Data Pipeline

This data pipeline is similar to one I built to process poll responses in IST256. This one here is a little simpler with some extra rules so we can practice tying together what we learned in the unit.

Professor Xavier uses a polling app in class to track participation and attendance.

The Polling Application.

• When the professor posts a poll, students respond with letters A,B,C or D.

• The are several polls during his Wednesday class.

• When class is over a file is generated poll-responses-YYYY-mm-dd.csv it contains every poll response during that class session.

• There is a file roster.csv which contains the list of students in the class.

• There are 4 weeks of polling records.

Grading:

• If the student records no poll responses for the session, the student in absent AB

• If the student records less than 50% poll responses, the student is a non-participant np

• otherwise +

Your Task:

• Build a data pipeline to read in the roster and poll responses then create this dataset:

  • student information

  • date of polling session

  • number of polls during session

  • number of polls student answered during session

  • label indicating if the student was absent or non participant

• streamlit UI where you can select a student and see their polling data and grade

• from the dataset, generate a CSV file for upload into for X-Menboard LMS:

  • one row per student

  • total class sessions

  • total absences AB

  • total non-participant np

  • pct of sessions AB or np