I did a pilot with the survey and have analyzed the data using Classical test theory (CTT), which enabled me to reduce the number of questions (items) from 50 to 17, keeping only the most useful items. I’ll soon analyze pilot data also with factor analysis and IRT, and use think-aloud protocols to help formulate the questions in an understandable way. Then the survey will be ready for the most important data collection point, in August.

My supervisors had warned me right from the start that there would be changes in my research design along the way, for various reasons. So I wasn’t too surprised when I heard last week about a scheduling change in the course that I’ll be collecting data from. Starting with the 2020 cohort, the course will be held in the spring semester instead of the fall semester, making it hard to compare these students with others classes. So, I had to make the first major change in my research design.

It took a few days for me to wrap my head around what this schedule change would entail for my research. Somehow this process ended up with a plan to write 4 articles instead of 3, and collecting data at 12 different points in time. Wish me luck!