Flipped students

I have mandatory work as a part of my position as a PhD-student here at UiT. Instead of doing a full-time PhD in three years (the norm in Norway), my PhD-stipend is for four years. This is because 25% of my time goes to duty work. So today I had my first students in the classroom! It felt great to be with students again – I’ve missed teaching!

They were first year psychology students, with a “flipped classroom” course on academic skills (learning, thinking and writing). Instead of having a lecture with a teacher in the classroom, they watch pre-recorded lectures, take a quiz, and do some exercises in order to prepare for a seminar in the classroom.

The 220 students are divided into 8 groups, and I guide one the groups through some exercises/groupwork based on the material they’ve learned. It went well, and the students participated eagerly in the active learning process.

So after 10 months doing research in my office, wondering why I’m getting paid, I finally feel like I’m doing something that’s useful to others!

The survey is out!

I’m now collecting data with a pretest which measures students’ levels of IL and their interest in becoming information literate people, before IL-instruction from the library. Yesterday I introduced this survey to a class with 220 new psychology students, explaining what it measures, why it’s important that they contribute, and telling about the prize that they can win if they participate!

I’ve also sent info and a link to the survey to all teaching librarians here at UiT, and to library directors and/or librarians at all other Norwegian colleges and universities! I’ve made some contacts here and there over the years, so I hope that helps.  And most of all, I hope that students answer the survey, so I have some data to work with. No data, no PhD…

It takes a lot of work and logistics to carry out a survey like this. I must admit, I’m somewhat envious of PhD-students who don’t have to collect their own data! Many just receive a data-set from a researcher who hasn’t had time to analyze some aspect of it. They save potentially a year or more of their research time! Nearly half of the PhD-students in my statistics class had their data served to them in this manner. I think that this is quite common in medicine and psychology.

It’s not just collecting the data that takes time in the beginning stages, it’s also the development of the measuring tools, of course. I started developing the survey in February, and finished now in August. Survey items must be developed based on theory, all items must be piloted, and those results must be analyzed using several statistical analyses, before the final selection of survey items can be made (and later defended).

Besides the survey, I’ll also be using 2 other measurement tools, but these measures have been developed by others, and I’ll only make slight changes before I use them. I’ll write more about these in another blog-post.

On another note – one of my supervisors, Torstein Låg, together with colleague Rannveig Grøm Sæle, has just published a research article called: “Does the Flipped Classroom Improve Student Learning and Satisfaction? A Systematic Review and Meta-Analysis”. https://doi.org/10.1177/2332858419870489   Congratulations Torstein and Rannveig! Good work! 🙂

Decision made

After a productive meeting with my supervisors today, I’ve decided to use my own survey items instead of those in a similar survey. I have, after all, come farther in testing the validity of my items, so I know that they’ll be useful in measuring students’ levels of information literacy.

And as of 5 PM, the first survey is out! Phew… What a day!

 

Frustration

It’s over 2 months since my last post. I’ve been working on my research, but I’ve also taken some vacation. Even PhD-students need a little time off!

After lots of hard work formulating survey questions, getting expert opinions and think-aloud responses from students about the questions, doing a pilot survey and analyzing the results with several statistical tests to decide which questions to keep, working out the logistics of survey distribution this fall (the plan was to start collecting data tomorrow!) – I just got a major blow. After all that work, I just found an article by a PhD-student in England who did the exact same thing that I’ve been trying to do! She beat me to it!

I’ve been attempting to make a relatively short, openly available test of information literacy that could assess students’ knowledge and abilities, independent of their study or location. (Other IL-tests out there are mostly either discipline-or geographically-specific, or they’re not free.) I was going to translate my survey into English and publish it as a data-set on an open-access platform that others could freely use, so that it could possibly become a standard for comparing different populations.

But another researcher has just done exactly this. I read her article on Thursday – 3 days ago – and realized that her survey and the articles she’s written about its purpose, development and face-validation, were exactly the articles that I was planning on writing. It’s all been done. I could kick myself for not reading her article before. It was published in February ’19 and has been in my EndNote-library since March. But since I’ve been so busy with course work and piloting my survey, I hadn’t read it until now. Kick, kick…

Nothing against her! Her articles and survey are really good! I just wish that I’d read them a few months ago.

I’ve been told that this sort of thing happens now and then in the world of research – that someone else has done similar research to your own and publishes it before you. But it doesn’t make it any easier.

My supervisors, who are amazingly positive people, are trying to turn this around into something, well, positive. Maybe I can collaborate with her, or use (some of) her survey questions, or translate her survey and validate it with Norwegian students?

And to be more precise, there are some differences between our surveys. Hers is for all adults, not just students, although she does have an add-on for higher education. And I’ve come further than her by piloting my survey and statistically analyzing the results, so I know that my questions are neither too easy nor too hard, and that they contribute to distinguishing between students with different levels of IL. Also, in my research I’ll be comparing the results of the survey (what the students KNOW about IL), with what they actually DO in their course work (how they evaluate and use their sources of information). This comparison is a form of criterion validity. (There are several different ways of validating research: face validity, content validity, criterion validity, and probably more…) So the survey is just one of three measuring tools that I’ll be using, and its development is not the sole purpose of my research. Somewhat consoling…

And just to make navigating my life even more excruciatingly difficult, my job in Hamar is now available (I have a 4-year leave-of-absence to do my PhD, and my temporary replacement is switching to another job), and my house, until yesterday, was empty (between 2 tenants)! The thought of quitting crossed my mind, I must admit, but I’m not going to give up! I’m committed to this. I have great supervisors, and I can do it. (I hope.)

So now the question is: HOW SHOULD I SOLVE THIS PROBLEM?  Should I use her questions or mine? The survey is due to go out this week. This is the biggest data collection period for my entire PhD research. And I don’t know what which survey to use.

To be continued…