C Task Materials of Initial PHASE1 and Final PHASE3 Phases

Phase 1 was conducted at the beginning of the semester, and Phase 3 was conducted at the end of the semester.

C.1 Pre-Task Questionnaire (for PHASE1 and PHASE3)

(The following items are adapted from Collins-Thompson et al. (2016).)

  1. How much do you know about this topic?
    (1) nothing | I know a lot (5)

  2. How interested are you to learn more about this topic?
    (1) not at all | very much (5)

  3. How difficult do you think it will be to search for information about this topic?
    (1) very easy | very difficult (5)

(The following items are adapted from Crescenzi (2020).)

Indicate your agreement with the following statements.

(1) Strongly Disagree | Neutral | Strongly Agree (5)

  1. I am interested to learn more about the topic of this task.

  2. I know a lot about this topic.

  3. I can write a good summary now without needing to look for information.

  4. It will be difficult to determine when I have enough information to write my summary.

  5. I think this will be a difficult task.

  6. I am confident I know (or can find) adequate information to write a good summary.

C.2 Post-Task Questionnaire (for SES1 and SES3)

(The following items are adapted from Collins-Thompson et al. (2016).)

Indicate your agreement with the following statements.

(1) Not at all | Unlikely | Somewhat | Likely | Very Likely (5)

Search for information exploration:

  1. I was cognitively engaged in search task.
  2. I made an effort at performing the search task.
  3. The time for search was spent productively on meaningful tasks.
  4. I was able to explore relationships among multiple concepts.
  5. I was able to expand the scope of my knowledge about the topic.
  6. I feel that I was able to put together pieces of information into one big concept.

Learner interest and motivation:

  1. I feel that I have full understanding of the topic of this task

  2. I became more interested in this topic.

  3. I would like to find more information about this topic

  4. I would like to share what I learned with my people I know.

  5. I feel that I learned useful information as a result of this search.

  6. I was able to develop new ideas or perspectives.

Perceived learning and search success:

On a scale of 0 - 100

  1. How would you grade your learning outcome?

  2. How would you grade your search outcome?

(The following items are adapted from Crescenzi (2020).)

Indicate your agreement with the following statements.

(1) Strongly Disagree | Neutral | Strongly Agree (5)

  1. Overall, it was difficult to search for information to make the summary.

  2. It was difficult to determine search terms to use to find relevant information.

  3. It was difficult to decide whether to continue inspecting the search results or to search again.

  4. It was difficult to choose which search results to view.

  5. It was difficult to determine when to stop looking for information.

  6. I would have preferred to think longer about my summary.

  7. If I had more time, I would have considered more information.

  8. I felt anxious while completing this task.

  9. I did not have enough time.

  10. It was difficult to decide which sources to select.

  11. I felt hurried or rushed during this task.

  12. I had adequate information to make a good summary.

  13. I felt I had enough information.

  14. My understanding of the topic was no longer changing.

  15. I collected enough information to make a summary.

  16. I was no longer learning about the topic.

  17. I felt I had adequate information to make a summary.

  18. I was focused on getting information about one thing.

  19. I felt continuing the search was a waste of time, as the same information was showing up.

  20. I had a list of certain things I was interested in.

  21. I stopped searching because I was not finding new information.

  22. I stopped searching when I had an option that satisfied the things that were important to me.

  23. I only considered looking for the piece of information most important to me.

  24. I kept finding the same information in every search.

  25. My view of the topic was no longer changing.

  26. I was most concerned about finding information on one specific aspect.

References

Collins-Thompson, K., Rieh, S. Y., Haynes, C. C., & Syed, R. (2016). Assessing learning outcomes in web search: A comparison of tasks and query strategies. Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval, 163–172.
Crescenzi, A. M. C. (2020). Adaptation in Information Search and Decision-Making under Time Pressure [PhD thesis, The University of North Carolina at Chapel Hill University Libraries]. https://doi.org/10.17615/YT6K-AC37