In a world increasingly shaped by innovation and collaboration, libraries are no exception. As part of the LibrarIN project, Deliverable D4.2 Questionnaire Design & Cognitive testing is not your typical research report – it doesn’t present data or conclusions, but rather, it takes you behind the scenes of how we designed a sophisticated tool to understand the innovation and co-creation activities taking place in libraries across nine EU countries.
This technical report outlines the step-by-step development of three carefully crafted questionnaires aimed at gathering both descriptive data and deeper insights to support future econometric analysis. Our focus? University libraries, main public (often municipal) libraries, and public branch libraries in Austria, Belgium, Denmark, Finland, France, Germany, Greece, the Netherlands, and Spain.
One Size Doesn’t Fit All
Early research for the LibrarIN conceptual framework (Deliverable 2.1) and Work Package 4 revealed significant differences in how different types of libraries innovate and make decisions. As such, a single, catch-all survey would not suffice. We developed three tailored questionnaires, each aligned with the specific context and needs of:
- University libraries
- Main public libraries
- Branch public libraries
Building on Strong Foundations
The questionnaire design was informed by previous work in the field. In fact, 57% of the questions are adapted from earlier surveys (with necessary modifications for library settings), while the remaining 43% are entirely new. Key inputs included:
- The LibrarIN conceptual framework
- The D4.1 report (Mapping of existing studies & metrics) reviewing existing library innovation surveys
- A broad assessment of public sector innovation research
While the surveys aim to address many of LibrarIN’s research questions – such as types of innovation, user involvement, and innovation outcomes – not all could be covered due to length constraints and the complexity of some topics. To maximise data quality, respondents at university and main public libraries were asked to reflect on a single, self-selected innovation. This focused approach is in line with best practices outlined in the Oslo Manual (Eurostat/OECD, 2018).
Three Versions, Multiple Revisions
Each questionnaire went through an iterative review process. Drafts prepared by Maastricht University (UM) were circulated among all project partners for feedback. Revisions were made based on collective input:
- 2 major revisions for the university library questionnaire
- 3 for the main public library version
- 1 for the branch library version
To encourage participation, the questionnaires were kept as concise as possible:
- 109 items for university libraries
- 92 for main public libraries
- 62 for branch libraries
Cognitive Testing Across Europe
With the draft questionnaires ready, the next step was to test their clarity and usability. Cognitive testing was carried out through 36 interviews in Belgium, Denmark, France, the Netherlands, and Spain. Library managers were asked to talk through their understanding of the questions to identify potential ambiguities or confusion. Based on their feedback, most questions were refined – except for a few that had been previously validated in earlier studies like the 2019 Co-Val project.
Translation and Implementation
After final adjustments, the English versions were translated into the seven relevant national languages. These questionnaires will be made available online. A version for national libraries was also developed but won’t be used due to the limited sample size.
The target sample includes 2,000 library managers, with the goal of achieving a 40% response rate. So far, as of 30 October 2024, 1,970 questionnaires have been sent out, and 376 completed responses have been received – a response rate of 19.1%. The survey rollout began in May 2024 and continued through October, using a combination of postal and online distribution methods to increase participation.
What’s Next?
While this report doesn’t yet reveal findings, it lays the groundwork for high-quality, cross-country data collection on how libraries innovate and co-create with their users. It’s a significant step towards understanding the evolving role of libraries in our communities – and ensuring they remain vibrant hubs of knowledge and innovation.
Download Deliverable D4.2 to explore the full methodology and survey design.