Ingenio's research evaluation team investigates methods to assess the diverse contribution of research, with a special focus on the socio-economic impact of research and the processes of knowledge exchange among researchers and stakeholders. A unique characteristic of Ingenio's evaluation is the combination of qualitative and quantitative research methods. In particular we have expertise in interview techniques, survey design and analysis and quantitative analyses, including scientometrics and econometrics. The team collaborates with major centres in research evaluation including CWTS (Leiden University), Rathenau Institute, SPRU (University of Sussex) or the School of Public Policy (Georgia Institute of Technology), and leading experts such as Barry Bozeman (Arizona State University) and Nabil Amara (Laval University). The team is led by Jordi Molas-Gallart, editor of the journal Research Evaluation, and chair of the Science Europe Working Group on Research Policy and Programme Evaluation.
Areas of interest
- Assessing the value and socio-economic impact of research
- Evaluative scientometrics, science mapping and collaboration networks
- Evaluation strategies and the design and use of indicators
- MoRRI (Monitoring of Responsible Research and Innovation) (2014-2018). Richard Woolley, Ismael Rafols, Jordi Molas-Gallart. European Commission Tender led by Technopolis (~240,000€).
- EXTRA (Scientific excellence and knowledge transfer, two riding together? organisational factors, individual antecedents and societal impact). (2014 to 2016), Elena Castro-Martinez, Carolina Cañibano Sanchez, Ismael Rafols, Pablo D'Este and Richard Woolley. Spanish Ministry of Economy and Competitiveness (~100,000€).
- PRESTENCE-España: Spanish University from Prestige to Excellence: an international comparison (2014-2017). Jordi Molas-Gallart and Carolina Cañibano (72,000€)
- RISIS - Research Infraestructure for Science and Innovation Studies. (2014-2017). Carolina Cañibano and Jordi Molas-Gallart. European Commission (~100,000€).
- Mapping and assessment of research portfolios (2013 to 2017). Ismael Rafols, European Commission (~100,000€).
- Mapping the Population, Careers, Mobilities and Impacts of Advanced Research Degree Graduates in the Social Sciences and Humanities (POCARIM) . (2012 to 2014). Carolina Cañibano, Richard Woolley, Elena Castro and Adela García. European Commission (~100,000€).
Assessing the value and socio-economic impact of research
- Molas-Gallart, J. (2015). Research evaluation and the assessment of public value. Arts and Humanities in Higher Education, 14: 116-126.
- Molas-Gallart, J., D’Este, P., Llopis, Ó. and Rafols, I. (2014) Towards an alternative framework for the evaluation of translational research initiatives . Ingenio Working papers No. 2014-03.
- Wallace, M.L., Rafols, I., (2014). Research portfolios in science policy: moving from financial returns to societal benefits. SSRN preprints.
- Martínez, C., Azagra-Caro, J.M., Maraut, S. (2013). Academic Inventors, Scientific Impact and the Institutionalisation of Pasteur's Quadrant in Spain. Industry and Innovation, 20(5), 438 - 455
- Jiménez-Sáez, F., Zabala-Iturriagagoitia, J.M., Zofío, J.L. (2013). Who leads research productivity growth? guidelines for R&D policy-makers. Scientometrics 94(1), 273-303.
- Molas-Gallart, J., & Tang, P. (2011). Tracing ‘productive interactions’ to identify social impacts: an example from the social sciences. Research Evaluation, 20(3), 219-226.
- Cortés-Aldana, F., Garcia-Melón, M., Fernández-de-Lucio, I.; Aragonés-Beltrán,P., Poveda-Bautista, R. (2009). University objectives and socioeconomic results: A multicriteria measuring of alignment. European Journal of Operational Research, 199(3), 811 – 822
Evaluation strategies and the design and use of indicators
- Sánchez-Barrioluengo, M. (2014) Articulating the ‘three-missions’ in Spanish universities. Research Policy, 43(10), 1760-1773
- Molas-Gallart, J. (2012) Research governance and the role of evaluation: a comparative study. American Journal of Evaluation, 33(4), 577 – 592.
- Rafols, I., Leydesdorff, L., O’Hare, A., Nightingale, P. and Stirling, A. (2012) How journal rankings can suppress interdisciplinarity. The case of innovation studies in business and management. Research Policy, 41(7), 1262–1282. Postprint. William Page Best Paper Award in the 2011 Atlanta Science and Innovation Conference. See comment in Paul Wouters' blog.
- Molas-Gallart, J., Castro-Martínez, E. (2007), Ambiguity and conflict in the development of “Third Mission” indicators. Research Evaluation, 16 (4), 321-330.
The value and socio-economic impact of social science and humanities
- Olmos-Peñuela, J., Benneworth, P., Castro-Martínez, E. (2015). Are sciences essential and humanities elective? Disentangling competing claims for humanities’ research public value. Arts & Humanities in Higher Education, 14, 61 - 78.
- Olmos-Peñuela J., Benneworth P., Castro-Martínez E. (2014). Are ‘STEM from Mars and SSH from Venus’?: Challenging disciplinary stereotypes of research’s social value. Science and Public Policy, 41 (3), 384 - 400
- Olmos-Peñuela, J., Castro-Martínez, E., & D’Este, P. (2014). Knowledge transfer activities in social sciences and humanities: Explaining the interactions of research groups with non-academic agents. Research Policy, 43(4), 696-706.
- Olmos-Peñuela J., Molas-Gallart J., Castro-Martínez E. (2013). Informal collaborations between social sciences and humanities researchers and non-academic partners. Science and Public Policy, 41(4), 493-506
Evaluative scientometrics, science mapping and collaboration networks
- Villanueva-Felez, A., Woolley, R., & Cañibano, C. (2015). Nanotechnology researchers’ collaboration relationships: A gender analysis of access to scientific information. Social Studies of Science, 45(1), 100-129.
- Woolley, R., Sánchez-Barrioluengo, M., Turpin, T. and Marceau J. (2014) Research collaboration in the social sciences: What factors are associated with disciplinary and interdisciplinary collaboration?. Science and Public Policy (online), doi: 10.1093/scipol/scu074
- Kay, L., Newman, N., Youtie, J., Porter, A.L., Rafols, I., (2014). Patent Overlay Mapping: Visualizing Technological Distance. Journal of the American Society for Information Science and Technology, 65 (12), 2432-2443.
- Villanueva-Félez, A., Molas-Gallart, J., Escribá-Esteve, A. (2013). Measuring Personal Networks and Their Relationship with Scientific Production. Minerva, 51(4), 465-483.
- Barberá-Tomás, D., Jiménez-Sáez, F., Castelló-Molina, I. (2011). Mapping the importance of the real world: The validity of connectivity analysis of patent citations networks. Research Policy 40(3), 473–486.
- Rafols, I., Porter, A.L. and Leydesdorff, L. (2010) Science overlay maps: A new tool for research policy and library management. Journal of the American Society for Information Science and Technology, 61(9), 871–1887.