Research on Research Institute (RoRI) launches to enable more strategic, open, diverse, and inclusive research

    Today, we’re proud to announce the launch of the Research on Research Institute (RoRI) – an international consortium of research funders, academic institutions, and technologists working to champion the latest approaches to research on research. 

    Co-founded by the Wellcome Trust, the universities of Sheffield and Leiden, and Digital Science, the RoRI consortium will undertake transformative and translational research on research (also known as meta-research, science of science or meta-science). By analysing research systems and experimenting with decision and evaluation data, tools and frameworks, we aim to advance more strategic, open, diverse and inclusive research.

    In support of its overall vision for transformative and translational research on research, RoRI has five objectives:

    • To support, expand and build capacity for interdisciplinary, mixed-methods research on research (RoR) in the UK and internationally;
    • To connect academic capabilities to the data and analytical resources of Wellcome, Digital Science and RoRI’s wider consortium of strategic partners;
    • To co-design, experiment and apply new tools, indicators, funding modes, prioritisation and evaluation frameworks; 
    • To critically evaluate RoR methods and support engagement with data and evidence about research systems by decision makers and society;
    • To create an independent space for learning, networking and collaboration between researchers, policymakers, funders & technologists.

    RoRI will be based for an initial two-year incubation phase at Wellcome’s offices in London. To date, ten strategic partners have expressed their interest in becoming part of the RoRI consortium, including private foundations, academic research institutions, and public funding agencies from eight countries – Austria, Canada, Denmark, Germany, India, Netherlands, Switzerland, and the USA.

    Together, the consortium will codesign projects and share data to inform comparative analysis of research systems and cultures, and develop, test and apply novel approaches to decision-making, prioritisation, allocation and evaluation.

    RoRI’s activities will include partnership projects, a rolling programme of research seminars and webinars, as well as regular reports, working papers and think-pieces. All of its research methodologies and findings will be made openly available. Within RoRI, funders and academic research institutions will also be able to access and use a secure data platform, hosted and managed by Wellcome as a neutral convenor and broker. This will provide a trusted space, where funders and academic research institutions can securely share data, policies and practices for primary research and experimentation.

    The following have expressed their interest in becoming part of the RoRI consortium; Austrian Science Fund; a consortium of Canadian funders including British Columbia’s Michael Smith Foundation for Health Research and Canadian Institutes of Health Research; Dutch Research Council (NWO); Howard Hughes Medical Institute (HHMI); Novo Nordisk Foundation; Albert P. Sloan Foundation; Swiss National Science Foundation; Wellcome Trust/DBT India Alliance; and Volkswagen Foundation. Over the coming months, RoRI hopes to expand the consortium to include additional funders, publishers, and learned and professional societies as partners.

    Chonnettia Jones, Co-Chair of RoRI and Director of Insight and Analysis at Wellcome, said: “Wellcome wants to distribute its funding in the most efficient, fair, effective, and beneficial ways possible to achieve our mission of improving health for everyone. To that end, Wellcome has joined the universities of Sheffield and Leiden, and Digital Science, to launch a Research on Research Institute (RoRI), an international consortium of funders, policymakers, academics and technologists working in collaboration to advance Research on Research. We wish to encourage research that helps us to better understand our own funding practices and policies – and those of other funders – and how they can be improved to enable research and innovation.”

    James Wilsdon, Director of RoRI and Digital Science Professor of Research Policy at the University of Sheffield said: “Worldwide, interest is intensifying in how research is funded, practiced and evaluated, and in how research systems can be made more efficient, open, inclusive and impactful. Research on research isn’t new – there is a wealth of excellent work to build on – but it can be poorly joined-up and applied in policies and practices. Working with our consortium of partners, who together invest several billion pounds a year in research, RoRI has a unique opportunity to co-design new methods, and experiment with creative approaches to decision making, prioritisation and evaluation.”  

    Daniel Hook, Co-Chair of RoRI and CEO of Digital Science said: “Digital Science is committed to empowering all those involved in research with the right tools – either to improve their research or to improve the ecosystem that supports research. RoRI is a unique ‘experiment’ that brings together perspectives from all stakeholders in research to understand how research on research can be translated to improve all aspects of global research capabilities. It is a pleasure to participate in such an exciting initiative.”

    Sarah de Rijcke, Co-Chair of RoRI, Professor in Science and Evaluation Studies and Director of the Centre for Science and Technology Studies (CWTS) at Leiden University said: “Science and innovation systems are changing rapidly to meet global challenges. These changes often go together with heated debates about the value and reliability of science and scholarship. At CWTS, we are thrilled to bring to RoRI our decades’ worth of experience in analysing the research system and its connections to technology, innovation, and society. RoRI combines know-how and innovation capacity at an unprecedented scale. This creates new and exciting opportunities for research on research, and for fostering a more open, collaborative, and impactful scientific enterprise.”

    Today RoRI is also pleased to announce the publication of its first of what will become a regular series of working papers:

    • The 21st Century PhD: Why we need better methods of tracking doctoral access, experiences and outcomesby Sally Hancock and Paul Wakeling
    • AI-Assisted Peer Review: opportunities, biases and uncertainties by Alessandro Checco, Lorenzo Bracciale, Pierpaolo Loreti and Giuseppe Bianchi

    Also, we are today launching a RoRI research funding landscape tool, which has been developed by Ludo Waltman and colleagues at CWTS-Leiden, together with a report that discusses how the tool can be used to support priority setting. 

    Working papers and further information about RoRI will be available from 00.01 on 30 September 2019 at

    The funding landscape tool is available here: (all sciences) (only biomedical and health sciences)