How do you define and measure the impact of translational research?
Impact is the ultimate goal of translational research, as it reflects the extent to which the research contributes to the improvement of human health and well-being, as well as the advancement of scientific knowledge and innovation. Impact can also justify the investment and resources allocated to translational research, and demonstrate the accountability and relevance of the research to the society and the funders. Therefore, measuring impact can help evaluate the performance and quality of translational research, and inform decision-making and priority-setting.
-
Sumeet Pandey, PhD
Translational Immunology & Omics 3x LinkedIn TopVoice
It involves assessing the successful integration of scientific discoveries into practical applications that benefit society. Key indicators include advancements in patient outcomes, successful commercialization of innovations, and contributions to the broader scientific community. Rigorous evaluation frameworks encompass quantitative metrics, such as citation indices and patent citations, as well as qualitative assessments of societal impact and improvements in healthcare delivery. A comprehensive approach considers the entire translational pathway, from basic research to clinical implementation, to gauge the effectiveness of translating scientific knowledge into tangible benefits for individuals and communities.
-
Zeshaan Maan
Plastic & Reconstructive Surgeon @Maan Plastic Surgery || Regenerative Medicine Scientist || Stanford GSB (Ignite) Alumnus
Determining how to measure this impact can be challenging. In many ways, the successful application of principles discovered through basic science research to a specific clinical or health problem (i.e. translational research), helps validate the impact of that discovery. Similarly, successful clinical trials that have been designed based on the findings of translational research determine the true impact of that translation.
Impact can be understood and measured in different dimensions, depending on the perspective and purpose of the evaluation. For example, scientific impact looks at the influence of research on the generation and dissemination of new knowledge, methods, and theories. Health impact considers the effect of research on the prevention, diagnosis, treatment, and management of diseases and conditions. Economic impact looks at the contribution of research to the creation and growth of wealth, productivity, and competitiveness. Lastly, social impact focuses on the impact of research on the enhancement of social welfare, justice, and engagement. All these dimensions can be evidenced by publications, citations, patents, awards, collaborations, clinical trials, guidelines, health policies, health services, commercialization, innovation, job creation, cost-effectiveness analysis, changes in attitudes, behaviors, norms, values, stakeholder involvement, public awareness and advocacy.
Measuring impact is a complex and challenging task, as it requires the identification and collection of data, the selection and application of methods and tools, and the interpretation and communication of the results. Common methods and tools for measuring impact include bibliometrics, altmetrics, logic models, case studies, surveys, and indicators. Bibliometrics involves the quantitative analysis of publications and citations. Altmetrics measure online attention and engagement with the research. Logic models are graphical representations of inputs, activities, outputs, outcomes, and impacts. Case studies are in-depth descriptions of specific examples of impact. Surveys collect self-reported data from researchers or stakeholders about their perceptions. Indicators are measures that reflect progress or achievement of impact.
Despite the availability and diversity of methods and tools for measuring impact, there are still some limitations and challenges that need to be addressed. One of these is the attribution problem, which refers to the difficulty of establishing a causal link between the research and the impact when multiple factors and actors are involved. Additionally, there is the time lag problem, where the realization of the impact can take months to years or even decades after the research is completed. Furthermore, there is the context problem, which highlights how the impact can vary across different settings, populations, and cultures. There is also the value problem, which refers to the subjectivity and heterogeneity of value judgments and preferences of different stakeholders that can influence how impact is defined and assessed. Lastly, there is the data problem, which involves issues with availability, accessibility, quality, and consistency of data needed to measure impact as well as ethical and legal issues related to data collection and use.
-
Paula Castro
Visión, cultura y estrategia para centros de investigación científica
Something important when assessing impact, aside from bibliometrics, is to focus on measuring the processes that facilitate the transfer of scientific knowledge to society. This impact manifests through scientists engaging in policy design, collaborating with civil society groups, when research organizations conduct workshops for local service providers and the like. This approach is also beneficial for addressing the time lag issue in impact assessment as it considers the intermediary steps involved in the process.
To overcome some of the limitations and challenges of impact measurement, it is important to adopt a mixed-methods approach which combines quantitative and qualitative methods and tools. Stakeholders should be engaged in the design, implementation, and dissemination of the impact measurement, as well as incorporating their feedback and perspectives. It is also important to align with existing or developing new frameworks that provide guidance and standards for defining and measuring impact. Building capacity among researchers and evaluators on how to measure impact effectively and efficiently is also key. Finally, results should be reported and disseminated in a clear, concise, and accessible way, with an emphasis on implications and recommendations for future research and practice.
Rate this article
More relevant reading
-
Translational ResearchWhat are the common barriers and facilitators of translational research in low- and middle-income countries?
-
Research ManagementHow can you assess the impact of translational research on stakeholders?
-
Research ManagementWhat are the key principles for a collaborative and interdisciplinary translational research project?
-
ResearchHow can you report translational research evaluation results effectively?