From b6eb84c09c8d9d0f32e696ce5ac4a7f84dd5210c Mon Sep 17 00:00:00 2001 From: Petros Stavropoulos Date: Tue, 16 Sep 2025 15:41:41 +0300 Subject: [PATCH 1/3] add operationalization details for PathOS case studies across multiple indicators --- .../1_open_science/availability_data_repositories.qmd | 9 ++++++++- .../availability_preprint_repositories.qmd | 7 +++++++ .../availability_publication_repositories.qmd | 7 +++++++ .../prevalence_open_access_publishing.qmd | 7 +++++++ sections/2_academic_impact/citation_impact.qmd | 10 ++++++++++ .../2_academic_impact/extra-academic_collaboration.qmd | 7 +++++++ sections/2_academic_impact/thematic_persistence.qmd | 7 +++++++ sections/2_academic_impact/use_of_data_in_research.qmd | 9 ++++++++- sections/3_societal_impact/OS_access_advantage.qmd | 7 +++++++ sections/3_societal_impact/scientific_literacy.qmd | 7 +++++++ .../uptake_and_impact_on_societal_issues.qmd | 9 ++++++++- sections/3_societal_impact/uptake_by_media.qmd | 7 +++++++ .../3_societal_impact/uptake_by_patient_groups.qmd | 9 ++++++++- sections/3_societal_impact/uptake_by_policy_makers.qmd | 7 +++++++ sections/3_societal_impact/uptake_in_education.qmd | 9 ++++++++- .../3_societal_impact/uptake_in_medical_practice.qmd | 9 +++++++++ .../3_societal_impact/uptake_in_the_legal_sector.qmd | 7 +++++++ sections/4_economic_impact/cost_savings.qmd | 7 +++++++ sections/4_economic_impact/innovation_output.qmd | 7 +++++++ .../science_industry_collaboration.qmd | 10 ++++++++++ .../5_reproducibility/reuse_of_code_in_research.qmd | 9 ++++++++- .../5_reproducibility/reuse_of_data_in_research.qmd | 7 +++++++ 22 files changed, 168 insertions(+), 6 deletions(-) diff --git a/sections/1_open_science/availability_data_repositories.qmd b/sections/1_open_science/availability_data_repositories.qmd index 2e5b15c..2e7b216 100644 --- a/sections/1_open_science/availability_data_repositories.qmd +++ b/sections/1_open_science/availability_data_repositories.qmd @@ -80,4 +80,11 @@ It can be difficult to obtain data on all existing data repositories, given the ##### Core Trust Seal -Core Trust Seal is a non-profit organisation that labels data sources with their seal if data sources adhere to the FAIR principles. On the website a [list](https://amt.coretrustseal.org/certificates/) is maintained with all the data sources that the seal has been assigned to. Data stored in these sources can thus be considered to be produced in accordance with the FAIR principles. When performing research related to the availability of data repositories, one can consider repositories that have received the CoreTrustSeal, the Nestor Seal DIN31644, the ISO16363 certification, or similar, to be automatically trusted [@jahn2023]. \ No newline at end of file +Core Trust Seal is a non-profit organisation that labels data sources with their seal if data sources adhere to the FAIR principles. On the website a [list](https://amt.coretrustseal.org/certificates/) is maintained with all the data sources that the seal has been assigned to. Data stored in these sources can thus be considered to be produced in accordance with the FAIR principles. When performing research related to the availability of data repositories, one can consider repositories that have received the CoreTrustSeal, the Nestor Seal DIN31644, the ISO16363 certification, or similar, to be automatically trusted [@jahn2023]. + +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- Effects of Data Repositories on Data Usage + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). \ No newline at end of file diff --git a/sections/1_open_science/availability_preprint_repositories.qmd b/sections/1_open_science/availability_preprint_repositories.qmd index 2b8d7ce..3b71dce 100644 --- a/sections/1_open_science/availability_preprint_repositories.qmd +++ b/sections/1_open_science/availability_preprint_repositories.qmd @@ -143,6 +143,13 @@ OpenAIRE Graph and Directory of Open Access Repositories (DOAR) (integrated in t All repositories in both data sources are Open Access. +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- French Open Access Infrastructure + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). + # Known correlates The availability of preprint repositories **may** correlate with specific fields of study, given that certain scientific disciplines are more inclined to use preprints than others. Furthermore, regional or national open science policies, funding opportunities, and research culture can also influence the presence or absence of preprint repositories in a particular country or region. diff --git a/sections/1_open_science/availability_publication_repositories.qmd b/sections/1_open_science/availability_publication_repositories.qmd index 5c60baa..f2e9b1e 100644 --- a/sections/1_open_science/availability_publication_repositories.qmd +++ b/sections/1_open_science/availability_publication_repositories.qmd @@ -68,6 +68,13 @@ OpenAIRE Graph and Directory of Open Access Repositories (DOAR) (integrated in t All repositories in both data sources are Open Access. +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- French Open Access Infrastructure + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). + # Known correlates Various factors **may** influence the availability of publication repositories in specific fields, countries, or organizations such as: research output, research funding, technological infrastructure, Open Access mandates, research collaboration, overall research infrastructure. diff --git a/sections/1_open_science/prevalence_open_access_publishing.qmd b/sections/1_open_science/prevalence_open_access_publishing.qmd index b6784dd..ea066e1 100644 --- a/sections/1_open_science/prevalence_open_access_publishing.qmd +++ b/sections/1_open_science/prevalence_open_access_publishing.qmd @@ -127,6 +127,13 @@ To facilitate interaction with the Unpaywall API there are also supporting packa Once we know the Open Access status of each publication, we can easily calculate the percentage, simply as the number of publications out of the total that are Open Access. Additionally, we can do this for each separate Open Access type. We could for example refer to the % Green OA or % Gold OA. Note that percentages may not add up to 100%, but the total may also even exceed 100%, because publications can have both a Green Open Access status and another Open Access status. For that reason, you should not report percentages of Open Access statuses in a cumulative fashion (e.g. not in a stacked bar chart), in particular not when reporting on Green Open Access. +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- French Open Access Infrastructure + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). + # Known correlates There is a large ongoing debate whether Open Access publishing increases the citation impact of publications, known as the so-called Open Access citation advantage. A recent systematic review on the topic suggests that the evidence is inconclusive [@langham-putrow2021]. diff --git a/sections/2_academic_impact/citation_impact.qmd b/sections/2_academic_impact/citation_impact.qmd index 78ecbbf..1110a6c 100644 --- a/sections/2_academic_impact/citation_impact.qmd +++ b/sections/2_academic_impact/citation_impact.qmd @@ -259,6 +259,16 @@ The database is closed access, and we therefore do not provide more details abou The database is closed access, and we therefore do not provide more details about API usage. +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- Impact of Artefact Reuse in COVID-19 Publications +- Impact of Open Access Routes on Topic Persistence +- Portuguese Repository Infrastructure RCAAP +- ELIXIR´s Bioinformatics Resources + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). + # Known correlates As already clarified, citations are affected in general by field and publication year, and these are quite clearly causal effects. There are many other factors that correlate with citations [@onodera2015], for which most it is unclear whether the effect is causal. One factor that is consistently associated with more citations is collaboration [@larivière2015], which is potentially driven by network effects [@schulz]. In addition, there is evidence for a clear causal effect of the journal where something is published on citations [@traag2021]. diff --git a/sections/2_academic_impact/extra-academic_collaboration.qmd b/sections/2_academic_impact/extra-academic_collaboration.qmd index 08639ea..0f0b5d8 100644 --- a/sections/2_academic_impact/extra-academic_collaboration.qmd +++ b/sections/2_academic_impact/extra-academic_collaboration.qmd @@ -150,3 +150,10 @@ The four types of non-academic organisations and the six types of possible colla The data sources described in the previous section can be used to populate this double entry table for a given piece of research, a set of researches or (even more interestingly) several sets of researches whose different collaboration-profile can be assessed comparing their value for each of the cell, row or column as well as for the entire table. In particular, all the metrics matrix and the data source described above can be employed to assess collaboration in OS but also in non-OS projects, allowing to investigate whether open science is less or more prone to facilitate specific types of collaboration. Similarly, the comparison can be carried out by disciplinary field, type of research, project size or duration, type of funding, etc. + +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- ELIXIR´s Bioinformatics Resources + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). diff --git a/sections/2_academic_impact/thematic_persistence.qmd b/sections/2_academic_impact/thematic_persistence.qmd index 0377cfe..259c307 100644 --- a/sections/2_academic_impact/thematic_persistence.qmd +++ b/sections/2_academic_impact/thematic_persistence.qmd @@ -137,3 +137,10 @@ The continuity framework [@Yan2014ResearchDM] quantifies persistence by categori Continuity is evaluated by the **strength of inter-year linkages** among topic clusters.\ This allows distinguishing different **modes of persistence** and topic evolution. + +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- Impact of Open Access Routes on Topic Persistence + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). diff --git a/sections/2_academic_impact/use_of_data_in_research.qmd b/sections/2_academic_impact/use_of_data_in_research.qmd index 87b2b39..30e3fe5 100644 --- a/sections/2_academic_impact/use_of_data_in_research.qmd +++ b/sections/2_academic_impact/use_of_data_in_research.qmd @@ -113,4 +113,11 @@ Based on the data retrieval information from the data repositories one can compi ##### Standardization protocols -To combat the issue of standardization for the tracking of clicks/views/downloads of data use in research [The COUNTER Code of Practice for Research Data](https://www.countermetrics.org/code-of-practice/) gives guidance on how to standardize count systems for data use. The guidelines provided by The COUNTER Code of Practice for Research Data can be followed to make inquiries in data retrieval information more comparable among researchers. \ No newline at end of file +To combat the issue of standardization for the tracking of clicks/views/downloads of data use in research [The COUNTER Code of Practice for Research Data](https://www.countermetrics.org/code-of-practice/) gives guidance on how to standardize count systems for data use. The guidelines provided by The COUNTER Code of Practice for Research Data can be followed to make inquiries in data retrieval information more comparable among researchers. + +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- Effects of Data Repositories on Data Usage + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). \ No newline at end of file diff --git a/sections/3_societal_impact/OS_access_advantage.qmd b/sections/3_societal_impact/OS_access_advantage.qmd index 4a4ba86..b35853c 100644 --- a/sections/3_societal_impact/OS_access_advantage.qmd +++ b/sections/3_societal_impact/OS_access_advantage.qmd @@ -91,3 +91,10 @@ The indicator described in these pages is meant to be computed based on access d As an example, one can (1) focus on the scientific domains associated with the accessed resources and (2) aggregate the IP-related information in countries and industrial sectors, for example follwiong the NACE typology ([ec.europa.eu/eurostat/web/nace](https://ec.europa.eu/eurostat/web/nace)). This data structure allows to observe not only the general access advantage (or disadvantage) of different type of scientific ressource, but to break the calculation down to different combination of scientific domains, countries and industrial sectors, in order to facilitate comparison and detect potential confounding factors. + +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- French Open Access Infrastructure + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). diff --git a/sections/3_societal_impact/scientific_literacy.qmd b/sections/3_societal_impact/scientific_literacy.qmd index f1f4982..ec2e682 100644 --- a/sections/3_societal_impact/scientific_literacy.qmd +++ b/sections/3_societal_impact/scientific_literacy.qmd @@ -62,3 +62,10 @@ While the PISA instrument is not publicly available, the framework includes deta Besides the PISA instrument, there is a great variety of other instruments used to assess scientific literacy, commonly aligned with vision II and the PISA conceptualization. In general, the focus seems to have shifted from viewing scientific literacy as one single ability to defining it as a multidimensional construct. Most of the instruments' contents focus on a specific domain or context (e.g., biology), employing various formats to test skills. The majority of instruments have been developed for use in (secondary school) students and have mainly been employed in that context [@coppi2023; @opitz2017]. A relatively recent and broadly used instrument is the Test of Scientific Literacy Skills (TOSLS), developed to be a comprehensive and psychometrically sound measure that can be employed on a large scale. The TOSLS includes 28 multiple-choice questions presented through realistic scenarios and requiring respondents to use skills that relate to understanding scientific methods and interpreting data [@gormally2012]. The instrument is available as the supplement to @gormally2012. + +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- French Open Access Infrastructure + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). diff --git a/sections/3_societal_impact/uptake_and_impact_on_societal_issues.qmd b/sections/3_societal_impact/uptake_and_impact_on_societal_issues.qmd index 5653761..627f495 100644 --- a/sections/3_societal_impact/uptake_and_impact_on_societal_issues.qmd +++ b/sections/3_societal_impact/uptake_and_impact_on_societal_issues.qmd @@ -117,4 +117,11 @@ Given the complexity of the assessment described in these pages, the metrics sug ## Metrics for task 4 Open Science uptake - Number of references to OS resources in the statements and documents of each actor or actor type active on each societal issue. -- Ratio of OS over non-OS references to OS resources in the statements and documents of each actor or actor type active on each societal issue. \ No newline at end of file +- Ratio of OS over non-OS references to OS resources in the statements and documents of each actor or actor type active on each societal issue. + +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- French Open Access Infrastructure + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). diff --git a/sections/3_societal_impact/uptake_by_media.qmd b/sections/3_societal_impact/uptake_by_media.qmd index 1a6acf0..42e83d4 100644 --- a/sections/3_societal_impact/uptake_by_media.qmd +++ b/sections/3_societal_impact/uptake_by_media.qmd @@ -123,6 +123,13 @@ In addition to citation, views and download information, PlumX collects data fro - Wikipedia - Facebook +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- French Open Access Infrastructure + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). + # Known correlates Correlations among various measure of uptake by media have been studies [@fang2020]. \ No newline at end of file diff --git a/sections/3_societal_impact/uptake_by_patient_groups.qmd b/sections/3_societal_impact/uptake_by_patient_groups.qmd index 2937d73..7add2e4 100644 --- a/sections/3_societal_impact/uptake_by_patient_groups.qmd +++ b/sections/3_societal_impact/uptake_by_patient_groups.qmd @@ -100,4 +100,11 @@ This is an automated tool [@stavropoulos2023], leveraging Deep Learning and Natu To measure the proposed metric, the tool can be used to identify the reused and created OS inputs in the texts of the patient group websites / reports. -One limitation of this methodology is that it may not capture all instances of research artifacts if they are not explicitly mentioned in the scientific text. Additionally, the machine learning algorithms used by the tool may not always accurately classify whether a research artifact has been reused or created, and may require manual validation. \ No newline at end of file +One limitation of this methodology is that it may not capture all instances of research artifacts if they are not explicitly mentioned in the scientific text. Additionally, the machine learning algorithms used by the tool may not always accurately classify whether a research artifact has been reused or created, and may require manual validation. + +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- French Open Access Infrastructure + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). diff --git a/sections/3_societal_impact/uptake_by_policy_makers.qmd b/sections/3_societal_impact/uptake_by_policy_makers.qmd index 41d4c19..c0673ac 100644 --- a/sections/3_societal_impact/uptake_by_policy_makers.qmd +++ b/sections/3_societal_impact/uptake_by_policy_makers.qmd @@ -67,6 +67,13 @@ Overton was founded in 2019 also by Euan Adie. It is a novel database with the g Beyond the methodologies of the different data providers mentioned above (Overton and Altmetric), and other past applications related to the extractions of mentions to scientific concepts, there are no other large methodologies focused on extracting mentions to scientific publications or scholarly entities from policy sources. +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- French Open Access Infrastructure + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). + # Known correlates Previous studies have reported mostly positive weak correlations between policy citations and other metrics, including scholarly citations [@fang2024; @bornmann2016a; @szomszor2022]. \ No newline at end of file diff --git a/sections/3_societal_impact/uptake_in_education.qmd b/sections/3_societal_impact/uptake_in_education.qmd index f39439c..c666002 100644 --- a/sections/3_societal_impact/uptake_in_education.qmd +++ b/sections/3_societal_impact/uptake_in_education.qmd @@ -96,4 +96,11 @@ This is an automated tool [@stavropoulos2023], leveraging Deep Learning and Natu To measure the proposed metric, the tool can be used to identify the reused and created OS inputs in the texts of the educational material. -One limitation of this methodology is that it may not capture all instances of research artifacts if they are not explicitly mentioned in the scientific text. Additionally, the machine learning algorithms used by the tool may not always accurately classify whether a research artifact has been reused or created, and may require manual validation. \ No newline at end of file +One limitation of this methodology is that it may not capture all instances of research artifacts if they are not explicitly mentioned in the scientific text. Additionally, the machine learning algorithms used by the tool may not always accurately classify whether a research artifact has been reused or created, and may require manual validation. + +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- French Open Access Infrastructure + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). diff --git a/sections/3_societal_impact/uptake_in_medical_practice.qmd b/sections/3_societal_impact/uptake_in_medical_practice.qmd index 34b4364..0117f0b 100644 --- a/sections/3_societal_impact/uptake_in_medical_practice.qmd +++ b/sections/3_societal_impact/uptake_in_medical_practice.qmd @@ -108,6 +108,15 @@ To measure the proposed metric, the tool can be used to identify the reused and One limitation of this methodology is that it may not capture all instances of research artifacts if they are not explicitly mentioned in the scientific text. Additionally, the machine learning algorithms used by the tool may not always accurately classify whether a research artifact has been reused or created, and may require manual validation. +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- Impact of Artefact Reuse in COVID-19 Publications +- French Open Access Infrastructure +- ELIXIR´s Bioinformatics Resources + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). + # References Stavropoulos, P., Lyris, I., Manola, N., Grypari, I., & Papageorgiou, H. (2023). Empowering Knowledge Discovery from Scientific Literature: A novel approach to Research Artifact Analysis. In L. Tan, D. Milajevs, G. Chauhan, J. Gwinnup, & E. Rippeth (Eds.), Proceedings of the 3rd Workshop for Natural Language Processing Open Source Software (NLP-OSS 2023) (pp. 37–53). Association for Computational Linguistics. https://doi.org/10.18653/v1/2023.nlposs-1.5 \ No newline at end of file diff --git a/sections/3_societal_impact/uptake_in_the_legal_sector.qmd b/sections/3_societal_impact/uptake_in_the_legal_sector.qmd index 636511f..29e9b73 100644 --- a/sections/3_societal_impact/uptake_in_the_legal_sector.qmd +++ b/sections/3_societal_impact/uptake_in_the_legal_sector.qmd @@ -159,6 +159,13 @@ Finally, it is crucial to include in any qualitative study or questionnaire a sa Once these limitations and pointers to qualitative assessment have been acknowledged, it is nevertheless possible to perform the same automatic queries than for other indicators, for instance the patient groups community or the policy-makers, in order to provide a possibly limited, top of the iceberg understanding of the reuse of OS by the legal sector, without evidencing all the real impact. +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- French Open Access Infrastructure + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). + # Known correlates In the absence of citation, it is difficult to assert that a legal decision has been taken following a research result published in an Open Access journal possibly relying on an Open Data set. Correlation (or coincidence, as explained in the Societal Issues indicator) cannot be interpreted as causation, or direct and only impact. diff --git a/sections/4_economic_impact/cost_savings.qmd b/sections/4_economic_impact/cost_savings.qmd index 29a83d4..3e448b8 100644 --- a/sections/4_economic_impact/cost_savings.qmd +++ b/sections/4_economic_impact/cost_savings.qmd @@ -209,6 +209,13 @@ Where: - is the production cost expressed per unit of storage space; - is the span of time over which the benefit should be computed and can be expressed in any unit of time. +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- Portuguese Repository Infrastructure RCAAP + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). + # Known correlates Cost savings are directly linked to the metrics of “Innovation output” and “Industry adoption of research findings”. The rationale is that the savings accrued in both time and finances could potentially be redirected towards R&D investments. Over time, this reallocation could result in a significant increase in R&D productivity and innovation. Furthermore, the cost savings over time might trigger “Economic growth of companies” in terms of variations in productivity and assets. For instance, the money saved from lower access and storage costs can be reinvested in the company. This reinvestment could go towards R&D – which also relates to the innovation output indicator – and expanding operational capacity, which can drive revenue growth and increase the company’s assets and innovation capability, both key ingredients of company growth. Similarly, by saving time, companies can achieve more with the same or fewer resources. This means that businesses can offer more products or services or improve the quality of their offerings without a corresponding increase in costs. Over time, this contributes to economic growth by enhancing the company’s competitive edge and market share. The direct involvement of efficiency improvements in the economic growth of companies is also evident in asset optimisation. By maximising the utility of existing assets (mostly intangibles), companies can achieve higher returns on investment (ROI) over time. diff --git a/sections/4_economic_impact/innovation_output.qmd b/sections/4_economic_impact/innovation_output.qmd index 09ef0af..23c5f04 100644 --- a/sections/4_economic_impact/innovation_output.qmd +++ b/sections/4_economic_impact/innovation_output.qmd @@ -233,6 +233,13 @@ PitchBook is a financial data and research platform that offers in-depth informa Dealroom is a business intelligence platform that provides data and insights on start-ups, venture capital, private equity, and innovation ecosystems. It is widely used by investors, corporations, and policymakers to track emerging companies, funding trends, and market developments. Dealroom aggregates data from public sources, proprietary research, and partnerships with governments and industry organizations, offering a comprehensive view of the European and global start-up landscape. Compared to Crunchbase and PitchBook, Dealroom places a strong emphasis on mapping start-up ecosystems, providing network intelligence, and analysing sector-specific innovation trends, making it a valuable tool for understanding high-growth industries and investment opportunities. +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- ELIXIR´s Bioinformatics Resources + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). + # Known correlates {#known-correlates .unnumbered} In addition to this general indicator measuring the impact of OS on innovation, two other indicators examine specific aspects of OS’s role in the innovation process: [science-industry collaboration](science_industry_collaboration.qmd) and [socially relevant products and processes](socially_relevant_products_and_processes.qmd). The impact of OS on innovation within the academic sphere, such as its effects on publications and citations, is covered in the [academic impact section](../2_academic_impact/introduction_academic_impact.qmd). Likewise, the cost savings generated by OS—through reduced time and increased R&D efficiency as discussed in the [CBA methodological note](https://zenodo.org/records/10277642) [@delugas2023a] —are addressed in the [cost savings](cost_savings.qmd) indicator, while its contribution to the economic value of innovation is discussed in the [economic growth](economic_growth_of_companies.qmd) indicator. diff --git a/sections/4_economic_impact/science_industry_collaboration.qmd b/sections/4_economic_impact/science_industry_collaboration.qmd index 7074672..43729e4 100644 --- a/sections/4_economic_impact/science_industry_collaboration.qmd +++ b/sections/4_economic_impact/science_industry_collaboration.qmd @@ -307,6 +307,16 @@ Crunchbase is a comprehensive platform that aggregates data on companies, founde Crunchbase can be used to identify the names and metadata of companies involved in academic-industry collaborations. By cross-referencing organizations from research outputs or project data, researchers can determine whether affiliations are from industry. Crunchbase’s metadata can also help uncover patterns such as funding sources, company size, and sectoral focus, which are crucial for understanding the scope and impact of collaborations. +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- Impact of Artefact Reuse in COVID-19 Publications +- Impact of Open Access Routes on Topic Persistence +- Portuguese Repository Infrastructure RCAAP +- ELIXIR´s Bioinformatics Resources + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). + # Notes {#notes .unnumbered} The proposed metrics offer a solid foundation for measuring the collaboration between science and industry, however some aspects require further exploration: diff --git a/sections/5_reproducibility/reuse_of_code_in_research.qmd b/sections/5_reproducibility/reuse_of_code_in_research.qmd index 9f40d74..128355d 100644 --- a/sections/5_reproducibility/reuse_of_code_in_research.qmd +++ b/sections/5_reproducibility/reuse_of_code_in_research.qmd @@ -46,4 +46,11 @@ This closely aligns with the metrics in the [Use of Code in Research](https://ha In the context of reproducibility, the reuse of code indicates that methods and processes described in research publications are transparent and accessible. When researchers reuse code, they signal that the original research is sufficiently documented and functional to support replication. This is a cornerstone of open science, as reproducible research enables validation of results, ensuring the robustness of scientific knowledge and minimizing errors. The extent of code reuse also highlights the community’s trust in the reliability and quality of the code, as widely adopted software is likely to have undergone rigorous validation by multiple users. -Furthermore, the act of reusing code fosters interdisciplinary collaboration and accelerates scientific progress. By building on shared resources rather than duplicating efforts, researchers save valuable time and energy. This collaborative approach to software reuse ensures that scientific communities can focus on advancing new knowledge rather than resolving redundant technical challenges. As a result, code reuse acts as a multiplier for reproducibility, allowing not only the original study but also derivative works to be verified and built upon, expanding the scope of reliable and impactful research. \ No newline at end of file +Furthermore, the act of reusing code fosters interdisciplinary collaboration and accelerates scientific progress. By building on shared resources rather than duplicating efforts, researchers save valuable time and energy. This collaborative approach to software reuse ensures that scientific communities can focus on advancing new knowledge rather than resolving redundant technical challenges. As a result, code reuse acts as a multiplier for reproducibility, allowing not only the original study but also derivative works to be verified and built upon, expanding the scope of reliable and impactful research. + +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- Impact of Artefact Reuse in COVID-19 Publications + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). diff --git a/sections/5_reproducibility/reuse_of_data_in_research.qmd b/sections/5_reproducibility/reuse_of_data_in_research.qmd index 8156624..c9ad590 100644 --- a/sections/5_reproducibility/reuse_of_data_in_research.qmd +++ b/sections/5_reproducibility/reuse_of_data_in_research.qmd @@ -47,3 +47,10 @@ This aligns closely with the metrics discussed in the [Use of Data in Research]( In the context of reproducibility, the reuse of datasets reflects the scientific community's ability to leverage existing data to answer new research questions. It underscores the importance of effective data sharing practices, robust metadata, and clear licensing, as these enable other researchers to trust, access, and incorporate datasets into their work. Furthermore, higher levels of data reuse often indicate stronger collaboration and trust within a scientific field, which are critical for advancing reproducible research. By interpreting dataset reuse through the lens of reproducibility, this indicator also highlights the extent to which researchers adopt transparent and open research practices. The repeated utilization of datasets ensures that original findings are validated and that the data itself is robust, reliable, and suitable for diverse applications. + +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- Impact of Artefact Reuse in COVID-19 Publications + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). From c42d0f68e8fba128fe683aa0369ea0af61051a2f Mon Sep 17 00:00:00 2001 From: Petros Stavropoulos Date: Tue, 16 Sep 2025 15:51:51 +0300 Subject: [PATCH 2/3] add operationalization details for diversity indicator --- sections/2_academic_impact/diversity.qmd | 12 +++++++++++- 1 file changed, 11 insertions(+), 1 deletion(-) diff --git a/sections/2_academic_impact/diversity.qmd b/sections/2_academic_impact/diversity.qmd index 3476a23..b6a66cd 100644 --- a/sections/2_academic_impact/diversity.qmd +++ b/sections/2_academic_impact/diversity.qmd @@ -94,4 +94,14 @@ This metrics supposes to have clearly defined what the specific needs of people The academic field is characterized by certain set of subnorms that define a specific scientific ethos. Without settling immense debate of defining those norms, it is important to note that this specific ethos has implications for how diversity functions in and on science. Complying to the scientific ethos, in order to be able to “play the game of science” requires specific socio-economic conditions such as stable income, decent housing, access to higher education etc. that enable individuals to acquire the set of scientific skills needed to produce scientifically valid statements, that is to say peer recognized and compliant to scientific discursive norms. -The socio-economic preconditions of this "scholastic view" [@bourdieu2000], may act as a barrier for the underprivileged. Conversely, a series of paradigm shifts in the history, sociology, and philosophy of science (Kuhn, Longino, Wylie) has demonstrated that science is more infused with social values and hierarchies than previously believed and stressed out the fact that well-orchestrated diversity in research communities could lead to more efficient and scientifically relevant research. Last, it is important to note that in recent years, policymakers have implemented initiatives mandating that science take a more direct role in confronting immediate and urgent societal challenges; “Science with and for society” subprogram in the Horizon 2020 2014-2021 Program, followed by the full integration of the Responsible Research and Innovation principles in the 2021-2027 Horizon Europe Program. \ No newline at end of file +The socio-economic preconditions of this "scholastic view" [@bourdieu2000], may act as a barrier for the underprivileged. Conversely, a series of paradigm shifts in the history, sociology, and philosophy of science (Kuhn, Longino, Wylie) has demonstrated that science is more infused with social values and hierarchies than previously believed and stressed out the fact that well-orchestrated diversity in research communities could lead to more efficient and scientifically relevant research. Last, it is important to note that in recent years, policymakers have implemented initiatives mandating that science take a more direct role in confronting immediate and urgent societal challenges; “Science with and for society” subprogram in the Horizon 2020 2014-2021 Program, followed by the full integration of the Responsible Research and Innovation principles in the 2021-2027 Horizon Europe Program. + +# Operationalization in PathOS Case Studies + +This indicator has been operationalized in the following case studies: +- Impact of Artefact Reuse in COVID-19 Publications +- Impact of Open Access Routes on Topic Persistence +- Portuguese Repository Infrastructure RCAAP +- ELIXIR´s Bioinformatics Resources + +Further details are available in Deliverable D3.3 of PathOS, accessible through the [PathOS Zenodo community](https://zenodo.org/communities/pathos/records?q=&l=list&p=1&s=10&sort=newest). From f653e1aa2149af22d8d770233410f72d9772ed92 Mon Sep 17 00:00:00 2001 From: Petros Stavropoulos Date: Wed, 8 Oct 2025 16:52:00 +0300 Subject: [PATCH 3/3] refactor: update section headers for case studies to remove "PathOS" --- sections/1_open_science/availability_data_repositories.qmd | 4 +++- .../1_open_science/availability_preprint_repositories.qmd | 4 +++- .../1_open_science/availability_publication_repositories.qmd | 4 +++- sections/1_open_science/prevalence_open_access_publishing.qmd | 4 +++- sections/2_academic_impact/citation_impact.qmd | 4 +++- sections/2_academic_impact/diversity.qmd | 4 +++- sections/2_academic_impact/extra-academic_collaboration.qmd | 4 +++- sections/2_academic_impact/thematic_persistence.qmd | 4 +++- sections/2_academic_impact/use_of_data_in_research.qmd | 4 +++- sections/3_societal_impact/OS_access_advantage.qmd | 4 +++- sections/3_societal_impact/scientific_literacy.qmd | 4 +++- .../uptake_and_impact_on_societal_issues.qmd | 4 +++- sections/3_societal_impact/uptake_by_media.qmd | 4 +++- sections/3_societal_impact/uptake_by_patient_groups.qmd | 4 +++- sections/3_societal_impact/uptake_by_policy_makers.qmd | 4 +++- sections/3_societal_impact/uptake_in_education.qmd | 4 +++- sections/3_societal_impact/uptake_in_medical_practice.qmd | 4 +++- sections/3_societal_impact/uptake_in_the_legal_sector.qmd | 4 +++- sections/4_economic_impact/cost_savings.qmd | 4 +++- sections/4_economic_impact/innovation_output.qmd | 4 +++- sections/4_economic_impact/science_industry_collaboration.qmd | 4 +++- sections/5_reproducibility/reuse_of_code_in_research.qmd | 4 +++- sections/5_reproducibility/reuse_of_data_in_research.qmd | 4 +++- 23 files changed, 69 insertions(+), 23 deletions(-) diff --git a/sections/1_open_science/availability_data_repositories.qmd b/sections/1_open_science/availability_data_repositories.qmd index 2e7b216..6dcf912 100644 --- a/sections/1_open_science/availability_data_repositories.qmd +++ b/sections/1_open_science/availability_data_repositories.qmd @@ -82,7 +82,9 @@ It can be difficult to obtain data on all existing data repositories, given the Core Trust Seal is a non-profit organisation that labels data sources with their seal if data sources adhere to the FAIR principles. On the website a [list](https://amt.coretrustseal.org/certificates/) is maintained with all the data sources that the seal has been assigned to. Data stored in these sources can thus be considered to be produced in accordance with the FAIR principles. When performing research related to the availability of data repositories, one can consider repositories that have received the CoreTrustSeal, the Nestor Seal DIN31644, the ISO16363 certification, or similar, to be automatically trusted [@jahn2023]. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - Effects of Data Repositories on Data Usage diff --git a/sections/1_open_science/availability_preprint_repositories.qmd b/sections/1_open_science/availability_preprint_repositories.qmd index 3b71dce..a389315 100644 --- a/sections/1_open_science/availability_preprint_repositories.qmd +++ b/sections/1_open_science/availability_preprint_repositories.qmd @@ -143,7 +143,9 @@ OpenAIRE Graph and Directory of Open Access Repositories (DOAR) (integrated in t All repositories in both data sources are Open Access. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - French Open Access Infrastructure diff --git a/sections/1_open_science/availability_publication_repositories.qmd b/sections/1_open_science/availability_publication_repositories.qmd index f2e9b1e..0ee00d8 100644 --- a/sections/1_open_science/availability_publication_repositories.qmd +++ b/sections/1_open_science/availability_publication_repositories.qmd @@ -68,7 +68,9 @@ OpenAIRE Graph and Directory of Open Access Repositories (DOAR) (integrated in t All repositories in both data sources are Open Access. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - French Open Access Infrastructure diff --git a/sections/1_open_science/prevalence_open_access_publishing.qmd b/sections/1_open_science/prevalence_open_access_publishing.qmd index ea066e1..d2453b8 100644 --- a/sections/1_open_science/prevalence_open_access_publishing.qmd +++ b/sections/1_open_science/prevalence_open_access_publishing.qmd @@ -127,7 +127,9 @@ To facilitate interaction with the Unpaywall API there are also supporting packa Once we know the Open Access status of each publication, we can easily calculate the percentage, simply as the number of publications out of the total that are Open Access. Additionally, we can do this for each separate Open Access type. We could for example refer to the % Green OA or % Gold OA. Note that percentages may not add up to 100%, but the total may also even exceed 100%, because publications can have both a Green Open Access status and another Open Access status. For that reason, you should not report percentages of Open Access statuses in a cumulative fashion (e.g. not in a stacked bar chart), in particular not when reporting on Green Open Access. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - French Open Access Infrastructure diff --git a/sections/2_academic_impact/citation_impact.qmd b/sections/2_academic_impact/citation_impact.qmd index 1110a6c..8ad89d4 100644 --- a/sections/2_academic_impact/citation_impact.qmd +++ b/sections/2_academic_impact/citation_impact.qmd @@ -259,7 +259,9 @@ The database is closed access, and we therefore do not provide more details abou The database is closed access, and we therefore do not provide more details about API usage. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - Impact of Artefact Reuse in COVID-19 Publications diff --git a/sections/2_academic_impact/diversity.qmd b/sections/2_academic_impact/diversity.qmd index b6a66cd..075c854 100644 --- a/sections/2_academic_impact/diversity.qmd +++ b/sections/2_academic_impact/diversity.qmd @@ -96,7 +96,9 @@ The academic field is characterized by certain set of subnorms that define a spe The socio-economic preconditions of this "scholastic view" [@bourdieu2000], may act as a barrier for the underprivileged. Conversely, a series of paradigm shifts in the history, sociology, and philosophy of science (Kuhn, Longino, Wylie) has demonstrated that science is more infused with social values and hierarchies than previously believed and stressed out the fact that well-orchestrated diversity in research communities could lead to more efficient and scientifically relevant research. Last, it is important to note that in recent years, policymakers have implemented initiatives mandating that science take a more direct role in confronting immediate and urgent societal challenges; “Science with and for society” subprogram in the Horizon 2020 2014-2021 Program, followed by the full integration of the Responsible Research and Innovation principles in the 2021-2027 Horizon Europe Program. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - Impact of Artefact Reuse in COVID-19 Publications diff --git a/sections/2_academic_impact/extra-academic_collaboration.qmd b/sections/2_academic_impact/extra-academic_collaboration.qmd index 0f0b5d8..ba0ae35 100644 --- a/sections/2_academic_impact/extra-academic_collaboration.qmd +++ b/sections/2_academic_impact/extra-academic_collaboration.qmd @@ -151,7 +151,9 @@ The data sources described in the previous section can be used to populate this In particular, all the metrics matrix and the data source described above can be employed to assess collaboration in OS but also in non-OS projects, allowing to investigate whether open science is less or more prone to facilitate specific types of collaboration. Similarly, the comparison can be carried out by disciplinary field, type of research, project size or duration, type of funding, etc. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - ELIXIR´s Bioinformatics Resources diff --git a/sections/2_academic_impact/thematic_persistence.qmd b/sections/2_academic_impact/thematic_persistence.qmd index 259c307..4ddb758 100644 --- a/sections/2_academic_impact/thematic_persistence.qmd +++ b/sections/2_academic_impact/thematic_persistence.qmd @@ -138,7 +138,9 @@ The continuity framework [@Yan2014ResearchDM] quantifies persistence by categori Continuity is evaluated by the **strength of inter-year linkages** among topic clusters.\ This allows distinguishing different **modes of persistence** and topic evolution. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - Impact of Open Access Routes on Topic Persistence diff --git a/sections/2_academic_impact/use_of_data_in_research.qmd b/sections/2_academic_impact/use_of_data_in_research.qmd index 30e3fe5..7cd9d4a 100644 --- a/sections/2_academic_impact/use_of_data_in_research.qmd +++ b/sections/2_academic_impact/use_of_data_in_research.qmd @@ -115,7 +115,9 @@ Based on the data retrieval information from the data repositories one can compi To combat the issue of standardization for the tracking of clicks/views/downloads of data use in research [The COUNTER Code of Practice for Research Data](https://www.countermetrics.org/code-of-practice/) gives guidance on how to standardize count systems for data use. The guidelines provided by The COUNTER Code of Practice for Research Data can be followed to make inquiries in data retrieval information more comparable among researchers. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - Effects of Data Repositories on Data Usage diff --git a/sections/3_societal_impact/OS_access_advantage.qmd b/sections/3_societal_impact/OS_access_advantage.qmd index b35853c..953479c 100644 --- a/sections/3_societal_impact/OS_access_advantage.qmd +++ b/sections/3_societal_impact/OS_access_advantage.qmd @@ -92,7 +92,9 @@ As an example, one can (1) focus on the scientific domains associated with the a This data structure allows to observe not only the general access advantage (or disadvantage) of different type of scientific ressource, but to break the calculation down to different combination of scientific domains, countries and industrial sectors, in order to facilitate comparison and detect potential confounding factors. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - French Open Access Infrastructure diff --git a/sections/3_societal_impact/scientific_literacy.qmd b/sections/3_societal_impact/scientific_literacy.qmd index ec2e682..1a359e5 100644 --- a/sections/3_societal_impact/scientific_literacy.qmd +++ b/sections/3_societal_impact/scientific_literacy.qmd @@ -63,7 +63,9 @@ Besides the PISA instrument, there is a great variety of other instruments used A relatively recent and broadly used instrument is the Test of Scientific Literacy Skills (TOSLS), developed to be a comprehensive and psychometrically sound measure that can be employed on a large scale. The TOSLS includes 28 multiple-choice questions presented through realistic scenarios and requiring respondents to use skills that relate to understanding scientific methods and interpreting data [@gormally2012]. The instrument is available as the supplement to @gormally2012. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - French Open Access Infrastructure diff --git a/sections/3_societal_impact/uptake_and_impact_on_societal_issues.qmd b/sections/3_societal_impact/uptake_and_impact_on_societal_issues.qmd index 627f495..dfc8d29 100644 --- a/sections/3_societal_impact/uptake_and_impact_on_societal_issues.qmd +++ b/sections/3_societal_impact/uptake_and_impact_on_societal_issues.qmd @@ -119,7 +119,9 @@ Given the complexity of the assessment described in these pages, the metrics sug - Number of references to OS resources in the statements and documents of each actor or actor type active on each societal issue. - Ratio of OS over non-OS references to OS resources in the statements and documents of each actor or actor type active on each societal issue. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - French Open Access Infrastructure diff --git a/sections/3_societal_impact/uptake_by_media.qmd b/sections/3_societal_impact/uptake_by_media.qmd index 42e83d4..dd46212 100644 --- a/sections/3_societal_impact/uptake_by_media.qmd +++ b/sections/3_societal_impact/uptake_by_media.qmd @@ -123,7 +123,9 @@ In addition to citation, views and download information, PlumX collects data fro - Wikipedia - Facebook -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - French Open Access Infrastructure diff --git a/sections/3_societal_impact/uptake_by_patient_groups.qmd b/sections/3_societal_impact/uptake_by_patient_groups.qmd index 7add2e4..7b29495 100644 --- a/sections/3_societal_impact/uptake_by_patient_groups.qmd +++ b/sections/3_societal_impact/uptake_by_patient_groups.qmd @@ -102,7 +102,9 @@ To measure the proposed metric, the tool can be used to identify the reused and One limitation of this methodology is that it may not capture all instances of research artifacts if they are not explicitly mentioned in the scientific text. Additionally, the machine learning algorithms used by the tool may not always accurately classify whether a research artifact has been reused or created, and may require manual validation. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - French Open Access Infrastructure diff --git a/sections/3_societal_impact/uptake_by_policy_makers.qmd b/sections/3_societal_impact/uptake_by_policy_makers.qmd index c0673ac..ef1c35b 100644 --- a/sections/3_societal_impact/uptake_by_policy_makers.qmd +++ b/sections/3_societal_impact/uptake_by_policy_makers.qmd @@ -67,7 +67,9 @@ Overton was founded in 2019 also by Euan Adie. It is a novel database with the g Beyond the methodologies of the different data providers mentioned above (Overton and Altmetric), and other past applications related to the extractions of mentions to scientific concepts, there are no other large methodologies focused on extracting mentions to scientific publications or scholarly entities from policy sources. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - French Open Access Infrastructure diff --git a/sections/3_societal_impact/uptake_in_education.qmd b/sections/3_societal_impact/uptake_in_education.qmd index c666002..47ef85f 100644 --- a/sections/3_societal_impact/uptake_in_education.qmd +++ b/sections/3_societal_impact/uptake_in_education.qmd @@ -98,7 +98,9 @@ To measure the proposed metric, the tool can be used to identify the reused and One limitation of this methodology is that it may not capture all instances of research artifacts if they are not explicitly mentioned in the scientific text. Additionally, the machine learning algorithms used by the tool may not always accurately classify whether a research artifact has been reused or created, and may require manual validation. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - French Open Access Infrastructure diff --git a/sections/3_societal_impact/uptake_in_medical_practice.qmd b/sections/3_societal_impact/uptake_in_medical_practice.qmd index 0117f0b..64a8b54 100644 --- a/sections/3_societal_impact/uptake_in_medical_practice.qmd +++ b/sections/3_societal_impact/uptake_in_medical_practice.qmd @@ -108,7 +108,9 @@ To measure the proposed metric, the tool can be used to identify the reused and One limitation of this methodology is that it may not capture all instances of research artifacts if they are not explicitly mentioned in the scientific text. Additionally, the machine learning algorithms used by the tool may not always accurately classify whether a research artifact has been reused or created, and may require manual validation. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - Impact of Artefact Reuse in COVID-19 Publications diff --git a/sections/3_societal_impact/uptake_in_the_legal_sector.qmd b/sections/3_societal_impact/uptake_in_the_legal_sector.qmd index 29e9b73..815860e 100644 --- a/sections/3_societal_impact/uptake_in_the_legal_sector.qmd +++ b/sections/3_societal_impact/uptake_in_the_legal_sector.qmd @@ -159,7 +159,9 @@ Finally, it is crucial to include in any qualitative study or questionnaire a sa Once these limitations and pointers to qualitative assessment have been acknowledged, it is nevertheless possible to perform the same automatic queries than for other indicators, for instance the patient groups community or the policy-makers, in order to provide a possibly limited, top of the iceberg understanding of the reuse of OS by the legal sector, without evidencing all the real impact. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - French Open Access Infrastructure diff --git a/sections/4_economic_impact/cost_savings.qmd b/sections/4_economic_impact/cost_savings.qmd index 3e448b8..2d15960 100644 --- a/sections/4_economic_impact/cost_savings.qmd +++ b/sections/4_economic_impact/cost_savings.qmd @@ -209,7 +209,9 @@ Where: - is the production cost expressed per unit of storage space; - is the span of time over which the benefit should be computed and can be expressed in any unit of time. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - Portuguese Repository Infrastructure RCAAP diff --git a/sections/4_economic_impact/innovation_output.qmd b/sections/4_economic_impact/innovation_output.qmd index 23c5f04..8d657b8 100644 --- a/sections/4_economic_impact/innovation_output.qmd +++ b/sections/4_economic_impact/innovation_output.qmd @@ -233,7 +233,9 @@ PitchBook is a financial data and research platform that offers in-depth informa Dealroom is a business intelligence platform that provides data and insights on start-ups, venture capital, private equity, and innovation ecosystems. It is widely used by investors, corporations, and policymakers to track emerging companies, funding trends, and market developments. Dealroom aggregates data from public sources, proprietary research, and partnerships with governments and industry organizations, offering a comprehensive view of the European and global start-up landscape. Compared to Crunchbase and PitchBook, Dealroom places a strong emphasis on mapping start-up ecosystems, providing network intelligence, and analysing sector-specific innovation trends, making it a valuable tool for understanding high-growth industries and investment opportunities. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - ELIXIR´s Bioinformatics Resources diff --git a/sections/4_economic_impact/science_industry_collaboration.qmd b/sections/4_economic_impact/science_industry_collaboration.qmd index 43729e4..4ebdfcd 100644 --- a/sections/4_economic_impact/science_industry_collaboration.qmd +++ b/sections/4_economic_impact/science_industry_collaboration.qmd @@ -307,7 +307,9 @@ Crunchbase is a comprehensive platform that aggregates data on companies, founde Crunchbase can be used to identify the names and metadata of companies involved in academic-industry collaborations. By cross-referencing organizations from research outputs or project data, researchers can determine whether affiliations are from industry. Crunchbase’s metadata can also help uncover patterns such as funding sources, company size, and sectoral focus, which are crucial for understanding the scope and impact of collaborations. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - Impact of Artefact Reuse in COVID-19 Publications diff --git a/sections/5_reproducibility/reuse_of_code_in_research.qmd b/sections/5_reproducibility/reuse_of_code_in_research.qmd index 128355d..84133df 100644 --- a/sections/5_reproducibility/reuse_of_code_in_research.qmd +++ b/sections/5_reproducibility/reuse_of_code_in_research.qmd @@ -48,7 +48,9 @@ In the context of reproducibility, the reuse of code indicates that methods and Furthermore, the act of reusing code fosters interdisciplinary collaboration and accelerates scientific progress. By building on shared resources rather than duplicating efforts, researchers save valuable time and energy. This collaborative approach to software reuse ensures that scientific communities can focus on advancing new knowledge rather than resolving redundant technical challenges. As a result, code reuse acts as a multiplier for reproducibility, allowing not only the original study but also derivative works to be verified and built upon, expanding the scope of reliable and impactful research. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - Impact of Artefact Reuse in COVID-19 Publications diff --git a/sections/5_reproducibility/reuse_of_data_in_research.qmd b/sections/5_reproducibility/reuse_of_data_in_research.qmd index c9ad590..365dbcd 100644 --- a/sections/5_reproducibility/reuse_of_data_in_research.qmd +++ b/sections/5_reproducibility/reuse_of_data_in_research.qmd @@ -48,7 +48,9 @@ In the context of reproducibility, the reuse of datasets reflects the scientific By interpreting dataset reuse through the lens of reproducibility, this indicator also highlights the extent to which researchers adopt transparent and open research practices. The repeated utilization of datasets ensures that original findings are validated and that the data itself is robust, reliable, and suitable for diverse applications. -# Operationalization in PathOS Case Studies +# Operationalization in Case Studies + +## PathOS Case Studies This indicator has been operationalized in the following case studies: - Impact of Artefact Reuse in COVID-19 Publications