Saturday, September 28, 2024

OePRESS: an Open ePrint and Rigorous Evaluation System for STEM

Based on the earlier paper “A Robust Community-Based Credit System to Enhance Peer Review in Scientific Research“, we will present more quantitative details of the full scheme of such an evaluation system — an Open ePrint and Rigorous Evaluation System for STEM (OePRESS) that is ready to be implemented.

Abstract:  In light of the failed peer review system in basic research, we propose a novel open science initiative: an Open ePrint and Rigorous Evaluation System for STEM (OePRESS). In particular, three different types of research activities — original research, indirect contributions (e.g., participation in the evaluation system), and funding/time requests — should be evaluated using quantitative and continually refined metrics. This new community-based rigorous evaluation system will provide the best incentive for all members by rewarding them with accurate recognition of their innovative achievements and accurate credit for their service and other contributions to the community. The system rewards the quality, not the quantity, of accomplishments. Community members earn credits for their research and other activities in OePRESS, and as they accumulate experience and credits they can advance in their role in the community. High-risk, high-reward research projects will have a better chance of being funded. Eventually, when funding agencies and hiring institutions rely on this rigorous evaluation system to make their decisions, we will see a self-sustaining community of researchers striving for perpetual innovation and development.

No comments:

Post a Comment

A possible solution to arbitrary evaluations

My letter to Physics Today was just published in its issue in October, 2024 . Hopefully, it’ll draw attention from a wider audience to the i...