SIPS 2025 Online

oHC4: Metavaluation: Recognising and rewarding diverse contributions to SIPS
2025-05-22 , Track 4 (Thur)

Metavaluation is a novel mechanism designed from first principles to address the collective action problem in academia by offering direct rewards for diverse contributions—including peer reviews. The Metavaluation app, developed by the Open Heart Mind (OHM) community, is a free, open-source tool created to demonstrate the model and make it accessible to a wide range of communities.

In this hackathon, participants will use the Metavaluation app to nominate SIPS contributions and determine their relative value through an inclusive peer-review process. Every participant will have the opportunity to vote for their preferred contributions and be rewarded for their input. By the end of the session, we will generate a set of multidimensional scores that reflect the unique qualities of each contribution—including the evaluations themselves. This dataset may serve as a replicable template for future investigations, potentially fostering a virtuous cycle of value creation within the SIPS community.


Landing page:

https://docs.google.com/document/d/1LlL4bmovQB4QEsx_pLVcKau5c8E-O4CD/edit?usp=sharing&ouid=102720080386074581271&rtpof=true&sd=true