

Additionally, we revisit previous observations from other fields on the relationships between artifact properties and various other characteristics of papers, authors, and venue and apply them to this field. We combine this manually curated dataset with citation counts to evaluate the relationships between different artifact properties and citation metrics. In addition to extensive data on the conferences, papers, and authors, this analyze dataset includes data on the release, ongoing availability, badging, and locations of research artifacts. To this end, we explore a cross-sectional dataset of papers from 56 contemporaneous systems conferences.

The primary goal of this study is to provide an exploratory statistical analysis of the artifact-sharing rates and associated factors in the research field of computer systems. And yet, the sharing of research artifacts is still not as common as warranted by its importance. Artifact availability has also been previously associated with higher paper impact, as measured by citations counts.
Artifact meaning in computer science software#
The availability of these artifacts is critical to the reproducibility and replicability of the research results, because system software often embodies numerous implicit assumptions and parameters that are not fully documented in the research article itself. Research in computer systems often involves the engineering, implementation, and measurement of complex systems software and data.
