Call for Artifacts

ACM MobiCom 2026 Call for Artifacts

The artifact evaluation process of ACM MobiCom 2026 is open to ACCEPTED papers at ACM MobiCom 2026, to promote and facilitate high-quality research in mobile computing and wireless networking through the PUBLIC distribution of data, hardware, software, scripts, instructions, survey results, proofs, models, test suites, benchmarks, and other artifacts associated with a paper available for use by other researchers.

The artifact evaluation process complements the paper review process by verifying that the artifacts associated with a paper are correct, complete, properly documented, functional and reproducible. The artifact evaluation intends to publicly recognize authors’ efforts with three artifact badges (Available, Evaluated – Functional, Validated – Results Reproduced, more details in the following guidelines). The Artifact Evaluation Committee also provides feedback to authors to improve those artifacts before their broader distribution in the community.

Important Dates

Artifact Submission Deadline (summer round)June 26, 2026 23:59PM AoE
Notification + Review Available (summer round)July 24, 2026
Artifact Final Version (summer round)July 31, 2026
Artifact Submission Deadline (winter round)(tentative) August 14, 2026
Notification + Review Available (winter round)September 11, 2026
Artifact Final Version (winter round)September 18, 2026

Organizers

★: AE members will be on the job market in year 2026-2027

Committee Co-Chairs
Chunyi PengPurdue University
Tianxin WangUniversity of Edinburgh
Committee
Ali Khalid★Rochester Institute of Technology
Andrew FergusonUniversity of Edinburgh
Aritrik Ghosh★University of Maryland, College Park
Bangjie Sun★National University of Singapore
Bofan Li★Florida State University
Chen GongShanghai Jiao Tong University
Gaurav GautamUniversity of Minnesota
Guosheng WangThe Hong Kong Polytechnic University
Haifeng JiaShanghai Jiao Tong University
Huixin Dong★Hong Kong University of Science and Technology
Jialuo Du★Michigan State University
Jinyan JiangTsinghua University
Juexing Wang★Michigan State University
Leming Shen★UCL & The Hong Kong Polytechnic University
Luca Jiang-Tao Yu★The University of Hong Kong
Lumin LiuHong Kong University of Science and Technology
Mohammad Nur Hossain Khan★Worcester Polytechnic Institute
Ningning HouMacquarie University
Qingrui PanUniversity of Edinburgh
Rong DingShanghai Jiao Tong University
Sarah TanveerUniversity of Wisconsin - Madison
Sean Tan Rui Xiang★National University of Singapore
Shen WangThe Hong Kong Polytechnic University
Shengqing Xia★Purdue University
Shiming YuThe Hong Kong Polytechnic University
Shuai Tong★Tsinghua Univeristy
Tanmay Srivastava★Stony Brook University
Ujjwal Pawar★University of Edinburgh
Xin LiuFlorida State University
Xin Zhe Khooi★National University of Singapore
Xiyuxing Zhang★Tsinghua University
Yan ZhuangShanghai Jiao Tong University
Yanbing Liu★Purdue University
Yawen LiuCarnegie Mellon University
Yimeng Liu★Michigan State University
Yong Yang★University of South Carolina
Zimo Liao★The Hong Kong Polytechnic University
Ziyan WuUniversity of Minnesota

Process Overview and Guidelines

Submission: Authors of accepted papers should use HotCRP to submit their accepted papers for artifact evaluation. Link: https://mobicom26ae.hotcrp.com

Review, Feedback and Revision: The Artifact Evaluation Committee will independently review the submitted artifacts, focusing on availability, functionality and reproducibility, in adherence to the paper's claims. The committee might communicate with the authors during this review phase to clarify any questions or request additional information.

Badges and Recognition: The Artifact Evaluation Committee will provide feedback to the authors. If required, authors may be asked to revise their artifacts based on the committee's suggestions. The process may involve several iterations to ensure the artifacts meet the evaluation criteria.

Search and Discoverability: Authors will apply for specific ACM badges for “Artifact available”, “Artifact evaluated - functional”, and “Results reproduced” for Artifact Evaluation Committee evaluation. These badges are independent, and authors may seek one, two, or all three of the badges for their papers. Badges that pass Artifact Evaluation Committee approval will be printed on the papers and included as meta information in the ACM Digital Library.

Guidelines for the preparation of research artifacts (for the authors)

  • When submitting a paper for artifact evaluation, authors should prepare a short artifact description, describing how to install and run the artifact. This description should be at most three pages but can be smaller. Please also include a full list of hardware and software requirements. Use this template for drafting the description and use this artifact checklist to make sure that the description contains all the necessary information.
  • The artifacts should contain a minimum working example, e.g., workflow scripts, to demonstrate that the artifact works, such that the artifact evaluators know that the basic functionalities of the artifact are easily reproducible. It would be better if the provided workflow scripts can be used by the reviewers to automatically repeat the listed experiments with the minimum involvement/help from the authors.
  • Existing tools such as the Collective Knowledge (CK) project project can be used for such automation purposes. If such scripts cannot be made or operated by the reviewers due to the involvement of proprietary or custom hardware/software, the authors should instead provide remote access to artifacts as described below.
  • Artifacts should specify how much time it takes to run each component of the artifact and what the hardware requirements are to run the artifact.
  • The source code of the artifact can be shared through openly accessible repositories such as http://github.com or http://gitlab.com or dedicated links provided directly to the artifact evaluators.
  • The artifact evaluation process is best-effort double-blind. Please try your best to anonymize artifact submissions.
  • After the artifact acceptance, please put your artifact on publicly accessible repositories such as https://zenodo.org/, https://figshare.com/, or http://datadryad.org/ to have the “Artifact Available” badge awarded. These repositories will generate a dedicated DOI link for your repository.
  • For software-only research artifacts, authors should submit the artifact as a container, e.g., using https://www.virtualbox.org/ or https://www.docker.com/.
  • For hardware-dependent research artifacts, authors provide the ability for the artifact evaluators to remotely (and anonymously) connect to the hardware setup to assess the artifact, e.g., using Zoom, Microsoft Teams, or Google Hangouts with anonymous accounts for both parties.

Artifact Evaluation Methods and Criteria (including badge-specific guidelines)

The following guidelines build on and complement the ACM’s guidelines on artifact review for different badges ( https://www.acm.org/publications/policies/artifact-review-badging ), but are specific to the hardware and software artifacts of papers published at SIGMOBILE conferences (e.g., MobiCom, MobiSys, SenSys, etc).

It is recommended that the artifact evaluation committee members bid on the submitted artifacts so that the artifacts can be reviewed by reviewers with the appropriate expertise. Conflict of Interests should be handled in a similar way as it is in regular paper submissions. The reviewers are encouraged to use the following guidelines as the reference in artifact evaluation and to communicate with the authors as necessary via the submission site (e.g., HotCRP).

At the end of the review period, each reviewer should submit recommendations about the badges to be granted, and it will be the artifact evaluation committee chairs’ discretion to make final decisions.

Artifacts Available badge

Artifacts Available: Default ACM guidelines will apply to evaluating this badge. For software artifacts, a publicly accessible DOI or link to the source code repository along with a unique identifier must be provided, in order to receive this badge. For hardware artifacts, similar accessibility to all the source files of hardware designs and source codes of associated firmware should be provided.

Artifacts Evaluated Functional badge

Artifacts Evaluated - Functional: For software artifacts that do not involve modification of hardware, we encourage reviewers who own the listed hardware and software systems that are required by the artifacts to bid on these artifacts. The reviewers will then use the authors’ submitted workflow scripts to operate the artifacts on the reviewers’ systems and follow standard ACM guidelines to evaluate for badges of “Artifacts Evaluated – Functional”.

During the review period, the reviewers can reach out to authors to ask for further explanations on using the scripts or request further revisions on the scripts.

In cases where reviewers with the required hardware or software systems to operate the artifacts cannot be found, remote access to the authors’ machines should be used instead for artifact evaluation. Refer to the following paragraph for remote access.

For hardware artifacts, the authors are responsible to provide remote access for the reviewers to access the authors’ machines and operate the artifacts. Commonly used remote access tools such as TeamViewer can be used for such purposes, and the authors are responsible to schedule evaluation appointments with the reviewers.

In evaluation via remote access, the authors should make sure that reviewers have full control over the artifacts and operate the entire artifact workflow, including but not limited to, compiling the source codes, uploading the compiled binaries to the target system, configuring the target hardware system, starting hardware system operations and executing experiments listed in the artifact description.

During this procedure, the authors are allowed to communicate with reviewers via audio/video chats and provide necessary instructions and explanations.

Results Reproduced badge

Artifacts Validated - Results Reproduced: Reviewers are requested to make judgments based on the key results to be reproduced that are listed in the authors’ artifact description being submitted and evaluate if these key results can be fully reproduced using the artifact submitted by the authors.

It is up to the reviewers’ discretion to decide whether the key results listed by the authors cover all the main results reported in the paper, and reviewers have the right to add more results to be evaluated from those reported in the paper. However, due to the practical difficulty of evaluating the reproducibility of the following types of artifacts, special evaluation criteria can be applied as described below.

  • Experiment results that require large amounts of repeating experiments: Given that many key results in mobile systems papers are statistical and hence require large amounts of repeating experiments in the same or different settings, it would be hard to reproduce the exact same experiment results in artifact evaluation.
  • Note that in these cases, upon mutual agreement between the reviewers and the authors, the authors could prepare and submit a demo video that is made by operating their workflow scripts being submitted and demonstrates all the key system functionalities in the artifact. The reviewers could then follow the workflow scripts and demo video to evaluate if the demonstrated system functionalities can be reproduced/replicated.

    It is the reviewer’s discretion to decide if the demo video sufficiently reflects the key results being reported in the paper.

  • For experiment results that are subject to specific environmental settings or conditions: Similar as above, the authors are responsible to make sure that 1) these environmental settings and conditions are fully reflected in the demo video; and 2) when artifacts are evaluated via remote access, these settings and conditions are fully replicated at the authors’ side. It is the reviewer’s discretion to decide if the environmental settings and conditions match those described in the paper.
  • For experiment results that involve large amounts of computations, data collection or transmissions that are time-consuming: The reviewers and the authors could communicate to decide on a reduced but still representative scope of experiments that can be completed within a reasonable time frame.
  • Examples of such reduced but representative scope include a) a subset of a public dataset with the same dimensionality (e.g., number of classes); b) a reduced amount of data transmissions under the same transmission link conditions.

  • For experiment results that involve human subjects: The authors are responsible to provide access to the system artifacts that are deployed on human subjects with the same conditions and system configurations as described in the paper. Similar to the above, the authors are also responsible to provide a demo video that instructs the reviewers to safely operate the artifact over human subjects. Such access, if being provided by remote access, is subject to IRB approval at the authors’ institutions.

Additional information

For any other questions, please reach out to the Artifact Evaluation Chairs.

Disclaimer

This text is adapted from ACM MobiCom 2025 Calls for Artifacts. We thank the MobiCom 2025 Artifact Evaluation chairs for their feedback and support.