Artifacts Tutorial

Artifacts Tutorial for FSE 2016

For an example of how one paper can contain multiple research artifacts, consider the chapter “Analytical Product Release Planning” (by Nayebi and Ruhe, forthcoming in “The Art and Science of Analyzing Software Data”). That paper contains notes on at least four artifacts, listed below. While a reader of that paper may never precisely repeat the analysis of that paper, they might reuse one, some, or all of the following in the other applications:

  1. Analogical reasoning
  2. DBScan (which is a kind of density-based clustering algorithm)
  3. Attribute weighting (the reprocessing of data to filter out erroneous values or to fill in missing values)
  4. Methodological tools for assessing a learned model (leave-n-out experiments; PRED; MMRE)

Other specific examples of “artifacts” include:

  • Checklists for assessing a case study design, as well as associated processing scripts (written in “R”), as offered by Ernst et al. in their FSE 2015 paper [Link]
  • The tutorial on qualitative sparklines by Robillard (with Ying) [Link]
  • Source code for the Cliff’s Delta effect size test [Link]
  • The 33 “CK” datasets (comprising defect logs and static code measures from open source Java projects) offered by Jureczko [Link]
  • Anti-patterns (i.e., tips and traps for researchers) such as this excellent discussion of anti-patterns in data analytics [Link]

Please review the longer (but non-exhaustive) list of known research artifact types. Note that the list of useful artifacts includes all of the items emphasized above, as well as:

  • Executables: e.g., standalone executable tools
  • Non-executables, e.g.:
    • Motivational statements that call for significant work in some new direction
    • Tutorials that explain complex research results to a general industrial audience
    • Data associated with a challenge problem that represents the state of the art in some area

Important Note

For artifacts that are executable tools, please submit to the FSE 2016 Demonstrations Track. For all other types of artifacts, please submit to the FSE 2016 Artifacts Track.


Registration now open

Important: Please pre-register to allow us to pre-print your badge in advance.
Note that we have limited availability for on-site registrations. Register early!

We look forward to seeing you at the conference!
Registration rates and policies

Attendee information

Everything you need to know for attending FSE.


The proceedings are now in the ACM Digital Library.

Print Program (*new*)

The program part of the FSE Yearbook. The pages with attendee profiles and advertisement will only be available in the print copy that attendees will receive at the conference.

FSE Week Overview

FSE conference (November 15-17), Workshops (November 13, 14, and 18), Doctoral Symposium (November 14)

Schedule Main Conference

Check out the schedule of the main conference.

Conference Preview

Check out a preview of conference highlights.

Hotel reservations now open

The room rate is USD 189.00 / Night (Excluding Taxes & Fees). The rate is available until October 15, 2016. Consider participating in the Room Sharing program.

Important Dates


  • Research papers: March 11, 2016
  • Workshop proposals: March 25, 2016
  • Visions and Reflections papers: June 15, 2016
  • Industry papers: June 15, 2016
  • Demo papers: June 15, 2016
  • Doctoral Symposium: June 15, 2016
  • Student Research Competition: June 15 July 1, 2016
  • Workshop papers: July 1, 2016

Rebuttal Period

  • For research papers only: April 30, 2016 (Noon PDT) - May 3, 2016 (23:59:59 AOE)


  • Pre-conference Events: November 13-14, 2016
  • Doctoral Symposium: November 14, 2016
  • Main Conference: November 15-17, 2016
  • Post-conference Events: November 18, 2016