A Web-Based Information System to Evaluate Different Versions of IT Artefacts in Online Experiments

  • Dennis M. Riehle Universität Münster - ERCIS
  • Stefan Fleischer Universität Münster - ERCIS
  • Jörg Becker Universität Münster - ERCIS
Keywords: IT Artefact, Online Experiments, Evaluation Platform, Versioning


Design science research is a common research method in the field of information systems (IS), as it bridges the gap between IS research and practice. The outcome of design science research are artifacts, which – besides others –can be prototypical applications, so-called IT artifacts. When such IT artifacts are evaluated as part of a design science research cycle, questionnaires and inter- views are a commonly used method. We have integrated the demonstration and evaluation phase of a web-based IT artifact, by developing a web-based infor- mation system which integrates both a web-based prototype with a questionnaire system. Our information system supports multiple studies, different versions of the IT artifact and several question-specific and participant-specific configura- tion options.


Hevner, A.R., March, S.T., Park, J., Ram, Sudha: Design Science in Information Systems Research. MIS Q. 28, 75–105 (2004).

Peffers, K., Tuunanen, T., Rothenberger, M.A., Chatterjee, S.: A Design Science Research Methodology for Information Systems Research. J. Manag. Inf. Syst. 24, 45–77 (2007). https://doi.org/10.2753/MIS0742-1222240302.

March, S.T., Smith, G.F.: Design and natural science research on information technology. Decis. Support Syst. 15, 251–266 (1995). https://doi.org/10.1016/0167-9236(94)00041-2.

March, S.T., Storey, V.C.: Design science in the information systems dicipline: an introduction to the special issue on design science research. MIS Q. 32, 725–730 (2008).

Nunes, D.A., Schwabe, D.: Rapid Prototyping of Web Applications Combining Domain Specific Languages and Model Driven Design. Presented at the ICWE 2006 , Palo Alto, USA (2006).

Pop, D.-P., Altar, A.: Designing an MVC Model for Rapid Web Application Development. Procedia Eng. 69, 1172–1179 (2014). https://doi.org/10.1016/j.proeng.2014.03.106.

Österle, H., Becker, J., Frank, U., Hess, T., Karagiannis, D., Krcmar, H., Loos, P., Mertens, P., Oberweis, A., Sinz, E.J.: Memorandum on design-oriented information systems research. Eur. J. Inf. Syst. 20, 7–10 (2011).

Chen, P.P.-S.: The Entity-Relationship Model – Toward a Unified View of Data. ACM Trans. Database Syst. 1, 9–36 (1975).

Fowler, M., Scott, K.: UML Distilled – Applying the Standard Object Modeling Language. Addison-Wesley, Reading, MA (1997).

Sonnenberg, C., vom Brocke, J.: Evaluations in the Science of the Artificial – Reconsidering the Build-Evaluate Pattern in Design Science Research. In: Peffers, K., Rothenberger, M., and Kuechler, B. (eds.) Design Science Research in Information Systems. Advances in Theory and Practice. pp. 381–397. Springer Berlin Heidelberg, Berlin, Heidelberg (2012). https://doi.org/10.1007/978-3-642-29863-9_28.

Bjork, R.A.: Positive forgetting: The noninterference of items intentionally forgotten. J. Verbal Learn. Verbal Behav. 9, 255–268 (1970).

Bjork, R.A., Woodward, A.E.: Directed forgetting of individual words in free recall. J. Exp. Psychol. 99, 22–27 (1973).

Bjork, E.L., Bjork, R.A.: Intentional forgetting can increase, not decrease, residual influences of to-be-forgotten information. J. Exp. Psychol. Learn. Mem. Cogn. 29, 524–531 (2003).

Thielsch, M.T., Meeßen, S.M., Hertel, G.: Trust and distrust in information systems at the workplace. PeerJ. 6:e6483, 1–26 (2018).

How to Cite
Riehle, D., Fleischer, S. and Becker, J. 2019. A Web-Based Information System to Evaluate Different Versions of IT Artefacts in Online Experiments. AIS Transactions on Enterprise Systems. 4, 1 (May 2019). DOI:https://doi.org/10.30844/ais-tes.v4i1.10.