Context, Composition, Automation, and Communication -- The C2AC Roadmap for Modeling and Simulation (2310.05649v2)
Abstract: Simulation has become, in many application areas, a sine-qua-non. Most recently, COVID-19 has underlined the importance of simulation studies and limitations in current practices and methods. We identify four goals of methodological work for addressing these limitations. The first is to provide better support for capturing, representing, and evaluating the context of simulation studies, including research questions, assumptions, requirements, and activities contributing to a simulation study. In addition, the composition of simulation models and other simulation studies' products must be supported beyond syntactical coherence, including aspects of semantics and purpose, enabling their effective reuse. A higher degree of automating simulation studies will contribute to more systematic, standardized simulation studies and their efficiency. Finally, it is essential to invest increased effort into effectively communicating results and the processes involved in simulation studies to enable their use in research and decision-making. These goals are not pursued independently of each other, but they will benefit from and sometimes even rely on advances in other subfields. In the present paper, we explore the basis and interdependencies evident in current research and practice and delineate future research directions based on these considerations.
- Eric Winsberg. Science in the Age of Computer Simulation. University of Chicago Press, 2010.
- Osman Balci. A life cycle for modeling and simulation. Simulation, 88(7):870–883, 2012.
- Averill M Law. How to build valid and credible simulation models. In 2019 Winter Simulation Conference (WSC), pages 1402–1414. IEEE, 2019.
- Stewart Robinson. Simulation: The Practice of Model Development and Use. Bloomsbury Publishing, 2014.
- Agent-based social simulation of the covid-19 pandemic: A systematic review. JASSS: Journal of Artificial Societies and Social Simulation, 24(3), 2021.
- Forecasting models for coronavirus disease (covid-19): A survey of the state-of-the-art. SN Computer Science, 1(4):1–15, 2020.
- Analytics saves lives during the covid crisis in chile. Technical report, 2022. Franz Edelman Award.
- Impact of non-pharmaceutical interventions (npis) to reduce covid-19 mortality and healthcare demand. Technical report, Imperial College COVID-19 Response Team London, 2020.
- Hospital preparedness during epidemics using simulation: the case of covid-19. Central European Journal of Operations Research, 30(1):213–249, 2022.
- Dmitry Ivanov. Predicting the impacts of epidemic outbreaks on global supply chains: A simulation-based analysis on the coronavirus outbreak (covid-19/sars-cov-2) case. Transportation Research Part E: Logistics and Transportation Review, 136:101922, 2020.
- Modeling for covid-19 college reopening decisions: Cornell, a case study. Proceedings of the National Academy of Sciences, 119(2):e2112532119, 2022.
- Importance of interaction structure and stochasticity for epidemic spreading: A COVID-19 case study. In Marco Gribaudo, David N. Jansen, and Anne Remke, editors, Quantitative Evaluation of Systems - 17th International Conference, QEST 2020, Vienna, Austria, August 31 - September 3, 2020, Proceedings, volume 12289 of Lecture Notes in Computer Science, pages 211–229. Springer, 2020. doi:10.1007/978-3-030-59854-9_16. URL https://doi.org/10.1007/978-3-030-59854-9_16.
- The impact of uncertainty on predictions of the CovidSim epidemiological code. Nature Computational Science, 1(2), February 2021. ISSN 2662-8457. doi:10.1038/s43588-021-00028-9. URL https://www.nature.com/articles/s43588-021-00028-9.
- How government leaders violated their epistemic duties during the sars-cov-2 crisis. Kennedy Institute of Ethics Journal, 30(3):215–242, 2020.
- Computer Science Methods for Effective and Sustainable Simulation Studies (Dagstuhl Seminar 22401). Dagstuhl Reports, 12(10):1–60, 2023. ISSN 2192-5283. doi:10.4230/DagRep.12.10.1. URL https://drops.dagstuhl.de/opus/volltexte/2023/17819.
- Theory of Modelling and Simulation: Integrating Discrete Event and Continuous Complex Dynamic Systems. Academic Press, San Diego, CA, 2000.
- Gianfranco Balbo. Introduction to stochastic petri nets. In School organized by the European Educational Forum, pages 84–155. Springer, 2000.
- Jane Hillston. Process algebras for quantitative analysis. In 20th Annual IEEE Symposium on Logic in Computer Science (LICS’05), pages 239–248. IEEE, 2005.
- The Unified Modeling Language User Guide. Addison-Wesley, 1998.
- Bernhard Rumpe. Agile Modeling with UML: Code Generation, Testing, Refactoring. Springer International, May 2017.
- UML Distilled: Applying the Standard Object Modeling Language. Addison-Wesley Longman Ltd., Essex, UK, UK, 1997. ISBN 0-201-32563-2.
- Tim Weilkiens. Systems Engineering with SysML/UML: Modeling, Analysis, Design. Elsevier, 2008.
- A Practical Guide to SysML: The Systems Modeling Language. The MK/OMG Press. Elsevier Science, 2011. ISBN 9780123852076. URL http://books.google.de/books?id=4xz6Fx50zwcC.
- The Language of SysML v2 under the Magnifying Glass. Journal of Object Technology (JOT), 21:1–15, July 2022.
- Bionetgen: Software for rule-based modeling of signal transduction based on the interactions of molecular domains. Bioinformatics, 20(17):3289–3291, 2004.
- The kappa platform for rule-based modeling. Bioinformatics, 34(13):i583–i592, 2018.
- Semantics and efficient simulation algorithms of an expressive multilevel modeling language. ACM Transactions on Modeling and Computer Simulation (TOMACS), 27(2):1–25, 2017.
- A language for agent-based discrete-event modeling and simulation of linked lives. ACM Transactions on Modeling and Computer Simulation (TOMACS), 32(1):1–26, 2022.
- On credibility of simulation studies of telecommunication networks. IEEE Communications Magazine, 40(1):132–139, 2002.
- Zeeya Merali. Computational science:… error. Nature, 467(7317):775–777, 2010.
- Sessl: A domain-specific language for simulation experiments. ACM Transactions on Modeling and Computer Simulation (TOMACS), 24(2):1–25, 2014.
- Reproducible computational biology experiments with sed-ml-the simulation experiment description markup language. BMC Systems Biology, 5(1):1–10, 2011a.
- The nlrx r package: A next-generation framework for reproducible netlogo model analyses. Methods in Ecology and Evolution, 10(11):1854–1863, 2019.
- Conventional workflow technology for scientific simulation. Guide to e-Science: Next Generation Scientific Research and Discovery, pages 323–352, 2011.
- Minimum Information about a Simulation Experiment (MIASE). PLoS Computational Biology, 7(4):e1001122, 2011b.
- Reporting guidelines for simulation-based research in social sciences. Systems Dynamics Review, 28(4):396–411, 2012.
- Towards better modelling and decision support: Documenting model development, testing, and analysis using trace. Ecological Modelling, 280:129–139, 2014.
- Strengthening the Reporting of Empirical Simulation Studies: Introducing the STRESS Guidelines. Journal of Simulation, 13(1):55–67, 2019.
- A survey of statistical model checking. ACM Transactions on Modeling and Computer Simulation (TOMACS), 28(1):1–39, 2018.
- Statistical Model Checking. In Bernhard Steffen and Gerhard Woeginger, editors, Computing and Software Science, volume 10000, pages 478–504. Springer International Publishing, Cham, 2019. ISBN 978-3-319-91907-2 978-3-319-91908-9. doi:10.1007/978-3-319-91908-9_23. URL http://link.springer.com/10.1007/978-3-319-91908-9_23. Series Title: Lecture Notes in Computer Science.
- Formal specification of hypotheses for assisting computer simulation studies. In Proceedings of the Symposium on Theory of Modeling & Simulation, pages 1–12, 2017.
- Bernhard Zeigler. Theory of Modeling and Simulation. John Wiley, 1976.
- Bernard P. Zeigler. Constructs for the specifications of models and experimental frames. SIGSIM Simul. Dig., 9(1):12–13, sep 1977. ISSN 0163-6103. doi:10.1145/1102505.1102510. URL https://doi.org/10.1145/1102505.1102510.
- Theory of Modeling and Simulation: Discrete Event & Iterative System Computational Foundations. Academic press, 2018.
- The experiment model and validity frame in m&s. In Proceedings of the Symposium on Theory of Modeling & Simulation, pages 1–12, 2017.
- Pegasus, a workflow management system for science automation. Future Generation Computer Systems, 46:17–35, 2015. ISSN 0167-739X. doi:https://doi.org/10.1016/j.future.2014.10.008. URL https://www.sciencedirect.com/science/article/pii/S0167739X14002015.
- Specification-Based Monitoring of Cyber-Physical Systems: A Survey on Theory, Tools and Applications. In Lectures on Runtime Verification, Lecture Notes in Computer Science, pages 135–175. Springer, Cham, 2018. ISBN 978-3-319-75631-8 978-3-319-75632-5. doi:10.1007/978-3-319-75632-5_5. URL https://link.springer.com/chapter/10.1007/978-3-319-75632-5_5.
- A logic for monitoring dynamic networks of spatially-distributed cyber-physical systems. Logical Methods in Computer Science, 18(1), 2022. doi:10.46298/lmcs-18(1:4)2022. URL https://doi.org/10.46298/lmcs-18(1:4)2022.
- A model-driven approach for conducting simulation experiments. Applied Sciences, 12(16):7977, 2022.
- Bpmn: An introduction to the standard. Computer Standards & Interfaces, 34(1):124–134, 2012.
- Pybionetfit and the biological property specification language. IScience, 19:1012–1036, 2019.
- Complex adaptive systems modeling with Repast Simphony. Complex Adaptive Systems Modeling, 1(1):3, March 2013. ISSN 2194-3206. doi:10.1186/2194-3206-1-3. URL https://doi.org/10.1186/2194-3206-1-3.
- ABS: A core language for abstract behavioral specification. In Bernhard K. Aichernig, Frank de Boer, and Marcello M. Bonsangue, editors, Proc. 9th Intl. Symp. on Formal Methods for Components and Objects (FMCO 2010), volume 6957 of LNCS, pages 142–164. Springer, 2011.
- A hybrid programming language for formal modeling and verification of hybrid systems. Leibniz Transactions on Embedded Systems, 8(1), 2022. Special Issue on Distributed Hybrid Systems.
- Complex simulation experiments made easy. In 2018 Winter Simulation Conference (WSC), pages 410–424. IEEE, 2018.
- Ludwig von Bertalanffy. General System Theory: Foundations, Development, Applications. G. Braziller, 1968.
- A calculus of mobile processes, i. Information and Computation, 100(1):1–40, 1992.
- Corrado Priami. Stochastic π𝜋\piitalic_π-calculus. The Computer Journal, 38(7):578–589, 1995. doi:10.1093/comjnl/38.7.578.
- Efficient, correct simulation of biological processes in the stochastic pi-calculus. In Proceedings of the 2007 International Conference on Computational Methods in Systems Biology, CMSB’07, page 184–199, Berlin, Heidelberg, 2007. Springer-Verlag. ISBN 3540751394.
- Kurt Jensen. Coloured Petri Nets: Basic Concepts, Analysis Methods and Practical Use, volume 1. Springer Science & Business Media, 1996.
- The Attributed Pi-Calculus with Priorities, pages 13–76. Springer Berlin Heidelberg, Berlin, Heidelberg, 2010. ISBN 978-3-642-11712-1. doi:10.1007/978-3-642-11712-1_2. URL https://doi.org/10.1007/978-3-642-11712-1_2.
- Fernando J. Barros. Modeling formalisms for dynamic structure systems. ACM Transactions on Modeling and Computer Simulation, 7(4):501–515, oct 1997. ISSN 1049-3301. doi:10.1145/268403.268423. URL https://doi.org/10.1145/268403.268423.
- Continuous System Modeling. Springer Science & Business Media, 2013.
- A case study using the imse experimentation tool. In Advanced Information Systems Engineering: Third International Conference CAiSE’91 Trondheim, Norway, May 13–15, 1991 Proceedings 3, pages 284–306. Springer, 1991.
- Capturing the dual relationship between simulation models and their context. Simulation Modelling Practice and Theory, 14(2):126–142, 2006.
- Exploring validity frames in practice. In Systems Modelling and Management: First International Conference, ICSMM 2020, Bergen, Norway, June 25–26, 2020, pages 131–148. Springer, 2020.
- Using workflows and web services to manage simulation studies (wip). In Proceedings of the 2012 Symposium on Theory of Modeling and Simulation-DEVS Integrative M&S Symposium, pages 1–6, 2012.
- Goal-directed grid-enabled computing for legacy simulations. In 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012), pages 873–879. IEEE, 2012.
- Scientific workflows and provenance: Introduction and research opportunities. Datenbank-Spektrum, 12(3):193–203, 2012. doi:10.1007/s13222-012-0100-z. URL https://doi.org/10.1007/s13222-012-0100-z.
- Coroutines and networks of parallel processes. 1976.
- Scientific workflow management and the kepler system. Concurrency and Computation: Practice and Experience, 18(10):1039–1065, 2006.
- Taverna: Lessons in creating a workflow environment for the life sciences. Concurrency and Computation: Practice and Experience, 18(10):1067–1100, 2006.
- A discussion on experimental model validation. In 2009 11th International Conference on Computer Modelling and Simulation, pages 161–167. IEEE, 2009.
- Working groups’ report: The challenge of combining simulation and verification. In Dagstuhl Seminar Proc. 06161: Simulation and Verification of Dynamic Systems, 2006.
- Model Checking. MIT Press, Cambridge, MA, USA, 1999. ISBN 0-262-03270-8.
- Efficient robust monitoring for stl. In International Conference on Computer Aided Verification, pages 264–279. Springer, 2013.
- Qualitative and quantitative monitoring of spatio-temporal properties with SSTL. Logical Methods in Computer Science, 14(4), 2018. doi:10.23638/LMCS-14(4:2)2018. URL https://doi.org/10.23638/LMCS-14(4:2)2018.
- Stl∗∗{}^{\ast}start_FLOATSUPERSCRIPT ∗ end_FLOATSUPERSCRIPT: Extending signal temporal logic with signal-value freezing operator. Information and Computation, 236:52–67, 2014. doi:10.1016/j.ic.2014.01.012. URL https://doi.org/10.1016/j.ic.2014.01.012.
- On temporal logic and signal processing. In Supratik Chakraborty and Madhavan Mukund, editors, Automated Technology for Verification and Analysis - 10th International Symposium, ATVA 2012, Thiruvananthapuram, India, October 3-6, 2012. Proceedings, volume 7561 of Lecture Notes in Computer Science, pages 92–106. Springer, 2012. doi:10.1007/978-3-642-33386-6_9. URL https://doi.org/10.1007/978-3-642-33386-6_9.
- Analysis of spatio-temporal properties of stochastic systems using tstl. ACM Transactions on Modeling and Computer Simulation, 29(4), 2019. ISSN 1049-3301. doi:10.1145/3326168. URL https://doi.org/10.1145/3326168.
- Martin Fowler. Domain-Specific Languages. Pearson Education, 2010.
- CDDiff: Semantic Differencing for Class Diagrams. In Mira Mezini, editor, ECOOP 2011 - Object-Oriented Programming, pages 230–254. Springer Berlin Heidelberg, 2011. URL https://se-rwth.de/publications/CDDiff-Semantic-Differencing-for-Class-Diagrams.pdf.
- Bernhard Rumpe. Modeling with UML: Language, Concepts, Methods. Springer International, July 2016. URL https://mbse.se-rwth.de/.
- Meta-Modelling Semantics of UML. In H. Kilov, B. Rumpe, and I. Simmonds, editors, Behavioral Specifications of Businesses and Systems, pages 45–60. Kluver Academic Publisher, 1999. ISBN 978-1-4613-7383-4.
- Making UML Precise. In OOPSLA’98 Workshop on “Formalizing UML. Why and How?”, Vancouver, Canada, October 1998.
- A model-driven approach to enable the simulation of complex systems on distributed architectures. SIMULATION, 95(12):1185–1211, 2019. doi:10.1177/0037549719829828. URL https://doi.org/10.1177/0037549719829828.
- Olivier Casse. SysML in Action with Cameo Systems Modeler. Elsevier, 2017. ISBN 978-1-78548-171-0.
- Simulating sysml models: Overview and challenges. In 2015 10th System of Systems Engineering Conference (SoSE), 2015. doi:10.1109/SYSOSE.2015.7151961.
- Reference modelling in support of m&s—foundations and applications. Journal of Simulation, 7:69–82, 2013.
- Conceptual Model of the Globalization for Domain-Specific Languages. In Globalizing Domain-Specific Languages, LNCS 9400, pages 7–20. Springer, 2015. URL http://www.se-rwth.de/publications/Conceptual-Model-of-the-Globalization-for-Domain-Specific-Languages.pdf.
- Rule-based modeling of biochemical systems with bionetgen. In Systems Biology, pages 113–167. Springer, 2009.
- Copasi—a complex pathway simulator. Bioinformatics, 22(24):3067–3074, 2006.
- Compartmental and spatial rule-based modeling with virtual cell. Biophysical Journal, 113(7):1365–1372, 2017.
- Bio-pepa: A framework for the modelling and analysis of biological systems. Theoretical Computer Science, 410(33-34):3065–3084, 2009.
- The pepa workbench: A tool to support a process algebra-based approach to performance modelling. Computer Performance Evaluation, 794:353–368, 1994.
- Agent based modelling and simulation tools: A review of the state-of-art software. Computer Science Review, 24:13–33, 2017. ISSN 1574-0137. doi:https://doi.org/10.1016/j.cosrev.2017.03.001. URL https://www.sciencedirect.com/science/article/pii/S1574013716301198.
- Introduction to DEVS Modeling and Simulation with JAVA: Developing Component-based Simulation Models. Technical report, Arizona Center of Integrative Modeling and Simulation, University of Arizona, 2005.
- Defining devs models with the cd++ toolkit. In Proceedings of SCS European Simulation Symposium, 2001.
- Experiences creating three implementations of the repast agent modeling toolkit. ACM Transactions on Modeling and Computer Simulation (TOMACS), 16(1):1–25, 2006.
- Mason: A multiagent simulation environment. Simulation, 81(7):517–527, 2005.
- Simjava: A discrete event simulation library for java. Simulation Series, 30:51–56, 1998.
- Using java for discrete event simulation. In Proceedings of the Twelfth UK Computer and Telecommunications Performance Engineering Workshop, pages 219–228. Citeseer, 1996.
- Hugues Bersini. Uml for abm. Journal of Artificial Societies and Social Simulation, 15(1):9, 2012.
- Gerd Wagner. Tutorial: Information and process modeling for simulation. In Proceedings of the 2014 Winter Simulation Conference, WSC ’14, page 103–117. IEEE Press, 2014.
- Population-based ctmcs and agent-based models. In 2016 Winter Simulation Conference (WSC), pages 1253–1264. IEEE, 2016.
- A survey of active object languages. ACM Computing Surveys, 50(5):76:1–76:39, oct 2017. Article 76.
- Active Object Languages: Current Research Trends, volume 14360 of LNCS. Springer, Cham, 2024. ISBN 978-3-031-51059-5.
- The ABS simulator toolchain. Science of Computer Programming, 223:102861, 2022. doi:10.1016/j.scico.2022.102861.
- Formal modeling and analysis of railway operations with active objects. Science of Computer Programming, 166:167–193, 2018. doi:10.1016/j.scico.2018.07.001. URL https://doi.org/10.1016/j.scico.2018.07.001.
- S4BXI: the mpi-ready portals 4 simulator. In 29th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, MASCOTS 2021, Houston, TX, USA, November 3-5, 2021, pages 1–8. IEEE, 2021. doi:10.1109/MASCOTS53633.2021.9614285. URL https://doi.org/10.1109/MASCOTS53633.2021.9614285.
- A formal model of the kubernetes container framework. In Tiziana Margaria and Bernhard Steffen, editors, Leveraging Applications of Formal Methods, Verification and Validation: Verification Principles - 9th International Symposium on Leveraging Applications of Formal Methods, ISoLA 2020, Rhodes, Greece, October 20-30, 2020, Proceedings, Part I, volume 12476 of Lecture Notes in Computer Science, pages 558–577. Springer, 2020. doi:10.1007/978-3-030-61362-4_32. URL https://doi.org/10.1007/978-3-030-61362-4_32.
- Modeling resource-aware virtualized applications for the cloud in real-time ABS. In Toshiaki Aoki and Kenji Taguchi, editors, Formal Methods and Software Engineering - 14th International Conference on Formal Engineering Methods, ICFEM 2012, Kyoto, Japan, November 12-16, 2012. Proceedings, volume 7635 of Lecture Notes in Computer Science, pages 71–86. Springer, 2012. doi:10.1007/978-3-642-34281-3_8. URL https://doi.org/10.1007/978-3-642-34281-3_8.
- An efficient TCTL model checking algorithm and a reduction technique for verification of timed actor models. Science of Computer Programming, 153:1–29, 2018. doi:10.1016/j.scico.2017.11.004. URL https://doi.org/10.1016/j.scico.2017.11.004.
- Marjan Sirjani. Analysing real-time distributed systems using timed actors. In Floriano De Rango, Carlos T. Calafate, Miroslav Voznák, Alfredo Garro, and Mauro Tropea, editors, 23rd IEEE/ACM International Symposium on Distributed Simulation and Real Time Applications DS-RT 2019, Cosenza, Italy, October 7-9, 2019, page 1. IEEE, 2019. doi:10.1109/DS-RT47707.2019.8958670. URL https://doi.org/10.1109/DS-RT47707.2019.8958670.
- Key-abs: A deductive verification tool for the concurrent modelling language ABS. In Amy P. Felty and Aart Middeldorp, editors, Automated Deduction - CADE-25 - 25th International Conference on Automated Deduction, Berlin, Germany, August 1-7, 2015, Proceedings, volume 9195 of Lecture Notes in Computer Science, pages 517–526. Springer, 2015. doi:10.1007/978-3-319-21401-6_35. URL https://doi.org/10.1007/978-3-319-21401-6_35.
- Behavioral contracts for cooperative scheduling. In Wolfgang Ahrendt, Bernhard Beckert, Richard Bubel, Reiner Hähnle, and Mattias Ulbrich, editors, Deductive Software Verification: Future Perspectives, volume 12345 of LNCS, pages 85–121. Springer, Cham, 2020.
- A framework for deadlock detection in core ABS. Software and Systems Modeling, 15(4):1013–1048, 2016. doi:10.1007/s10270-014-0444-y.
- Quantified abstract configurations of distributed systems. Formal Aspects of Computing, 27(4):665–699, 2015. doi:10.1007/s00165-014-0321-z.
- Analysis of executable software models. In Marco Bernardo, Ferruccio Damiani, Reiner Hähnle, Einar Broch Johnsen, and Ina Schaefer, editors, Formal Methods for Executable Software Models: 14th Intl. School on Formal Methods for the Design of Computer, Communication, and Software Systems, SFM, Bertinoro, Italy, volume 8483 of LNCS, pages 1–25. Springer, 2014. doi:10.1007/978-3-319-07317-0_1.
- Multiactive objects and their applications. Logical Methods in Computer Science, 13(4), 2017. doi:10.23638/LMCS-13(4:12)2017. URL https://doi.org/10.23638/LMCS-13(4:12)2017.
- Norm Matloff. Introduction to discrete-event simulation and the simpy language. Davis, CA. Dept of Computer Science. University of California at Davis., 2(2009):1–33, 2008.
- A python extension to simulate petri nets in process mining. arXiv preprint arXiv:2102.08774, 2021.
- The modular architecture of the python (p) devs simulation kernel. In Proceedings of the 2014 Symposium on Theory of Modeling and Simulation-DEVS, pages 387–392, 2014.
- Certain trends in uncertainty and sensitivity analysis: An overview of software tools and techniques. Environmental Modelling & Software, 124:104588, 2020.
- A tutorial on how to connect python with different simulation software to develop rich simheuristics. In 2021 Winter Simulation Conference (WSC), pages 1–12, 2021. doi:10.1109/WSC52266.2021.9715511.
- Reusing simulation experiment specifications to support developing models by successive extension. Simulation Modelling Practice and Theory, 68:33–53, 2016. doi:10.1016/j.simpat.2016.07.006. URL https://doi.org/10.1016/j.simpat.2016.07.006.
- Automatic reuse, adaption, and execution of simulation experiments via provenance patterns. ACM Transactions on Modeling and Computer Simulation, 33(1–2), feb 2023a. ISSN 1049-3301. doi:10.1145/3564928. URL https://doi.org/10.1145/3564928.
- Scientific workflows: Business as usual? In Umeshwar Dayal, Johann Eder, Jana Koehler, and Hajo A. Reijers, editors, Business Process Management (BPM), 7th Intl. Conference, volume 5701 of LNCS, pages 31–47, Ulm, Germany, 2009. Springer. doi:10.1007/978-3-642-03848-8_4. URL https://doi.org/10.1007/978-3-642-03848-8_4.
- Scientific workflow design for mere mortals. Future Generation Computer Systems, 25(5):541–551, 2009. doi:10.1016/j.future.2008.06.013. URL https://doi.org/10.1016/j.future.2008.06.013.
- Scientific workflow design with data assembly lines. In Ewa Deelman and Ian J. Taylor, editors, 4th Workshop on Workflows in Support of Large-Scale Scienc (WORKS). ACM, 2009. doi:10.1145/1645164.1645178. URL https://doi.org/10.1145/1645164.1645178.
- Methods included: Standardizing computational reuse and portability with the Common Workflow Language. Communications of the ACM, 65(6):54–63, May 2022. ISSN 0001-0782. doi:10.1145/3486897. URL https://dl.acm.org/doi/10.1145/3486897.
- Formal requirements modeling for simulation-based verification. In 11th International Modelica Conference, 2015.
- Validation without data - formalizing stylized facts of time series. In Winter Simulation Conference (WSC 2023). IEEE Press, 2023b. accepted.
- Probabilistic model checking in practice: Case studies with PRISM. SIGMETRICS Performance Evaluation Review, 32(4):16–21, 2005. doi:10.1145/1059816.1059820. URL https://doi.org/10.1145/1059816.1059820.
- Smoothed model checking for uncertain continuous-time markov chains. Information and Computation, 247:235–253, 2016. doi:10.1016/j.ic.2016.01.004. URL https://doi.org/10.1016/j.ic.2016.01.004.
- Survey on mining signal temporal logic specifications. Information and Computation, 289(Part):104957, 2022. doi:https://doi.org/10.1016/j.ic.2022.104957.
- A new Concept of Refinement used for Behaviour Modelling with Automata. In Proceedings of the Industrial Benefit of Formal Methods (FME’94), LNCS 873, pages 154–174. Springer, 1994.
- Refinement of Information Flow Architectures. In M. Hinchey, editor, ICFEM’97 Proceedings, Hiroshima, Japan, 1997. IEEE CS Press.
- Requirements modeling languages for software product lines: A systematic literature review. Information and Software Technology, 69:16–36, 2016. ISSN 0950-5849. doi:https://doi.org/10.1016/j.infsof.2015.08.007. URL https://www.sciencedirect.com/science/article/pii/S0950584915001494.
- Engineering Modeling Languages: Turning Domain Knowledge into Tools. Chapman & Hall/CRC Innovations in Software Engineering and Software Development Series, November 2016.
- Variability within Modeling Language Definitions. In Conference on Model Driven Engineering Languages and Systems (MODELS’09), LNCS 5795, pages 670–684. Springer, 2009. URL http://www.se-rwth.de/publications/Variability-within-Modeling-Language-Definitions.pdf.
- MontiCore Language Workbench and Library Handbook: Edition 2021. Aachener Informatik-Berichte, Software Engineering, Band 48. Shaker Verlag, May 2021. ISBN 978-3-8440-8010-0. URL http://www.monticore.de/handbook.pdf.
- An executable metamodelling facility for domain specific language design. In Proc. 4th OOPSLA Workshop on Domain-Specific Modeling, 2004.
- Model-driven development: a metamodeling foundation. IEEE Software, 20(5), 2003. ISSN 0740-7459.
- Anneke Kleppe. Software Language Engineering: Creating Domain-Specific Languages using Metamodels. Pearson Education, 2008.
- Domain-specific metamodelling languages for software language engineering. In International Conference on Software Language Engineering, pages 334–353. Springer, 2009.
- Object Management Group. Meta Object Facility (MOF) 2.0 Query/View/Transformation Specification, April 2008. URL https://www.omg.org/spec/QVT/1.3/PDF. Accessed: 2023-09-30.
- A declarative approach for transforming sysml models to executable simulation models. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 51(6):3330–3345, 2021. doi:10.1109/TSMC.2019.2922153.
- Model transformation from bpmn to devs in the mdd4ms framework. In Proceedings of the 2012 Symposium on Theory of Modeling and Simulation - DEVS Integrative M&S Symposium, TMS/DEVS ’12, San Diego, CA, USA, 2012. Society for Computer Simulation International. ISBN 9781618397867.
- Multi-formalism and multi-solution-method modeling frameworks: The möbius approach. In Proc. Symp. Performance Evaluation - Stories and Perspectives, pages 241–256, 2003.
- Meta-modelling and graph grammars for multi-paradigm modelling in AToM3. Software & Systems Modeling, 3(3):194–209, August 2004. ISSN 1619-1374. doi:10.1007/s10270-003-0047-5. URL https://doi.org/10.1007/s10270-003-0047-5.
- Model-driven architecture. In International Conference on Object-Oriented Information Systems, pages 290–297. Springer, 2002.
- A model-driven engineering approach to simulation experiment design and execution. In 2015 Winter Simulation Conference (WSC), pages 2632–2643, 2015. doi:10.1109/WSC.2015.7408371.
- Steffen Zschaler and Fiona A. C. Polack. A family of languages for trustworthy agent-based simulation. In Proceedings of the 13th ACM SIGPLAN International Conference on Software Language Engineering, SLE 2020, pages 16–21, New York, NY, USA, November 2020. Association for Computing Machinery. doi:10.1145/3426425.3426929.
- The goal structuring notation–a safety argument notation. In Proceedings of the dependable systems and networks 2004 workshop on assurance cases, volume 6. Citeseer, 2004.
- Stewart Robinson. Conceptual modelling for simulation part i: Definition and requirements. Journal of the Operational Research Society, 59(3):278–290, 2008.
- Conceptual modeling: Definition, purpose and benefits. In 2015 Winter Simulation Conference (WSC), pages 2812–2826, 2015. doi:10.1109/WSC.2015.7408386.
- Research Challenges in Modeling and Simulation for Engineering Complex Systems. Springer, 2017.
- Conceptual models in simulation studies: Making it explicit. In 2020 Winter Simulation Conference (WSC), pages 2353–2364. IEEE, 2020.
- Exploring mechanistic and temporal regulation of lrp6 endocytosis in canonical wnt signaling. Journal of Cell Science, 133(15), August 2020.
- Documenting social simulation models: the odd protocol as a standard. In Simulating Social Complexity, pages 349–365. Springer, 2017.
- The odd protocol for describing agent-based and other simulation models: A second update to improve clarity, replication, and structural realism. Journal of Artificial Societies and Social Simulation, 23(2), 2020.
- Considerations for reporting finite element analysis studies in biomechanics. Journal of Biomechanics, 45(4):625–633, 2012.
- Annotation and merging of sbml models with semantic sbml. Bioinformatics, 26(3):421–422, 2010.
- Provenance: an introduction to prov. Synthesis Lectures on the Semantic Web: Theory and Technology, 3(4):1–129, 2013.
- Provenance in modeling and simulation studies—bridging gaps. In 2017 Winter Simulation Conference (WSC), pages 872–883. IEEE, 2017.
- Relating simulation studies by provenance—developing a family of wnt signaling models. PLOS Computational Biology, 17(8):e1009227, 2021.
- Scientific Workflows. In Ling Liu and M. Tamer Özsu, editors, Encyclopedia of Database Systems, pages 2507–2511. Springer US, Boston, MA, 2009. ISBN 978-0-387-39940-9. doi:10.1007/978-0-387-39940-9_1471. URL https://doi.org/10.1007/978-0-387-39940-9_1471.
- Scientific Workflows: Moving Across Paradigms. ACM Computing Surveys, 49(4):66:1–66:39, December 2016. ISSN 0360-0300. doi:10.1145/3012429. URL https://dl.acm.org/doi/10.1145/3012429.
- A survey on provenance: What for? What form? What from? The VLDB Journal, 26(6):881–906, December 2017. ISSN 1066-8888, 0949-877X. doi:10.1007/s00778-017-0486-1. URL https://link-springer-com.proxy2.library.illinois.edu/article/10.1007/s00778-017-0486-1.
- Capturing and Reporting Provenance Information of Simulation Studies Based on an Artifact-Based Workflow Approach. In Proceedings of the 2019 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation, SIGSIM-PADS ’19, pages 185–196, New York, NY, USA, 2019a. ACM. ISBN 978-1-4503-6723-3. event-place: Chicago, IL, USA.
- Declarative business artifact centric modeling of decision and knowledge intensive business processes. In 2011 IEEE 15th International Enterprise Distributed Object Computing Conference, pages 151–160. IEEE, 2011.
- Artifact-based workflows for supporting simulation studies. IEEE Transactions on Knowledge and Data Engineering, 32(6):1064–1078, 2019b.
- An agent-based decision model of migration, embedded in the life course-model description in odd+ d format. Max Planck Institute for Demographic Research, 2015.
- Perspectives on languages for specifying simulation experiments. In Winter Simulation Conference (WSC 2014), pages 2836–2847, Electronic ISSN: 1558-4305 Print ISSN: 0891-7736, 2014. IEEE. URL http://eprints.mosi.informatik.uni-rostock.de/32/. doi:10.1109/WSC.2014.7020125.
- Automatic ontology construction from text: a review from shallow to deep learning trend. Artificial Intelligence Review, 53(6):3901–3928, 2020.
- Combine archive and omex format: One file to share all information to reproduce a modeling project. BMC Bioinformatics, 15(1):1–9, 2014.
- Keeping modelling notebooks with trace: Good for you and good for environmental research and management support. Environmental Modelling & Software, 136:104932, 2021.
- noworkflow: a tool for collecting, analyzing, and managing provenance from python scripts. Proceedings of the VLDB Endowment, 10(12), 2017.
- Feature-Oriented Software Product Lines: Concepts and Implementation. Springer, 2013. ISBN 978-3-642-37520-0.
- Feature diagrams: A survey and a formal semantics. In 14th IEEE International Conference on Requirements Engineering (RE 2006), 11-15 September 2006, Minneapolis/St.Paul, Minnesota, USA, pages 136–145. IEEE Computer Society, 2006. doi:10.1109/RE.2006.23. URL https://doi.org/10.1109/RE.2006.23.
- Delta-Oriented Programming of Software Product Lines. In Jan Bosch and Jaejoon Lee, editors, Software Product Lines: Going Beyond (SPLC 2010), volume 6287 of LNCS, pages 77–91, 2010. ISBN 978-3-642-15578-9. doi:10.1007/978-3-642-15579-6_6.
- Family-based deductive verification of software product lines. In Klaus Ostermann and Walter Binder, editors, Generative Programming and Component Engineering, GPCE’12, Dresden, Germany, pages 11–20. ACM, 2012.
- Exploratory Analysis and a Case History of Multiresolution, Multiperspective Modeling. Number RP-925. Rand Corporation, 2000.
- Software Product Line Engineering: Foundations, Principles and Techniques. Springer-Verlag, 2005.
- Tijs Slaats. Declarative and hybrid process discovery: Recent advances and open challenges. Journal on Data Semantics, 9(1):3–20, 2020.
- An artefact-based workflow for finite element simulation studies. Simulation Modelling Practice and Theory, 116:102464, 2022.
- Michael Pidd. Simulation software and model reuse: A polemic. In Proceedings of the Winter Simulation Conference, volume 1, pages 772–775. IEEE, 2002.
- Simulation model reuse: Definitions, benefits and obstacles. Simulation Modelling Practice and Theory, 12(7-8):479–494, 2004.
- Model composition and reuse. In Model Engineering for Simulation, pages 57–85. Elsevier, 2019.
- What use is model reuse: Is there a crook at the end of the rainbow? In Proceedings of the Winter Simulation Conference, volume 1, pages 648–652. IEEE, 2002.
- On syntactic composability and model reuse. In First Asia International Conference on Modelling & Simulation (AMS’07), pages 230–237. IEEE, 2007.
- On code sharing and model documentation of published individual and agent-based models. Environmental Modelling & Software, 134:104873, 2020.
- Synthetic reproduction and augmentation of covid-19 case reporting data by agent-based simulation. medRxiv, pages 2020–11, 2020.
- Gepoc abm: A generic agent-based population model for austria. In 2018 Winter Simulation Conference (WSC), pages 2656–2667. IEEE, 2018.
- Reusability and composability analysis for an agent-based hierarchical modelling and simulation framework. Simulation Modelling Practice and Theory, 90:81–97, 2019.
- In Search of the Philosopher’s Stone: Simulation Composability Versus Component-Based Software Design. In Proceedings of the Fall Simulation Interoperability Workshop, Orlando, USA, 2004.
- Olivier Dalle. OSA: An Open Component-based Architecture for Discrete-event Simulation. In Proceedings of the 20thsuperscript20𝑡ℎ20^{th}20 start_POSTSUPERSCRIPT italic_t italic_h end_POSTSUPERSCRIPT European Conference on Modeling and Simulation, Prague, Czech Republic, 2006.
- Plug’n simulate. In Proceedings of the 40th Annual Simulation Symposium, ANSS ’07, page 137–143, USA, 2007. IEEE Computer Society. ISBN 0769528147. doi:10.1109/ANSS.2007.34. URL https://doi.org/10.1109/ANSS.2007.34.
- The levels of conceptual interoperability model. In Proceedings of the 2003 Fall Simulation Interoperability Workshop, volume 7, pages 1–11. Citeseer, 2003.
- Definition and analysis of composition structures for discrete-event models. In 2008 Winter Simulation Conference, pages 942–950, 2008. doi:10.1109/WSC.2008.4736160.
- The levels of conceptual interoperability model: Applying systems engineering principles to m&s. In Proceedings of the 2009 Spring Simulation Multiconference, SpringSim ’09, San Diego, CA, USA, 2009. Society for Computer Simulation International.
- Atom 3: A tool for multi-formalism and meta-modelling. In International Conference on Fundamental Approaches to Software Engineering, pages 174–188. Springer, 2002.
- A component-based approach to modeling and simulating mixed-signal and hybrid systems. ACM Transactions on Modeling and Computer Simulation, 12(4):343–368, 2002. ISSN 1049-3301. doi:10.1145/643120.643125. URL https://doi.org/10.1145/643120.643125.
- Minimum information requested in the annotation of biochemical models (miriam). Nature Biotechnology, 23(12):1509–1515, 2005.
- Cellml: its future, present and past. Progress in Biophysics and Molecular Biology, 85(2-3):433–450, 2004.
- The systems biology markup language (sbml): a medium for representation and exchange of biochemical network models. Bioinformatics, 19(4):524–531, 2003.
- Sbml and cellml translation in antimony and jsim. Bioinformatics, 30(7):903–907, 2014.
- Observations on the complexity of composable simulation. In Proceedings of the 31st Winter Simulation Conference, pages 553–560. IEEE, 1999.
- Sbml level 3 package: spatial processes, version 1, release 1. Journal of Integrative Bioinformatics, 20(1):20220054, 2023.
- The simulation experiment description markup language (sed-ml): language specification for level 1 version 4. Journal of integrative bioinformatics, 18(3):20210021, 2021.
- An ontology for discrete-event modeling and simulation. Simulation, 87(9):747–773, 2011.
- Biomodels database: An enhanced, curated and annotated resource for published quantitative kinetic models. BMC Systems Biology, 4(1):1–14, 2010.
- ACM. Artifact reviewing and badging, accessed 2024. URL https://www.acm.org/publications/policies/artifact-review-and-badging-current.
- Reusing software: Issues and research directions. IEEE Transactions on Software Engineering, 21(6):528–562, 1995.
- Quality, productivity and economic benefits of software reuse: A review of industrial studies. Empirical Software Engineering, 12:471–516, 2007.
- Describing human decisions in agent-based models–odd+ d, an extension of the odd protocol. Environmental Modelling & Software, 48:37–48, 2013.
- Simulation of Stylized Facts in Agent-Based Computational Economic Market Models. Papers 1812.02726, arXiv.org, November 2018. URL https://ideas.repec.org/p/arx/papers/1812.02726.html.
- Intensional couplings in variable-structure models: An exploration based on multilevel-devs. ACM Transactions on Modeling and Computer Simulation, 26(2):9:1–9:27, 2016. doi:10.1145/2818641. URL https://doi.org/10.1145/2818641.
- Modelica-the next generation modeling language: An international design effort. In Proceedings of First World Congress of System Simulation, pages 1–3. Citeseer, 1997.
- Model composition for macromolecular regulatory networks. IEEE/ACM Transactions on Computational Biology and Bioinformatics, 7(2):278–287, 2010. doi:10.1109/TCBB.2008.64.
- Sbmlmerge, a system for combining biochemical network models. Genome Informatics, 17(1):62–71, 2006.
- Approaches for simulation model reuse in systems design—a review. SAE Technical Paper, (2022-01-0355), 2022.
- Software Product Lines: Practices & Patterns. Addison Wesley Longman, 2001.
- Maya Retno Ayu Setyautami and Reiner Hähnle. An architectural pattern to realize multi software product lines in Java. In Paul Grünbacher, Christoph Seidl, Deepak Dhungana, and Helena Lovasz-Bukvova, editors, VaMoS’21: 15th Intl. Working Conf. on Variability Modelling of Software-Intensive Systems, Virtual Event, pages 9:1–9:9. ACM, 2021. doi:10.1145/3442391.
- Notions of similarity for systems biology models. Briefings in Bioinformatics, 19(1):77–88, 2018.
- Automating science. Science, 324(5923):43–44, 2009.
- Pairing conceptual modeling with machine learning. Data & Knowledge Engineering, 134:101909, July 2021. ISSN 0169-023X. doi:10.1016/j.datak.2021.101909. URL https://www.sciencedirect.com/science/article/pii/S0169023X21000367.
- From narratives to conceptual models via natural language processing. In 2022 Winter Simulation Conference (WSC), pages 2222–2233, 2022. doi:10.1109/WSC57314.2022.10015274.
- Dbpedia: A nucleus for a web of open data. In Karl Aberer, Key-Sun Choi, Natasha Noy, Dean Allemang, Kyung-Il Lee, Lyndon Nixon, Jennifer Golbeck, Peter Mika, Diana Maynard, Riichiro Mizoguchi, Guus Schreiber, and Philippe Cudré-Mauroux, editors, The Semantic Web, pages 722–735, Berlin, Heidelberg, 2007. Springer Berlin Heidelberg. ISBN 978-3-540-76298-0.
- CovidGraph: A Graph to Fight COVID-19. Bioinformatics, 38(20):4843–4845, 08 2022. ISSN 1367-4803. doi:10.1093/bioinformatics/btac592. URL https://doi.org/10.1093/bioinformatics/btac592.
- A Methodology for Aligning Process Model Abstraction Levels and Stakeholder Needs. In ICEIS (1), pages 137–147, 2022.
- Generative abstraction of markov population processes. Theoretical Computer Science, 977:114169, 2023. ISSN 0304-3975. doi:https://doi.org/10.1016/j.tcs.2023.114169.
- From natural language to simulations: Applying gpt-3 codex to automate simulation modeling of logistics systems, 2023.
- Language models are few-shot learners. In H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin, editors, Advances in Neural Information Processing Systems, volume 33, pages 1877–1901. Curran Associates, Inc., 2020. URL https://proceedings.neurips.cc/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf.
- Semantic features of object concepts generated with gpt-3, 2022. URL https://arxiv.org/abs/2202.03753.
- Equation discovery for systems biology: Finding the structure and dynamics of biological networks from time course data. Current Opinion in Biotechnology, 19(4):360–368, 2008. doi:https://doi.org/10.1016/j.copbio.2008.07.002. Protein technologies / Systems biology.
- A review of data-driven discovery for dynamic systems, 2022.
- Data-driven discovery of formulas by symbolic regression. MRS Bulletin, 44(7):559–564, 2019.
- Discovering governing equations from data by sparse identification of nonlinear dynamical systems. Proceedings of the National Academy of Sciences, 113(15):3932–3937, 2016. doi:10.1073/pnas.1517384113.
- Using a library of chemical reactions to fit systems of ordinary differential equations to agent-based models: a machine learning approach. Numerical Algorithms, 2024. ISSN 1572-9265. doi:10.1007/s11075-023-01737-0.
- Identification of dynamic mass-action biochemical reaction networks using sparse bayesian methods. PLOS Computational Biology, 18(1):1–21, 01 2022. doi:10.1371/journal.pcbi.1009830.
- Context-aware knowledge selection and reliable model recommendation with accordion. bioRxiv, 2023. doi:10.1101/2022.01.22.477231. URL https://www.biorxiv.org/content/early/2023/01/15/2022.01.22.477231.
- Fabian Lorig. Hypothesis-Driven Simulation Studies: Assistance for the Systematic Design and Conducting of Computer Simulation Experiments. Springer Vieweg, Wiesbaden, 2019.
- Safe: Simulation automation framework for experiments. In Proceedings of the 2012 Winter Simulation Conference (WSC), pages 1–12. IEEE, 2012.
- Exploiting provenance and ontologies in supporting best practices for simulation experiments: A case study on sensitivity analysis. In 2021 Winter Simulation Conference (WSC), pages 1–12, 2021. doi:10.1109/WSC52266.2021.9715362.
- Composing problem solvers for simulation experimentation: A case study on steady state estimation. PLOS ONE, 9(4):1–13, 04 2014. doi:10.1371/journal.pone.0091948. URL https://doi.org/10.1371/journal.pone.0091948.
- Sensitivity-driven simulation development: A case study in forced migration. Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 379(2197):20200077, may 2021. doi:10.1098/rsta.2020.0077. Publisher: Royal Society.
- Benchmarking Optimization Methods for Parameter Estimation in Large Kinetic Models. Bioinformatics, 35(5):830–838, 08 2018. ISSN 1367-4803. doi:10.1093/bioinformatics/bty736. URL https://doi.org/10.1093/bioinformatics/bty736.
- Smoothing methods for automatic differentiation across conditional branches. IEEE Access, 11:143190–143211, 2023. doi:10.1109/ACCESS.2023.3342136.
- Speeding up neural network robustness verification via algorithm configuration and an optimised mixed integer linear programming solver portfolio. Machine Learning, pages 1–20, 2022.
- Deepmath - deep sequence models for premise selection. In Proceedings of the 30th International Conference on Neural Information Processing Systems, NIPS’16, page 2243–2251, Red Hook, NY, USA, 2016. Curran Associates Inc. ISBN 9781510838819.
- Towards automated deep learning: Efficient joint neural architecture and hyperparameter search. 2018. doi:10.48550/ARXIV.1807.06906. URL https://arxiv.org/abs/1807.06906.
- Automatic runtime adaptation for component-based simulation algorithms. ACM Transactions on Modeling and Computer Simulation (TOMACS), 26(1):1–24, 2015.
- An introduction to multiobjective simulation optimization. ACM Transactions on Modeling and Computer Simulation, 29(1), 2019. ISSN 1049-3301. doi:10.1145/3299872. URL https://doi.org/10.1145/3299872.
- Openablext: An automatic code generation framework for agent-based simulations on cpu-gpu-fpga heterogeneous platforms. Concurrency and Computation: Practice and Experience, 32(21):e5807, 2020. doi:https://doi.org/10.1002/cpe.5807.
- A similarity-based approach for test case prioritization using historical failure data. In 2015 IEEE 26th International Symposium on Software Reliability Engineering (ISSRE), pages 58–68, 2015. doi:10.1109/ISSRE.2015.7381799.
- A saas-based automated framework to build and execute distributed simulations from sysml models. In 2013 Winter Simulations Conference (WSC), pages 1371–1382, 2013. doi:10.1109/WSC.2013.6721523.
- Knowledge Discovery in Simulation Data. ACM Transactions on Modeling and Computer Simulation, 30(4):24:1–24:25, November 2020a. ISSN 1049-3301. doi:10.1145/3391299. URL https://doi.org/10.1145/3391299.
- Clustering and classification for time series data in visual analytics: A survey. IEEE Access, 7:181314–181338, 2019. doi:10.1109/ACCESS.2019.2958551.
- Oscillation detection in process industries – part i: Review of the detection methods. Journal of Process Control, 78:108–123, 2019. ISSN 0959-1524. doi:https://doi.org/10.1016/j.jprocont.2019.04.002. URL https://www.sciencedirect.com/science/article/pii/S0959152419302239.
- A review on outlier/anomaly detection in time series data. ACM Computing Surveys, 54(3), apr 2021. ISSN 0360-0300. doi:10.1145/3444690. URL https://doi.org/10.1145/3444690.
- Green Simulation: Reusing the Output of Repeated Experiments. ACM Transactions on Modeling and Computer Simulation, 27(4):23:1–23:28, October 2017. ISSN 1049-3301. doi:10.1145/3129130. URL https://doi.org/10.1145/3129130.
- Observed vs. Possible Provenance (Research Track). 2021. URL https://www.usenix.org/conference/tapp2021/presentation/blount.
- Provenance capture and use: A practical guide. Technical report, Mitre CorpP McLean VA, 2010.
- Exploring the evolution of biochemical models at the network level. PLOS ONE, 17(3):e0265735, March 2022. ISSN 1932-6203. doi:10.1371/journal.pone.0265735. URL https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0265735. Publisher: Public Library of Science.
- Process mining for python (pm4py): Bridging the gap between process and data science. arXiv preprint arXiv:1905.06169, 2019.
- A survey of transformers. AI Open, 3:111–132, 2022a. ISSN 2666-6510. doi:https://doi.org/10.1016/j.aiopen.2022.10.001. URL https://www.sciencedirect.com/science/article/pii/S2666651022000146.
- Philippe J. Giabbanelli. Gpt-based models meet simulation: How to efficiently use large-scale pre-trained language models across simulation tasks, 2023.
- Expectation vs. experience: Evaluating the usability of code generation tools powered by large language models. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems, CHI EA ’22, New York, NY, USA, 2022. Association for Computing Machinery. ISBN 9781450391566. doi:10.1145/3491101.3519665. URL https://doi.org/10.1145/3491101.3519665.
- Marcus Woo. The rise of no/low code software development—no experience needed? Engineering (Beijing, China), 6(9):960, 2020.
- Exploring the performance of spatial stochastic simulation algorithms. Journal of Computational Physics, 230(7):2562–2574, 2011. ISSN 0021-9991. doi:https://doi.org/10.1016/j.jcp.2010.12.030. URL https://www.sciencedirect.com/science/article/pii/S0021999110007047.
- Jack P. C. Kleijnen. Sensitivity analysis and optimization in simulation: Design of experiments and case studies. In Proceedings of the 27th Conference on Winter Simulation, WSC ’95, page 133–140, USA, 1995. IEEE Computer Society. ISBN 0780330188. doi:10.1145/224401.224454. URL https://doi.org/10.1145/224401.224454.
- Collaborative Research Center SFB-TRR 161. Quantitative methods for visual computing, 2019. URL https://www.sfbtrr161.de/. Accessed: 2023-01-27.
- Towards better user studies in computer graphics and vision, 2022. URL https://arxiv.org/abs/2206.11461.
- The strengthening the reporting of observational studies in epidemiology (strobe) statement: Guidelines for reporting observational studies. The Lancet, 370(9596):1453–1457, 2007.
- Tips for successful practice of simulation. In WSC’99. 1999 Winter Simulation Conference, volume 1, pages 60–66. IEEE, 1999.
- David T Sturrock. Tested success tips for simulation project excellence. In 2020 Winter Simulation Conference (WSC), pages 1143–1151. IEEE, 2020.
- David T Sturrock. Tutorial: Tips for successful practice of simulation. In 2015 Winter Simulation Conference (WSC), pages 1756–1764. IEEE, 2015.
- Simulation in healthcare management: A soft approach (mapiu). Simulation, Modelling, Practice and Theory, 12(7-8):541–557, 2004.
- Emma Blomkamp. The promise of co-design for public policy. Australian journal of public administration, 77(4):729–743, 2018.
- The use of research evidence in public health decision making processes: Systematic review. PloS One, 6(7):e21704, 2011.
- ‘black magic’ and ‘gold dust’: the epistemic and political uses of evidence tools in public health policy making. Evidence & Policy, 11(3):415–437, 2015.
- A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Services Research, 14:1–12, 2014.
- Policy-makers’ attitudes to decision support models for coronary heart disease: a qualitative study. Journal of Health Services Research & Policy, 13(4):209–2014, 2008.
- Science communication: A contemporary definition. Public Understanding of Science, 12(2):183–202, 2003.
- Why science communication, and does it work? a taxonomy of science communication aims and a survey of the empirical evidence. Frontiers in Communication, 4:55, 2019.
- Science communication as a field of research: Identifying trends, challenges and gaps by analysing research papers. Journal of Science Communication, 16:A02, 2017. doi:https://doi.org/10.22323/2.16020202.
- Automated lay language summarization of biomedical scientific reviews. In Proceedings of the AAAI Conference on Artificial Intelligence, pages 160–168, 2021. doi:https://doi.org/10.1609/aaai.v35i1.16089.
- Paul K. Davis. Capabilities for Joint Analysis in the Department of Defense: Rethinking Support for Strategic Analysis. RAND Corporation, Santa Monica, CA, 2016. doi:10.7249/RR1469.
- Defense Science Board. AD1155605 - Task Force on Gaming, Exercising, Modeling, and Simulation (GEMS). US DoD, Defense Science Board, OUSD(R&E), 1400 Defense Pentagon, Washington, DC, 2020.
- Li Chen and Pearl Pu. Survey of preference elicitation methods. Technical Report IC/2004/67, Ecole Politechnique Federale de Lausanne (EPFL), 2004.
- Prior elicitation. Bayesian Methods in Pharmaceutical Research, pages 87–109, 2020.
- Multiple criteria decision making, multiattribute utility theory: Recent accomplishments and what lies ahead. Management Science, 54(7):1336–1349, 2008.
- Joshua Knowles. Parego: A hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems. IEEE Transactions on Evolutionary Computation, 10(1):50–66, 2006.
- Parallel bayesian optimization of multiple noisy objectives with expected hypervolume improvement. Advances in Neural Information Processing Systems, 34:2187–2200, 2021.
- Multi-attribute bayesian optimization with interactive preference learning. In International Conference on Artificial Intelligence and Statistics, pages 4496–4507. PMLR, 2020.
- Preference exploration for efficient bayesian optimization with multiple outcomes. In International Conference on Artificial Intelligence and Statistics, pages 4235–4258. PMLR, 2022b.
- Preferential bayesian optimization. In International Conference on Machine Learning, pages 1282–1291. PMLR, 2017.
- Facets of trust in simulation studies. European Journal of Operational Research, 289(1):197–213, 2021. ISSN 0377-2217. doi:https://doi.org/10.1016/j.ejor.2020.06.043.
- Effective visualization in modeling & simulation. In Proceedings of the 48th Annual Simulation Symposium, ANSS ’15, page 33–40, San Diego, CA, USA, 2015. Society for Computer Simulation International.
- David C. Lane. The emergence and use of diagramming in system dynamics: a critical account. Systems Research and Behavioral Science, 25(1):3–23, 2008. doi:https://doi.org/10.1002/sres.826.
- What Software Engineering Has to Offer to Agent-Based Social Simulation, pages 81–117. Springer International Publishing, Cham, 2017. doi:10.1007/978-3-319-66948-9_6.
- Cgv—an interactive graph visualization system. Computers & Graphics, 33(6):660–678, 2009.
- Hans-Jorg Schulz. Treevis.net: A tree visualization reference. IEEE Computer Graphics and Applications, 31(6):11–15, 2011.
- A survey of visualization capabilities for simulation environments. In 2023 Annual Modeling and Simulation Conference (ANNSIM), pages 13–24, 2023.
- Visual support for the understanding of simulation processes. In 2009 IEEE Pacific Visualization Symposium, pages 57–64, 2009. doi:10.1109/PACIFICVIS.2009.4906838.
- Analyzing simulations of biochemical systems with feature-based visual analytics. Computers & Graphics, 38:18–26, 2014. ISSN 0097-8493. doi:https://doi.org/10.1016/j.cag.2013.09.001.
- Knowledge discovery in simulation data. ACM Transactions on Modeling and Computer Simulation, 30(4), nov 2020b. ISSN 1049-3301. doi:10.1145/3391299.
- Visual analytics for simulation ensembles. In 2018 Winter Simulation Conference (WSC), pages 321–335, 2018. doi:10.1109/WSC.2018.8632312.
- Interactivized: Visual interaction for better decisions with interactive multiobjective optimization. IEEE Access, 10:33661–33678, 2022. doi:10.1109/ACCESS.2022.3161465.
- Viewing visual analytics as model building. In Computer Graphics Forum, volume 37, pages 275–299. Wiley Online Library, 2018.
- Visual analytics of contact tracing policy simulations during an emergency response. In Computer Graphics Forum, volume 41, pages 29–41. Wiley Online Library, 2022.
- A visual analytics based decision making environment for covid-19 modeling and visualization. In 2020 IEEE Visualization Conference (VIS), pages 86–90. IEEE, 2020.
- Jac A. M. Vennix. Group model-building: Tackling messy problems. System Dynamics Review, 15(4):379–401, 1999. doi:https://doi.org/10.1002/(SICI)1099-1727(199924)15:4<379::AID-SDR179>3.0.CO;2-E.
- The design of participatory agent-based social simulations. Journal of Artificial Societies and Social Simulation, 7(4):1, 2004. URL https://www.jasss.org/7/4/1.html.
- Tools and methods in participatory modeling: Selecting the right tool for the job. Environmental Modelling & Software, 109:232–255, 2018. ISSN 1364-8152. doi:https://doi.org/10.1016/j.envsoft.2018.08.028.
- Participatory Approaches, in Simulating Social Complexity: A Handbook, pages 253–292. Springer International Publishing, 2017. doi:10.1007/978-3-319-66948-9_12. URL https://doi.org/10.1007/978-3-319-66948-9_12.
- Multi-agent simulations to explore rules for rural credit in a highland farming community of northern thailand. Ecological Economics, 66(4):615–627, 2008. doi:https://doi.org/10.1016/j.ecolecon.2007.10.022.
- Integrating ecological networks modelling in a participatory approach for assessing impacts of planning scenarios on landscape connectivity. Landscape and Urban Planning, 209:104039, 2021. doi:https://doi.org/10.1016/j.landurbplan.2021.104039.
- Modeling with stakeholders for transformative change. Sustainability, 11(3):825, 2019. doi:https://doi.org/10.3390/su11030825.
- Olivier Barreteau and Others. Our companion modelling approach. Journal of Artificial Societies and Social Simulation, 6(2):1, 2003. URL https://jasss.soc.surrey.ac.uk/6/2/1.html.
- How to make socio-environmental modelling more useful to support policy and management? People and Nature, 3(3):560–572, 2021. doi:https://doi.org/10.1002/pan3.10207.
- Using causal loop diagrams to conceptualize groundwater as a social-ecological system. Frontiers in Environmental Science, 10:836206, 2022.
- A comparative analysis of parallel processing and super-individual methods for improving the computational performance of a large individual-based model. Ecological Modelling, 214(2-4):141–152, 2008.
- Visual analytics: Definition, process, and challenges. In Andreas Kerren, John T. Stasko, Jean-Daniel Fekete, and Chris North, editors, Information Visualization - Human-Centered Issues and Perspectives, volume 4950 of Lecture Notes in Computer Science, pages 154–175. Springer, 2008. doi:10.1007/978-3-540-70956-5_7. URL https://doi.org/10.1007/978-3-540-70956-5_7.