Random Testing of Simulation Languages - Revision history

Ceres at 17:20, 18 October 2016

2016-10-18T17:20:38Z

Ceres at 23:24, 21 October 2014

2014-10-21T23:24:12Z

Ceres: Ceres moved page Random Generation of Acumen Models to Random Testing of Simulation Languages

2014-10-21T20:32:25Z

Ceres moved page Random Generation of Acumen Models to Random Testing of Simulation Languages

Ceres at 20:29, 21 October 2014

2014-10-21T20:29:32Z

Ceres: Tweaked heading format.

2014-10-21T15:27:55Z

Tweaked heading format.

Ceres: Created proposal.

2014-10-21T15:26:10Z

Created proposal.

New page

{{StudentProjectTemplate
|Title=Random Generation of Acumen Models
|Summary=Testing a simulation language implementation using a random generator of valid, interesting models.
|Author=Adam Duracz
|Supervisor=Adam Duracz, Walid Taha
|Level=Master
|Status=Open
}}
= Description =

Testing is the dominant method for quality control in software development. Generator-driven tests decrease the effort of implementing test cases by providing a vast and varied amount of data to challenge the system under test. Such tests enable Property-Based Testing, where the specification of the system (properties) is separated from the construction of test data (generators). Generators of simple data types have been studied extensively and can be implemented in a way that mirrors the structure of the type.

The focus of this project is to develop a generator of Acumen programs (values of the Acumen AST type). The task is complicated by the fact that important properties of valid, interesting Acumen models are not captured by the AST type. Such models are programs that are executable, have finite trajectories throughout execution, whose behavior is diverse and that are representative of known models written by human modelers.

= Research questions =
# How can a generator of programs of a hybrid programming language (combining differential equations with discrete state changes) be implemented so that models are valid by construction?
# How can an implementation be designed so that it performs well enough to be useful in practical testing?
# How should such a generator be implemented so that it is easily maintainable and extensible?

= Expected outcomes =
# A description of how a generator can be constructed to meet the criteria outlined in the research questions.
# An implementation of a generator based on this description.
# An analysis of test coverage achieved by using the generator to test several components of Acumen, including a parser, an interpreter, a compiler and a source-to-source transformation.

= Prerequisites =

# Course: Advanced Object-Oriented Programming.
# Some familiarity with Scala or another functional programming language, as well as probability theory, will be very useful.

= References =
# Waild Taha, Paul Brauner, Corky Cartwright, Veronica Gaspes, Aaron Ames, “Core Acumen Tutorial”, 2011.
# Koen Claessen and John Hughes, "QuickCheck: A Lightweight Tool for Random Testing of Haskell Programs", In Proc. of International Conference on Functional Programming (ICFP), 2000.
# Michał H. Pałka, “Testing an Optimising Compiler by Generating Random Lambda Terms”, Licentiate Thesis, 2011.

@@ Line 1: / Line 1: @@
 {{StudentProjectTemplate
 |Title=Random Testing of Simulation Languages
-|Summary=Testing a simulation language implementation using a random generator of valid, interesting models.
+|Summary=Incorrect simulations are worthless. Develop the technology to catch bad simulators.
 |Author=
 |Supervisor=Adam Duracz, Walid Taha

← Older revision	Revision as of 20:32, 21 October 2014
(No difference)

@@ Line 1: / Line 1: @@
 {{StudentProjectTemplate
-|Title=Random Generation of Acumen Models
+|Title=Random Testing of Simulation Languages
 |Summary=Testing a simulation language implementation using a random generator of valid, interesting models.
 |Author=Adam Duracz
@@ Line 11: / Line 11: @@
 Testing is the dominant method for quality control in software development. Generator-driven tests decrease the effort of implementing test cases by providing a vast and varied amount of data to challenge the system under test. Such tests enable Property-Based Testing, where the specification of the system (properties) is separated from the construction of test data (generators). Generators of simple data types have been studied extensively and can be implemented in a way that mirrors the structure of the type.
-The focus of this project is to develop a generator of Acumen programs (values of the Acumen AST type). The task is complicated by the fact that important properties of valid, interesting Acumen models are not captured by the AST type. Such models are programs that are executable, have finite trajectories throughout execution, whose behavior is diverse and that are representative of known models written by human modelers.
+The focus of this project is to develop a generator of [http://www.acumen-language.org/ Acumen] models (values of the Acumen AST type). The task is complicated by the fact that important properties of valid, interesting Acumen models are not captured by the AST type. Such models are programs that are executable, have finite trajectories throughout execution, whose behavior is diverse and that are representative of known models written by human modelers.
 == Research questions ==

@@ Line 13: / Line 13: @@
 The focus of this project is to develop a generator of Acumen programs (values of the Acumen AST type). The task is complicated by the fact that important properties of valid, interesting Acumen models are not captured by the AST type. Such models are programs that are executable, have finite trajectories throughout execution, whose behavior is diverse and that are representative of known models written by human modelers.
-= Research questions =
+== Research questions ==
 # How can a generator of programs of a hybrid programming language (combining differential equations with discrete state changes) be implemented so that models are valid by construction?
 # How can an implementation be designed so that it performs well enough to be useful in practical testing?
 # How should such a generator be implemented so that it is easily maintainable and extensible?
-= Expected outcomes =
+== Expected outcomes ==
 # A description of how a generator can be constructed to meet the criteria outlined in the research questions.
 # An implementation of a generator based on this description.