Universitatea Babeş-Bolyai Cluj-Napoca
Facultatea de Matematică şi Informatică
Ciclul de studii: Masterat
Domeniul: Informatica
Programul de studii: Metode formale în programare - în limba engleză
Limba de predare: Engleză

SYLLABUS

I. General data
Code	Subject	
MID1023	Validation of Simulation	

Semester	Hours: C+S+L+P	Category	Status	
4	2+1+0+1	speciality	optional	

II. Full status faculty members
Name and	Scientific	Didactic	Chair	Type of activity	
surname	title	title		C	S	L	
PREJMEREAN Vasile	Ph.D.	Lect.	Programming  Languages and Methods	*			

Associated faculty members
Name and	Scientific	Institution	Type of	Type of activity	
surname	title		position	C	S	L	

III. Course objectives
To assimilate the Simulation as a method of studying the real phenomenon. To gain skils related to problem solving through simulation. To teach the students the concepts used in the field of modeling and simulation and to acquire the methods for validation of simulation.
After promotion the students should be able to use simulation as a method of solving real problems. They will know to verify their programs and to validate the simulation results.

IV. Course contents
(C1-C14 lectures, S1-S14 seminars) 

C1 (+S1)- The Object of simulation ([4,6,9])
&#8226;	What is simulation?
&#8226;	When to use simulation?
&#8226;	Types of modeling and simulation
&#8226;	Advantages of simulation
C2 (+S2)-  Examples of Simulation ([8] chapter  5)
&#8226;	Two problems that can be used by simulation
&#8226;	The components of the simulation programs
&#8226;	We need the parameters of the models, random numbers and statistical methods!
C3 (+S3) - The steps of a Simulation study ([6] chapters 1&2)
&#8226;	Statement of the problem 
&#8226;	Data collection
&#8226;	Model building
&#8226;	Program implementation
&#8226;	Program verification
&#8226;	Output Analysis and validation
&#8226;	Decision making
&#8226;	Document the entire simulation activity
C4  (+S4 ) - Verification and validation of a software system ([2], chapters [1,2])
&#8226;	The components of verification and validation
&#8226;	Is the program correct?
&#8226;	Static, dynamic, and formal verification
&#8226;	Program validation: inspection and testing
&#8226;	Input and output validation
C5 (+S5 )- Validation of simulation model  ([6] chapter 5, [7])
&#8226;	Is the model correct for what is required?
&#8226;	Choosing the important variables
&#8226;	Validate the parameters of the model
C6(+S6)-  Program Inspection ([5] chapter 3)
&#8226;	What is Inspection ? 
&#8226;	Inspection team
&#8226;	The steps of Inspection
&#8226;	Advantages of inspection over testing
C7(+S7)- Program Testing  ([5] chapter 3)
&#8226;	What is testing?
&#8226;	Types of testing
&#8226;	Unit testing, integration testing
&#8226;	Regression testing 
C8(+S8)- Input analysis ([2,3])
&#8226;	Parameter estimation methods
&#8226;	Confidence intervals 
&#8226;	Data validity
&#8226;	Data availability
&#8226;	What if no real data is available?
C9(+S9)-  Sensitive Analysis ([O2])
&#8226;	What is sensitive analysis
&#8226;	Regression analysis
&#8226;	Statistical design
&#8226;	Factorial analysis
C10(+S10)-  Calibration ([1, 6 chapter 5, O6])
&#8226;	What is  calibration? 
&#8226;	Comparation of results with real data
&#8226;	Acceptability of simulation results
C11 (+S11) -  Statistical analysis of output data ([O1])
&#8226;	Parameter estimation methods
&#8226;	Confidence intervals 
&#8226;	Statistical hypothesis verification 
&#8226;	Compare the simulation results to real data
C12 (+S12) - Certification, Acreditation  ([6], chapter 6)
&#8226;	The needs of certification and accreditation
&#8226;	What are they?
&#8226;	Elements of  certification and accreditation
C13 (+S13) - Software tools for validation  ( [6, 11])
&#8226;	testing tools
&#8226;	debugging tools
&#8226;	programs for performing statistical data analysis

C14 (+S14) -  Simulation Documentation ( [2,7])
&#8226;	Why document?
&#8226;	What must it contain?
&#8226;	Documentation validation.
There are laboratory classes where the department network is used. Specific bibliographic materials are also used (books, articles, Internet resources)

V. Bibliography
1. ARSHAM H., Systems Simulation: The Shortest Path from Learning to Applications, 
    http://www.ubmail.ubalt.edu/~harsham/simulation/sim.htm 
2. BALCI, O., Validation, Verification, and Testing Techniques throught the Life Cycle of a Simulation Study, Annals of  Operations Research, 1994, no.12, pp.1-49
3. BLAGA P., Statistica prin MATLAB, Presa Universitara Clujeana, 2002. 
4. DODESCU Gh., Simularea sistemelor, Ed.Militara, Bucuresti.
5. M.Frenţiu, Verificarea corectitudinii programelor, Ed.Univ.&#8221;Petru-Maior&#8221;, Tg.-Mureş,   2001, 116 pp., ISBN 973-8084-32-6
6. Averill M. Law and W. David Kelton, Simulation Modeling and Analysis, McGraw Hill, Third Edition (2000).
7. Kleijnen J.P.C., Theory and methodology of Verification and validation of simulation models,  European Journal of Operational Research, 82(1995), 145-162.
8. STATE, L., J.POPESCU, Modele probabiliste in Inteligenta Artificiala, Litog. Univ. Bucuresti, 1979.
9. VADUVA I., Modele de simulare cu calculatorul, Ed. Tehnica, Bucuresti 1977.
O1. Jack P.C. Kleijnen, Five-stage procedure for the evaluation of simulation models through statistical techniques, Proceedings of the 1996 Winter Simulation Conference, p.248-254.
O2. Kleijnen J.P.C., Sensitivity analysis and optimization, Proceed. of the 1995 Winter Simulation  Conference, p.133-140, 19959.
O3. Kleijnen J.P.C., Validation of models: statistical techniques and data availability, Proceed. of the 1999 Winter Simulation  Conference, 1999.
O4. RACEANU, E., Limbaje de simulare, Ed.Militara, Bucuresti, 1981
O5. SANDERSON D.P., R.SHARMA, R.ROZIN, and S.TREU, The Hierarchical Simulation Language HSL: A Versatile Tool for Process-Oriented Simulation, ACM Trans.on Modeling and Computer Simulation, Vol.1, no.2, 1991, pp.113-153.
O6. T.I. Oren, Concepts and Criteria to Asses Acceptability of Simulation Study : a  frame of reference, Comm.ACM, vol.24(1981), no.4, 180-184.
O7. Papers on Software Metrics from the Journals: 
a.	IEEE Software. 
b.	IEEE Transactions on Software Engineering. 
c.	Transactions on Modeling and Simulation, ACM.
d.	Software -- Practice and Experience, Wiley. 

VI. Thematic of didactic activities per weeks

VII. Didactic methods used

VIII. Assessment
The final grade will rezult from the evaluation of the seminars work and of a final exam.
Webpage: http://www.cs.ubbcluj.ro/~per/Val_Sim.html	

IX. Additional references

	Dean,							Chair head,

	Date,							Course responsible,
								Lect. PREJMEREAN Vasile, Ph.D.