SpinGrid Testing Documents
SpinGrid Testing Documents
Project Group 1
Project Team:
Sven Bego Roel Coset Robert Leeuwestein Maarten Leijten Ivo van der Linden Joery Mens Marcel Moreaux Tim Muller Tom Kleijkers L. Somers Y.Usenko C. Plevier H. de Wolf
0550191 0548132 0546746 0547649 0547632 0547515 0499480 0547961 0515015 TU/e HG 7.83 TU/e HG 5.71 Dutch Space Dutch Space
Abstract
This document describes the Acceptance Test Plan (ATP) for the SPINGRID system and was made according to the software engineering standard provided by the European Space Agency described in [ESA]. The projects acceptance test for the product is described here. This project is one of seven assignments for the course 2IP40 at Eindhoven University of Technology.
SPINGRID
Contents
1 Introduction 1.1 1.2 1.3 Purpose . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Scope . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . List of denitions and abbreviations . . . . . . . . . . . . . . . . . . . . . . . 1.3.1 1.3.2 1.4 Denitions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Abbreviations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 6 6 7 7 8 8 8 8 8 9 9 9 9 10 10 11 12 13 15 16 21 22
1.5
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
2 Test plan 2.1 2.2 2.3 2.4 2.5 2.6 Test items . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Features to be tested . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Test deliverables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Testing tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Environmental needs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Test case pass/fail criteria . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
3 Test case specications 3.1 3.2 3.3 3.4 3.5 General Requirements Acceptance Tests . . . . . . . . . . . . . . . . . . . . . Job Requirements Acceptance Tests . . . . . . . . . . . . . . . . . . . . . . . System Admin Requirements Acceptance Tests . . . . . . . . . . . . . . . . . Resource Provider Requirements Acceptance Tests . . . . . . . . . . . . . . . Project Admin Requirements Acceptance Tests . . . . . . . . . . . . . . . . .
SPINGRID
CONTENTS
Application Provider Requirements Acceptance Tests . . . . . . . . . . . . . . Data Provider Requirements Acceptance Tests . . . . . . . . . . . . . . . . . Job Provider Requirements Acceptance Tests . . . . . . . . . . . . . . . . . . Extrafunctional Requirements Acceptance Tests . . . . . . . . . . . . . . . . .
25 27 29 30 33 33 33 34 34 34 34 34 35
4 Test procedures 4.1 4.2 4.3 4.4 4.5 4.6 4.7 Test procedure for system admin . . . . . . . . . . . . . . . . . . . . . . . . . Test procedure for resource provider . . . . . . . . . . . . . . . . . . . . . . . Test procedure for project admin . . . . . . . . . . . . . . . . . . . . . . . . . Test procedure for application provider . . . . . . . . . . . . . . . . . . . . . . Test procedure for data provider . . . . . . . . . . . . . . . . . . . . . . . . . Test procedure for job provider . . . . . . . . . . . . . . . . . . . . . . . . . . Other test procedures . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
5 Test report
SPINGRID
SPINGRID
SPINGRID
Chapter 1
Introduction
1.1 Purpose
15
This document describes the plan for testing the developed SPINGRID software against the user requirements as dened in [URD]. The purpose of this acceptance test is to make sure that the system developed during the SPINGRID project complies with the requirements of URD. These tests should be executed in the Acceptance Test (AT) phase of the SPINGRID project.
1.2
20
Scope
The software implements a computational grid. This grid is able to execute jobs when it receives an application accompanied by a set of data les. By hiding the complexity of grid technology the system will be easy to use. Usability is also increased by oering a web-based front-end for users to access the system.
SPINGRID
CHAPTER 1. INTRODUCTION
1.3
25
1.3.1
Agent
Application
Application Provider
Customer Data Provider Dispatcher Job Job Provider Project Project Administrator
Resource Provider
SPINGRID
CHAPTER 1. INTRODUCTION
1.3.2
ATP ESA JRE NAT URD
Abbreviations
Acceptance Test Plan European Space Agency Java Runtime Environment Network Address Translation User Requirements Document
1.4
30
Documents
Reference Documents
BSSC 2005 Java Coding Standard, Issue 1.0, March 2005 ESA Software Engineering Standards (ESA PSS-05-0 Issue 2), ESA Board for Software Standardization and Control (BSSC), 1991 Job Submission Description Language (JSDL) Specication, Version 1.0, November 2005 Software Transfer Document, SPINGRID team, TU/e, Version 0.0.1, May 2006 Software User Manual, SPINGRID team, TU/e, Version 0.0.1, May 2006 Software Verication and Validation Plan, SPINGRID team, TU/e, Version 0.1.2, March 2006
1.4.1
[BSSC] [ESA] [JSDL] [STD]
[SUM] [SVVP]
1.4.2
[URD] [SRD]
Applicable Documents
User Requirements Document, SPINGRID team, TU/e, version 1.0.0, February 2006 Software Requirements Document, SPINGRID team, TU/e, version 1.0.1, March 2006
1.5
Overview
35
In the second chapter the items to be tested are mentioned. A specication for each test case is given in the third chapter. The fourth chapter species the procedures for these test cases. In the fth chapter the reports for all test cases are presented.
SPINGRID
Chapter 2
Test plan
2.1 Test items
40
The software to be tested is the SPINGRID system. The user requirements can be found in [URD].
2.2
Features to be tested
The SPINGRID system will adhere to the requirements, which are documented in chapter 4 of the URD.
2.3
45
Test deliverables
The following items must be delivered before testing begins: The Software Verication and Validation Plan [SVVP]. The Software Requirements Document [SRD]. The User Requirements Document [URD]. The Software Transfer Document [STD].
50
Chapters 1, 2, 3 and 4 of this Acceptance Test Plan. Acceptance Test input data. Software to be tested. The following items must be delivered when the testing is nished: Acceptance test report. SPINGRID Acceptance Test Plan 1.0.0 9
55
2.4
Testing tasks
The following tasks are necessary for preparing and performing the acceptance tests: Designing the acceptance tests.
60
Ensuring that all environmental needs are satised for the acceptance tests. Performing the acceptance tests.
2.5
Environmental needs
65
The environmental requirements in [URD] only describe that the SPINGRID system runs on Windows XP, Mac OS or Linux. The environmental requirements are described in more detail in [SRD]. The requirements in [SRD] are taken instead of the requirements in [URD] because the URD does not describe the environment sucient. General Requirements: 1 dispatcher 40 agents
70
75
dedicated server Linux 2.4 (or higher) Sun JRE 1.4.2 or 1.5 MySQL 5.0 MySQL Connector/J JDBC driver (libmysql-java)
80
IP-tables
SPINGRID
10
Agent: Intel Pentium II 300 MHz or equivalent, G4 700 MHz or equivalent 128 MB RAM 256 MB Available Harddisk Space
85
Windows XP, Mac OS X or Linux 2.4 (or higher) Sun JRE 1.4.2 or 1.5 Client: Windows XP, Mac OS X or Linux 2.4 (or higher) Sun JRE 1.4.2 or 1.5
90
2.6
Every test should describe the criteria that should be met to pass that specic test.
SPINGRID
11
Chapter 3
95
UR 0010 UR 0060 UR 0070 UR 2010 The user requirements below dont have an acceptance test because the requirements are not implemented in the SPINGRID system: UR 2140 UR 3010 UR 3020 UR 3030
105
110
UR 3040 UR 3060 UR 3062 UR 3072 UR 3074 SPINGRID Acceptance Test Plan 1.0.0 12
115
120
125
UR 7090 UR 7100 UR 7110 The user requirements below dont have an acceptance test because they are trivial. This is because there is only one dispatcher in the SPINGRID system:
130
UR 8010 UR 8020
3.1
135
SPINGRID
13
Environmental Needs
TC 0040 This test case veries whether all users can interact with a webbased interface in the SPINGRID system This test case is veried by performing all acceptance tests in sections 3.2 to 3.8 in the web-based interface Check if all acceptance tests can be done with the web-based interface None
145
SPINGRID
14
3.2
Input Specication
150
155
SPINGRID
15
Input Specication
Output Specication
160
Environmental Needs
3.3
SPINGRID
16
165
170
175
SPINGRID
17
180
Environmental Needs
TC 2114 This test case veries whether the system admin can view a list of all project admins of a project Type java -jar sgclient.jar list users having rol:projadmin Check if the output gives a list of project admins of the specied project None
Environmental Needs
195
SPINGRID
19
Output Specication
200
Environmental Needs
205
SPINGRID
20
3.4
210
215
SPINGRID
21
220
3.5
Output Specication
225
Environmental Needs
SPINGRID
22
230
235
SPINGRID
23
Environmental Needs
TC 4042b This test case veries whether a project admin can select which data sources (either a data provider or a dataset) he trusts Type java -jar sgclient.jar distrust usr:testuser as rol:datprov for pro:project Check if the user is not trusted anymore as data provider for the project None
245
SPINGRID
24
250
3.6
255
260
Environmental Needs
TC 5042 This test case veries whether an application provider can see which applications he provides Type java -jar sgclient.jar as rol:appprov list apps Check if the output gives a list of applications provided by the application provider None
270
SPINGRID
26
275
3.7
280
285
Environmental Needs
TC 6032 This test case veries whether a data provider can see which data he provides Type java -jar sgclient.jar as rol:datprov list data Check if the output gives a list of data provided by the data provider None
295
SPINGRID
28
3.8
Output Specication
300
Environmental Needs
305
310
SPINGRID
29
315
3.9
320
SPINGRID
30
SPINGRID
31
330
Input Specication
335
SPINGRID
32
Chapter 4
340
Test procedures
As general prerequisite, all required hardware and software is assumed to be present, installed and running error free. Therefore the customer is responsible to have an environment as described in chapter 2. The test procedure must be run in this environment. Also, the dispatcher should have the database as described in test.sql, the client should have testjob.jsdl, testjobfail.jsdl, testapp.xml and testdata.dat. After performing a test procedure the database of the dispatcher should be reset to test.sql.
345
4.1
4.2
SPINGRID
33
4.3
4.4
355
4.5
4.6
4.7
SPINGRID
34
Chapter 5
Test report
The results of the acceptance tests can be found in [STD].
SPINGRID
35