Assessor Resource

ICAT5081B
Perform systems test

Assessment tool

Version 1.0
Issue Date: March 2024


This unit defines the competency required to ensure that the properties of the entire system are tested and proved adequate before handover to the client/user for final acceptance testing.

These units are linked and form an appropriate cluster:

ICAA5056B Prepare disaster recovery and contingency plans

ICAT5084B Perform stress and load testing on integrated platform

No licensing, legislative, regulatory or certification requirements apply to this unit at the time of publication.

You may want to include more information here about the target group and the purpose of the assessments (eg formative, summative, recognition)

Prerequisites

ICAT3025B

Run standard diagnostic tests


Employability Skills

This unit contains employability skills.




Evidence Required

List the assessment methods to be used and the context and resources required for assessment. Copy and paste the relevant sections from the evidence guide below and then re-write these in plain English.

The evidence guide provides advice on assessment and must be read in conjunction with the performance criteria, required skills and knowledge, range statement and the Assessment Guidelines for the Training Package.

Overview of assessment

Critical aspects for assessment and evidence required to demonstrate competency in this unit

Evidence of the following is essential:

Assessment must confirm sufficient knowledge of components and run-able modules that make up a total system.

To demonstrate competency in this unit the person will require access to:

System test plan

Requirements and design documents

Test plan

Human resources assigned and in place

Test hardware and environments in place and free for system test use

System/application suitable for testing

Context of and specific resources for assessment

All testing should be carried out on the same platform as the completed system. Scheduled testing should be on the production platform. The production environment is required as part of test preparation.

The systems test is a fully functional exercising of the system to be implemented. As such, all resources necessary to execute the entire system will be required.

The purpose of system testing is to identify defects that will only surface when a complete system is assembled. That is, defects that cannot be attributed to individual components or the interaction between two components. System testing includes testing of performance, security, configuration sensitivity, start-up and recovery from failure modes and takes place prior to delivery.

The breadth, depth and complexity covering planning and initiation of alternative approaches to skills or knowledge applications across a broad range of technical and/or management requirements, evaluation and coordination would be characteristic.

Assessment must ensure:

The demonstration of competency may also require self-directed application of knowledge and skills, with substantial depth in some areas where judgement is required in planning and selecting appropriate equipment, services and techniques for self and others.

Applications involve participation in development of strategic initiatives as well as personal responsibility and autonomy in performing complex technical operations or organising others. It may include participation in teams including teams concerned with planning and evaluation functions. Group or team coordination may also be involved.

Method of assessment

The purpose of this unit is to define the standard of performance to be achieved in the workplace. In undertaking training and assessment activities related to this unit, consideration should be given to the implementation of appropriate diversity and accessibility practices in order to accommodate people who may have special needs. Additional guidance on these and related matters is provided in ICA05 Section 1.

Competency in this unit should be assessed using summative assessment to ensure consistency of performance in a range of contexts. This unit can be assessed either in the workplace or in a simulated environment. However, simulated activities must closely reflect the workplace to enable full demonstration of competency.

Assessment will usually include observation of real or simulated work processes and procedures and/or performance in a project context as well as questioning on underpinning knowledge and skills. The questioning of team members, supervisors, subordinates, peers and clients where appropriate may provide valuable input to the assessment process. The interdependence of units for assessment purposes may vary with the particular project or scenario.

Guidance information for assessment

Assessment must confirm the ability to test the operation and consistency of the total system according to the system requirements.

The person will have clearly identified the results of the systems tests. The system test should clearly confirm that:

Functionality, delivered by the development team, is as specified by the business in the business design specification document and the requirements documentation

Software is of high quality; the software will replace/support the intended business functions and achieves the standards required by the organisation for the development of new systems

Software delivered interfaces correctly with existing systems

If the system test does not confirm the above, then the person will need to document how the system has not met the test criteria.

Holistic assessment with other units relevant to the industry sector, workplace and job role is recommended, for example:

ICAA5056B Prepare disaster recovery and contingency plans

ICAT5084B Perform stress and load testing on integrated platform

An individual demonstrating this competency would be able to:

Demonstrate understanding of a broad knowledge base incorporating theoretical concepts, with substantial depth in some areas

Analyse and plan approaches to technical problems or management requirements

Transfer and apply theoretical concepts and/or technical or creative skills to a range of situations

Evaluate information, using it to forecast for planning or research purposes

Take responsibility for own outputs in relation to broad quantity and quality parameters

Take some responsibility for the achievement of group outcomes

Maintain knowledge of industry products and services


Submission Requirements

List each assessment task's title, type (eg project, observation/demonstration, essay, assingnment, checklist) and due date here

Assessment task 1: [title]      Due date:

(add new lines for each of the assessment tasks)


Assessment Tasks

Copy and paste from the following data to produce each assessment task. Write these in plain English and spell out how, when and where the task is to be carried out, under what conditions, and what resources are needed. Include guidelines about how well the candidate has to perform a task for it to be judged satisfactory.

Required skills

Problem solving skills for a defined range of unpredictable problems involving participation in the development of strategic initiatives, for example when ability to recognise and separate the system into run-able modules mirroring live scenarios is demonstrated such as the case with end of day, interactive query scenarios of various loads)

Plain English literacy and communication skills in relation to analysis, evaluation and presentation of information (e.g. when attendees' details/comments are logged and signatures are gained)

Analysis/Programming skills in relation to testing the operation and consistency of the total system (e.g. when test scripts (online test) or test run (batch test) are prepared for running)

Questioning and active listening skills (e.g. when attendees' details/comments are logged and signatures are gained)

Required knowledge

Broad general knowledge of system requirements, with detailed knowledge of particular system requirements and features

Broad knowledge of automated test tools, with detailed knowledge of features and processes in some areas

Organisational rules for preparing test

Detailed knowledge of underlying test data

Detailed knowledge of input/output requirements

The range statement relates to the unit of competency as a whole. It allows for different work environments and situations that may affect performance. Bold italicised wording, if used in the performance criteria, is detailed below. Essential operating conditions that may be present with training and assessment (depending on the work situation, needs of the candidate, accessibility of the item, and local industry and regional contexts) may also be included.

Test environment

data

program libraries

network/communications and other equipment

operating system

other support software

Testtools may include:

Code/unit/class testing: AssertMate, BoundsChecker, C-Cover, CodeReview, CodeWizard, DeepCover, FailSafe, Hindsight, Insure++, JCAST, Logiscope, JavaPureCheck

Stress load testing: automated test facilities, e-Load, E-TEST Suite, e-MONITO, Astra SiteManager, Astra SiteTest, AutoTester Web, LoadRunner, JavaLoad

Applications testing: DataShark, Cyrano Suite, Datatect, preVue-C/S

Copy and paste from the following performance criteria to create an observation checklist for each task. When you have finished writing your assessment tool every one of these must have been addressed, preferably several times in a variety of contexts. To ensure this occurs download the assessment matrix for the unit; enter each assessment task as a column header and place check marks against each performance criteria that task addresses.

Observation Checklist

Tasks to be observed according to workplace/college/TAFE policy and procedures, relevant legislation and Codes of Practice Yes No Comments/feedback
Prepare the test environment 
Determine software life cycle 
Define test plan and appropriate test tools 
Recognise and separate the system into run-able modules mirroring live scenarios 
Gather and prepare logs and result sheets 
Notify operations of scheduled test to ensure preparedness and understanding of implications for operations 
Prepare test scripts (online test) or test run (batch test) for running 
Review expected results against acceptance criteria (walkthrough) and system requirements documentation 
Run test scripts and document results in line with test and acceptance processes 
Perform required quality benchmarks or comparisons in readiness for acceptance testing 
Adopt organisation/industry standards, where appropriate 
Compare actual results to expected results on completion of each system unit, and complete result sheets 
Summarise and classify results, highlighting critical or urgent areas of concern and prepare report 
Compare results against requirements 
Notify operations of test completion 
Log attendees' details/comments and gain required signatures 
Schedule feedback meeting to discuss report and possible next actions with stakeholders if necessary 
Ensure test reporting compliance with documentation and reporting standards 

Forms

Assessment Cover Sheet

ICAT5081B - Perform systems test
Assessment task 1: [title]

Student name:

Student ID:

I declare that the assessment tasks submitted for this unit are my own work.

Student signature:

Result: Competent Not yet competent

Feedback to student

 

 

 

 

 

 

 

 

Assessor name:

Signature:

Date:


Assessment Record Sheet

ICAT5081B - Perform systems test

Student name:

Student ID:

Assessment task 1: [title] Result: Competent Not yet competent

(add lines for each task)

Feedback to student:

 

 

 

 

 

 

 

 

Overall assessment result: Competent Not yet competent

Assessor name:

Signature:

Date:

Student signature:

Date: