DEFEVL001
Develop an evaluation program


Application

This unit describes the skills required to develop an evaluation program for an organisation. It includes defining terms of reference and context; identifying key stages and outcomes; assessing and defining data management requirements and identifying the resources needed to undertake the program.

This unit applies to those responsible for the design and development of an evaluation and reporting strategy to measure performance and the value of investment decisions.

The skills and knowledge described in this unit must be applied within the legislative, regulatory and policy environment in which they are carried out. Organisational policies and procedures must be consulted and adhered to.

Those undertaking this unit would work autonomously while performing complex tasks in a familiar context.

No licensing, legislative or certification requirements apply to unit at the time of publication.


Elements and Performance Criteria

ELEMENTS

PERFORMANCE CRITERIA

Elements describe the essential outcomes

Performance criteria describe the performance needed to demonstrate achievement of the element. Where bold italicised text is used, further information is detailed in the range of conditions section.

1. Define terms of reference & evaluation context

1.1 Identify and clarify the outcomes sought, who will use the information and for what purpose.

1.2 Identify the key stakeholders who will be consulted.

1.3 Select evaluation and monitoring methods which are suitable to the size and significance of the program, and the terms of reference.

1.4 Complete a review of existing evidence and literature relevant to the proposed evaluation.

1.5 Develop an evaluation methodology that supports broader management targets, standards, and outputs.

2. Identify the key stages and outcomes of the program

2.1 Define key stages, milestones and timeframe.

2.2 Communicate with clients and stakeholders the details of the program and delivery timeline for endorsement.

2.3 Identify potential risks which may impact on the proposed program.

2.4 Refine targets and objectives as required.

3. Define reporting and record keeping requirements for data management

3.1 Identify data collection, management and reporting requirements to meet the objectives of the program.

3.2 Identify existing data sets that may be accessed for the program.

3.3 Design data collection protocols to meet relevant standards and required formats.

3.4 Store data to ensure security and appropriate access taking into account required formats.

3.5 Identify the information products required taking into account clients and stakeholders' needs and use.

3.6 Produce reports to suit program audience types.

4. Identify the resources needed to implement the program

4.1 Identify the personnel and skills required to implement the monitoring and evaluation program.

4.2 Assess the material resources required to undertake the work.

4.3 Determine the cost of the program and develop a budget.

Evidence of Performance

Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the candidate must demonstrate evidence of performance of the following on at least one occasion.

scoping and reviewing a program

collecting and managing data

budgeting and identifying program costs

planning evaluation programs

using literacy skills to fulfil job roles as required by the organisation

reading and understanding documentation

completing written reports

using oral communication skills/language competence to fulfil the job role

questioning

active listening

asking for clarification

negotiating solutions

responding to a range of views

using numeracy skills to estimate, calculate and record complex workplace measures

using interpersonal skills to work with others and relate to people from a range of cultural, social and religious backgrounds and with a range of physical and mental abilities

defining terms of reference and context

identifying key stages and outcomes

assessing and defining data management requirements

identifying the resources needed to undertake the program


Evidence of Knowledge

Evidence required to demonstrate competence must satisfy all of the requirements of the elements and performance criteria. If not otherwise specified the depth of knowledge demonstrated must be appropriate to the job context of the candidate.

program design considerations (cost, equality, technically valid, ethics)

quantitative and qualitative methods for monitoring and evaluation

data management


Assessment Conditions

Competency should be assessed in an actual workplace or in a simulated environment, with access to equipment and infrastructure appropriate to the outcome. Competency should be demonstrated over time to ensure the candidate is assessed across a variety of situations.

Assessors must satisfy the NVR/AQTF mandatory competency requirements for assessors.


Foundation Skills

The foundation skills demands of this unit have been mapped for alignment with the Australian Core Skills Framework (ACSF). The following tables outline the performance levels indicated for successful attainment of the unit.

ACSF levels indicative of performance:

Further information on ACSF and the foundation skills underpinning this unit can be found in the Foundation Skills Guide on the GSA website.


Competency Field

Evaluation