DEVELOPMENT OF META-EVALUATION MODEL FOR FUNCTIONAL PENERA TRAINING PROGRAM

• Main Author: Adzani Rachmawanda, Roshviana
• Format: Theses
• Language: Indonesia
• Online Access: https://digilib.itb.ac.id/gdl/view/69766
• Institution: Institut Teknologi Bandung

One of the initiatives used to build metrological human resources is Penera Functional Training. The purpose of training assessment is to identify areas for development and improvement in order to raise the standard of future functional trainer training. It is challenging to identify chances for system improvement when training assessment data consistently yield positive outcomes. Evaluation of the training may indicate that there are no issues with the training, but this is not always the case. In fact, flaws in the evaluation process may lead to incorrect conclusions and advice that ultimately harms stakeholders. Meta-evaluation, or the evaluation of evaluation, is crucial. By evaluating the standards, meta-evaluation will be able to determine the effectiveness of the evaluation process. Although attempts at meta-evaluation have been made, the issues that are now present have not been resolved. Based on the evaluation process's usefulness, practicality, appropriateness, accuracy, accountability, and quality of the evaluation report, symptoms of difficulties can be found. The findings of the literature review indicate that there is no meta-evaluation model that can provide a solution to these issues. In order to address issues in the area and close gaps in earlier research, the goal of this study is to create and use a meta-evaluation model. Six standards, including utility, feasibility, appropriateness, accuracy, accountability, and report quality, were considered during the development of the model. There are a total of 30 criteria among the 6 standards. then, using this meta-evaluation paradigm becomes a reference point for assessors to evaluate the evaluation procedure for the Functional Trainers' training in 2019, 2020, and 2021. Given that the meta-evaluation study is a qualitative study, this research will employ a qualitative method approach. Data collection methods utilizing focus groups (FGD). A total of 9 (nine) evaluators from internal and external organizations make up the panel. Using the Analytical Hierarchy Process (AHP) approach and the Delphi method, data gathering was done in two stages. According to the study model, the average percentage of system achievement compared to the standard (score) for the assessment system in 2019 was 29.56%, in 2020 it was 30.30%, and in 2021 it was 30.51%. was 33%. According to statistics from the criteria category, 56.67% of the criteria received a fixed score, 13.33% of the criteria saw an increase in score, and 30% of the criteria were not considered. The analysis's findings revealed several contributing elements, including the fact that PPSDK's evaluation did not include post-training evaluations and that the new evaluation's scope took into account the internal stakeholders of the organization and the evaluation's participants' restrictions. The analysis's findings also indicate that the training system's implementation stage is where its strengths lie, while the evaluation (follow-up) stage is where its faults exist. The findings of this study can be beneficial that companies may use right away. These advantages include creating meta-evaluation standards that evaluators can use as a reference, incorporating meta-evaluation activities into the system, raising awareness of the quality of the evaluation system through various trainings and seminars, and modifying the stages of the ADIIE model evaluation process based on literature. Future training evaluation system recommendations include improving the evaluation stage (follow-up) as the top priority, followed by improving the planning stage and implementing improvements as the second and third priorities, respectively.