Development of a Student-Centred Evaluation Framework for Environmental Vocational Education and Training Courses. Development and validation of a Student-Centred Evaluation Framework for Environmental Vocational Education and Training Courses derived from Biggs' 3P Model and Kirkpatrick's Four Levels Evaluation Model.

View/ Open
F. J. DRAPER.pdf (1.633Mb)
Download
Publication date
2012-12-06Author
Draper, Fiona J.Supervisor
Oltean-Dumbrava, CrinaKara-Zaitri, Chakib
Keyword
Environmental vocational education and trainingContinuing education and training
Student-centred learning
Organisation-centred learning
Training evaluation
Biggs' 3P Model
Kirkpatrick's Four Levels Evaluation Model
Rights

The University of Bradford theses are licenced under a Creative Commons Licence.
Institution
University of BradfordDepartment
School of Engineering, Design and TechnologyAwarded
2012
Metadata
Show full item recordAbstract
Individuals and organisations need to do much more if sustainable development is to be achieved. Appropriate environmental vocational education and training (EVET) is essential for current decision makers. Crucial decisions need to be made before the present generation of school and college students achieve significant positions of authority. An increasing range of EVET courses and course providers are available within the UK. However, availability is not synonymous with suitability for either the attendee and/or his/her (future) employer. Previous research indicates that, as a component of lifelong learning, EVET courses should and the methods used to evaluate them should be student-centred. This thesis describes the development and validation of a new studentcentred evaluation framework. Preliminary literature reviews identified six fundamental issues which needed to be addressed. Existing academically productive evaluation models were examined and critically appraised in the context of these problems. The output from this process was used to develop a bespoke research methodology. Empirical research on four commercial EVET programmes revealed distinct personal, teaching and work-based presage factors which influenced course attendance, individual learning and subsequent organisational learning. Modified versions of Biggs' 3P model and Kirkpatrick's Four level Evaluation Model were shown to provide an effective student-centred evaluation framework for EVET courses. Additional critical elements pertaining course utility and the student's long(er) term ii retention of knowledge/skill were derived from previous research by Alliger et al (1997). Work-based presage factors and the student¿s return on expectation were added as a direct consequence of this research. The resultant new framework, the Presage-Product Evaluation Framework, was positively received during an independent validation. This confirmed inter alia that the framework should also be capable of adaption for use with other VET courses. Recommendations for additional research focus on the need to demonstrate this through further empirical studies.Type
ThesisQualification name
PhDCollections
Related items
Showing items related by title, author, creator and subject.
-
A realist process evaluation of robot-assisted surgery: integration into routine practice and impacts on communication, collaboration and decision-makingRandell, Rebecca; Honey, S.; Hindmarsh, J.; Alvarado, Natasha; Greenhalgh, J.; Pearman, A.; Long, A.; Cope, A.; Gill, A.; Gardner, Peter H.; et al. (2017-06)Background: The implementation of robot-assisted surgery (RAS) can be challenging, with reports of surgical robots being underused. This raises questions about differences compared with open and laparoscopic surgery and how best to integrate RAS into practice. Objectives: To (1) contribute to reporting of the ROLARR (RObotic versus LAparoscopic Resection for Rectal cancer) trial, by investigating how variations in the implementation of RAS and the context impact outcomes; (2) produce guidance on factors likely to facilitate successful implementation; (3) produce guidance on how to ensure effective teamwork; and (4) provide data to inform the development of tools for RAS. Design: Realist process evaluation alongside ROLARR. Phase 1 – a literature review identified theories concerning how RAS becomes embedded into practice and impacts on teamwork and decision-making. These were refined through interviews across nine NHS trusts with theatre teams. Phase 2 – a multisite case study was conducted across four trusts to test the theories. Data were collected using observation, video recording, interviews and questionnaires. Phase 3 – interviews were conducted in other surgical disciplines to assess the generalisability of the findings. Findings: The introduction of RAS is surgeon led but dependent on support at multiple levels. There is significant variation in the training provided to theatre teams. Contextual factors supporting the integration of RAS include the provision of whole-team training, the presence of handpicked dedicated teams and the availability of suitably sized operating theatres. RAS introduces challenges for teamwork that can impact operation duration, but, over time, teams develop strategies to overcome these challenges. Working with an experienced assistant supports teamwork, but experience of the procedure is insufficient for competence in RAS and experienced scrub practitioners are important in supporting inexperienced assistants. RAS can result in reduced distraction and increased concentration for the surgeon when he or she is supported by an experienced assistant or scrub practitioner. Conclusions: Our research suggests a need to pay greater attention to the training and skill mix of the team. To support effective teamwork, our research suggests that it is beneficial for surgeons to (1) encourage the team to communicate actions and concerns; (2) alert the attention of the assistant before issuing a request; and (3) acknowledge the scrub practitioner’s role in supporting inexperienced assistants. It is beneficial for the team to provide oral responses to the surgeon’s requests. Limitations: This study started after the trial, limiting impact on analysis of the trial. The small number of operations observed may mean that less frequent impacts of RAS were missed. Future work: Future research should include (1) exploring the transferability of guidance for effective teamwork to other surgical domains in which technology leads to the physical or perceptual separation of surgeon and team; (2) exploring the benefits and challenges of including realist methods in feasibility and pilot studies; (3) assessing the feasibility of using routine data to understand the impact of RAS on rare end points associated with patient safety; (4) developing and evaluating methods for whole-team training; and (5) evaluating the impact of different physical configurations of the robotic console and team members on teamwork.
-
Evaluation of Dementia Training for Staff in Acute Hospital SettingsSmythe, A.; Jenkins, C.; Harries, M.; Atkins, S.; Miller, J.; Wright, J.; Wheeler, N.; Dee, P.; Bentham, P.; Oyebode, Jan R. (2014-02-28)he development, pilot and evaluation of a brief psychosocial training intervention (BPTI) for staff working with people with dementia in an acute hospital setting are described. The project had two phases. Phase one involved adapting an existing competency framework and developing the BPTI using focus groups. For the pilot and evaluation, in phase two, a mixed methods approach was adopted using self-administered standardised questionnaires and qualitative interviews. Qualitative analysis suggested that delivering skills-based training can develop communication, problem-solving and self-directed learning skills; benefit staff in terms of increased knowledge, skills and confidence; and be problematic in the clinical area in terms of time, organisation and the physical environment. These factors must be taken into consideration when delivering training. These changes were not reflected in the quantitative results and measures were not always sensitive to changes in this setting. Definitive conclusions cannot be drawn about the efficacy of the intervention, due to the contradictory outcomes between the quantitative and qualitative data. Further developments and research are required to explore how staff and organisations can be supported to deliver the best possible care.
-
Education and Security: Design and Evaluation Tools for Deliberate Disease Risks MitigationWhitby, Simon M.; Mancini, Guilio M. (University of BradfordFaculty of Social Sciences, 2016)This thesis addresses the role of education to mitigate the risks of deliberate disease, including biological weapons. Specifically, it aims to analyse how education was constructed as a potential instrument to mitigate specific security risks; if and how education could impact on risks; and how effectiveness of education as a risk mitigation measure could be improved. The research framework combines concepts of security, risk and education within a general constructionist approach. Securitization is used to analyse attempts to construct education as a tool to mitigate specific security risks; risk assessment is used to identify and characterize risk scenarios and potential for risks mitigation; and instructional design and evaluation models are used for the design and evaluation of education. The thesis contends that education has been constructed as a mitigation tool for what were presented as urgent security risks of deliberate disease. Nine attempted securitization moves are identified and assessed. Improved competences identified in four thematic areas, and built with education, can mitigate risks in specific scenarios via impacting factors that primarily influence risk likelihood. The thesis presents several examples of achieved learning objectives, and tools that can be useful to evaluate behavioural and risk impacts, though empirical results on these levels here are still scarce. Design and evaluation tools, illustrated through a large amount of original and pre-existing data from a range of countries and contexts, are presented that can improve effectiveness of education as a deliberate disease risks mitigation measure.