Massey Documents by Type

Permanent URI for this communityhttps://mro.massey.ac.nz/handle/10179/294

Browse

Has files: YesSubject: search.filters.subject.Rating of employees

Search Results

Now showing 1 - 2 of 2
  • Thumbnail Image
    Item
    Is workplace assessment working? : a critical theory analysis of the stated intentions for NQF workplace assessment in NZ and their realization in a case study in the ambulance service : a thesis presented in partial fulfilment of the requirements for the degree of Masters of Education (Adult Education) at Massey University
    (Massey University, 2003) Hoy-Mack, Penny
    Workplace Assessment (WPA) of National Qualifications Framework (NQF) competency standards has assumed significance as an alternative pathway for vocational qualifications for the NZ workforce. The stated intentions of the initiators of workplace assessment of NQF qualifications were multiple, an, at times, uneasy alliance of differing ideologies. These intentions included: an increase in the capability of the workforce, unified qualifications, social well-being and upward mobility for workers, the widening of participation in education, more fair and valid assessment and public choice. These official narratives for WPA are viewed through a critical theory 'lens', which is then focussed on a case study within the NZ Ambulance Service. The qualitative field work constitutes semi-structured interviews of six workplace assessors and eight candidates employed by Wellington Free Ambulance service. This research indicates that the intention to increase skill levels was partly realised in the valid and direct assessment of performance offered by WPA. Yet, competition with university qualifications detracted from the unified nature of the NQF; its qualifications were relegated to lower levels of the ambulance service. The intention to provide equitable pathways encountered barriers, particularly for volunteer ambulance officers. Moreover, lessened provider capture has resulted in inconsistencies in assessment practice. However, the assessors' holistic evidence-gathering methodologies employed an interplay model, integrating atomistic competencies and holistic judgements of ambulance work. This hermeneutic knowledge counters tendencies to reductionist assessment of ambulance work. A further model of workplace assessors' practice is developed showing how the level of closeness or distance between assessors and candidates influences the candidates' confidence and therefore fairness in workplace assessment. Participatory practices and positive closeness favourably affected assessment events. Costs, particularly the time required for WPA, are partly borne by the ambulance workers, with a resulting intrusive effect into the 'lifeworld' of these workers. The study concludes that WPA is a site where the ongoing contest for emancipation is played out, where workers may challenge the subjectivity of the learning organisation. Yet, candidates saw WPA as a way to meet their personal and career aspirations and valued the rewards attached to the qualifications gained, which offered them protection from the vagaries of the labour market.
  • Thumbnail Image
    Item
    Reference reports : a meta-analytic review of predictive validity and an experimental study of rating accuracy : a thesis presented in partial fulfilment of the requirements for the degree of Doctor of Philosophy in Psychology at Massey University
    (Massey University, 1996) Pajo, Karl Brandon
    Reference reports are a commonly used selection method in New Zealand and overseas. Although popular with practitioners, they have attracted little attention from researchers. To ascertain the predictive validity of reference reports a meta-analytic review was conducted. Results of the preliminary analysis provided a bare-bones estimated mean validity of 0.15, and a fully corrected estimated mean validity of 0.32. Substantial variance remained unaccounted for following corrections for sampling error. Subsequent moderated meta-analyses, based on degree of structure and psychometric soundness of the reference reports, was found to account for much of the variation in observed validity coefficients. Highly structured reports were found to be consistently superior to unstructured reports. Improvements in the validity of highly structured reports can be attributed to the control of leniency in ratings. However, no studies to date have evaluated the accuracy of referees' ratings. Drawing on the performance rating literature, an experimental study examining the influence of scale format, ratee characteristics, rating purpose, and rater affect on the accuracy of ratings was implemented. Asymmetrical, positively toned scales were found to reduce leniency in ratings compared to unstructured and Likert-type rating forms. Raters who expressed liking for the ratee were more lenient in their ratings compared to raters who expressed neutral or antagonistic feelings toward the ratee. No significant effects for rating purpose and ratee characteristics were apparent. Overall, the investigation points to deficiencies in the way reference reports are presently employed, and highlights the need for a more rigorous approach in their development and application.