Journal Articles

Permanent URI for this collectionhttps://mro.massey.ac.nz/handle/10179/7915

Browse

Subject: search.filters.subject.validity

Search Results

Now showing 1 - 8 of 8
  • Thumbnail Image
    Item
    Does student sampling impact our understanding of argumentativeness and verbal aggressiveness?
    (Taylor and Francis Group on behalf of the American Forensic Association, 2024-08-17) Croucher SM; Kelly S; Elers P; Jackson K; Nguyen T
    Student samples are regularly used in research. While student samples are convenient and easy to access, the use of such samples has been criticized for exposing theories and research to internal validity threats, as students are not representative of the general population. Using argumentativeness and verbal aggressiveness as contexts for analysis, this study explores the extent to which student and non-student samples differ in published empirical research. We found that in the case of the original verbal aggression and argumentativeness measures, sample type did not moderate the means among argumentativeness and verbal aggressiveness studies. We discuss the implications of these findings in terms of student vs. non-student samples.
  • Thumbnail Image
    Item
    Cross-cultural measurement validation: an analysis of dissent, workplace freedom of speech, and perceived immediacy
    (Taylor and Francis Group on behalf of the Eastern Communication Association, 2024-03-12) Croucher SM; Kelly S; Ashwell D; Condon S; Tootell B
    Croucher and Kelly (2019) laid out guidelines to develop measures that can be used across cultures. The present study provides support for their guidelines, indicating that pancultural measurements cannot be behavioral and should not include unnecessary contexts; however, they should be worded as simplistically as possible. This study utilizes measures of dissent, perceived immediacy, and workplace freedom of speech in Australia, Canada, New Zealand, and the United States. Only the perceived immediacy measure, which follows Croucher and Kelly’s (2019) guidelines, maintained internal consistency.
  • Thumbnail Image
    Item
    Psychometric validation of the sibling inventory of behavior in three- to six-year-old Chinese children.
    (Frontiers Media S.A., 2023-03-06) Xu H; Wang Z; Gao X; Wang X; Wu Q; Osman A
    With increasing attention on sibling relationship studies in China, one problem that has been neglected is the limited validation of instruments used to assess these relationships. The present study evaluated the psychometric properties of the Sibling Inventory of Behavior to measure Chinese children’s sibling relationships using a stratified random sample of 590 parents of three- to six-year-olds in three economic regions. The confirmatory factor analysis obtained an adequate fit, suggesting that the Chinese version of the instrument had a six-factor structure (i.e., Companionship, Empathy, Teaching, Rivalry, Aggression, and Avoidance). It demonstrated satisfactory internal consistency as well as test–retest reliability. Results of discriminant, convergent, and criterion-related validity test also fulfilled psychometric requirements. Furthermore, the residual measurement invariance across regions was discovered. Given the importance, emergence, and tendency of sibling studies in China, having a reliable and valid instrument with robust psychometric properties is essential and impactful.
  • Thumbnail Image
    Item
    A General Math Anxiety Measure
    (MDPI (Basel, Switzerland), 2022-06) Kelly S; Croucher SM; Kim KY; Permyakova T; Turdubaeva E; Rocker KT; Eskiçorapçı N; Stanalieva G; Orunbekov B; Rimkeeratikul S; Jameson MM
    Math anxiety is a psychological burden that can hinder individuals across their lifetimes. However, the current literature lacks a valid measure of math anxiety that can be used across instructional modalities and among non-student populations. As such, it is difficult to assess math anxiety in virtual learning environments, track math anxiety across lifetimes, or determine the utility of math anxiety inoculations for non-student populations. This study presents a validity portfolio for a generalized math anxiety measure that can be used across teaching modalities, across lifetimes, and is simple enough to be used cross-culturally. The measure yielded evidence of validity when used in all tested samples: the United States (student and non-student samples), New Zealand (student and non-student samples), Kyrgyzstan (non-student sample), Turkey (non-student sample), Russia (non-student sample), and Thailand (non-student sample). The data support the use of the new math anxiety measure free of context.
  • Thumbnail Image
    Item
    GPs’ awareness of car driving among oldest patients: exploratory results from a primary care cohort
    (Royal College of General Practitioners, 2021-04) Leve V; Pentzek M; Fuchs A; Bickel H; Weeg D; Weyerer S; Werle J; König H-H; Hajek A; Lühmann D; van den Bussche H; Wiese B; Oey A; Heser K; Wagner M; Luppa M; Röhr S; Maier W; Scherer M; Kaduszkiewicz H; Riedel-Heller SG; for the AgeCoDe/AgeQualiDe Study Group
    Background Increasingly more very old people are active drivers. Sensory, motor and cognitive limitations, and medication can increase safety risks. Timely attention to driving safety in the patient–doctor relationship can promote patient-centred solutions. Aim To explore the following questions: do GPs know which patients drive a car? Is fitness to drive addressed with patients? Design & setting Cross-sectional data from patient interviews and GP survey in the ninth follow-up phase of a prospective primary care cohort (the German Study on Ageing, Cognition and Dementia in Primary Care Patients (AgeCoDe) and the Study on Needs, Health Service Use, Costs and Health-Related Quality of Life in a large sample of ‘oldest-old’ primary care patients (≥85 years; AgeQualiDe)) . Method The sample consisted of patients in the age group ≥85 years and their GPs. Independent reports were gathered on driving activity from the GP and the patient, and information was gained from GPs on whether driving ability was discussed with the patient. Statistical analyses included validity parameters and bivariate characterisation of subgroups (non-parametric significance tests, effect size). Results Self-reports of 553 patients were available (69.5% female; mean age 90.5 years; 15.9% drive a car). For 427 patients, GP data were also available: GPs recognised 67.1% correctly as drivers and 94.9% as non-drivers. GPs said that they had discussed fitness to drive with 32.1% of potentially driving patients. Among drivers who were not recognised and with whom driving had not been discussed, there were more patients with a low educational level. Conclusion The GP’s assessment of driving activity among very old patients showed moderate sensitivity and good specificity. Driving ability was seldom discussed. Asking an appropriate question during assessment could increase GPs’ awareness of older patients’ automobility.
  • Thumbnail Image
    Item
    Autism in Aotearoa: Is the RAADS-14 a valid tool for a New Zealand population?
    (Hogrefe for the European Association of Psychological Assessment (EAPA), 6/07/2020) Kember S; Williams MN
    Screening measures for autism spectrum disorder (ASD) are important tools for clinicians and researchers. However, where a measure developed and validated for one population is used with another, its performance in this new context must be carefully examined. The RAADS-14, a brief ASD screen developed in Sweden, was evaluated with a sample of New Zealand adults (N = 387), 41 of whom self-reported a prior diagnosis of ASD. The convergent validity of the RAADS-14 (Hypothesis 2) was supported by a strong positive correlation with the AQ-10 (short version of the Autism Spectrum Quotient), r = .81. Discriminant validity (Hypothesis 3) was also supported by a strong negative correlation with the EQ-Short (short version of the Empathy Quotient), r = −.75. However, the measure did not meet inferential criteria for internal consistency (Hypothesis 1), and confirmatory factor analysis (CFA) found a poor fit of the proposed three-factor model (Hypothesis 4) to the data. A cut-off score of 14/42 provided adequate sensitivity (95%) to detect participants with self-reported ASD diagnoses, but not adequate specificity (70%), suggesting a very high rate of false positives should be expected if relying on RAADS-14 scores alone to interpret presence of ASD. In sum, our results do not provide sufficient evidence of reliability and validity to support the use of the RAADS-14 with the New Zealand population. We provide suggestions for refinement of the RAADS-14 that may lead to increased reliability and validity.
  • Thumbnail Image
    Item
    Validity and reliability of Life Cycle Assessment: A case study of New Zealand Dairy Production
    (Veritas Publications Ltd, 14/06/2020) Flemmer C
    The purpose of this work is to evaluate the validity and reliability of life cycle assessment as a research methodology to measure the ecological footprint of New Zealand’s dairy production (by the dairy farming and dairy processing sectors). Environmental Input-Output Analysis was used as a macro-level life cycle assessment tool and applied to the dairy production over a period of six years. Eco-efficiencies were used as performance metrics to assess the sustainability of the dairy production. Over the six year period, New Zealand’s annual milk production increased from 11.4 to 15.1 million tonnes and its annual production of dairy products increased from 1.9 to 2.6 million tonnes. Eco-efficiencies indicate that over this time dairy farming became significantly more efficient in terms of land use (-27%), electricity use (-12%), water use (-21%) and lime use (-16%) and produced significantly less water-based effluent (-20%). At the same time fuel and fertilizer use were slightly less efficient (increasing by 2% and 6% respectively). The dairy processing industry used 21% less water and discharged 21% less effluent water. Fuel used in milk transportation was 14% more efficient. The internal validity of the research was good despite significant structural changes to the dairy processing sector but commercial sensitivity had a negative impact on the results. External validity was affected by different boundaries, different climates and different time frames for published studies but some comparisons were possible. The underlying data was generally accurate, reproducible and representative of the entire sectors with checks for anomalies to ensure good reliability. The choice of Environmental Input-Output Analysis for the life cycle assessment tool and error analysis of all underlying data contributed to both the validity of the research method and the reliability of the data. These, in turn, give good credibility to the research findings.
  • Thumbnail Image
    Item