Editorial Type:
Article Category: Research Article
 | 
Online Publication Date: 05 Mar 2025

Is the Peer Assessment Rating index a valid measure for change in Oral Health-Related Quality of Life following orthodontic treatment? Results of a cohort study

,
, and
Page Range: 438 – 444
DOI: 10.2319/091924-769.1
Save
Download PDF

ABSTRACT

Objectives

To explore the relationship between changes in Peer Assessment Rating (PAR) score and Oral Health-Related Quality of Life (OHRQoL) following orthodontic treatment and to assess responsiveness of the Psychosocial Impact of Dental Aesthetics Questionnaire (PIDAQ) in a cohort of young adults.

Materials and Methods

Participants (n = 162) aged 18–25 years requiring comprehensive fixed orthodontic treatment were recruited. Changes in OHRQoL were measured using the PIDAQ, while malocclusion severity was assessed using the PAR index and Index of Orthodontic Treatment Need. Data were collected before treatment (T0) and 1 month after treatment completion (T1). Responsiveness of the PIDAQ was evaluated using standardized effect size, standardized response mean, and Global Transition Judgment.

Results

A positive, moderate overall correlation (r = 0.417, P < .05) was observed between changes in PAR and PIDAQ scores posttreatment, with significant improvements in OHRQoL reported by 88.1% of participants at T1. Subgroup analysis revealed strong correlations in cases of crowding (r = 0.711) and increased overjet (r = 0.703), while Class III malocclusion showed a weaker correlation (r = 0.263). Multivariate regression analysis revealed that change in PAR score was independently associated (R2 = 0.652) with change in OHRQoL score. The PIDAQ demonstrated responsiveness to treatment-associated changes, with a significant reduction in OHRQoL scores posttreatment.

Conclusions

While a positive correlation between the objective measure of malocclusion severity (PAR) and subjective OHRQoL was identified, the relationship was moderate. The PIDAQ was found to be a responsive scale for assessing OHRQoL in orthodontic patients.

INTRODUCTION

Recognition of the profound influence of orthodontic treatment on patient quality of life (QoL) has grown, extending beyond the traditional focus on dental esthetics and function. Central to this paradigm shift is the concept of Oral Health-Related Quality of Life (OHRQoL), which encompasses the multifaceted impact of oral health conditions on physical, psychological, and social well-being.1 Understanding the interplay between orthodontic intervention and OHRQoL is essential for optimizing patient outcomes and refining treatment approaches.

Normative indices such as the Peer Assessment Rating (PAR) index and Index of Orthodontic Treatment Need (IOTN) serve as objective measures of malocclusion severity, primarily focusing on occlusal parameters. Conversely, OHRQoL scales represent subjective measures, reflecting an individual’s perception of his or her oral health status in the context of overall well-being.2 The assessment of OHRQoL might provide valuable insights into the long-term impact of orthodontic treatment beyond clinical endpoints.3

Improvement in PAR score and OHRQoL are generally anticipated to go hand in hand, yet this correlation is not always linear.3 The exact nature of this relationship can be complex and individual specific, underscoring the need for better understanding to aid clinicians in treatment planning.

Most measures available to gauge OHRQoL are generic and adaptable to diverse dental conditions. These generic measures may fail to fully encapsulate the nuanced impacts of specific conditions.4 Consequently, condition-specific instruments, such as the Psychosocial Impact of Dental Aesthetics Questionnaire (PIDAQ), have been developed to provide a more tailored and comprehensive evaluation.5 The scale has undergone translation and cross-sectional validation processes across a spectrum of languages.6–9 However, longitudinal research to assess the responsiveness of the PIDAQ is limited.

In this study, therefore, we aimed to determine the relationship between change in PAR score and change in OHRQoL following orthodontic treatment and to test the responsiveness of the PIDAQ to changes associated with orthodontic treatment.

MATERIALS AND METHODS

Study Design and Setting

This research constituted a prospective longitudinal cohort investigation, carried out in the Department of Orthodontics & Dentofacial Orthopedics, Government Dental College, Kerala, India. The protocol was approved by the Institutional Ethics Committee (IEC/M/14/2017/DCK), and the study adhered to the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) guidelines.10

Study Participants

All participants aged 18 years to 25 years requiring comprehensive fixed orthodontic treatment were invited to participate in the study. Enrollment was contingent upon willingness to participate and the provision of informed consent. Exclusion parameters were set to preclude individuals with a history of previous orthodontic intervention, those requiring surgical correction, or those unable to consent. Treatment was administered by one of the co-investigators (E.P.) and the Principal Investigator, supervised by the former.

The sample size estimation using G*Power software (G*Power Version 3.1.9.7., Heinrich Heine University, Düsseldorf, Germany) indicated a sample size of 135 to detect a moderate effect size at a 5% significance level and 90% power. Anticipating a high attrition rate (20%) by the end of treatment, the final sample size was increased to 162, consistent with previous studies.3 Participants were recruited from May to December 2018.

OHRQoL Scale

The PIDAQ encompasses 23 items under four domains: Dental Self-Confidence (DSC) with 6 items, Social Impact having 8 items, Psychological Impact comprising 6 items, and the Aesthetic Concern domain with 3 items.5 Each item was rated on a five-point Likert scale (0 = not at all, 1 = a little, 2 = somewhat, 3 = strongly, and 4 = very strongly).5 Notably, the items in all domains, except those in DSC, are negatively worded. The version of the PIDAQ cross-culturally adapted for the study population was used.9

Methodology

Prior to the initiation of orthodontic intervention (T0), participants were administered the cross-culturally adapted version of the PIDAQ and given sufficient time to complete the response sheet.9 Objective assessment of malocclusion severity used the Dental Health Component of the IOTN (IOTN-DHC) and PAR index. The overall PAR score was computed using the weightings by Richmond et al.11 Concurrently, participants’ subjective perceptions were documented using the Aesthetic Component of the IOTN (IOTN-AC). The Principal Investigator, who underwent training and calibration under the co-investigator E.P., carried out the data collection process. Intraobserver reliability was ensured by repeating the pretreatment PAR evaluation of 30 randomly selected participants after a 2-week interval. The data collection process was reiterated 1 month following treatment completion (T1).

The responsiveness assessment typically employs two methods: anchor based and distribution based.12 The anchor-based approach correlates changes in the OHRQoL instrument with a recognizable anchor, providing insight into the significance of a particular level of change. Conversely, the distribution-based approach associates changes in treatment with specific measures of variability, such as standardized effect size (SES) and standardized response mean (SRM).12 The following single-item measure, termed the Global Transition Judgment (GTJ), was employed for the anchor-based approach: “How would you rate the difference in your quality of life related to oral health following brace treatment?” The response options included improved a lot, improved a little, remained the same, worsened a little, and worsened a lot. The determination of minimally important difference (MID) was also carried out as part of responsiveness testing.12

Statistical Analysis

Data analysis was done with SPSS software, version 16.0 (SPSS, Chicago, Ill). The intraobserver reliability in PAR evaluation was confirmed by intraclass correlation coefficient (ICC). The DSC domain items of the PIDAQ scale were reverse-scored, as they were positively worded, to ensure consistency in scoring direction across all domains.9 The Shapiro-Wilk test was used to assess the normality of the data.

Relationship between PAR and OHRQoL Measure

The relation between the change in weighted PAR score and change in total PIDAQ score (T0 – T1) overall was assessed using Pearson’s product moment correlation, both overall and within each GTJ group.

The dataset was stratified into six subgroups based on the malocclusion type, categorized using the IOTN-DHC and PAR index. The subgroups included crowding, spacing, bimaxillary proclination, anterior openbite, Class II–increased overjet, and Class III. The correlation between change in PIDAQ score and change in PAR score was assessed within each subgroup using Pearson’s correlation.

A χ2 analysis was performed to identify the relationship between sociodemographic factors (age, gender, and socioeconomic status), treatment duration, and OHRQoL. Multivariate regression analysis was subsequently undertaken to establish the relationship between significant independent variables and OHRQoL.

PIDAQ Responsiveness

Assessment of PIDAQ score change involved computing the difference between total baseline scores and total posttreatment PIDAQ scores. Improvement in OHRQoL would be interpreted as a positive change in scores and a deterioration in case of negative change. Responsiveness was gauged using SES and SRM, both quantifying the extent of change, categorized into small (≤0.2), moderate (0.3–0.7), and large (≥0.9).13

The significance of change in scores within subjects among those reporting improvement in OHRQoL and those reporting no improvement was evaluated using paired t-tests, as in existing research.3 Significant changes in the improved group and insignificant changes in the no-improvement group is indicative of a responsive scale. To determine MID, the difference between the mean change scores of participants who reported minimal change and those who reported no change in their OHRQoL at T1 was calculated.14 The resultant value was used to compute Guyatt’s responsiveness statistic, which is represented by the ratio of MID to the variability in participants who reported no change.15

Construct Validity of PIDAQ Over Time

In this study, we examined the relationship between changes in total PIDAQ scores and GTJ using one-way analyses of variance. Robust longitudinal construct validity was evidenced by positive mean score changes in participants reporting improvement in GTJ, negative changes for those reporting worsening, and negligible score differences for those indicating no change.16

RESULTS

Participant and Clinician Characteristics

In this study, we enrolled 162 participants (48.7% males; 51.3% females) with a mean age of 20.9 ± 2.033 years who completed the questionnaire at T0 (Figure 1; Table 1). It was conducted from May 2018 to December 2021, with an average treatment duration of 2.3 ± 1.2 years. Follow-up attrition resulted in a 12% dropout rate (n = 19), reducing the sample size to 143 (47.6% males, 52.4% females; mean age = 21.3 ± 1.8 years; Figure 1; Table 1). The data were found to be normally distributed (P > .05).

Figure 1.Figure 1.Figure 1.
Figure 1.STROBE flowchart.

Citation: The Angle Orthodontist 95, 4; 10.2319/091924-769.1

Table 1.Sociodemographic and Clinical Characteristics of Participantsa
Table 1.

A larger proportion of participants (63.6%) was categorized as having a definite need for treatment according to the IOTN-DHC (Table 1). GTJs revealed that a substantial majority of participants (88.1%) perceived an improvement in their OHRQoL at T1 (Table 2).

Table 2.Pretreatment and Posttreatment Total PIDAQ Scores, Change Scores, SES, and SRM for the Different GTJ Categoriesa
Table 2.

The operators were orthodontic clinicians, with the supervisor (E.P.) having over 25 years of clinical experience. The ICC demonstrated a high intrarater reliability (0.982, 95% confidence interval = 0.977, 0.986).

Relationship Between PAR and OHRQoL Measure

A positive and statistically significant correlation (P < .05) was observed between change in total PIDAQ score and change in PAR score across all groups and subgroups tested (Table 3). The strength of correlation, overall, was moderate (r = 0.417), with moderate correlation in the GTJ 4 and 5 groups (r = 0.524 and 0.613, respectively) and weak in the GTJ 3 group (r = 0.271; Table 3).

Table 3.Correlation Between Change in PAR Score and Change in PIDAQ Scorea
Table 3.

Subgroup analysis revealed a strong correlation in participants with crowding (r = 0.711) and increased overjet (r = 0.703), a weak correlation in Class III (r = 0.263), and a moderate correlation in others (Table 3).

Chi-square analysis showed a statistically nonsignificant (P > .05) association between sociodemographic factors and change in OHRQoL following orthodontic treatment (Table 4). In contrast, treatment duration was found to have a statistically significant (P < .05) positive association with OHRQoL change (Table 4). The multivariate regression analysis model revealed that change in PAR score was independently associated (R2 = 0.652) with change in OHRQoL score.

Table 4.Bivariate and Multivariate Linear Regression for Change in OHRQoL Scorea
Table 4.

PIDAQ Responsiveness

Table 2 shows that both groups, those who improved (GTJ 4 and 5) and those who did not (GTJ 3), exhibited significant differences (P < .05) in total PIDAQ scores between pretreatment (T0) and posttreatment (T1). Based on the GTJ, a larger proportion of participants (n = 81, 56.6%) reported significant improvements in their OHRQoL. A smaller group (n = 17, 11.9%) indicated no change, and notably, none of the participants reported any deterioration (Table 2).

The effect size was large for participants who reported significant improvement (GTJ 5: 8.5) and small for those who reported no change (GTJ 3: 4.8; Table 2). The MID was determined to be 19.5, and Guyatt’s responsiveness statistic was 2.4.

Construct Validity of PIDAQ Over Time

The mean difference (T0 − T1) in total PIDAQ scores was greatest (76.8) for participants who reported significant improvement (GTJ 5), moderate (65.5) for those reporting slight improvements (GTJ 4), and smallest (46.0) for those who experienced no change (GTJ 3; Table 2).

DISCUSSION

The PAR index provides a measurable, objective indicator of the need for orthodontic treatment as well as the effectiveness of interventions applied.11 Over time, its validity and reliability have been well documented.17–19 However, it is primarily limited to clinical viewpoints and does not always capture patient perceptions.20

PAR and OHRQoL

In this study, we confirmed a significant, albeit variable, association between the PAR index and OHRQoL. A positive and moderate overall correlation was observed between changes in PIDAQ and PAR scores. This implies that improved dental outcomes (lower PAR scores) are moderately associated with enhanced psychosocial well-being (lower PIDAQ scores). The Pearson correlation and effect size reflected a similar trend, with higher values in participants who reported improvement in OHRQoL following orthodontic treatment (GTJ 4 and 5) and lower in those who reported no change in OHRQoL (GTJ 3). However, the correlation was only moderate, as anticipated, given that they assess different constructs, one objective while the other subjective.3

Though treatment of malocclusion has been found to improve OHRQoL, the relationship is not always straightforward. Around 12% of participants reported no change in OHRQoL, despite definite improvements in their occlusal status. This was consistent with the findings of Peter et al.,3 who reported a comparable rate of 15%. Chapman et al.20 compared the impact of orthodontic treatment on OHRQoL of cleft lip and palate patients with a noncleft group. They found that the improvement in OHRQoL following treatment was similar in both cohorts, although the noncleft group achieved more favorable occlusal outcomes. These findings highlight the complex and sometimes divergent relationship between objective measures and patient-reported outcomes.

Considering the different malocclusion groups, the correlation was strong in participants with crowding and increased overjet, likely due to the higher incidence of teasing and bullying associated with these conditions.21,22 Consequently, orthodontic interventions in these cases can yield substantial psychosocial benefits.23 These findings were in agreement with previous studies, in which authors demonstrated that crowding and increased overjet significantly impacted the OHRQoL.22,24 Conversely, Class III participants demonstrated a weak correlation. This could have been due to the inclusion of cases amenable to nonsurgical correction only. Surgical intervention could have brought about a higher OHRQoL change, as reported by others.25

Bimaxillary proclination, spacing, and anterior open bite subgroups exhibited moderate correlations, indicating a noticeable, although less pronounced, relationship between dental improvements and psychosocial benefits. This was, partly, in agreement with the findings of Anthony et al.,24 who reported anterior openbite to have no statistically significant impact on OHRQoL. However, they also reported that spacing was associated with a significant impact on OHRQoL, which contrasted with the current findings of only a moderate correlation.24

Multivariate regression analysis showed that change in PAR score independently influenced the change in OHRQoL following orthodontic treatment, as evidenced by an R2 value of 0.652. This suggested that approximately 65% of the variability in OHRQoL score could be elucidated by this model.

PIDAQ Responsiveness

Responsiveness is the key attribute of a scale, defined by its ability to detect clinically significant changes over time.15 A responsive OHRQoL scale is a valuable tool, as it aids in assessing the effectiveness of treatment, monitoring disease progression, and understanding the impact of oral health on overall QoL.26

The observed positive correlation between the change in OHRQoL and PAR scores indicated that the PIDAQ effectively captures dental changes following treatment. The mean PIDAQ scores decreased significantly following treatment, with no instance of an increase in scores. This finding reinforces the positive effect of orthodontic treatment on OHRQoL.

In evaluating the scale’s longitudinal construct validity, patients who reported improvements and those who did not both demonstrated positive score changes. However, the degree of change followed a clear gradient across the three groups, categorized by the GTJ, as reported in the responsiveness assessment of the Malocclusion Impact Questionnaire.3

Limitations

Nineteen participants failed to complete treatment, primarily due to the COVID-19 pandemic. While an adequately increased sample size mitigated the potential loss of statistical power, a high dropout rate remains a concern in longitudinal studies such as this. Additionally, long-term follow-up over several years is necessary to confirm the stability of subjective treatment satisfaction, as measured by patient-reported outcome measures, and to confirm if it aligns with objective changes assessed using PAR.

CONCLUSIONS

  • Though there was a positive correlation between objective assessment of malocclusion using the PAR index and subjective assessment using the PIDAQ, the association was only moderate.

  • This highlights the importance of patient-reported outcome measures to capture patient perceptions.

  • In the sample studied, crowding showed the maximum change in OHRQoL after orthodontic treatment, followed by an increase in overjet.

  • The PIDAQ was found to be a valid and responsive measure in assessing OHRQoL following orthodontic treatment.

REFERENCES

  • 1.
    Cunningham SJ,Hunt NP. Quality of life and its importance in orthodontics. J Orthod. 2001;28(
    2
    ):152158.
  • 2.
    Cunningham SJ,Garratt AM,Hunt NP. Development of a condition-specific quality of life measure for patients with dentofacial deformity: I. Reliability of the instrument. Community Dent Oral Epidemiol. 2000;28(
    3
    ):195201.
  • 3.
    Peter E,Monisha J,Benson PE,George SA. Does orthodontic treatment improve the Oral Health-Related Quality of Life when assessed using the Malocclusion Impact Questionnaire—a 3-year prospective longitudinal cohort study. Eur J Orthod. 2023;45(
    6
    ):773780.
  • 4.
    Marshman Z,Gibson BJ,Benson PE. Is the short-form Child Perceptions Questionnaire meaningful and relevant to children with malocclusion in the UK? J Orthod. 2010;37(1):29–36. Erratum in: J Orthod. 2010;37(
    2
    ):140.
  • 5.
    Klages U,Claus N,Wehrbein H,Zentner A. Development of a questionnaire for assessment of the psychosocial impact of dental aesthetics in young adults. Eur J Orthod. 2006;28(
    2
    ):103111.
  • 6.
    Sardenberg F,Oliveira AC,Paiva SM,Auad SM,Vale MP. Validity and reliability of the Brazilian version of the Psychosocial Impact of Dental Aesthetics Questionnaire. Eur J Orthod. 2011;33(
    3
    ):270275.
  • 7.
    Spalj S,Lajnert V,Ivankovic L. The Psychosocial Impact of Dental Aesthetics Questionnaire—translation and cross-cultural validation in Croatia. Qual Life Res. 2014;23(
    4
    ):12671271.
  • 8.
    Lin H,Quan C,Guo C,Zhou C,Wang Y,Bao B. Translation and validation of the Chinese version of the Psychosocial Impact of Dental Aesthetics Questionnaire. Eur J Orthod. 2013;35(
    3
    ):354360.
  • 9.
    Monisha J,Peter E,Ani GS. Is Psychosocial Impact of Dental Aesthetics Questionnaire (PIDAQ) valid for the Indian population? A psychometric study. J Int Soc Prev Community Dent. 2021;11(
    2
    ):207215.
  • 10.
    von Elm E,Altman DG,Egger M,Pocock SJ,Gøtzsche PC,Vandenbroucke JP; STROBE Initiative. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ. 2007;335(
    7624
    ):806808.
  • 11.
    Richmond S,Shaw WC,O’Brien KD, et al. The development of the PAR index (Peer Assessment Rating): reliability and validity. Eur J Orthod. 1992;14(
    2
    ):125139.
  • 12.
    Revicki D,Hays RD,Cella D,Sloan J. Recommended methods for determining responsiveness and minimally important differences for patient-reported outcomes. J Clin Epidemiol. 2008;61(
    2
    ):102109.
  • 13.
    Cohen J. Statistical Power Analysis for the Behavioral Sciences (
    2nd ed
    .).
    Hillsdale, NJ
    :
    Lawrence Erlbaum Associates
    , 1988.
  • 14.
    Masood M,Masood Y,Saub R,Newton JT. Need of minimal important difference for Oral Health-Related Quality of Life measures. J Public Health Dent. 2014;74(
    1
    ):1320.
  • 15.
    Guyatt G,Walter S,Norman G. Measuring change over time: assessing the usefulness of evaluative instruments. J Chronic Dis. 1987;40(
    2
    ):171178.
  • 16.
    Beaton DE,Hogg-Johnson S,Bombardier C. Evaluating changes in health status: reliability and responsiveness of five generic health status measures in workers with musculoskeletal disorders. J Clin Epidemiol. 1997;50(
    1
    ):7993.
  • 17.
    Buchanan IB,Shaw WC,Richmond S,O’Brien KD,Andrews M. A comparison of the reliability and validity of the PAR index and Summers’ Occlusal Index. Eur J Orthod. 1993;15(
    1
    ):2731.
  • 18.
    DeGuzman L,Bahiraei D,Vig KW,Vig PS,Weyant RJ,O’Brien K. The validation of the Peer Assessment Rating index for malocclusion severity and treatment difficulty. Am J Orthod Dentofacial Orthop. 1995;107(
    2
    ):172176.
  • 19.
    Firestone AR,Beck FM,Beglin FM,Vig KW. Evaluation of the Peer Assessment Rating (PAR) index as an Index of Orthodontic Treatment Need. Am J Orthod Dentofacial Orthop. 2002;122(
    5
    ):463469.
  • 20.
    Chapman R,Fowler P,Antoun J,Page L. The impact of orthodontic treatment on the dental occlusion and Oral Health-Related Quality of Life of individuals with cleft lip and/or palate. Aus Orthod J. 2019;35(
    2
    ):119126.
  • 21.
    Seehra J,Fleming PS,Newton T,DiBiase AT. Bullying in orthodontic patients and its relationship to malocclusion, self-esteem and Oral Health-Related Quality of Life. J Orthod. 2011;38(
    4
    ):247256.
  • 22.
    Dimberg L,Arnrup K,Bondemark L. The impact of malocclusion on the quality of life among children and adolescents: a systematic review of quantitative studies. Eur J Orthod. 2015;37(
    3
    ):238247.
  • 23.
    Zheng DH,Wang XX,Su YR, et al. Assessing changes in quality of life using the Oral Health Impact Profile (OHIP) in patients with different classifications of malocclusion during comprehensive orthodontic treatment. BMC Oral Health. 2015;15:148.
  • 24.
    Anthony SN,Zimba K,Subramanian B. Impact of malocclusions on the Oral Health-Related Quality of Life of early adolescents in Ndola, Zambia. Int J Dent. 2018;2018:7920973.
  • 25.
    Rezaei F,Masalehi H,Golshah A,Imani MM. Oral Health Related Quality of Life of patients with Class III skeletal malocclusion before and after orthognathic surgery. BMC Oral Health. 2019;19(
    1
    ):289.
  • 26.
    Locker D,Jokovic A,Clarke M. Assessing the responsiveness of measures of Oral Health-Related Quality of Life. Community Dent Oral Epidemiol. 2004;32(
    1
    ):1018.
Copyright: © 2025 by The EH Angle Education and Research Foundation, Inc.
Figure 1.
Figure 1.

STROBE flowchart.


Contributor Notes

Corresponding author: Dr Elbe Peter, Professor & Head, Department of Orthodontics & Dentofacial Orthopedics, Government Dental College, Thrissur, Kerala 680596, India (e-mail: elbeortho@yahoo.co.in)
Received: 19 Sept 2024
Accepted: 02 Feb 2025
  • Download PDF