Editorial Type:
Article Category: Research Article
 | 
Online Publication Date: 01 Oct 2001

A 2-Center Comparison of Orthodontist's Perceptions of Orthodontic Treatment Difficulty

BDS, MScD, PhD, FDS, RCS (Ed), FDS RCS (Eng), D.Orth,
BDS,
BDS,
BSc,
, and
Page Range: 404 – 410
DOI: 10.1043/0003-3219(2001)071<0404:ACCOOP>2.0.CO;2
Save
Download PDF

Abstract

The aim of this study was to determine which factors correlate with easy and difficult treatments and to assess the use of the Index of Complexity, Outcome & Need (ICON) as an indicator for treatment difficulty. The study was conducted at 2 centers using a retrospective cross-sectional questionnaire-based design. The participants were specialist orthodontic practitioners in Dresden, Germany and Cardiff, UK. Sixteen specialist orthodontists participated. Each supplied 10 completed cases—5 they regarded as being easy and 5 as being difficult. The specialist orthodontists completed a questionnaire and stated up to 5 reasons why they considered the case easy or difficult. Two examiners were calibrated in the use of the ICON. Logistic regression analysis using a forward conditional systematic model with complexity of case (ie, easy or difficult) as the dependent variable demonstrated statistical significance of the following patient-related factors: pretreatment ICON score, number of appointments, and age. Chi-squared testing demonstrated statistical significance of the following factors: cooperation, extent of overbite, presence of dysfunction, extent of overjet, anchorage, angulation of teeth, presence of crossbite, center-line shift, nonextraction treatment, age at start of treatment, compliance during the course of treatment, oral hygiene level. This study indicates that the main distinguishing factors between easy and difficult cases appear to be pretreatment age, number of appointments, and pretreatment ICON score. However, the odds ratios were not sufficiently high for these factors to be strong predictors of difficulty.

INTRODUCTION

In recent years, there has been increased interest in the development of an index of orthodontic treatment difficulty. An orthodontic index is a numerical scale that is derived by scoring specific features of a malocclusion to objectively assess some parameter, such as how far a malocclusion varies from an ideal occlusion. The reasons for this increased interest are 3-fold. First, the index could be used to allocate resources. This is, in theory, based on the belief that patients could be treated utilizing the most effective appliances, by practitioners competent to carry out treatment to a high or optimal standard. Second, an index could be used to obtain appropriate remuneration. If a case is considered difficult, it is likely to take more time and effort, thus, time and effort should be awarded accordingly. Third, an index of orthodontic treatment difficulty could be used to increase professional esteem among individuals or groups of practitioners who treat difficult cases to a high standard. Although all these objectives seem plausible, it is questionable whether they have validity, as treatment difficulty may mean different things to different clinicians for different cases.

Despite the common belief that one case may be more difficult to treat than another, exactly what defines a case as easy or difficult is still not clear. The terms complexity, difficulty, and severity are often used in the same context. Both difficulty and severity are defined by the Oxford English Dictionary as “needing much effort or skill.” Complexity is defined as “intricate or complicated,” which is not dissimilar to difficulty. However, in terms of orthodontics, the authors suggest that difficulty and complexity are synonymous and should be defined as a measure of effort and skill, while severity is a measure of how far a malocclusion deviates from normal.

However, these definitions are not mutually exclusive. Rowe1 studied the assessment of 30 orthodontists in examining the pretreatment records and giving their opinion regarding difficulty of treatment. The study casts were analyzed with an objective measure of malocclusion. They found that treatment difficulty and malocclusion severity were distinct but related entities, even though some factors of malocclusion were not reliable predictors of perceived treatment difficulty.

DeGuzman et al2 attempted to validate the Peer Assessment Rating (PAR) Index3 for malocclusion severity and treatment difficulty by using the opinions of a panel of 11 American orthodontists. They found a close association between the orthodontists' perception of severity of malocclusion and perceived difficulty of treatment.

Richmond et al4 studied the professional perception of orthodontic treatment complexity by sampling specialist and nonspecialist practitioners in General Dental Services (GDS) in the United Kingdom (UK). Data for 280 cases were collected, including the use of the IOTN and PAR indices. They concluded that cost (in the GDS cost is directly related to the appliance type), number of appointments, length of appointments, age of patient at the start of treatment, and initial PAR score (equivalent to initial malocclusion severity) were all significant associations with the judgment of difficulty. In effect, in the UK treatment difficulty was already being rewarded with higher fees. In addition, this study found no predictive factors prior to treatment to assess orthodontic treatment. Only post-treatment factors were important in assessing treatment difficulty. Cassinelli5 found that difficulty in patient care was associated with high initial PAR score, treatment plan changes, extractions, total number of appointments, and treatment duration.

The Index of Complexity, Outcome & Need (ICON) was derived from the expert opinion of 97 practicing specialist orthodontists from Germany, Greece, Hungary, Italy, Netherlands, Norway, Spain, United Kingdom, and the United States.6 It is a single assessment method to record complexity, outcome, and need designed for use on patients or study models. The ICON measures 5 components and taking about 1 minute to complete.

The pretreatment ICON score exhibited a strong linear relationship with the mean case score of the 97 orthodontist's perceptions of difficulty (R2 = 0.756). The authors devised different levels of difficulty based on the mean subjective opinions of the 98 orthodontists: Easy <29; Mild 29–50; Moderate 51–63; Difficult 64–77; and Very Difficult >77.

The aim of this study was to determine those factors that are related to difficult and easy treatments and to assess the use of the ICON as an indicator of treatment difficulty.

MATERIALS AND METHODS

The study was carried out in 2 centers—one in Dresden, Germany and the other in Cardiff, UK. Eight specialist orthodontists in each center were invited to participate in the study. An explanatory letter and 10 questionnaires (5 for easy cases and 5 for difficult cases) were sent in advance to each participant. Each orthodontist was asked to supply 5 completed cases they regarded as being easy to treat and 5 they regarded as being difficult to treat. The selection of cases was deliberately polarized into easy and difficult to increase the chance of detecting possible factors related to difficulty.

Patient-related factors selected for collection in the questionnaires and reasons for the case being regarded as easy or difficult are as shown in Table 1. The orthodontists were invited to write up to 5 factors that they considered as making the case difficult or easy beyond the fixed questions on the questionnaire.

TABLE 1. Patient Related Factors Which are Significant in Influencing the Difficulty of an Orthodontic Treatment

          TABLE 1.

The ICON index assesses 5 factors. The scores are then weighted and totaled to give the total ICON score. Two examiners were trained and calibrated in the use of the ICON. The ICON scores were recorded for both pre- and post-treatment study models.

Statistical analyses

Calibration of the examiner was assessed using the Root Mean Square (RMS).7 The answers to patient related factors were number coded, and a logistic regression analysis (forward conditional systematic model (P<.05)) using the difficulty of the case as the dependent variable was carried out. Chi-squared tests were employed to analyze the reasons given for determining easy and difficult cases.

RESULTS

The Root Mean Square of the calibration exercise was less than 7 points and the mean difference compared to the gold standard was below 2 points, which indicated excellent reliability. Sixteen specialist orthodontists, 8 in Dresden and 8 in Cardiff, submitted a total of 160 completed cases, 80 designated as easy cases and 80 designated as difficult.

A logistic regression demonstrated patient-related factors that were statistically significant in influencing the complexity of an orthodontic treatment in both countries (Table 1).

A chi-squared analysis of reasons, as supplied by the specialist orthodontists, was carried out to discover which reasons, if any, had a statistically significant influence in the perceptions of difficulty of a case in both countries. The results for this are shown in Tables 2, 3, and 4.

TABLE 2. Results of Analysis of Reasons to Show Influence on the Difficulty of a Case in Germany

          TABLE 2.

DISCUSSION

The greater the number of appointments, the older the patient, and the greater the ICON score, the more likely the case will be considered as difficult. However, the odds ratio for these factors are not greatly predictive of treatment difficulty (Exp (B) = 1.1). It is interesting that factors such as skeletal pattern (anteroposterior and vertical) were not considered important in the statistical model. Also, a change in treatment plan, extraction patterns, and length of treatment were not found to have an effect on difficulty. This is contrary to that reported by Cassenelli although the total number of appointments was found to have an influence.5

A detailed look at the reasons cited by the orthodontists revealed some differences between easy and difficult cases in Germany and the UK, and there may be a difference between Europe and the United States. More influence was placed on dysfunction in Germany than in the UK. This probably reflects the ethos of orthodontic training in Germany. In the UK, crowding was cited as an important factor by practitioners in difficult and easy cases. This can be explained by the fact that when crowding matches extractions, the alignment is more straightforward than where extraction residual spaces need to be closed or extra space needs to be created. Compliance seems to be an important factor in cases considered to be easy. The optimal age for treatment was cited for 20 of the easy cases in Germany but not in the UK. This optimal age is the subjective age designated by German orthodontists as the right age to undertake orthodontic treatment. Including 2 centers in 2 different countries has highlighted similarities and differences in decision-making by orthodontists regarding treatment difficulty.

When the data from Germany and the UK is combined, more factors come into play. When considering difficulty, skeletal relationships, crowding and molar relationships showed statistically significant differences. There were also statistically significant differences between factors common to Germany and the UK: cooperation, overbite, and compliance (Table 5). Lack of cooperation and compliance seem to be more important in Germany than in the UK, while overbite is more important in the UK than in Germany. None of the orthodontists cited soft tissues as a factor in determining difficulty. Although orthodontist's reliability in assessing soft tissues is very poor, it is often cited as an indication for treatment difficulty.8

TABLE 5. Comparison of Factors Common to Both Easy and Difficult Cases in Germany and the UK

          TABLE 5.

This study emphasizes that if treatment goes according to plan the case is regarded as easy. However, if treatment is disrupted for any reason, resulting in a change of treatment plan that increases the number of appointments, the case would be regarded as difficult.

The ICON was developed to assess orthodontic treatment difficulty, need, and outcome. The initial correlation of ICON scores with orthodontists subjective opinions of difficulty was high (R2 = .756).6 The relatively low odds ratio for the ICON score may reflect the polarization of easy and difficult cases rather than comparing ICON scores with a continuous scale of difficulty.

Orthodontists' reliability in assessing treatment difficulty has been reported as poor and this will have an effect on determining which factors are important in its assessment. It appears that treatment difficulty means different things to different practitioners for different cases.

CONCLUSIONS

This study indicates that the main distinguishing factors between easy and difficult cases appear to be pretreatment age, number of appointments, and pretreatment ICON score. Although these factors are statistically significant, they are not particularly good predictors of treatment difficulty.

The factors stated by the orthodontists indicate the multifactorial aspect of orthodontic treatment difficulty. However, there were 3 factors commonly cited in Germany and the UK: cooperation, overbite, and compliance. Lack of cooperation and compliance seem to be more important in Germany than in the UK, while overbite is more important in the UK than in Germany.

TABLE 3. Results of Analysis of Reasons to Show Influence on the Difficulty of a Case in the UK

          TABLE 3.
TABLE 4. Results of Analysis of Reasons to Show Influence on the Difficulty of a Case in Both Germany and the UK

          TABLE 4.

REFERENCES

  • 1

    Rowe, T. K.
    ,
    J. A.Weintraub
    ,
    P. S.Vig
    ,
    C. J.Kowalski
    , and
    K. W. L.Vig
    . The influence of malocclusion components on perceived severity and treatment difficulty [abstract].J Dent Res1990. 69:260. Abstract 1210.

  • 2

    DeGuzman, L.
    ,
    D.Babiraei
    ,
    K.Vig
    ,
    P.Vig
    ,
    R.Weyant
    , and
    K. D.O´Brien
    . The validation of the Peer Assessment rating Index for malocclusion severity and treatment difficulty.Am J Orthod1995. 107:172176.

  • 3

    Richmond, S.
    ,
    W. C.Shaw
    ,
    K. D.O´Brien
    ,
    I. B.Buchanan
    ,
    R.Jones
    ,
    C. D.Stephens
    ,
    C. T.Roberts
    , and
    M.Andrews
    . The development of the PAR Index (Peer Assessment Rating): reliability and validity.Eur J Orthod1992. 14:125139.

  • 4

    Richmond, S.
    ,
    C. P.Daniels
    , and
    J.Wright
    . The professional perception of orthodontic treatment complexity.Br Dent J1997. 183:371375.

  • 5

    Cassinelli, A. G.
    The influence of malocclusion severity on the perceived treatment difficulty of orthodontic patients [masters thesis]. Columbus, Ohio: The Ohio State University; 1998.

  • 6

    Daniels, C. P.
    and
    S.Richmond
    . The development of the Index of Complexity, Outcome and Need (ICON).J Orthod2000. 27:149162.

  • 7

    Roberts, C. T.
    and
    S.Richmond
    . The design and analysis of reliability studies for the use of epidemiological and audit indices in orthodontics.Br J Orthod1997. 24:139147.

  • 8

    Daniels, C. P.
    An evaluation of international professional perceptions in orthodontics comparing professional assessments of treatment need, complexity and outcomes in 9 countries [PhD thesis]. Cardiff, UK: University of Wales College of Medicine; 1998.

APPENDIX 1EASY/DIFFICULT

Copyright: Edward H. Angle Society of Orthodontists

Contributor Notes

Corresponding author: Professor S. Richmond, Department of Dental Health and Development, Dental School, University of Wales College of Medicine, Cardiff, CF14 4XY, UK. (richmonds@cardiff.ac.uk).

Received: 01 Jan 2001
Accepted: 01 Feb 2001
  • Download PDF