Editorial Type:
Article Category: Research Article
 | 
Online Publication Date: 25 Nov 2020

The reliability and reproducibility of an Android cephalometric smartphone application in comparison with the conventional method

and
Page Range: 236 – 242
DOI: 10.2319/042320-345.1
Save
Download PDF

ABSTRACT

Objectives

To assess the reliability and reproducibility of linear and angular measurements of the cephalometric smartphone Android application OneCeph in comparison with the conventional method.

Materials and Methods

A total number of 22 landmarks were registered, and 26 skeletal and dental cephalometric parameters were measured on 30 pretreatment cephalograms. The measurements for both digital (OneCeph) and conventional tracings were performed twice with a 4-week interval. The reliability (intraexaminer error) was evaluated by using the Pearson correlation coefficient. The variation in measurements between the tracing techniques (reproducibility) was determined by paired t-test.

Results

The Pearson correlation coefficients of all cephalometric measurements for each tracing technique were ≥ 0.95. Significant differences between the two tracing techniques were detected in five measurements (SNB angle, N I to Pog linear measurement, U1-Apoint linear measurement, U lip to S line, and nasiolabial angle; P < .05).

Conclusions

Using 26 measurements to compare both tracing methods, all mean differences between the digital (OneCeph) and conventional methods were below 1 degree/1 mm, indicating that differences between the tracing methods were clinically insignificant. The U1-A point measurement was an exception for the digital method (OneCeph) with a clinically significant difference of 1.25 mm (P < .01); the difference was a result of wrongly measuring the distance from the A line to the incisor edge of the upper central incisor rather than the facial surface of the upper incisor. This leads to the conclusion that both tracing methods were reliable for daily clinical practice.

INTRODUCTION

Cephalometric radiographs are important tools for proper orthodontic diagnosis and treatment planning. Traditionally, cephalometric analysis is done manually. However, this technique is time consuming and it is subject to measurement and magnification errors.1,2 Digital computer-assisted cephalometric programs can save time and eliminate measurement and magnification errors because these measurements are done automatically.3 Despite the advantages, however, computer-assisted cephalometric programs are still relatively expensive, and they need a computer, which is less portable in comparison with smartphones.

Recently, the usage of smartphones has spread in many fields, including dentistry. The ability to download custom-built software applications (apps) has created opportunities for orthodontists to use this technology in orthodontic treatment.4 A new released app for cephalometric analysis called “OneCeph” was launched in the Google Play store in 2016. The application was developed by Prof. Dr. M. Pavan Kumar, Kamineni Institute of Dental Sciences, Narketpally, Telangana, India. This free app has the ability to produce several cephalometric analyses in a short period.5 However, no previous study has verified the reliability (intraexaminer error) and reproducibility (agreement between two measurements of different methods) of this app. Thus, the aim of the present study was to determine the reliability and reproducibility of the cephalometric smartphone app OneCeph and compare it with the conventional hand tracing method.

MATERIALS AND METHODS

This study was conducted on 30 pretreatment lateral cephalograms. The cephalograms were selected from the digital archive of the Department of Orthodontics, School of Dentistry, İstanbul Yeni Yüzyıl University. The study was approved by the ethical committee of İstanbul Yeni Yüzyıl University. The inclusion criteria for radiographs were pretreatment cephalograms of individuals who were seeking orthodontic treatment, no pathology, no artifacts, and no gross craniofacial asymmetry and the dentition was in maximum intercuspation with the lips in a relaxed position.

All of the selected lateral cephalometric radiographs were taken by the same technician and cephalostat. The X-ray images were obtained digitally (PCH-2500 Digital Cephalometric Unit, Vatech, Hwaseong, Korea). The patients' heads were positioned with the Frankfort horizontal plane parallel to the floor, and the midsagittal plane was at a 90-degree angle to the X-ray beam. The radiographs were taken in centric occlusion and a light lip seal.

To perform manual hand tracing, the digital cephalometric images were printed out at a scale of 1:1. The radiographs were traced in daylight. The tracing was done using a 0.3 mm hard black (HB) lead pencil. Landmarks were identified by a single point. In case of superimposed bilateral anatomical structures and double images, the mid-point was chosen. After identifying the 22 selected landmarks and 7 planes (Figure 1), 26 linear and angular parameters (Table 1) were measured manually and digitally.

Figure 1.Figure 1.Figure 1.
Figure 1. Cephalometric landmarks used in the study: (1) sella (S), (2) nasion (N), (3) anterior nasal spine (ANS), (4) posterior nasal spine (PNS), (5) A point (A), (6) incisor superius (Is), (7) incisor inferius (Ii), (8) B point (B), (9) pogonion (Pog), (10) gnathion (Gn), (11) menton (Me), (12) gonion (Go), (13) condylon (Cd), (14) articulare (Ar), (15) orbitale (Or), (16) porion (Po), (17) mid-point between molar superioris (Ms) and molar inferioris (Mi), (18) subnasal (Sn), (19) S point (Steiner analysis), (20) labial superius (LS), (21) labial inferius (LI), (22) soft tissue pogonion (Pog'). (A) SN plane, (B) Frankfort plane (Po-Or), (C) maxillary plane (ANS-PNS), (D) bisecting occlusal plane (BOP), (E) mandibular plane (Go-Gn), (F) mandibular plane (Go-Me), (G) mandibular plane (tangent to lower border of mandible).

Citation: The Angle Orthodontist 91, 2; 10.2319/042320-345.1

Table 1. Cephalometric Measurements
Table 1.

Cephalometric measurements were performed by importing high-quality JPEG images (resolution quality of 96 dpi and dimensions of 2272 × 2045 pixels at a 24-bit depth) of all digital cephalograms to the OneCeph app using a Samsung Galaxy A7 2018 smartphone (Samsung C&T Corporation, Seoul, South Korea). The conventional hand tracing and cephalometric smartphone OneCeph app measurements were performed twice by the same investigator with intervals of 4 weeks between the measurements.

Statistical Methods

Sample size calculation was performed by G*Power 3 and based on expecting a moderate level of correlation for all cephalometric measurements (r2 = 0.5). Power analysis showed that a minimum of 29 radiographs were required at power, 0.80; β, 0.20; and α, 0.05.

Data analyses were carried out using SPSS software version 22 (SPSS Inc., Chicago, IL). The mean, standard deviation, and standard error of the difference between the repeated measurements for each method and between the two methods were calculated. The reliability of each method was defined using the Pearson correlation coefficient (r2). The levels of the correlation strength were the following: r2 > 0.8 = high (strong), 0.5 ≤ r2 ≤ 0.8 = moderate, r2 < 0.5 = weak. The reproducibility was determined by comparing the paired measurements through t-tests. The level of statistical significance was set at P< .05.

RESULTS

The reliability (intraexaminer error) of the conventional and digital methods for all measurements was evaluated using Pearson correlation coefficients (r2). Overall, the reliability analysis (Table 2) showed high correlation between repeated measurements of the digital and manual methods. The greatest differences between the first and second tracing trials were 0.82 mm and 0.43 degrees for the digital method and 0.87 mm and 0.90 degrees for the conventional method.

Table 2. Mean Differences, Standard Deviation and Correlation Coefficient (Intraexaminer Error) for Repeated Measurements of Digital and Conventional Tracing
Table 2.

The reproducibility (comparison between the digital and the conventional methods) showed statistically significant differences for five measurements (SNB, N I to Pog, U1-A point, U lip to S line, and nasolabial angle; P < .05, P < .01; Table 3). The conventional method had significantly higher means than the digital method for the following measures: SNB (P = .013), N I to Pog (P = .035), U1-A point (P = .001), and U lip to S line (P = .001). The digital method had a significantly higher mean than the conventional method for the nasolabial angle measurements (P = .002). However, the differences between the digital and the conventional methods regarding the rest of the sagittal linear and angular measurements were not statistically significant. The highest differences between sample means were 1.25 mm and 0.77 degrees.

Table 3. Comparison of Digital and Conventional Tracing Measurements
Table 3.

DISCUSSION

Lateral cephalograms continue to be an essential part of orthodontic records. Conventionally, cephalometric analysis is done manually. However, the source of errors in conventional tracing could arise from the variation in landmark identification, measurement errors, and magnification errors.1,6,7 To overcome the disadvantages of manual tracing, computerized cephalometric software products were introduced into clinical orthodontics. This computerized technique requires only digitizing the cephalometric landmarks on the cephalometric X-ray, and the calculation of measurements is done automatically.3 Thus, the digital technique eliminates most potential human errors except for landmark identification errors. Despite all the advantages, it is important to evaluate the reliability and reproducibility of new computerized software and to compare it with conventional tracing. Many studies have examined the reliability and reproducibility of computerized cephalometric software programs that are commercially available; however, as technology evolved, custom-built cephalometric software apps for smartphones have created useful opportunities for clinical practice.4

Thus, the aim of this study was to evaluate the reliability and reproducibility of the cephalometric smartphone application OneCeph, which runs on Android systems (Google LLC., Mountain View, Calif), and compare it with the manual tracing method. In examining the reliability and reproducibility of the OneCeph app, the use of cephalometric measurements was prioritized over landmark identification. Santoro et al.8 mentioned that any study that aims to evaluate the consistency and reliability of digital cephalometrics shall focus on the sources of errors and the use of measurements rather than landmarks because cephalometric measurements are the final product of the cephalometric tracing procedure and they are the basis of treatment planning. To minimize the errors in the digital technique, the grayscale of the digital images was kept at 24 bits. Ongkosuwito et al.9 showed that a grayscale less than 7 bits can lead to uncertainty for the reproducibility of cephalometric measurements.

Erkan et al.10 inferred that during the assessment of the reliability of computerized cephalometric software, intraexaminer error was much less than the interexaminer error. Therefore, this study was focused on intraexaminer errors (the reliability) for both linear and angular measurements. The reliability analysis (Table 2) showed a high correlation between the repeated measurements of the digital and manual methods (r2 > 0.9 for all measurements), indicating that the operator had no difficulty in accurately repeating measurements in each technique. There was good agreement between the current findings and those of previous studies. For instance, Sayinsu et al.11 found that the operator was consistent in repeated measurements, and all intraexaminer correlation coefficients were >0.90. AlBarakati et al. showed a high correlation between repeated measurements (the reliability) of both conventional and digital tracing techniques. In their study, all intraexaminer correlation coefficients for repeated measurements were at least 0.90, except for the maxillary length (ANS-PNS), which was not included in the current study.12

The number of studies that investigated the reproducibility of smartphone cephalometric apps are limited in the literature, and the available studies had targeted apps that run mainly on the iPhone (Apple Inc., Cupertino, Calif). Sayar and Kilinc13 examined the reproducibility of the CephNinja 3.10 app, which runs on Apple's IPhone operating system (IOS), in comparison with the hand-tracing method. They found that there were significant statistical differences for all measured parameters, but the differences were clinically insignificant. On the other hand, Aksakalli et al.14 investigated the accuracy of two cephalometric apps, CephNinja 3.3 and SmartCeph Pro 1.1, which run on iPad (Apple Inc.), and they compared those apps with the computerized Dolphin imaging software. The authors concluded that smartphone apps should be developed to provide more accurate results because most of the measurements differed significantly from the Dolphin imaging software. Although OneCeph is a smartphone app, comparison between the digital and conventional methods (the reproducibility) indicated statistically significant differences for only five measurements (SNB, N I to Pog, U1-A point, U lip to S line, and nasiolabial angle; P < .05, P < .01; Table 3). Similar findings were reported in previous studies that compared conventional tracing to digital tracing using software that runs on personal computers. AlBarakati et al.12 reported significant differences in SNB measurements. A possible explanation for such a difference according to previous studies was that the nasion can be difficult to locate precisely when the nasofrontal suture is not clearly visualized.15 In addition, the B point is located on a curve, and, thus, it might show slightly greater errors of measurement. Similarly, the S point (U lip to S line) is located on a curve with wide radii, and it might increase the chance of error.1 Celik et al.16 and Sayinsu et al.11 reported significant differences in N I to Pog measurements, which might have arisen from the fact that the porion is an inconsistent cephalometric point.17 Despite the previously reported explanations regarding the differences in SNB, N I to Pog, and U lip to S line measurements between the tracing methods, the intraexaminer reliability in the present study was high for both tracing techniques. This might suggest that the landmark identification for the operator was relatively unchallenging. The inconsistency between conventional and digital measurements (SNB, N I to Pog, and U lip to S) might be related to the operator identifying some cephalometric points slightly differently when projected on a mobile touchscreen, even if they could be repeated consistently within each method. However, it is important to emphasize that the differences were below 1 mm or 0.5 degree; thus, they clinically might be considered insignificant.

The nasolabial angle measurements were inconsistent between the digital and the conventional methods. Sayinsu et al.11 reported a similar result, and they explained the difference by the fact that the nasolabial angle is calculated based on landmarks that are located on curves with wide radii and therefore showing proportionally greater errors.1 However, in the current study, the significant differences for nasolabial angle measurements between the two methods could have been attributed to the impractical technique for determining the tangent line of the nose in the OneCeph app. The app asks the user to place a point far away from the soft tissue profile of the nose as a part of constructing the tangent line of the nose (Figure 2); thus, the chance of error in correctly determining the tangent line of the nose increases, and the nasolabial angle is affected as a consequence.

Figure 2.Figure 2.Figure 2.
Figure 2. Placement of anterior point far away from soft tissue to construct the tangent line of the nose as part of nasiolabial angle measurement.

Citation: The Angle Orthodontist 91, 2; 10.2319/042320-345.1

The U1-A point measurements were also inconsistent between the digital and conventional methods. The U1-A point measurement is defined as “A line constructed through point A parallel to nasion perpendicular and the distance measured to the facial surface of the upper incisor. It relates the upper incisor to the maxilla.”18 However, the distance in the OneCeph app is measured incorrectly: to the incisal edge of the maxillary central incisor (Figure 3) rather than the facial surface of the upper incisor.18,19 Thus, there were significant differences in U1-A point measurements between the two tracing methods.

Figure 3.Figure 3.Figure 3.
Figure 3. For the U1-A point measurement in the OneCeph app, the distance is measured, incorrectly, to the incisal edge of the maxillary central incisor rather than to the facial surface of the upper incisor.

Citation: The Angle Orthodontist 91, 2; 10.2319/042320-345.1

CONCLUSIONS

  • Using 26 measurements to compare the two tracing methods, the results showed statistically significant differences for five measurements (SNB, N I to Pog, U1-A point, U lip to S line, and the nasiolabial angle; P < .05, P < .01). However, all mean differences between the digital (OneCeph) and conventional methods were below 1 degree/1 mm, indicating that differences between the tracing methods were clinically insignificant. However, the U1-A point measurement was an exception, with a clinically significant difference of 1.25 mm (P < .01); the difference was a result of the digital app incorrectly calculating the distance from the A line to the incisal edge of the upper central incisor rather than the facial surface of the upper incisor. This leads to the conclusion that both tracing methods were reliable for daily clinical practice.

REFERENCES

  • 1. 

    Baumrind S, Frantz RC. The reliability of head film measurements. 1. Landmark identification. Am J Orthod. 1971; 60

    (2)
    : 111127.

  • 2. 

    Cooke MS, Wei SH. Cephalometric errors: a comparison between repeat measurements and retaken radiographs. Aust Dent J. 1991; 36

    (1)
    : 3843.

  • 3. 

    Iseri H, Acikbas A, Yilmaz O. The evaluation of accuracy and reliability of the measurement os cephalometric radiographs by tracing and direct digitization. Turk J Orthod. 1992; 5

    (1)
    : 16.

  • 4. 

    Baheti MJ, Toshniwal N. Orthodontic apps at fingertips. Prog Orthod. 2014; 15

    (1)
    : 36.

  • 5. 

    Mamillapalli PK, Sesham VM, Neela PK, Mandaloju SP, Keesara S. A smartphone app for cephalometric analysis. J Clin Orthod. 2016; 50

    (11)
    : 694633.

  • 6. 

    Sandler PJ. Reproducibility of cephalometric measurements. Br J Orthod. 1988; 15

    (2)
    : 105110.

  • 7. 

    Ricketts RM. Perspectives in the clinical application of cephalometrics. The first fifty years. Angle Orthod. 1981; 51

    (2)
    : 115150.

  • 8. 

    Santoro M, Jarjoura K, Cangialosi TJ. Accuracy of digital and analogue cephalometric measurements assessed with the sandwich technique. Am J Orthod Dentofacial Orthop. 2006; 129

    (3)
    : 345351.

  • 9. 

    Ongkosuwito EM, Katsaros C, van 't Hof MA, Bodegom JC, Kuijpers-Jagtman AM. The reproducibility of cephalometric measurements: a comparison of analogue and digital methods. Eur J Orthod. 2002; 24

    (6)
    : 655665.

  • 10. 

    Erkan M, Gurel HG, Nur M, Demirel B. Reliability of four different computerized cephalometric analysis programs. Eur J Orthod. 2012; 34

    (3)
    : 318321.

  • 11. 

    Sayinsu K, Isik F, Trakyali G, Arun T. An evaluation of the errors in cephalometric measurements on scanned cephalometric images and conventional tracings. Eur J Orthod. 2007; 29

    (1)
    : 105108.

  • 12. 

    Albarakati SF, Kula KS, Ghoneima AA. The reliability and reproducibility of cephalometric measurements: a comparison of conventional and digital methods. Dentomaxillofac Radiol. 2012; 41

    (1)
    : 1117.

  • 13. 

    Sayar G, Kilinc DD. Manual tracing versus smartphone application (app) tracing: a comparative study. Acta Odontol Scand. 2017; 75

    (8)
    : 588594.

  • 14. 

    Aksakalli S, Yilanci H, Gorukmez E, Ramoglu SI. Reliability assessment of orthodontic apps for cephalometrics. Turk J Orthod. 2016; 29

    (4)
    : 98102.

  • 15. 

    Sekiguchi T, Savara BS. Variability of cephalometric landmarks used for face growth studies. Am J Orthod. 1972; 61

    (6)
    : 603618.

  • 16. 

    Celik E, Polat-Ozsoy O, Toygar Memikoglu TU. Comparison of cephalometric measurements with digital versus conventional cephalometric analysis. Eur J Orthod. 2009; 31

    (3)
    : 241246.

  • 17. 

    Chen YJ, Chen SK, Chang HF, Chen KC. Comparison of landmark identification in traditional versus computer-aided digital cephalometry. Angle Orthod. 2000; 70

    (5)
    : 387392.

  • 18. 

    Cobourne M, DiBiase A. Handbook of Orthodontics. 2nd ed.

    Oxford, UK
    :
    Elsevier;
    2016.

  • 19. 

    McNamara JA. A method of cephalometric evaluation. Am J Orthod Dentofacial Orthop. 1984; 86

    (6)
    : 449469.

Copyright: © 2021 by The EH Angle Education and Research Foundation, Inc.
Figure 1.
Figure 1.

Cephalometric landmarks used in the study: (1) sella (S), (2) nasion (N), (3) anterior nasal spine (ANS), (4) posterior nasal spine (PNS), (5) A point (A), (6) incisor superius (Is), (7) incisor inferius (Ii), (8) B point (B), (9) pogonion (Pog), (10) gnathion (Gn), (11) menton (Me), (12) gonion (Go), (13) condylon (Cd), (14) articulare (Ar), (15) orbitale (Or), (16) porion (Po), (17) mid-point between molar superioris (Ms) and molar inferioris (Mi), (18) subnasal (Sn), (19) S point (Steiner analysis), (20) labial superius (LS), (21) labial inferius (LI), (22) soft tissue pogonion (Pog'). (A) SN plane, (B) Frankfort plane (Po-Or), (C) maxillary plane (ANS-PNS), (D) bisecting occlusal plane (BOP), (E) mandibular plane (Go-Gn), (F) mandibular plane (Go-Me), (G) mandibular plane (tangent to lower border of mandible).


Figure 2.
Figure 2.

Placement of anterior point far away from soft tissue to construct the tangent line of the nose as part of nasiolabial angle measurement.


Figure 3.
Figure 3.

For the U1-A point measurement in the OneCeph app, the distance is measured, incorrectly, to the incisal edge of the maxillary central incisor rather than to the facial surface of the upper incisor.


Contributor Notes

Graduate Student, Department of Orthodontics, School of Dentistry, Istanbul Yeni Yüzyıl University, Istanbul, Turkey.
Professor and Chairman, Department of Orthodontics, School of Dentistry, Istanbul Yeni Yüzyıl University, Istanbul, Turkey.
Corresponding author: Dr Obada M. Zamrik, MS Graduate student, Department of Orthodontics, School of Dentistry, Istanbul Yeni Yüzyıl University, Binektaşı Sokak No. 10, Beyoğlu, Istanbul 34445, Turkey (e-mail: dr.zamrik@outlook.sa)
Received: 01 Apr 2020
Accepted: 01 Sept 2020
  • Download PDF