Development and validation of a graph convolutional network (GCN)-based automatic superimposition method for maxillary digital dental models (MDMs)
To validate the accuracy and reliability of a graph convolutional network (GCN)-based superimposition method of a maxillary digital dental model (MDM) by comparing it with manual superimposition and quantifying the clinical error from this method. Based on a GCN, learning the features from 100 three-dimensional digital occlusal models under supervision of the palatal stable structure labels that were manually annotated by senior specialists, the palatal stable structure was automatically segmented. The average Hausdorff distance was calculated to assess the difference between automatic and manual segmentations. Tooth position and angulation, including rotation, tip, and torque, of bilateral upper first molars and central incisors were obtained to measure the clinical error of automatic superimposition. Reliability was calculated by intraclass correlation coefficient (ICC). The average Hausdorff distance was 0.36 mm between automatic and manual segmentations of the palatal stable region and was larger than the intraexaminer and interexaminer deviations. The tooth position deviation was <0.32 mm, and the tooth angulation difference was <0.26° for tip and torque, and 0.46–0.61° in rotation. ICCs, used for assessment of reliability, ranged from 0.82 to 0.99 in all variables. The GCN-based MDM superimposition is an efficient method for the assessment of tooth movement in adults. The clinical error in tooth position and angulation induced by the method was clinically acceptable. Reliability was as high as manual segmentation.ABSTRACT
Objectives
Materials and Methods
Results
Conclusions
INTRODUCTION
Typical orthodontic treatment requires obtaining various information from patients. A dental model is an irreplaceable tool that accurately and clearly duplicates tooth position, tooth shape, and occlusal relationships. The popularization of oral scanning improved the use of digital dental models in clinical practice. Without x-ray exposure, digital dental models can be obtained repeatedly during treatment to record progression of tooth movement.
Measurement of tooth movement is especially important in orthodontic outcome evaluation. Historically, measurement of orthodontic tooth movement and bone growth have been based on superimposition on the stable areas that change only minimally during treatment.1 Analysis of treatment and growth changes in tooth and bone can be traced back to Björk et al.,2–4 who adopted a cephalometric superimposition method based on metallic implants. Ruan et al.5 used metallic implants as stable anchors in cone beam computed tomography (CBCT) images to evaluate tooth movement. For digital dental models, Chen et al.6 proposed a maxillary digital dental model (MDM) superimposition method based on the stable region including the medial 2/3 of the third palatal rugae and the adjacent palatal vault region. This MDM superimposition was already validated in a previous study7 to be as accurate and reliable as CBCT voxel-based superimposition in adult patients.
Usually, the processing of digital dental models transfers STL files into point clouds, or they are imported as mesh surfaces.8,9 At present, application of an artificial intelligence–assisted approach to analyze a digital dental model is most commonly used for tooth crown segmentation.10,11 Graph convolutional networks (GCNs) have been widely used in analysis of three-dimensional (3D) medical imaging.12–15 In the current study, we creatively propose a GCN-based superimposition method for digital dental models. The study was designed to validate the accuracy of this method by comparing automatic segmentation with manual segmentation and quantifying the clinical error in measuring tooth movement by MDM superimposition between an automatically and manually segmented palatal stable region.
MATERIALS AND METHODS
Patients and Dental Casts
Dental casts were collected from consecutive patients from the Department of Orthodontics, Peking University School and Hospital of Stomatology. Exclusion criteria were patients under 18 years old, patients with craniofacial abnormalities, craniofacial surgery or trauma history, and dental casts of low quality. The dental casts collected were scanned by an R700 linear laser scanner (3Shape Corp., Copenhagen, Denmark) and saved in stereolithography interface (STL) format. The procedure of this study is illustrated in Figure 1. Informed consent was signed by all the patients, and the research protocol was approved by the Institutional Review Board of Peking University School and Hospital of Stomatology (IRB00001052-09010).


Citation: The Angle Orthodontist 95, 3; 10.2319/071224-555.1
Training for the Automatic Stable Region Segmentation
The reference area for superimposition was defined as the medial 2/3 of the third rugae and the adjacent regional palatal vault in front of the most distal points of upper first molars.6 Authors of a previous study showed that this method was as accurate and repeatable as CBCT voxel-based superimposition in adults.7 Labeling of the stable regions of 100 MDMs was conducted using MeshLab (version 2022, Visual Computing Lab of ISTI-CNR, Pisa, Italy), and all labels were checked by two senior specialists (Figure 2), from which 80 were used as training samples and 20 as test samples.


Citation: The Angle Orthodontist 95, 3; 10.2319/071224-555.1
This network extracted the features of each vertex on the MDM under the supervision of the labels manually annotated by specialists and trained a binary vertex classifier to predict the probability that each vertex of the model belonged to the palatal stable region. The network adopted a supervised training method and used a loss function, which was to be minimized, to calculate the difference between the manually annotated labels (ground truth) and the network estimated labels of the MDM to optimize the network parameters.
Testing of the Automatic Segmentation Network
Testing of the network was done by making comparisons between automatic and manual segmentations. For the newly input MDM, the vertex features and their adjacency relationships extracted from the MDM were input into the trained network, which could output the probability prediction of the palatal stable region for each vertex. The automatic segmentation could be completed by binary classification based on a predefined threshold. The set of vertices predicted as palatal stable regions constituted the segmentation result.
In MeshLab2022, the automatic and manual segmentations were extracted as two single layers (Figure 3). The average Hausdorff distance (Table 1) could be calculated automatically in a built-in function in MeshLab2022 to measure the difference between the two segmented layers. Two examiners repeated all the measurements after 2 weeks.


Citation: The Angle Orthodontist 95, 3; 10.2319/071224-555.1

Accuracy of Automatic Superimposition
The pretreatment and posttreatment models were imported into Rapidform2006 (INUS Technology Inc., Seoul, Korea). Two posttreatment models were superimposed by automatically and manually segmented stable regions denoted as AS (automatic superimposition) and MS (manual superimposition), respectively. Position and angulation of bilateral upper first molars and central incisors were measured to appraise the clinical error.
A coordinate system was created on the pretreatment model. The functional occlusal plane (FOP) was defined as the transverse plane (Table 1). Then two points on the palatal suture were marked as A and B (Figure 4a) and projected on the transverse plane as A′ and B′ (Figure 4b). The A, B and A′, B′ points were used to compose the midsagittal plane (Figure 4a). The B′ point was set as the origin of the coordinate system, B′A′ as the x axis, and B′B as the y axis (Figure 4c).


Citation: The Angle Orthodontist 95, 3; 10.2319/071224-555.1
Measurement of tooth position and angulation were elaborated in a previous study7 (Table1, Figure 4d–h). Tooth position was represented by the values of coordinates (x, y, z) of the U6 mesial-buccal cusp (Figure 4d) and the midpoint of the U1 incisal edge (Figure 4e). Tooth angulation was represented by the angle between reference planes and tooth axes (Table 1, Figure 4f–h). To eliminate the method error caused by the identification of crown landmarks, the dental crowns together with crown landmarks were transferred from the MS model to the AS model in Rapidform2006 (Figure 4i–k).
Statistical Analysis
Sample size calculation was conducted in Power Analysis and Sample Size (PASS) version 15.0.1 software (NCSS LLC, East Kaysville, UT). To achieve a power <0.80 with the largest true mean as 0.6 and a standard deviation of 1.5, sample size was calculated to be <9.
In SPSS Statistics version 23.0 (IBM, Armonk, NY), one-sample t-tests were conducted by comparing the 3D deviations of AS and MS models with zero to evaluate the accuracy of AS of MDM, based on automatic identification of the stable region of the palatal vault. An error of <1 mm was considered clinically acceptable.16,17 The intraclass correlation coefficient (ICC) was used to assess the reliability of superimposition. A P value of <.05 was considered statistically significant.
RESULTS
Accuracy and Reliability of Stable Region Segmentation
The average absolute distance from the border of automatic to manual segmentation was 0.36 mm (Table 2). The difference between automatic and manual segmentations was a bit larger than the intraexaminer and interexaminer average differences, which were both <0.10 mm. The root mean square (RMS), which is naturally larger than the arithmetic mean in mathematics, was 0.60 mm in this study. The image of segmented models was specifically analyzed, and it was found that the largest deviation was usually seen in the posterior border of the stable region.

Accuracy of AS
The difference in tooth position and angulation could represent the clinical error derived from the AS method. For all variables, no significant difference was found between the superimpositions based on automatic and manual palatal region segmentations (Table 3). Clinically, the average deviation ranged from 0.03 mm to 0.32 mm in tooth position, and 0.01° to 0.61° in tooth angulation. Specifically, the average difference in tooth tip and torque between the AS and MS was 0.01–0.26°, and the largest deviation was observed in tooth rotation ranging from 0.46° to 0.61°.

Reliability of AS
Reliability was calculated by ICC. An ICC >0.75 was considered acceptable reliability. Both intraexaminer and interexaminer ICCs ranged from 0.87 to 0.99 for tooth position and 0.82 to 0.99 for tooth angulation. The intraexaminer ICC was between 0.92 and 0.99, and the interexaminer ICC was slightly lower. The overall consistency between MS and AS ranged from 0.87 to 0.99. The least consistency was observed in the y direction of the coordinate axis, ranging from 0.87 to 0.96, and in tooth rotation, ranging from 0.82 to 0.97.
DISCUSSION
In this study, we proposed a new, automatic MDM superimposition method based on GCN and validated the accuracy and reliability of the method compared with MS. It was found that the newly proposed method was almost as accurate and reliable as MS and can be of great help in clinical practice.
Deep learning–assisted segmentation in dental models have been widely used for the tooth crown area.18 Compared with crown areas, the surface of the palatal region is not as rugged and lacks characteristic structures like dental cusps and grooves, making it harder for segmentation training tasks.19,20
The Hausdorff distance indicates the largest distance from a point in one set to the closest point in the other set, being vulnerable to outliers, and is used to assess border differences between two images.21,22 In this study, the average Hausdorff distance was used to diminish the influence of outliers.23 The average Hausdorff distance was 0.36 mm in this study, which is not a substantial value clinically. The largest deviation was found in the posterior border of the segmented area. The clinical definition of the posterior border was the most distal point of the bilateral first molars,6 but in some patients, the left and right first molars were not strictly symmetric, which might have confused the training model. The mean Hausdorff distance in automatic segmentation was a bit larger than in manual segmentation by about 0.3 mm, but both were clinically acceptable.
Generally, iterative closest point superimposition has been applied to align two selected surfaces.24,25 In several commercial software applications, local surface superimposition can be done after a gross alignment based on reference points.26–28 This process usually takes 3 to 5 minutes for skilled operators. The superimposition of multiple stage models may take >10 minutes for models from only one patient. AS would save a great amount of time for researchers.29
Authors of a previous study showed that MDM superimposition was as accurate and reliable as CBCT superimposition.7 Generally, 1 mm has been considered to be clinically acceptable in cephalometric analysis.16,17 Moon et al.30 developed a computer-aided cephalometric superimposition, but the error was >1 mm. Additionally, Moon et al.31 developed a deep learning–based approach to superimpose soft tissue landmarks on digital photographs and lateral cephalometric radiographs, and the positional difference with the manual approach was generally around 0.1 mm to 0.5 mm. Xiao et al.32 used 3D facial scanning features as the basis for MDM superimposition and achieved a clinical error of <0.42 mm and 0.92°. In the current study, the average deviation in tooth position was <0.32 mm, which is clinically acceptable and no larger than the deviation between MDM and CBCT superimposition in a previous study.7 In this study, the average deviation in tooth angulation was <0.26° in tooth tip and torque and ranged from 0.46° to 0.61° in rotation. Compared with a previous study, the clinical error was basically equal in tooth tip and torque.7 Tooth rotation was not measured in the previous study,7 but in this study, the greatest difference between AS and MS was detected in tooth rotation. This phenomenon may be explained by the shape of the palatal region. Tooth rotation was defined as the angle between the midsagittal plane and the tooth mesiodistal plane which is an angle parallel to the transverse plane. The palatal vault, approximately a smooth curved surface, also lies transversely and is, therefore, less resistant to positional changes in the transverse orientation. Therefore, it is suggested that a smoothing procedure not be conducted because smoothing may reduce roughness of the palatal surface and decrease the identifiability of palatal structures.33
Although segmentation of the stable region was not exactly as accurate as defined, superimposition based on this region still showed high accuracy and reliability. The identification of palatal stable regions themselves was a bit subjective, although the border was defined, but in clinical use, the superimposition was based on the inner shape of the 3D palatal surface rather than the edge. Additionally, the difference was only a bit larger than MS, showing promise for clinical use.
CONCLUSIONS
The GCN-based automatic MDM superimposition is an efficient method for the assessment of tooth movement in adults.
The clinical error induced by AS was clinically acceptable.
Reliability of the method is as high as manual segmentation and sufficient for clinical practice.

Flowchart of the study procedure.

Labeling of the palatal stable region in Meshlab2022.

Superimposition of automatic segmentation (gray) and manual labeling (black).

(a) Palatal suture landmarks (A, front point of palatal suture; B, back point of palatal suture). (b) Midsagittal plane and transverse plane (A′, B′, projected points of A, B on the transverse plane). (c) Coordinate system on the pretreatment model. (d) Landmarks of U6s (C, mesial-buccal cusp; D, most distal point; E, most mesial point; F, occlusal point of buccal groove; and G, gingival point of buccal groove). (e) Landmarks of U1s (H, midpoint of incisal edge; I, most distal point of incisal edge; J, most mesial point of incisal edge; and K, midpoint of gingival edge). (f) Measurement of U1 rotation. (g) Measurement of U6 tip. (h) Measurement of U1 torque. (i)–(k) Landmark transference by (j) tooth crown area from (i) manual superimposition (MS) model to (k) automatic superimposition (AS) model.
Contributor Notes