Validity and intra-rater reliability of an Android phone application to measure cervical range-of-motion
© Quek et al.; licensee BioMed Central Ltd. 2014
Received: 7 January 2014
Accepted: 8 April 2014
Published: 17 April 2014
Concurrent validity and intra-rater reliability using a customized Android phone application to measure cervical-spine range-of-motion (ROM) has not been previously validated against a gold-standard three-dimensional motion analysis (3DMA) system.
Twenty-one healthy individuals (age:31 ± 9.1 years, male:11) participated, with 16 re-examined for intra-rater reliability 1–7 days later. An Android phone was fixed on a helmet, which was then securely fastened on the participant’s head. Cervical-spine ROM in flexion, extension, lateral flexion and rotation were performed in sitting with concurrent measurements obtained from both a 3DMA system and the phone.
The phone demonstrated moderate to excellent (ICC = 0.53-0.98, Spearman ρ = 0.52-0.98) concurrent validity for ROM measurements in cervical flexion, extension, lateral-flexion and rotation. However, cervical rotation demonstrated both proportional and fixed bias. Excellent intra-rater reliability was demonstrated for cervical flexion, extension and lateral flexion (ICC = 0.82-0.90), but poor for right- and left-rotation (ICC = 0.05-0.33) using the phone. Possible reasons for the outcome are that flexion, extension and lateral-flexion measurements are detected by gravity-dependent accelerometers while rotation measurements are detected by the magnetometer which can be adversely affected by surrounding magnetic fields.
The results of this study demonstrate that the tested Android phone application is valid and reliable to measure ROM of the cervical-spine in flexion, extension and lateral-flexion but not in rotation likely due to magnetic interference. The clinical implication of this study is that therapists should be mindful of the plane of measurement when using the Android phone to measure ROM of the cervical-spine.
Cervical range-of-motion (ROM) assessment forms an integral part of physiotherapy evaluation in people with neck-pain by quantifying an important physical impairment  and providing potentially useful diagnostic data . In this regard, the cervical range-of-motion device (CROM) [3, 4] and single inclinometer are considered the most appropriate clinical measurement instruments. However, the CROM is relatively expensive (US$395) and cumbersome, and the inclinometer although more affordable, has been reported to have inconsistent and inferior validity for cervical lateral-flexion and rotation measurements [5, 6].
Advances in smart phone sensor technology have resulted in inexpensive ROM measurement tools with clinical and research potential. Specifically, the smart phone uses an embedded-accelerometer and a magnetometer to detect motion using gravity and the earth’s magnetic field respectively. To our knowledge, only one published study  has examined the validity and reliability of the smartphone to measure cervical ROM. Although that study reported some promising findings, it did possess limitations including: a) the criterion reference used (i.e. CROM) did not allow for concurrent testing of the phone, and lacked the sensitivity and precision of a multi-camera three-dimensional motion analysis (3DMA) system, which may have negatively influenced the mostly moderate validity findings; b) no reported effort was made to ensure that movement was well-controlled and along the intended axis of head movement; and c) the examiner was not blinded to the results obtained from the phone and the CROM device, hence error due to reporting bias cannot be ruled out. This may potentially overestimate the validity results. Therefore the purpose of this study was to investigate the concurrent validity and test-retest reliability of an Android smart phone to assess cervical ROM. Our study extends prior research by (i) verifying the validity of the smart phone by concurrently assessing with a 3DMA system, the gold-standard for capturing motion analysis , (ii) adding a spirit-level type indicator to the phone application to ensure a pure axis of movement  and (iii) blinding the examiner to the results. We hypothesize that the phone will be valid and reliable.
Twenty-one healthy individuals (age:31 ± 9.1 years, height: 172.7 ± 8.9 cm, weight:68.5 ± 11.2 kg, male:11) with no reported neck-pain participated. Sixteen participants returned 1–7 days later to assess intra-rater reliability. All participants provided informed consent as outlined by the institution’s Human Research Ethics Committee and all procedures were conducted according to the Declaration of Helsinki.
All measures were performed with the subject seated in the same high-back padded chair. To ensure minimal contribution from the thoracic spine, the participant was securely strapped across the shoulders to the chair using an inelastic belt (Figure 1: Mulligan Mobilization Belt). An Android 4.0 phone (Samsung Galaxy S3, GT-I9300T) was mounted on a helmet (Figure 1), and the helmet was fastened securely on the patient’s head using an internal adjustable head strap fixed within the helmet. This phone contains a LSM330DLC inertial monitoring unit combining tri-axial accelerometer and gyroscope sensors, and an AKM8975 tri-axial magnetometer.
The following cervical-spine ROM limit measurements were obtained in the same order in all subjects: (i)flexion, (ii)extension, (iii)right-lateral-flexion, (iv)left-lateral-flexion, (v)right-rotation and (vi)left-rotation. The flexion/extension, lateral flexion/extension and rotation axes were measured using the pitch, roll and azimuth angles respectively. Given that cervical rotation values are based on the magnetometer within the phone and the outcome may be influenced by the surrounding magnetic fields, a magnetic yoke was placed around the subject’s neck in an attempt to address this problem. This replicates the use of the CROM, which also uses magnetic fields to determine angles and requires the use of a magnetic yoke.
The patient was instructed to perform each test actively, with manual guidance provided by the examiner to ensure that the movement was along the pure axis of alignment if necessary. Specifically, the examiner determined the end of ROM when a firm resistance was felt. No pain was reported by any subject during the procedure. Three consecutive trials using concurrent measurements from the VICON and the phone were obtained for each movement. The mean value of the three measurements for the first testing day was used to calculate validity, and an inter-day comparison of these mean values was performed to determine intra-rater reliability.
Validity was determined from Spearman’s correlation and intra-class correlation coefficient (ICC) in combination with assessment of systematic bias. Bland and Altman plots were constructed to determine the 95% limits of agreement (LoA) between the 3DMA and phone measures [10, 11]. Ordinary least products (OLP) regression, which accounts for error in both devices, was used to determine fixed and proportional biases . All calculations were performed as described previously .
Intra-rater reliability was determined using intra-class coefficients (ICC [3,3]), and OLP regression to quantify the relationship between sequential measurements for both instruments. ICC was calculated in a 2-way analysis of variance based on absolute agreement. Point estimates of the ICC values >0.75 were considered excellent, 0.4-0.75 modest or <0.4 poor . To estimate measurement error, standard error of measurement (SEM), LOA, and minimal detectable change (MDC) were calculated. Statistical analyses were completed using PASW software V21.
Validity of the phone compared to 3DMA using 3 repetitions of each cervical movement (n = 21)
Phone (Mean ± SD)
3DMA (Mean ± SD)
Average systematic bias (CI)
Width of 95% LoA
52.0 ± 8.7
49.9 ± 8.8
0.30 to 0.996
79.3 ± 8.0
80.4 ± 9.9
0.80 to 0.97
Right Lateral Flexion¥
45.0 ± 7.3
43.0 ± 7.0
0.71 to 0.99
Left Lateral Flexion
48.8 ± 8.8
47.8 ± 8.0
0.89 to 0.98
57.1 ± 9.7
70.9 ± 7.2
-0.13 to 0.85
-33.7 + 0.31
65.3 ± 15.1
71.4 ± 5.8
-0.60 to 0.80
-71.2 + 0.95
Intra-rater reliability of the phone (n = 16)
Phone D1 (Mean ± SD)
Phone D2 (Mean ± SD)
Width of 95% LoA
LOA 2SD (mean diff ±2.1*SDdiff)
51.3 ± 7.9
54.9 ± 7.5
-12.84 to 5.48
79.0 ± 7.6
80.8 ± 7.03
-13.67 to 10.3
Right Lateral Flexion
43.5 ± 6.7
44.9 ± 7.0
-9.73 to 6.95
Left Lateral Flexion
49.1 ± 8.8
51.2 ± 7.4
-14.20 to 10.16
50.0 ± 17.1
70.5 ± 22.7
-70.79 to 29.81
64.3 ± 16.3
69.8 ± 15.6
-52.38 to 41.36
Reliability of the 3DMA (n = 16)
Phone D1 (Mean ± SD)
Phone D2 (Mean ± SD)
Width of 95% LoA
LOA 2SD (mean diff ±2.1*SDdiff)
48.9 ± 7.7
51.9 ± 6.9
-14.77 to 8.90
79.1 ± 9.9
81.6 ± 9.2
-12.69 to 7.56
Right Lateral Flexion
41.7 ± 6.7
42.9 ± 6.9
-8.01 to 5.51
Left Lateral Flexion
46.7 ± 7.6
47.1 ± 6.6
-8.57 to 7.89
68.8 ± 5.1
72.7 ± 5.9
-14.45 to 6.81
70.2 ± 6.7
73.4 ± 6.7
-14.35 to 8.03
This study demonstrates that an Android phone can be a valid and reliable tool to measure ROM of cervical flexion, extension and lateral-flexion but not cervical rotation, consistent with previous results . Cervical rotation results cannot be seen as valid and reliable as, although the rotation measurements from the phone showed moderate validity values (ICC = 0.53), the reliability results were poor. Possible reasons for these results are that, in the position tested, both sagittal and frontal measurements rely on the gravity-dependent accelerometers within the phone but the movements in the transverse plane are detected by the magnetometer, which can be adversely affected by any surrounding magnetic fields. This includes equipment such as computers, speakers and some automatic doors, which were all present in the laboratory and may have caused the error observed in this axis. We attempted to overcome this issue using the magnet supplied with the CROM, however our results were still invalid in this axis. This is clinically relevant because strong magnetic fields are likely to be present in many clinical settings and thus rotation ROM assessment using devices that rely on data from the magnetometer cannot be recommended (i.e. rotation in sitting).
Potential reasons for the greater ICC values in the present study compared to previous work  are the concurrent measurements and the addition of the spirit level indicator to improve the accuracy of measurement. The latter is especially important because the cervical-spine is a multi-joint structure and susceptible to coupled movements. Furthermore, we minimized measurement errors by standard fixation of the phone on a helmet, compared to the phone being held by hand on the participant’s head in the previous study . This also implies that the phone ought to be mounted on a helmet when it is being used in the clinical setting, and may be considered a limitation of this study. Furthermore, we found that when measuring cervical extension, the combined weight of the helmet and the phone tended to cause the helmet to slip. The examiner overcame this problem by providing adequate support to ensure that the helmet was firmly fixed on the head during the movement.
This study has several other limitations. (i) We did not assess inter-rater reliability and this may potentially limit the applicability of our findings in clinical settings between observers. (ii) We did not include a rigorous warm-up regime to ensure consistent inter-day readiness to perform the movements. While this is unlikely to affect the concurrent validity data (i.e. an increase in range of motion intra-session would be detected by both devices if they are comparable), it may have negatively affected our reliability results. (iii) As a preliminary step to assess the validity and reliability of the Android phone application, all participants were healthy, therefore the results need to be replicated in populations of interest, such as those with neck-pain. (iv) The reliability data of the 3DMA system for the rotation axis was not particularly good, and it is not possible to determine whether this is due to intra-day subject variation (which would provide justification for the poor phone reliability results) or equipment-related measurement error (which would not have affected the phone reliability values).
In summary, this study aimed to establish the validity and intra-rater reliability of an Android phone application to measure cervical-spine ROM and found that cervical flexion, extension and lateral-flexion measurements are both valid and reliable in sitting and may be used in the clinical setting. In contrast, cervical rotation measurements in sitting are neither valid nor reliable likely due to magnetic field interference. We suggest further study to determine whether the phone is valid to measure cervical-rotation in supine, which would use the accelerometer derived angles and is therefore likely to provide more consistent results.
JQ received a PhD scholarship funded by Singapore General Hospital.
- Dall'Alba PT, Sterling MM, Treleaven JM, Edwards SL, Jull GA: Cervical range of motion discriminates between asymptomatic persons and those with whiplash. Spine 2001,26(19):2090-2094. 10.1097/00007632-200110010-00009View ArticlePubMedGoogle Scholar
- O'Leary T, Sterling J: Whiplash, headache, and neck pain: research-based directions for physical therapies. Edinburgh: Churchill Livingstone; 2008.Google Scholar
- Rheault W, Albright B, Byers C, Franta M, Johnson A, Skowronek M, Dougherty J: Intertester reliability of the cervical range of motion device. J Orthop Sports Phys Ther 1992,15(3):147-150. 10.2519/jospt.19184.108.40.206View ArticlePubMedGoogle Scholar
- Fletcher JP, Bandy WD: Intrarater reliability of CROM measurement of cervical spine active range of motion in persons with and without neck pain. J Orthop Sports Phys Ther 2008,38(10):640-5. 10.2519/jospt.2008.2680View ArticlePubMedGoogle Scholar
- Hole DE, Cook JM, Bolton JE: Reliability and concurrent validity of two instruments for measuring cervical range of motion: effects of age and gender. Man Ther 1995,1(1):36-42. 10.1054/math.1995.0248View ArticlePubMedGoogle Scholar
- Bush KW, Collins N, Portman L, Tillett N: Validity and intertester reliability of cervical range of motion using inclinometer measurements. J Manual Manipul Ther 2000,8(2):52-61. 10.1179/106698100790819546View ArticleGoogle Scholar
- Tousignant-Laflamme Y, Boutin N, Dion AM, Vallée CA: Reliability and criterion validity of two applications of the iPhone™ to measure cervical range of motion in healthy participants. J NeuroEngineering Rehab 2013,10(1):69. 10.1186/1743-0003-10-69View ArticleGoogle Scholar
- Goodvin C, Park EJ, Huang K, Sakaki K: Development of a real-time three-dimensional spinal motion measurement system for clinical practice. Med Biol Eng Comput 2006,44(12):1061-75. 10.1007/s11517-006-0132-3View ArticlePubMedGoogle Scholar
- Quek J, Pua YH, Clark RA, Bryant AL: Effects of thoracic kyphosis and forward head posture on cervical range of motion in older adults. Manual Therapy 2013, 18: 65-71. 10.1016/j.math.2012.07.005View ArticlePubMedGoogle Scholar
- Bland JM, Altman DG: Statistical Methods for Assessing Agreement between Two Methods of Clinical Measurement. Lancet 1986,1(8476):307-310.View ArticlePubMedGoogle Scholar
- Bland JM, Altman DG: Measuring agreement in method comparison studies. Stat Met Med Res 1999,8(2):135-160. 10.1191/096228099673819272View ArticleGoogle Scholar
- Ludbrook J: Statistical techniques for comparing measurers and methods of measurement: a critical review. Clin Exp Pharmacol Physiol 2002,29(7):527-536. 10.1046/j.1440-1681.2002.03686.xView ArticlePubMedGoogle Scholar
- Ludbrook J: Special article comparing methods of measurement. Clin Exp Pharmacol Physiol 1997,24(2):193-203. 10.1111/j.1440-1681.1997.tb01807.xView ArticlePubMedGoogle Scholar
- Fleiss JL: The design and analysis of clinical experiments, Wiley series in probability and mathematical statistics Applied probability and statistics. New York: Wiley; 1986:xiv-432.Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.