**6. Conclusions**

This chapter presents a robust approach for cost-effect detection of potholes on asphalt pavements. By first proposing a system for pavement surface mapping using Kinect v2.o and based on the iMMSS hardware-software system, the implementation first incorporates *k*-means clustering and horizontal-vertical integration as data search or filtering algorithms, followed with spatial fuzzy *c*-means (SPCM) segmentation for pothole and non-pothole detection. The results of the processing illustrates the potential of using RGB and depth image in the detection of potholes based on low-cost consumer grade sensors, and shows the potential of fusing RGB + depth data for improved pothole detection.

From the experimental analysis, it is conclusive that using a single Kinect may not only limit the maximum traveling speed for data collection, but does not also cover the whole width of a traffic lane. This means that the field of view (FOV) can be increased by determining and using an array of Kinect sensors so that the lateral data collection extent can be increased. Further, the development of suitable depth and RGB fusion should be investigated both at object and at feature fusion levels.

In summary, it is demonstrated that low-cost and high-performance vision and depth sensors are capable of providing new possibilities for achieving autonomous inspection of pavement structures, and are suitable for overcoming the spatial and temporal limitations associated with both the manual human-based inspection and the expensive techniques. Overall, the findings of the study are significant, in terms of the new data and their processing challenges and results.

## **Acknowledgements**

This research work was carried with the framework of research sponsorship by the Alexander von Humboldt Foundation (Germany), and the author would like to acknowledge and thank the Alexander von Humboldt Foundation for the financial support.

*Geographic Information Systems in Geospatial Intelligence*

**References**

[1] Ouma YO, Hahn M. Waveletmorphology based detection of incipient linear cracks in asphalt pavements from RGB camera imagery and classification

*DOI: http://dx.doi.org/10.5772/intechopen.88877*

2D-colour pothole images using fuzzy *c*-means clustering and morphological

[9] Zakeri H, Nejad FM, Fahimifar A. Image based techniques for crack detection, classification and

quantification in asphalt pavement: A review. Archives of Computational Methods in Engineering. 2017;**24**(4):

[10] Zhou J, Huang PS, Chiang F-P. Wavelet-based pavement distress detection and evaluation. Optical Engineering. 2006;**45**(2):027007

[11] Cord A, Chambon S. Automatic road defect detection by textural pattern recognition based on AdaBoost. Computer-Aided Civil and

Infrastructure Engineering. 2012;**27**(4):

[12] Werro P, Robinson I, Benbow E, Wright A. SCANNER accredited surveys on local roads in England – accreditation, QA and audit testing – annual report 2009–10. Wokingham, Berkshire: Transportation Research

[13] Siddiqui AA. A new inspection method based on RGB-D profiling [MSc thesis]. Blacksburg, Virginia: Virginia Polytechnic Institute and State

[14] Pöhlmann STL, Harkness EF, Taylor CJ, Astley SM. Evaluation of Kinect 3D sensor for healthcare imaging. Journal of Medical and Biological Engineering. 2016;**36**(6):

[15] Pagliari D, Pinto L. Calibration of Kinect for Xbox one and comparison between the two generations of Microsoft sensors. Sensors. 2015;**15**:

reconstruction. Automation in Construction. 2017;**83**:196-211

935-977

*On the Use of Low-Cost RGB-D Sensors for Autonomous Pothole Detection with Spatial…*

244-259

Laboratory; 2010

University; 2015

857-870

27569-27589

using circular radon transform. Advanced Engineering Informatics.

[2] Yan WY, Yuan X-X. A low-cost video-based pavement distress

screening system for low-volume roads. Journal of Intelligent Transportation Systems: Technology, Planning, and Operations. 2018;**22**(5):376–389

[3] Huang J, Liu W, Sun X. A pavement crack detection method combining 2D

[4] Schnebele E, Tanyu BF, Cervone G, Waters N. Review of remote sensing methodologies for pavement management and assessment. European Transportation

[5] Zakeri H, Nejad FM, Fahimifar A, Torshizi AD, Zarandi MHF. A multistage expert system for classification of pavement cracking. In: IFSA World Congress and NAFIPS annual meeting (IFSA/NAFIPS), 2013 Joint. 2013

Research Review. 2015;**7**(2):1-19

[6] Adu-Gyamfi Y, Okine NA, Garateguy G, Carrillo R, Arce GR. Multiresolution information mining for pavement crack image analysis. Journal of Computing in Civil Engineering.

[7] Jahanshahi MR, Kelly JS, Masri SF, Sukhatme GS. A survey and evaluation of promising approaches for automatic image-based defect detection of bridge structures. Structure and Infrastructure

Engineering. 2009;**5**(6):455-486

[8] Ouma YO, Hahn M. Pothole detection on asphalt pavements from

2011;**26**(6):741-749

**171**

with 3D information based on Dempster-Shafer theory. Computer-Aided Civil and Infrastructure Engineering. 2014;**29**(4):299-313

2016;**30**(3):481-499
