Tracking Control of Unmanned Aerial Vehicle for Power Line Inspection

*Kenta Takaya, Hiroshi Ohta, Keishi Shibayama and Valeri Kroumov*

## **Abstract**

This work presents some results about power transmission line tracking control and a full autonomous inspection using a quadrotor helicopter. The presented in this paper power line autonomous inspection allows detecting power line defects caused by thunderstorms, corrosion, insulator malfunctions, and same time monitoring of vegetation under the power line corridor. Traditional inspection is performed by helicopters equipped with high-resolution cameras or by direct visual examination carried out by highly skilled staff climbing over de-energized power lines. However, the visual inspection is time-expensive and costly. Moreover, due to regulatory constraints, the helicopters cannot cover narrow mountainous areas. Unmanned aerial vehicles (UAV) are an attractive alternative for power line inspection. In this work, a mathematical model for the quadrotor helicopter used in the autonomous inspection is presented. The model is successfully evaluated through simulations and flight experiments. Next, the construction of a quadrotor helicopter system and its application to power line autonomous inspection is introduced. Simulation and experimental results demonstrate the efficiency and applicability of that system. The results of this research are in the process of implementation for regular inspection of electrical transmission lines.

**Keywords:** power line tracking, UAV navigation, power line inspection, quadrotor helicopter, field robotics

## **1. Introduction**

Electric power companies worldwide are obliged to guarantee disruptive electrical power supply. The power transmission facilities mainly include power lines, towers, and insulators. These facilities are exposed to thunderstorms, thermal deviations, ice, rain, pollutions like volcanic gases and sour rains: a severe environment that may lead to material fatigue, oxidation, and corrosion. Electric companies are required to inspect and maintain the power transmission equipment periodically. Ground patrols partially inspect these facilities, and, as shown in **Figure 1**, direct visual examination is carried out by skilled personnel climbing over de-energized power lines. As yet, visual inspection is time-expensive and labour-intensive. A common approach nowadays is to use helicopters equipped with high-resolution cameras, but in such inspection, helicopters cannot cover narrow mountainous

**Figure 1.** *Power line inspection works.*

regions due to regulatory constraints. According to the Statistical Report of the Federation of Electric Power Companies in Japan, the total length of high voltage power transmission lines in the country in 2010 is more than 100,000 km, and the number of power transmission towers is much more than 220,000 [1]. Most power transmission facilities in Japan are situated in mountainous regions with no ordinary roads, making the inspection time-consuming and costly.

Unmanned aerial vehicles (UAV) are a promising solution for power line inspection because of time and cost efficiency and because UAVs can approach and inspect energized lines safely. Hence, a significant amount of research is addressing this field. Many researchers have applied computer vision techniques for power transmission towers, and insulators recognition [2–8]. Image processing algorithms are also heavily employed to power lines recognition and tracking [2, 9–17]. However, in most of these studies, distance to the lines is not measured, and their robustness is challenging. In [2] a Region-Based Convolutional Neural Network (R-CNN) is used to localization of transmission towers, and their UAV navigation relies on real-time image processing. The authors of [2] claim that "It is the first time to navigate UAV simultaneously utilizing transmission towers and lines". In [9, 15] after the quadrotor helicopter is navigated to the start point of inspection manually, the vehicle performs autonomous waypoint flight above power lines. Additionally, a Light Detection and Ranging (LiDAR) sensor detect and reconstruct the power line shape [15]. Nevertheless, such navigation may be applied to power distribution lines, but manual flight cannot be performed safely enough when there is a substantial distance to the inspection object. In [11] power transmission lines situated in a highly-populated area are successfully tracked in waypoint flight mode with an aerial speed of 8 m/s. Similar algorithms for power transmission line tracking using position-based visual servo controllers are developed in [10, 12, 13] and are evaluated through several simulations. In [16] an image-based visual servoing combined with a linear quadratic servo control is developed. Deep reinforcement learning is quite successfully applied to autonomous line tracking in [18]. However, network training is performed within a simulation environment, and the robustness of that approach in the real world remains a challenge. The distance to the power line in [18] is measured using a depth camera or stereo camera.

### *Tracking Control of Unmanned Aerial Vehicle for Power Line Inspection DOI: http://dx.doi.org/10.5772/intechopen.100067*

Because of the great significance of automated power lines inspection, power supply companies are rigorously approaching the problem, too [19–23]. However, as far as we know, UAVs are not yet deployed to inspect power line transmission facilities. Hydro-Québec [19] is developing a robot called LineRanger to inspect transmission line conductor bundles. The robot is directly attached to the power line bundle and automatically crosses obstacles like line separators and suspension insulators. LineRanger is equipped with a high-resolution camera and a LiDAR for vegetation monitoring. The system can cover several kilometers a day. They have also developed a similar robotic system called LineScout, capable of inspecting a single transmission line [20]. It can acquire visual information and measure the joints' electrical resistance and monitor the corrosion level of the conductors. DJI M200 Series drones produced by DJI are effectively deployed for power line inspection mainly under manual operation [21]. Although manual vehicle guidance is not time-effective, such inspection is much better than the direct one. The University of KwaZulu-Natal is working with Eskom Holdings SOC Ltd. to develop a power line inspection robot [22], which can climb around jumpers and suspension clamps on a single power transmission line or ground wire. The Electric Power Research Institute (EPRI) is developing a transmission line inspection robot [23], known as "Ti," that can be permanently installed to traverse about 130 km of transmission lines. The robot can transmit in real-time weather data, vegetation imaging, and detect any obstructions on lines. EPRI also worked with manufacturer RADēCO Inc. and Exyn Technologies to develop "an autonomous drone to inspect components in elevated hard-to-access areas, search for temperature anomalies, and collect dose rate surveys in radiological zones" [24]. With UAV's Level 4 technology, the UAV can perform a free-flight exploration of complex spaces while collecting data from the environment [25, 26]. This technology will speed up the implementation of UAVs in the autonomous inspection.

This work presents a novel quadrotor-based system for power line inspection. An outline and some preliminary results of this research are presented in [27], but this paper describes the power line tracking algorithm and its effectiveness and applicability. The main contributions of this study are (1) the development of a quadrotor based system for autonomous inspection of electrical energy transmission and distribution assets. The presented in this paper system has almost Level 4 autonomy in the sense that it can perform flights beyond visual line of sight and without operator based navigation. (2) As far as we are concerned, this is the first time a quadrotor UAV is used in a real application for full autonomous inspection of power lines. (3) The developed system can be applied to almost any industrial multirotor helicopter able to carry the payload of sensors and cameras necessary for inspection.

The rest of the paper is organized as follows. Section 2 presents the quadrotor model used in this development. Section 3 describes the hardware and software configuration of the quadrotor system briefly. The quadrotor model described in Section 2 is evaluated in Section 4 and simulation and experimental results demonstrating the usability of the developed tracking system are depicted there. The last section concludes the paper and gives some plans for further expansion of this work.

## **2. Quadrotor helicopter dynamics and control**

#### **2.1 Quadrotor dynamics**

The quadrotor configuration and its reference coordinate systems are shown in **Figure 2**. The vehicle model is acquired under the following assumptions:


The world reference frame is *On* and the body fixed frame is *Ob*. The *xb* axis of body frame points at normal flight direction, *yb* is in starboard side, and *zb* axis is in descend direction. The absolute position of the quadrotor body frame *<sup>p</sup><sup>n</sup>* <sup>¼</sup> *xn yn zn <sup>T</sup>* is given by three coordinates of the center of mass in *On*, and its attitude is given by three Euler angles *<sup>r</sup><sup>b</sup>* <sup>¼</sup> ½ � *ϕθψ <sup>T</sup>* standing for roll, pitch and yaw angles, respectively.

The dynamics of the quadrotor helicopter expressed in Newton–Euler notation [28–31] as:

$$
\dot{\mathbf{p}}^n = \mathbf{v}^n \tag{1}
$$

$$
\dot{\mathbf{v}}^n = m^{-1} \mathbf{C}\_b^n \mathbf{F}\_b \tag{2}
$$

$$
\dot{\mathbf{r}}^b = \boldsymbol{\alpha}^b \tag{3}
$$

$$\dot{\boldsymbol{\alpha}}^b = \mathbf{J}^{-1} \mathbf{M}\_b + \mathbf{J}^{-1} (\boldsymbol{\alpha}^b \times \mathbf{J} \boldsymbol{\alpha}^b),\tag{4}$$

where *m* is the mass of the quadrotor frame and *Cn <sup>b</sup>* is the rotation matrix to transform the body frame into world reference frame *On*. The quadrotor translational and rotational motions control is performed by properly changing the thrust *FTi* , *i* ¼ 1, *::*, 4 of rotors. The thrust of the rotors varies by changing their angular speed. The rotor thrust is proportional to the square of the angular rotor speed:

**Figure 2.** *Quadrotor UAV body and world coordinate systems.*

*Tracking Control of Unmanned Aerial Vehicle for Power Line Inspection DOI: http://dx.doi.org/10.5772/intechopen.100067*

$$F\_{T\_i} = C\_T o\_{m\_i}^2,\tag{5}$$

where *CT* is a thrust coefficient, and the angular speed of the rotor is [28]:

$$\dot{o}\_{m\_i} = \frac{1}{J\_m} \left( \frac{k\_\epsilon}{R\_m} (U\_i - k\_\epsilon o\_{m\_i}) - (k\_t F\_{T\_i} + D o\_{m\_i}) \right), \quad i = 1, \ldots, 4,\tag{6}$$

where *Ui* is the voltage applied to the motor, *Jm* is the moment of inertia of the armature and the propeller, *Rm* is the resistance of the armature coil, *ke* and *kt* are the electromotive force and torque constants, respectively, and *D* is the motor viscous friction constant.

The torque generated by the motor *i* is:

$$M\_i = k\_t F\_{T\_i} = k\_t C\_T \alpha\_{m\_i}^2. \tag{7}$$

The total thrust *Fz* is:

$$F\_x = \sum\_{i=1}^{4} F\_{T\_i},\tag{8}$$

and control torque vector produced by the four motors is:

$$\mathbf{M} = \begin{bmatrix} \mathbf{M}\_x \\ \mathbf{M}\_y \\ \mathbf{M}\_x \end{bmatrix} = \begin{bmatrix} ((F\_{T\_1} + F\_{T\_4}) - (F\_{T\_2} + F\_{T\_3}))l\_m/\sqrt{2} \\ ((F\_{T\_1} + F\_{T\_2}) - (F\_{T\_3} + F\_{T\_4}))l\_m/\sqrt{2} \\ -\mathbf{M}\_1 + \mathbf{M}\_2 - \mathbf{M}\_3 + \mathbf{M}\_4 \end{bmatrix}. \tag{9}$$

The propeller gyro moments in roll and yaw directions are:

$$M\_{\dot{\mathbf{x}}} = -J\_r a \dot{\theta} \tag{10}$$

$$M\_{\dot{\mathcal{Y}}} = f\_r \rho\_r \dot{\psi} \tag{11}$$

where *Jr* is the rotor inertia and *ω<sup>r</sup>* ¼ *ω<sup>m</sup>*<sup>1</sup> � *ω<sup>m</sup>*<sup>2</sup> þ *ω<sup>m</sup>*<sup>3</sup> � *ω<sup>m</sup>*<sup>4</sup> . The gravitational force in *z* direction is:

$$F\_{\mathcal{g}} = m\mathbf{C}\_{b}^{\prime}[\begin{array}{cc} \mathbf{0} & \mathbf{0} & \mathbf{g} \end{array}]^{T}.\tag{12}$$

The drag reluctant force is a result of the air friction during vehicle movement and rotation:

$$F\_d = \mathbf{C}\_{d,F} |\boldsymbol{\nu}^b| \boldsymbol{\nu}^b \tag{13}$$

$$M\_d = \mathbb{C}\_{d,M} |a^b| a^b \tag{14}$$

where, *Cd*,*<sup>F</sup>* and *Cd*,*<sup>M</sup>* are aerodynamic coefficient matrices:

$$\begin{array}{ccccc}\mathbf{C}\_{d,F} = \mathbf{diag}\left[\mathbf{C}\_{d,F\_x} \quad \mathbf{C}\_{d,F\_y} \quad \mathbf{C}\_{d,F\_x}\right] & \\ \mathbf{C}\_{d,M} = \mathbf{diag}\left[\mathbf{C}\_{d,M\_x} \quad \mathbf{C}\_{d,M\_y} \quad \mathbf{C}\_{d,M\_x}\right]. \end{array} \tag{15}$$

The drag generated by the lateral wind is proportional to square of the wind speed:

$$F\_w = C\_{d,F}|\nu\_w|\nu\_w. \tag{16}$$

The speed dynamics is expressed as:

$$
\begin{bmatrix}
\dot{\boldsymbol{v}}\_{x}^{b} \\
\dot{\boldsymbol{v}}\_{y}^{b} \\
\dot{\boldsymbol{v}}\_{x}^{b}
\end{bmatrix} = \frac{1}{m} \begin{bmatrix}
(\text{S}\phi\text{S}\varphi - \text{C}\phi\text{S}\theta\text{C}\varphi)\boldsymbol{F}\_{x} - \boldsymbol{F}\_{d,\text{x}} - \boldsymbol{F}\_{w,\text{x}} \\
(\text{S}\phi\text{C}\varphi + \text{C}\phi\text{S}\theta\text{S}\varphi)\boldsymbol{F}\_{x} - \boldsymbol{F}\_{d,\text{y}} - \boldsymbol{F}\_{w,\text{y}} \\
m\text{g} - \text{C}\phi\text{C}\theta\text{F}\_{x} - \boldsymbol{F}\_{d,\text{x}} - \boldsymbol{F}\_{w,\text{x}}
\end{bmatrix},
\tag{17}
$$

where C and S stand for sin and cos functions.

Now, for simplicity the gyro angular moment and vehicle angular moment are included in disturbance vector *Md*:

$$\begin{bmatrix} \ddot{\phi} \\ \ddot{\theta} \\ \ddot{\Psi} \end{bmatrix} = \begin{bmatrix} J\_x^{-1} (\mathcal{M}\_x - \mathcal{M}\_{d,x}) \\ J\_y^{-1} (\mathcal{M}\_y - \mathcal{M}\_{d,y}) \\ J\_x^{-1} (\mathcal{M}\_x - \mathcal{M}\_{d,x}) \end{bmatrix} \tag{18}$$

Finally, the vehicle dynamics, including the motor models, become [28, 30, 32]:

*<sup>x</sup>*\_ <sup>¼</sup> *vb x <sup>y</sup>*\_ <sup>¼</sup> *vb y <sup>z</sup>*\_ <sup>¼</sup> *vb z <sup>x</sup>*€ <sup>¼</sup> *<sup>m</sup>*�<sup>1</sup> ð Þ ð Þ S*ϕ*S*ψ* � C*ϕ*S*θ*C*ψ Fz* � *Fd*,*<sup>x</sup>* � *Fw*,*<sup>x</sup>* €*<sup>y</sup>* <sup>¼</sup> *<sup>m</sup>*�<sup>1</sup> ð Þ <sup>S</sup>*ϕ*S*<sup>ψ</sup>* � <sup>C</sup>*ϕ*S*θ*C*<sup>ψ</sup> Fz* � *Fd*,*<sup>y</sup>* � *Fw*,*<sup>y</sup>* � � €*<sup>z</sup>* <sup>¼</sup> *<sup>m</sup>*�<sup>1</sup> ð Þ ð Þ *mg* � C*ϕ*C*θ Fz* � *Fd*,*<sup>z</sup>* � *Fw*,*<sup>z</sup> <sup>ϕ</sup>*\_ <sup>¼</sup> *<sup>ω</sup><sup>x</sup>* \_ *θ* ¼ *ω<sup>y</sup> ψ*\_ ¼ *ω<sup>z</sup> <sup>ϕ</sup>*€ <sup>¼</sup> *<sup>J</sup>* �1 *<sup>x</sup> FT*<sup>1</sup> <sup>þ</sup> *FT*<sup>4</sup> ð Þ� *FT*<sup>2</sup> <sup>þ</sup> *FT*<sup>3</sup> ð Þ ð Þ *lM<sup>=</sup>* ffiffi 2 <sup>p</sup> � *Md*,*<sup>x</sup>* � � €*<sup>θ</sup>* <sup>¼</sup> *<sup>J</sup>* �1 *<sup>y</sup> FT*<sup>1</sup> <sup>þ</sup> *FT*<sup>4</sup> ð Þ� *FT*<sup>2</sup> <sup>þ</sup> *FT*<sup>3</sup> ð Þ ð Þ *lM<sup>=</sup>* ffiffi 2 <sup>p</sup> � *Md*,*<sup>y</sup>* � � *ψ*€ ¼ *J* �1 *<sup>z</sup>* ð Þ ð�*M*<sup>1</sup> þ *M*<sup>2</sup> � *M*<sup>3</sup> þ *M*4Þ � *Md*,*<sup>z</sup> ω*\_ *<sup>m</sup>*<sup>1</sup> ¼ *J* �1 *m ke Rm U*<sup>1</sup> � *keω<sup>m</sup>*<sup>1</sup> ð Þ� *ktFT*<sup>1</sup> � � *ω*\_ *<sup>m</sup>*<sup>2</sup> ¼ *J* �1 *m ke Rm U*<sup>2</sup> � *keω<sup>m</sup>*<sup>2</sup> ð Þ� *ktFT*<sup>2</sup> � � *ω*\_ *<sup>m</sup>*<sup>3</sup> ¼ *J* �1 *m ke Rm U*<sup>3</sup> � *keω<sup>m</sup>*<sup>3</sup> ð Þ� *ktFT*<sup>3</sup> � � *ω*\_ *<sup>m</sup>*<sup>4</sup> ¼ *J* �1 *m ke Rm U*<sup>4</sup> � *keω<sup>m</sup>*<sup>4</sup> ð Þ� *ktFT*<sup>4</sup> � �, (19)

where the viscous friction *D* in (6) is neglected. The frame control inputs become the motor drive voltages *Ui*.

## *Tracking Control of Unmanned Aerial Vehicle for Power Line Inspection DOI: http://dx.doi.org/10.5772/intechopen.100067*

**Figure 3.**

*Quadrotor helicopter cascaded PID control system.*

## **2.2 Control scheme**

The overall structure of the closed-loop control of the quadrotor frame is shown in **Figure 3**. The vehicle is an underactuated mechanical system with six degrees of freedom and only four control inputs. The controller consists of a set of cascaded PID controllers arranged in inner and outer loops. The inner loops control the attitude, yaw rate, and vertical velocity. The outer loop controls the altitude and heading. Both loops are designed similarly to those implemented in the actual quadrotor flight controller [33]. This control technique is called a time-scale separation [34] and works well when the inner loops are significantly faster than the outer ones. The MIXER block in **Figure 3** forms the voltages applied to the motors:

$$\begin{aligned} U\_1 &= -\boldsymbol{\mu}\_{\phi} + \boldsymbol{\mu}\_{\theta} - \boldsymbol{\mu}\_{\psi} + \boldsymbol{\mu}\_{v\_x^b} \\ U\_2 &= \boldsymbol{\mu}\_{\phi} + \boldsymbol{\mu}\_{\theta} + \boldsymbol{\mu}\_{\psi} + \boldsymbol{\mu}\_{v\_x^b} \\ U\_3 &= \boldsymbol{\mu}\_{\phi} - \boldsymbol{\mu}\_{\theta} - \boldsymbol{\mu}\_{\psi} + \boldsymbol{\mu}\_{v\_x^b} \\ U\_4 &= -\boldsymbol{\mu}\_{\phi} - \boldsymbol{\mu}\_{\theta} + \boldsymbol{\mu}\_{\psi} + \boldsymbol{\mu}\_{v\_x^b}. \end{aligned} \tag{20}$$

## **3. Power line autonomous inspection system architecture**

#### **3.1 Hardware design**

The hardware architecture of the quadrotor system is shown in **Figure 4a**. The power transmission lines are detected using a LiDAR pointing in a vertical direction. Measured distance to the power line by the same LiDAR is used to adjust the zoom and focus of the image acquisition camera. The obstacle avoidance algorithm uses an infrared Time-of-Flight (ToF) sensor having 360° range and pointing horizontally. Because the magnetic field generated by the power lines interferes with the internal compass of the flight controller, the heading of the vehicle is estimated through a moving baseline real-time kinematics (RTK) [35] technique. For safety reasons, a second GNSS module is added to the frame. A second camera pointing in the down direction performs the vegetation monitoring under the power line corridor. All sensors are connected to NVIDIA Jetson TX2 [36] companion computer, which controls the position of the vehicle via MAVLink protocol [37]. The real-time

#### **Figure 4.**

*Hardware architecture and vehicle appearance. (a) Hardware architecture, (b) appearance of the quadrotor system.*

images from a first-person view (FPV) camera and the complete status of the quadrotor (position in the world and the local coordinate systems, battery level, GNSS status, magnetic field strength) are transmitted to the ground station computer in 1 s intervals for system monitoring. The wireless modem (SkyHopper PRO V [38]) performs all necessary communications between the quadrotor frame and the ground station. The aircraft is stabilized by a Pixhawk flight controller (FC) [39]. However, the altitude *zb* and lateral control *xb* during line tracking is

*Tracking Control of Unmanned Aerial Vehicle for Power Line Inspection DOI: http://dx.doi.org/10.5772/intechopen.100067*


## **Table 1.**

*Quadrotor vehicle specifications.*

performed using three outer loops realized on the companion computer as shown in **Figure 4a**. FC controls the forward speed with a reference command from the companion computer. The vision system estimates the yaw angle *ψ*. **Figure 4b** depicts the UAV appearance. The specifications of the quadrotor helicopter are given in **Table 1**.

## **3.2 Software**

The control software is realized in Python language, and most of it runs under Robot Operating System (ROS) [40]. The software consists of modules for sensor data acquisition and processing, camera control node, and node for sensor data transmission to the control process and the same time to the base station computer. The control process receives power line position measured by the LiDAR pointing in the down position in the body coordinate system, GNSS coordinates of the tower to be inspected, GNSS receiver status, battery status, and FC status. The control process uses three PID controllers for altitude and yaw control, as shown in **Figure 4a**. It performs path generation as well as almost all necessary processing for realizing a safe flight.

Even though the vehicle control software communicates with the sensor relating nodes, it runs thoroughly independent from the ROS processes for safety reasons. Because of this autonomy, the control process can bring the vehicle safely back to the home position even if the whole ROS crashes or all sensors except one of the GPS modules get out of order.

#### **3.3 Power line tracking**

The inspection process includes the following actions. As shown in **Figure 5**, after taking off at safe altitude, the vehicle approaches the start tower of the inspection path using *a priori* information about the tower world coordinates and its height. Then the electrical line subject to inspection is detected by the LiDAR pointing in a downward direction. Next, the vehicle is positioned above the wire at a distance allowing it to acquire good quality images. While keeping a constant distance to the power line, the quadrotor moves along it at a constant speed and acquires high-resolution images of the wire and the vegetation below. After reaching the last tower subject of inspection, the quadrotor returns safely to the home position.

The autonomous inspection consists of the following steps:


#### **Figure 5.** *Power line tracking concept.*

### **Figure 6.**

*GUI for power line inspection. GW: ground wire, L: left, R: right, RTL: return to launch.*

*Tracking Control of Unmanned Aerial Vehicle for Power Line Inspection DOI: http://dx.doi.org/10.5772/intechopen.100067*

**Figure 7.** *Quadrotor system during power line autonomous inspection.*


The GUI is used to send the inspection subject to the quadrotor companion computer before the beginning of the inspection. It also displays the UAV status during the flight and its position on the map. The power transmission towers are displayed on the same map, too. Preflight safety tests of the vehicle and the control software can also be invoked from the same GUI. After the beginning of the inspection, communication from the aircraft only is performed. Only the Return to Launch (RTL) command can be transmitted from the GUI.

The GUI in **Figure 6** shows a setting for a ground wire (GW) inspection. Images of the ground wire can be acquired from above and from a slant direction. The subject shown in the figure is a transmission tower with two ground wires. The leftside wire is selected, and the images from the top above are to be acquired. Left or right side GWs can also be inspected from slant direction: "R-Left" means right-side wire to be scanned from the left-side, "R-Right" means right-side wire to be scanned from the right-side and so on.

**Figure 7** shows the UAV during autonomous ground wire inspection. The image in **Figure 7** is acquired by a camera mounted on a second aircraft.

## **4. Simulation and experimental results**

#### **4.1 Step response simulation and experiments**

In this section, the quadrotor model (Eq. (19)) is validated by simulation and experiments. The UAV specification is shown in **Table 1**. The parameters of the

quadrotor are shown in **Table 2** and PID controller parameters are depicted in **Table 3**. In these experiments, the model and actual vehicle are moved along body coordinates system axes at a constant speed. The simulation and experimental responses are compared in **Figure 8**. **Figure 8a**, **c**, and **e** show the responses during up-down, forward-backward, and left–right flights. The simulation and experimental results are very similar, showing that the model presents the actual vehicle's behavior well. It can be seen that the actual vehicle in up-down flights tends to increase the altitude slightly, and we suppose that might exist some problem in tuning the flight controller filter parameters, causing error in the estimation of the


### **Table 2.**

*UAV parameters.*


#### **Table 3.** *PID controllers parameters.*

## *Tracking Control of Unmanned Aerial Vehicle for Power Line Inspection DOI: http://dx.doi.org/10.5772/intechopen.100067*

### **Figure 8.**

*Step response simulations and experiment results. (a) Up-down movement, (b) roll and pitch angles during updown flight, (c) flight in forward and backward directions, (d) roll and pitch during forward and backward flight, (e) left and right movement, (f) roll and pitch during left and right flight.*

altitude. In **Figure 8b**, **d**, and **f** the body roll and pitch angles are drawn. It can be observed that angles *ϕ* and *θ* during simulation and experiments slightly differ. Therefore, we can conclude that the experimental results demonstrate the theoretical expectations.

## **4.2 Power line tracking simulation**

In this section, simulation and experimental results during power line tracking are presented. The simulation setting is given in **Figure 9**. The simulation conditions are as follows:


**Figure 9.** *Setup for power line tracking simulations and experiments.*

**Figure 10.**

*Power line tracking simulation result. (a) Position error, (b) vehicle position vs power line, (c) vehicle speed, (d) roll and pitch body angles.*

*Tracking Control of Unmanned Aerial Vehicle for Power Line Inspection DOI: http://dx.doi.org/10.5772/intechopen.100067*

To achieve good performance during the simulation, the control frequency of inner loops is 400 Hz while the outer loops are at 10 Hz (see Section 2.2).

In the simulations, the catenary shape of the power line is expressed as:

$$w\_x = \cosh\left(a\_w(\mathbf{x}\_n - w\_l/2)\right) + w\_h,\tag{21}$$

where *wz* is the vertical position of the power line in local coordinates, *wl* ¼ 90 is the distance between two towers the wire is attached to, and taking *aw* ¼ 0*:*03, *wh* ¼ 8 give a sag of 1 m with towers height of 10 m.

**Figure 11.** *Ground wire tracking experiment. (a) Position error, (b) UAV path.*

**Figure 12.** *GW tracking experiment in presence of strong wind. (a) Position error, (b) wind speed and direction, (c) control input, (d) UAV path.*

**Figure 13.** *Images of ground wire. (a) Defect caused by a lightning strike. (b) Two minor defects.*

Simulation results are shown in **Figure 10**. It can be seen from the same figure that the position error is negligible and converges quite fast.

### **4.3 Ground wire tracking experiment**

In this section, the experimental results of actual ground line tracking flight are shown. The experimental setting is the same as the simulation one (see **Figure 9**). The diameter of the wire is 8 mm. The flights were performed autonomously, as explained in Section 3.3. The experimental results are shown in **Figures 11** and **12**.

The graphs in **Figure 11a** depict the position errors. The error in the vertical direction is less than 0.2 m and but the control quality is good. **Figure 11b** shows the vehicle trajectory—the catenary shape of the wire is well tracked. The vehicle speed was 0.7 m/s.

The graphs in **Figure 12** are taken in the presence of quite strong wind. It can be seen from the graph shown in **Figure 12a** that the position error in a vertical direction is small, but the error in the horizontal direction is about 0.5 m. **Figure 12b** shows the wind speed and direction measured using an anemometer mounted on the vehicle body. The wind speed and direction are measured in 0.33 s interval, and graphs present 1 s average values. However, there were sudden changes in the wind speed up to 9 m/s. **Figure 12c** and **d** depict the control input and the catenary shape of vehicle trajectory. The vehicle speed in this experiment was 1.4 m/s.

Two images acquired during vehicle flight are depicted in **Figure 13**. Some minor defects can be observed there.

## **5. Conclusions**

This work aims to develop a reliable autonomous power line tracking and inspection system based on a quadrotor helicopter. The model of the UAV was presented and evaluated in simulation and experiments performed in the real environment. Classical PID controllers were deployed, and their performances were demonstrated during ground wire line tracking. It can be concluded that the PID controller had a good performance, but in windy weather conditions, the position error increases to some extend. The presented system has almost Level 4 autonomy in the sense that it can perform flights beyond visual line of sight and without operator based navigation.

*Tracking Control of Unmanned Aerial Vehicle for Power Line Inspection DOI: http://dx.doi.org/10.5772/intechopen.100067*

As a part of future work, we will implement a fuzzy PID controller to explore if further performance improvement can be achieved. This system will be implemented on regular inspections and maintenance of power facilities in an electric power company in Japan.

## **Acknowledgements**

This research is performed in cooperation with Electric Power Development Co., LTD. from Tokyo, Japan. The authors would like to thank for their financial support of this project. We want to thank Mr. K. Tanaka, Mr. T. Sugiyama and Mr. Y. Oota from the same company for their help and support in performing most of the experiments.

## **Author details**

Kenta Takaya1†, Hiroshi Ohta2†, Keishi Shibayama3† and Valeri Kroumov<sup>2</sup> \*†


© 2021 The Author(s). Licensee IntechOpen. This chapter is distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/ by/3.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

## **References**

[1] 60 Years Power Industry in Japan: Statistics. https://www.fepc.or.jp/ library/data/60tokei/index.html, [Accessed: 02 Jul 2021], In Japanese.

[2] Bian J., Hui X., Zhao X., and Tan M. A novel monocular-based navigation approach for uav autonomous transmission-line inspection. In *2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)*, pages 1–7, 2018. doi: 10.1109/ IROS.2018.8593926.

[3] Yue L., Jun Y., Liang L., Jinlong Z., and Zongyu L. The method of insulator recognition based on deep learning. In *2016 4th International Conference on Applied Robotics for the Power Industry (CARPI)*, pages 1–5, 2016. doi: 10.1109/ CARPI.2016.7745630.

[4] Jabid T. and Uddin Md. Z. Rotation invariant power line insulator detection using local directional pattern and support vector machine. In *2016 International Conference on Innovations in Science, Engineering and Technology (ICISET)*, pages 1–4, 2016. doi: 10.1109/ ICISET.2016.7856522.

[5] Ohta H., Sato Y., Mori T., Takaya K., and Kroumov V. Image acquisition of power line transmission towers using uav and deep learning technique for insulators localization and recognition. In *2019 23rd International Conference on System Theory, Control and Computing (ICSTCC)*, pages 125–130, 2019. doi: 10.1109/ICSTCC.2019.8885695.

[6] Zhai Y., Chen R., Yang Q., Li X., and Zhao Z. Insulator fault detection based on spatial morphological features of aerial images. IEEE Access, 6: 35316–35326, 2018. doi: 10.1109/ ACCESS.2018.2846293.

[7] Tao X., Zhang D., Wang Z., Liu X., Zhang H., and Xu D. Detection of power line insulator defects using aerial images analyzed with convolutional neural networks. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 50(4):1486–1498, 2020. doi: 10.1109/TSMC.2018.2871750.

[8] Jiang H., Qiu X., Chen J., Liu X., Miao X., and S. Zhuang. Insulator fault detection in aerial images based on ensemble learning with multi-level perception. IEEE Access, 7:61797–61810, 2019. doi: 10.1109/ACCESS.2019. 2915985.

[9] Luque-Vega L. F., Castillo-Toledo B., Loukianov A., and Gonzalez-Jimenez L. E. Power line inspection via an unmanned aerial system based on the quadrotor helicopter. In *MELECON 2014 – 2014 17th IEEE Mediterranean Electrotechnical Conference*, pages 393–397, 2014. doi: 10.1109/ MELCON.2014.6820566.

[10] Li Z., Liu Y., Hayward R., Zhang J., and Cai J. Knowledge-based power line detection for uav surveillance and inspection systems. In *2008 23rd International Conference Image and Vision Computing New Zealand*, pages 1–6, 2008. doi: 10.1109/ IVCNZ.2008.4762118.

[11] Zhou G., Yuan J., Yen I-L., and Bastani F. Robust real-time uav based power line detection and tracking. In *2016 IEEE International Conference on Image Processing (ICIP)*, pages 744–748, 2016. doi: 10.1109/ICIP.2016.7532456.

[12] Golightly I. and Jones D. Visual control of an unmanned aerial vehicle for power line inspection. In ICAR '05. *Proceedings., 12th International Conference on Advanced Robotics, 2005*., pages 288–295, 2005. doi: 10.1109/ ICAR.2005.1507426.

[13] Jones D., Golightly I., Roberts J., and Usher K. Modeling and control of a robotic power line inspection vehicle.

*Tracking Control of Unmanned Aerial Vehicle for Power Line Inspection DOI: http://dx.doi.org/10.5772/intechopen.100067*

In *2006 IEEE Conference on Computer Aided Control System Design, 2006 IEEE International Conference on Control Applications, 2006 IEEE International Symposium on Intelligent Control*, pages 632–637, 2006. doi: 10.1109/CACSD-CCA-ISIC.2006.4776719.

[14] Feng T., Wang Y., and Zhu L. Power line recognition and tracking method for uavs inspection. In *2015 IEEE International Conference on Information and Automation*, pages 2136–2141, 2015. doi: 10.1109/ICInfA.2015.7279641.

[15] Chuang Deng, Jun-yong Liu, You-bo Liu, and Yang-yang Tan. Real time autonomous transmission line following system for quadrotor helicopters. In *2016 International Conference on Smart Grid and Clean Energy Technologies (ICSGCE)*, pages 61–64, 2016. doi: 10.1109/ICSGCE.2016.7876026.

[16] Araar O. and Aouf N. Visual servoing of a quadrotor uav for autonomous power lines inspection. In *22nd Mediterranean Conference on Control and Automation*, pages 1418–1424, 2014. doi: 10.1109/ MED.2014.6961575.

[17] Valipour S., Khandani H., and Moradi H. The design and implementation of a hotline tracking uav. In *2015 3rd RSI International Conference on Robotics and Mechatronics (ICROM)*, pages 252–258, 2015. doi: 10.1109/ICRoM.2015.7367793.

[18] Pienroj P., Schönborn S., and Birke R. Exploring deep reinforcement learning for autonomous powerline tracking. In *IEEE INFOCOM 2019 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS)*, pages 496–501, 2019. doi: 10.1109/INFCOMW.2019.8845212.

[19] LineRanger : A Revolution in Transmission Line Robotics. http:// www.hydroquebec.com/robots/en/, [Accessed: 08 Aug 2021].

[20] NYPA TESTS ROBOTIC TRANSMISSION INSPECTION TECHNOLOGY. https://www.youtube. com/watch?v=DuKjnaiBP4c, [Accessed: 08 Aug 2021].

[21] DJI – M200 Series– Powerline Inspection Tool. https://www.youtube. com/watch?v=Bj5ByZKVNao, [Accessed: 08 Aug 2021].

[22] Power Line Inspection Robot: Inspection Sample. https://www. youtube.com/watch?v=cTPooHx6rr8, [Accessed: 08 Aug 2021].

[23] Barker B. Robots take on tough tasks in transmission and distribution. *EPRI Journal*, pages 1–6, 02 2019.

[24] EPRI demonstrates autonomous drone. https://www.neimagazine.com/ features/featureepri-demonstratesautonomous-drone-7967221/, [Accessed: 08 Aug 2021].

[25] Explore the most dangerous places with autonomous drones. https://www. exyn.com/, [Accessed: 08 Aug 2021].

[26] Japan's first on-demand drone delivery service for hot lunches to healthcare professionals. https://aeronext. com/news/yokosuka beefbowldelivery/, [Accessed: 08 Aug 2021].

[27] Takaya K., Ohta H., Kroumov V., Shibayama K., and Nakamura M. Development of uav system for autonomous power line inspection. In *2019 23rd International Conference on System Theory, Control and Computing (ICSTCC)*, pages 762–767, 2019. doi: 10.1109/ICSTCC.2019.8885596.

[28] Meyer J., Sendobry A., Kohlbrecher S., and Klingauf U. von Stryk O. Comprehensive simulation of quadrotor uavs using ros and gazebo. In *3rd Int. Conf. on Simulation, Modeling and Programming for Autonomous Robots (SIMPAR)*, pages 400–411, 2012. doi: 10.1007/978-3-642-34327-8 36.

[29] Bouabdallah S. *Design and Control of quadrotors with application to autonomous flying*. PhD thesis, EPFL, Lausanne, 01 2007.

[30] Hoffmann G., Waslander S., and Tomlin C. Quadrotor helicopter trajectory tracking control. In *AIAA Guidance, Navigation and Control Conference and Exhibit*, 2018. doi: 10.2514/6.2008-7410.

[31] Dydek Z. T., Annaswamy A. M., and Lavretsky E. Adaptive control of quadrotor uavs: A design trade study with flight evaluations. IEEE Transactions on Control Systems Technology, 21(4):1400–1406, 2013. doi: 10.1109/TCST.2012.2200104.

[32] Bouabdallah S., Noth A., and Siegwart R. Pid vs lq control techniques applied to an indoor micro quadrotor. In *Proceedings of 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems*, volume 3, pages 2451 – 2456, 01 2004. ISBN 0-7803-8463-6. doi: 10.1109/IROS.2004.1389776.

[33] PX4 Development Guide: PX4 Architectural Overview. https://dev. px4.io/en/concept/architecture.html, [Accessed: 04 May 2021].

[34] Brescianini D., Hehn M., and D'Andrea R. Nonlinear quadrocopter attitude control. technical report. Technical report, EPFL, Zürich, 2013.

[35] GPS for Yaw (aka Moving Baseline). https://ardupilot.org/copter/docs/ common-gps-for-yaw.html, [Accessed: 07/06/2021].

[36] Jetson-TX2 (Embedded computer). https://developer.nvidia.com/ embedded/jetson-tx2, [Accessed: 04 May 2021].

[37] MAVLink (Micro Air Vehicle Communication Protocol). https:// mavlink.io/en/, [Accessed: 04 May 2021].

[38] SkyHopper PRO. https://www. skyhopper.biz/products/communicationdata-links/, [Accessed: 04 Jul 2021].

[39] PixHawk (Flight Controller). https://ardupilot.org/copter/docs/ common-pixhawk-overview.html, [Accessed: 04 May 2021].

[40] ROS Kinetic Kame. http://wiki.ros. org/kinetic, [Accessed: 04 Jun 2021].

## Section 2
