Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Robot Crawler for Surveying Pipelines and Metal Structures of Complex Spatial Configuration

Robot Crawler for Surveying Pipelines and Metal Structures of Complex Spatial Configuration Article Robot Crawler for Surveying Pipelines and Metal Structures of Complex Spatial Configuration Vladimir Pshenin *, Anastasia Liagova, Alexander Razin, Alexander Skorobogatov and Maxim Komarovsky Department of Transport and Storage of Oil and Gas, Saint Petersburg Mining University, 199106 Saint Petersburg, Russia; lyagova_aa@pers.spmi.ru (A.L.); s180507@stud.spmi.ru (A.R.); s170506@stud.spmi.ru (A.S.); s200506@stud.spmi.ru (M.K.) * Correspondence: pshenin_vv@pers.spmi.ru Abstract: There is an obvious tendency towards increasing the information content of surveys of hard-to-reach objects at high altitudes through the use of remote-controlled robot crawlers. This can be explained by the reasonable desire of industrial objects owners to maintain their property: pipelines, containers, metal structures in operating technical condition, which contributes to reducing accident risks and increasing the economic efficiency of operation (optimization of repair planning, etc.) This paper presents the concept of a robotic device equipped with LIDAR and EMAT which can move over pipes from a diameter of 100 mm by using a special type of magnetic wheel. The robot uses convolutional neural networks to detect structural elements and classify their defects. The article contains information about tests held on a specially developed test rig. The results showed that the device could increase the information level of survey and reduce the labour intensity. In this work, we consider a prototype of the device which has not started mass operation Citation: Pshenin, V.; Razin, A.; at industrial facilities yet. Skorobogatov, A.; Komarovsky, M. Robot Crawler for Surveying Keywords: robot crawler; magnetic wheel; technical condition; LIDAR; EMAT; machine vision Pipelines and Metal Structures of Complex Spatial Configuration. Infrastructures 2022, 7, 75. https://doi.org/10.3390/ 1. Introduction infrastructures7060075 Nowadays, the most common way of condition monitoring of remote pipeline Academic Editor: Raffaele Landolfo sections and metal structures at altitude is rope access. These objects can be found both Received: 14 April 2022 on industrial enterprise (for example, pipeline overpass, see Figure 1) and within the city Accepted: 23 May 2022 (for example, gas pipeline to roof boiler room, see Figure 2). Published: 25 May 2022 Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. Copyright: © 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/license Figure 1. Gas pipeline overpass through an obstacle. Copyrighted by authors. s/by/4.0/). Infrastructures 2022, 7, 75. https://doi.org/10.3390/infrastructures7060075 www.mdpi.com/journal/infrastructures Infrastructures 2022, 7, 75 2 of 20 (a) (b) (c) Figure 2. (a) Pipeline overpasses and metal structures; (b) Reservoirs; (c) Gas pipeline to roof boiler room. Copyrighted by authors. Remote-controlled robotic devices are feasible to apply in order to minimize the risks of occupational injuries, reduce the cost of surveys, and increase the quality level of information content. The authors of the study propose the following steps to reach this goal: 1. To analyze spatial configuration of the most common objects and create the informational album of typical obstacles; 2. To review the world experience in surveying above-ground pipelines and metal structures at altitude; 3. To run an analysis of existing kinematic patterns of movement on vertical metal planes and pipelines of different configurations using magnetic field force for grip; 4. To analyze existing magnetic wheel structures; 5. To create a device capable of moving over high-situated above-ground gas pipelines and monitoring their technical condition; 6. To test the device on a test rig comprising generic obstacles of typical gas pipeline; 7. To make recommendations on the organization of work using the developed device. 2. Theoretical Study 2.1. Analysis of Spatial Configurations of the Most Common Objects Existing options for surface pipelines include vertical, horizontal, and, much less frequently, sloped sections. The most difficult part of a survey is connected with different types of sections in one fragment: for example, the presence of branched horizontal parts makes use of devices with power cable complex. T-junctions, bends, and concentric reducer fittings are the main shaped elements of overhead pipelines. The maximum height of the weld above the welded pipes depends on the type of connection, but generally is not more than 10 mm. A variety of supports are used for fixing pipelines to walls of buildings and metal structures. The most common of them are supports with U-bolt clamp and rubber inserts. As the diameter increases, the curvature of the surface decreases, so the pipes with small diameter about 57 mm … 108 mm (2″–4″) due to high curvature significantly complicate the survey process, increase the turning radius of the devices, or make it completely impossible. The thickness of the metal at the joint has a certain influence on the magnetic adhesion force. Thus, thin-shelled assembly bears the risk of uncontrolled fall [1]. 2.2. Development of an Experimental Test Rig Based on the established information base of typical objects in terms of above-ground pipeline, a list of the main obstacles was drawn up (see Table 1). The test rig comprises pipe supports, fittings, and specific types of obstacles such as an electric insulation joint, test site of bypass with rainwater pipes, not sealed tightly clamp, wide paronite gasket, Infrastructures 2022, 7, 75 3 of 20 and consists of three pipe sections: DN50, DN100, and DN200 (2″, 4″, 8″). The general view of the test rig with the main types of obstacles is shown in Figure 3. Table 1. Main types of obstacles on the pipeline for robotic examination. Pipe Supports Schematic Item Visual Representation Short Title A variety of options for 4 fixing pipelines to building walls and metal structures Specific types of obstacles Schematic item Visual representation Short title 8 Insulating flanged joint 9 Insulating monolithic sleeve Support with U-bolt clamp and rubber insert Test site of bypass with rainwater pipes Not sealed tightly on the saddle clamp 13 Faulty welded joint Fittings Schematic item Visual representation Short title Infrastructures 2022, 7, 75 4 of 20 14 Bend 90° 15 Bend 45° 16 Straight T-junction 17 Transition T-junction 18 Concentric reducer Figure 3. Construction of the test rig. 2.3. Review of the World Experience in Surveying Above-Ground Pipelines and Metal Structures of Complex Spatial Configuration In the oil and gas industry, there is an urgent need to find alternatives to manual inspection in case of reducing risks and costs. The use of drones is one of the recent technologies [2]. This method has a number of advantages, such as access to objects at altitude, technical diagnosis of pipes with nonferromagnetic surfaces, large viewing angle, and high resolution shooting [3]. The usage of drones can solve some problems connected with surveying of hard-to- reach objects, but it has a lot of disadvantages: 1. Generally, drones have a low battery charge, therefore due to the presence of special inspection equipment the duration of the examination is about 15–20 min; 2. As the battery capacity increases, the size of the drone and the number of screws grow, which negatively affects maneuverability; 3. There is a high risk of accident while surveying narrow areas; 4. It is not possible to inspect the complex pipe manifold due to advanced maneuvering. 5. Limited on-board computer selection caused by weight restriction; 6. High control complexity compared to land-based devices. Infrastructures 2022, 7, 75 5 of 20 This way, the use of drones is less informative and does not allow to reach the information content completeness of survey, which makes it suitable only for the initial assessment of large objects. Let us consider more advanced remote monitoring arrangements for above-ground pipelines and metal structures: Saudi Aramco [4], INTROSCAN [5], ARA Lab [6], Waygate technologies [7], University of Tsukuba [8], University of Coimbra [9], SSC Pacific [10], DEEP TREKKER [11], DFKI [12], and RIT [13]. Table 2 presents the technical characteristics of the proposed device. Table 2. Technical characteristics of robotic devices. Saudi INTROSC Waygate University of University of SSC DEEP Unit of ARA Lab DFKI RIT Parameter Aramco AN technologies Tsukuba Coimbra Pacific TREKKER measure [6] [12] [13] [4] [5] [7] [8] [9] [10] [11] Dimensions: - length 325 400 163 247 345 240 No 710 380 380 - width mm 180 270 145 190 210 240 informatio 406 280 130 - height 215 240 198 217 130 140 n 228 150 120 No Weight kg 9.5 18 3 9.6 2.3 1.12 informatio 16.6 0.67 6 No No Maximum speed mm/s 140 83,3 200 50 320 140 informatio 200 500 informatio n n Gas detector – CH4, CO2, O2 Absent Absent Absent Absent Absent Absent Absent Absent Absent Infrared Ultrasonic Ultrasonic Ultrasonic sensor and Ultrasonic wet Type of sensor – Hall transducer Absent Absent Absent Absent dry dry contact dry contact eddy current contact contact sensor Camera pcs 1 1 2 2 0 0 1 1 1 2 No No Operating No °C 0… +50 −20… +60 No information No information No information informatio 5… +40 informatio 10… +50 temperature information n n Obstacle – No No Partly Partly Partly No Yes Partly Partly No negotiation General view – An analysis of existing devices revealed the following «weak spots»: Outer diameter of 125 mm (5″) is the minimum diameter to survey the pipelines, most robot crawlers are not able to move over the pipes of smaller diameter or move erratically due to high surface curvature; Electrical power cable is most frequently used to power the robots. The use of this cable makes it impossible to survey metal structures of complex spatial configuration; These devices have no possibility to overcome specific obstacles. This leads to an uncontrolled fall. Considered robotic devices have the following types of kinematic configurations: Magnetic crawler. The possibility of a tank steering and solved problem of low surface contact are the pros [14]. Cons: high coefficient of friction and adhesion due to large contact surface resulting in increased energy consumption for moving, bad maneuverability need for caterpillar tension systems, etc. [15]. Magnetic circuits of different configurations [16]. Highly adhesive, simply structured, and cheaply produced [17]. Disadvantages connected with the risks of breaking away from the surface in case of «magnetic chain» disconnection. Magnetic wheel. Wheeled robots have the highest speed of movement, simple mechanics and control, and besides, the ability of land–wall transition [18]. However, they Infrastructures 2022, 7, 75 6 of 20 are not suitable for overcoming specific obstacles and have low surface contact, which can lead to failure. Wheel with magnets, located according to Halbach-Array [19]. While using a special configuration of permanent magnets—Halbach-Array—it is easy to get a significant increase of adhesion force (about two times, see Figure 4). The main purpose of the assembling is that the compensation of lower magnetic flux leads to strengthening of the upper one [20]. Figure 4. Magnetic wheel with Halbach-Array. However, Halbach-Array requires a rigid wheel design or presence of a specific mechanism [21], which rotates the shaft with the assembly when crossing certain types of obstacles. Wheel with swinging inside part [22]. If the inside part is in an incorrect position, there is a risk of losing adhesion and the following uncontrolled fall, see Figure 5. Figure 5. Wheel construction with Halbach-Array inside. 2.4. Design of Wireless Mobile Robot Crawler System for Pipe Inspection During the engineering development, the design of the device presented in Figure 6 was proposed. The robot crawler has a LIDAR system [23] as well as an EMAT on a telescopic retractable rod. Infrastructures 2022, 7, 75 7 of 20 Figure 6. Design of the proposed robot crawler. The special flexible shape of the wheel with the magnet inside makes it possible to overcome obstacles (Figure 7). Figure 7. Special design of flexible rubber tire allows to overcome obstacles without separation from the ferromagnetic surface. Copyrighted by authors. The characteristics of the device and its components are presented in Table 3. Table 3. Technical characteristics of the developed robot crawler. LiDAR Intel RealSense L515 Parameters Type of tracking Laser scanning Operating range 0.25–9 m Depth camera resolution and FPS 1024 × 768; 30 FPS RGB camera resolution and FPS 1920 × 1080; 30 FPS Color depth camera resolution and FPS 1920 × 1080; 30 FPS Depth accuracy 5 mm Depth camera coverage 70 × 55 degrees RGB camera coverage 70 × 43 degrees Color depth camera coverage 69 × 42 degrees IMU sensor model Bosch BMI085 IMU sensor number of degrees of freedom 6 Speed of accelerometer data output 100 Hz/200 Hz/400 Hz Speed of gyroscope data output 100 Hz/200 Hz/400 Hz Infrastructures 2022, 7, 75 8 of 20 Operating temperature range of the −20…+70 °C environment EMAT parameters Range of thickness measured for steel 2–80 mm Thickness measurement uncertainty 0.08 mm Permissible gap between sensor and unit up to 4 mm under test Permissible misalignment of sensor ±25 degrees relatively to surface normal Minimum permissible radius of surface ≥10 mm curvature Device operating frequency 4 MHz Operating temperature range of the testing −20…+80 °C object surface Robot crawler parameters Width 180 mm Length 180 mm Height 165 mm Mass (without accumulator) 1.8 kg Kinematics 4WD, fully rotatable Above-ground gas pipelines are subject to vibrations that are potentially hazardous processes. A large number of studies are underway to explore it and minimize its negative impact [24–26]. With some modifications, the device will be able to evaluate the vibration parameters along the length of the gas pipeline. In this work we consider only the prototype device (as in many other robotic works [4–6], and therefore the indicator of reliability, durability, and maintainability of the robot cannot be precisely determined. However, the following may be noted: 1. We have used the most suitable constructive materials that will ensure sufficient durability (Table 4); 2. Maintainability is provided with the possibility of large-unit repair. In addition, the sensors are easily removable, this allows them to be «hot» replaced in the field. Individual elements (fasteners, gears) are made of unified standard sizes—this allows them to achieve good interchangeability; 3. Overall metrics of reliability of the device are still difficult to assess, as there is no extensive field experience. Table 4. Materials used in the design of the device. № Constructive Part Material Durability 1 Spur gear Nylon 5 years 2 Body ABS up to 10 years 3 Wheel tire Polyurethane 5 years 4 Wheel shaft Titanium 30 years Infrastructures 2022, 7, 75 9 of 20 2.5. Neural Network Classification of Objects While surveying hard-to-reach objects, it is important to identify the obstacle and to estimate its main parameters. The detection of complication signatures (traces of corrosion, cracks, misalignment of supports) is also important [27–32]. Damage caused by incorrect identification of an obstacle may entail the risk of uncontrolled fall of the device and occurrence of emergency, untimely complications, and detecting may result in extra material costs for their separate investigation and liquidation. Therefore, the use of machine vision and the prediction of complications in the surveying pipelines and metal structures of complex spatial configuration is a crucial task, which, being realized, will improve quality of the surveying hard-to-reach objects and will help to avoid contingency, resulting in safe operation. The application of machine vision technology involves the automated objects classification and helps the engineer to take into account the possible risk of emergency. As the objects classification task is flexible and varies according to the field of application, it was decided to use artificial intelligence technology with the possibility of overfitting to the necessary databases of obstacles and complications. The input data obtained by the robotic device in the surveying pipelines and metal structures of complex spatial configuration are characterized by the following features: 1. Axial displacement, change of the angle, rotations, other distortions; 2. Fast staff turnover, the need for high data processing rate; 3. A wide variety of different types of objects (elements of pipe manifold, supporting structures, defects, leaks); 4. The use of high-resolution cameras results in a large amount of input data; 5. Updating the database for the new survey. For the project realization, the authors used convolutional neural network with extractor of FPN functions (Feature Pyramid Network) [33], which has the following advantages: 1. Decreased amount of learnable parameters and increased speed of learning in comparison with fully connected neural network [34]; 2. Ability to implement computations and network learning algorithms on graphic processors (GPU) [35]; 3. Displacement stability of input data [36]; 4. The use of convolutional kernels helps to avoid generalization of the displayed information. Scanning by parts allows to take into consideration a larger number of properties of the object, which improves the quality of recognition. The architecture of the neural network consists of: 1. Number of layers; 2. Number of sites (neurons) in each layer; 3. Type of activation function. Convolutional neural networks are constructed from the following types of layers: 1. Convolutional—performs convolution, which is characterized by the following parameters:  Filters: number of output channels;  Kernel size: convolutional kernel, is a local receptive field that specifies the width and height of the 2D convolution window;  Padding: function that allows to create a zero-fill around the perimeter of the input image, so that the output has the same width and height;  Activation: activation function;  Input shape: dimension of the input signal. 2. Pooling—this layer works in a similar way to the convolutional layer, but it does not have the convolutional kernel, but the pooling layer calculates the maximum or average values of the input data; Infrastructures 2022, 7, 75 10 of 20 3. Reshaping layers—change the dimension the input data; 4. Dense—fully connected layer; 5. Dropout—regularization technique that allows to avoid overfitting by keeping neurons in a state of activity (not zero) with a given probability. Figure 8 presents a typical topology of a convolutional neural network containing input layer, convolutional layers, pooling layers, and standard fully connected layer. Figure 8. Convolutional Neural Network topology. Since this study addresses two classification challenges, namely, the identification of obstacles on the path of the robotic device and the detection of complication signatures, it was agreed to use two convolutional neural networks with different topologies trained in different databases, the architectures of which are presented in Table 5. Table 5. Architectures of applied neural networks. CNN for Obstacle Identification CNN for Detecting Complication Signatures Number of Layer Output Number of Layer (Type) Output Shape Parameters (Type) Shape Parameters 250 × 250 Input 250 × 250 × 1 0 Input 0 × 3 Convolutional 250 × 250 × 128 1280 Convolutio 250 × 250 Convolutional 250 × 250 × 128 147,584 nal × 16 MaxPooling 125 × 125 × 128 0 Convolutio 250 × 250 Dropout 125 × 125 × 128 0 nal × 16 Convolutional 125 × 125 × 128 147,584 125 × 125 MaxPooling 0 Convolutional 125 × 125 × 128 147,584 × 32 MaxPooling 62 × 62 × 128 0 125 × 125 Dropout 0 Dropout 62 × 62 × 128 0 × 32 Convolutional 62 × 62 × 128 147,584 Convolutio 125 × 125 Convolutional 62 × 62 × 128 147,584 nal × 32 MaxPooling 31 × 31 × 128 0 Convolutio 125 × 125 18,496 Dropout 31 × 31 × 128 0 nal × 32 Convolutional 31 × 31 × 128 147,584 62 × 62 × MaxPooling 0 Convolutional 31 × 31 × 128 147,584 64 MaxPooling 15 × 15 × 128 0 62 × 62 × Dropout 0 Dropout 15 × 15 × 128 0 64 Flatten 28,800 0 Flatten 246,016 0 Dense 128 3,686,528 Dense 256 6,2980,352 Dropout 128 0 Dropout 256 0 Dense 11 1419 Dense 2 514 Infrastructures 2022, 7, 75 11 of 20 Total Total parameters: 4,722,315 63,013,698 parameters: Input layer receives data in the format of the image with dimension of WxHxCin pixels, where W = 1920—the width of the image, H = 1080—the height of the image, Cin = 3—the number of image channels. In this layer of the neural network there is a compression to dimension of 250 × 250 × 1 in case of identifying the obstacles and 250 × 250 × 3 in case of detection of complication signatures as the number of image channels (color) has no informative value for the first task, but for detection of complication signatures color is an important characteristic, for example for detecting signs of corrosion. Next, the data is normalized to a range (−0.5:1) for further processing by subsequent layers: ( ) , , = − 0,5, (1) where () —normalization function; —pixel color value; —pixel maximum value—255; —pixel minimum value—0. Convolutional layer is a set of feature maps that slide across the entire data region of the previous layer and highlight certain features of objects. The convolutional layer can be considered as a special case of a fully connected layer, provided that weights outside the local receptive field are equal to zero for each neuron, and the parameters of the convolutional kernel are distributed among the neurons. = ( ∙ + ), (2) where –j—feature map (previous input layer output); –k layer shift coefficients for the j—feature map; –j map, k layer convolutional kernel; ()—activation function, LeakyReLU activation (() = (, )) is used in both architectures. The choice of LeakyReLU activation function is explained by the fact that it has a number of advantages:  Fast in computation 1. Gradients do not disappear for > 0; 2. Provides fast convergence in practice; 3. Works if < 0, which ensures continuous computing, as opposed to function ReLU (() = (0, )) [37]. MaxPooling minimizes the size of the previous layer maps by selecting maximum local features: ( ( ) ) (3) = ∙ + , where —layer k outlet; , —k layer shift coefficients; () —local maximum feature sampling operation. Dropout layer reduces the process of retraining the neural network. In case of using this layer, the learning process affects only part of the parameters on each iteration. All neurons are present during testing, but their outputs are multiplied by a given probability to maintain the scale of input data (Figure 9). Infrastructures 2022, 7, 75 12 of 20 training testing pw Present with Always present probability Figure 9. Dropout technology, where p—given probability value, w—neural network sites weight. The flatten layer smooths input data without affecting size. When receiving input data in 15 × 15 × 128 dimension, output data dimension after conversion is 28,800 × 1. Dense layer is a fully connected layer that classifies an object, simulating a non-linear function, whose gradual optimization increases the efficiency of recognition. The neurons of each map of the pooling are interconnected with one neuron of that layer. The value of the neuron can be calculated according to the following formula [38]: = ( ∙ + ), (4) where –j—feature map (previous k layer output); () —LeakyReLU activation function; – − 1 layer shift coefficient; – − 1 layer weighting matrix. The output layer is connected to all the neurons of the previous fully connected layer. The number of neurons in this layer corresponds to the number of identified objects (classes) for a classification task. In each architecture of the used neural networks an additional Dense layer was added, which performed the object detection task, and the number of neurons of this layer matched the bounding box that coordinates to highlight objects. An error backpropagation algorithm was chosen to teach the neural network—it is the terminology of the neural network to minimize the cost function (a function of calculating the error value or the «cost of a given target function») as well as gradient descent in logistic or linear regression [39]. Teaching by this method involves two passes across all layers of the network: forward pass and backward pass. The purpose of the method is to calculate: ( ) (5) where ()—cost function. Thus, it is necessary to minimize the cost function J using the optimal set of parameters in theta. Let us introduce the following notation: —input vector, —output vector, — i-th weight coefficient of the j-th neuron of the k-th layer, —i-th neuron limit of the k-th layer, —reference output value of the i-th neuron [40]. The output value of the j-th neuron of the k-th layer is calculated by the formula: = ∙ − (6) The output of the j-th neuron of the output layer is calculated by the formula: Infrastructures 2022, 7, 75 13 of 20 = ∙ − (7) Network error functional is equal: = − , (8) where = − —error of the j-th neuron of the output layer. Error of the j-th element of the k-th hidden layer: = = = = (9) = − = , , Error gradients are equal: = = , , , = = − , (10) = = . , , The weight coefficients and displacement of the neurons are calculated by the following formulae: ( + 1) = − , , , (11) ( + 1) = − . After teaching the neural network model, a decision was accepted to use TensorFlow Lite technology—a tool set that provides machine learning on the device, helping developers run their models on mobile, built-in devices and devices of the Internet of things [41]. The acceleration sequence of the standard neural network model is shown in Figure 10. Training CNN on a Database SavedModel NN TFLite Converter TFLite Flatbuffer Figure 10. Sequencer for converting the neural network model to an accelerated TFLite model. Infrastructures 2022, 7, 75 14 of 20 Thus, the pre-trained convolutional neural network was converted to an accelerated model using Flatbuffer—an effective cross-platform library for serialization (the process of converting the data structure into a sequence of bytes) [42], which helped to achieve the following benefits: 1. Optimization for machine learning on the device, excluding 5 key constraints: delay (no return to server), confidentiality (no personal data leaving the device), connectivity (no Internet connection required), size (reduced model and binary size), and energy consumption (efficient output and lack of network connections, possibility to reduce the weight of the used computer in the robotic device) [43]; 2. Support for multiple platforms including Linux devices, microcontrollers, and microcomputers (if there is a need to overfit to a new data set, the process can be performed directly on a robotic device); 3. High performance with hardware acceleration and model optimization. 2.6. Modelling of Wheel Magnetic Fields The modelling of the magnetic field of wheels was implemented in the Comsol Multiphysics software based on Maxwell’s equation: (12) ∇ × = + ; (13) ∇ × = − ; ∇ × = ; (14) ∇ × = 0, (15) where D—dielectric density; J—current density; H—magnetic field strength; B—magnetic induction; E—electric field strength; —electric foreign charge volume density. Since the magnetostatics problem was solved in the absence of electrical currents, it is permissible to use one equation ∇ × H = 0, which is equal to putting in a magnetic scalar potential Vm, which is determined from H = −∇Vm. The design of the wheel has neodymium magnets of N38 class, and their calculation was carried out in an improved way with the properties’ assignment by the remanence method. 3. Experimental Apparatus and Procedure Description of Experimental Device Survey The experimental program evaluated the device’s ability to pass over pipelines, as well as to perform its functions of LIDAR scanning and measuring metal thickness using EMAT (see Figure 11). Figure 11. Test rig shot with LIDAR. Copyrighted by authors. Infrastructures 2022, 7, 75 15 of 20 In addition to the EMAT and LIDAR studies, there were tests conducted on the detachable forces and moments that occur on the device drives using the PCE-FM200 dynamometer (the characteristics are shown in the Table 6). Table 6. Technical characteristics of the dynamometer. Model PCE-FM200 General view of device Measurement range 0…20 kg/0…200 N Resolution 0,05 kg/0,2 N Accuracy ±0.5% Unit gram/newton Extreme overload 50% (max. up to 150 kg) Measurement of compression and tensile Metering function forces 4. Results and Discussion The developed device demonstrated the successful passing over the surveyed above- ground pipelines, including overcoming obstacles. During the testing of the robotic device and its embedded neural networks a pilot database was established, containing 937 elements of above-ground pipelines, a fragment of which is presented in Table 7. Table 7. Database fragment. Processed Image Object Object Bbox Bbox Bbox Bbox № Image Array Image Object Array Id Id Name xmin ymin ymax xmax Array [[202, 200, [[202, 200, [[[255, 255, 200, 206, 205, 200, 206, 205, Insulating 255, 255, 255, 0 0.0 0.0 84.0 25.0 225.0 265.0 207, 204, 204, 207, 204, 204, flanged joint 255, 255, 255, 200, …]] 200, …]] 255, …]]] Support [[202, 200, [[223, 230, [[[255, 255, with U-bolt 200, 206, 205, 229, 218, 222, 255, 255, 255, 1 0.0 1.0 clamp and 243.0 3.0 250.0 336.0 207, 204, 204, 221, 214, 213, 255, 255, 255, rubber 200, …]] 212, …]] 255, …]]] insert [[208, 202, [[208, 202, [[[255, 255, 202, 199, 199, 202, 199, 199, 255, 255, 255, 2 1.0 2.0 Pipe clamp 215.0 97.0 227.0 313.0 202, 199, 198, 202, 199, 198, 255, 255, 255, 200, …]] 200, …]] 255, …]] … … … … … … … … … … … [[68, 70, 69, [[68, 70, 69, [[[255, 255, 68, 69, 68, 65, 68, 69, 68, 65, 255, 255, 255, 936 846.0 936.0 Bend 90° 5.0 4.0 252.0 321.0 63, 62, 62, 62, 63, 62, 62, 62, 255, 255, 255, …]] …]] 255, …]]] Table 8 details the process of input processing, classification, and detection of pipeline constructive elements, which is a visualization of row 2 in Table 7. Infrastructures 2022, 7, 75 16 of 20 Table 8. Step-by-step visualization of the obstacle classification process. Copyrighted by authors. Output Data After Initial Processing CNN Processing on Isolated Data of Input Data (Data Dimension Obstacle Element Discovered Change) Detection and Object Classification Figure 12a,b illustrates the results of data processing by the neural network for detection of complication signatures on elements of above-ground pipelines affected by coating destruction and/or corrosion. On the left, there are original data before processing by the neural network, on the right there are data after processing in the mode of applying the red contour with shading of the silhouette of discovered objects. (a) (b) Figure 12. The result of data processing by the neural network on detection of complication signatures on the example of corrosion identification. (a) Original data before processing by the neural network; (b) data after processing in the mode of applying the red contour with shading of the silhouette of discovered objects. Copyrighted by authors. To obtain experimental data representing the result of a robotic device working in a mode of classification of obstacles and complications after learning the neural network, based on the NVIDIA Jetson AGX Xavier processor, 36 successful runs were performed on the test bench shown in Figure 3. The work collected statistical data on the classification of obstacles. The robotic device proposed by the authors correctly identified each obstacle presented on the test bench. Due to input data convolutional technique and the use of an accelerated neural network model, an effective object classification speed on the average of 0.0025 s. was achieved. Figure 13 presents statistics on the data processing speed of the neural network, the results of each test, reduced to the average for each of the 36 iterations. The use of the Infrastructures 2022, 7, 75 17 of 20 additional component FPN (Feature Pyramid Network) by the neural network, which improves the method of target detection, allowed us to achieve maximum efficiency of object classification (see Figure 14). 3.2 2.8 2.6 2.4 2.2 1.8 1.6 1.4 1.2 0 5 10 15 20 25 30 35 40 Experience number Figure 13. Neural network object classification speed diagram. 7.20 7.15 7.10 7.05 7.00 6.95 6.90 6.85 6.80 0 2 4 6 8 10 Experiment measurement EMAT measurements real thickness Figure 14. Results of the comparison of EMAT thickness measurements with their real values. The comparison of the 219 × 7 mm wall thickness measurement data obtained by EMAT with their real values measured by a wet contact high-precision thickness gauge showed convincing convergence. Thus, it is shown that in an existing configuration the device is able to accurately measure the thickness of the elements, while magnetic wheels with their existing configuration have little effect on the accuracy of measurement. The results of the tests showed, in the simulation of magnetic force in the software complex Comsol Multiphysics (9.8 kg on one wheel), that the forces values obtained using the dynamometer (9.6 kg) and the calculated values differ no more than 5%, which is a very good approximation. 5. Conclusions The result of the work was the development of a robot crawler prototype capable of moving on complex curvilinear surfaces and evaluating the thickness of pipe metal. The device has successfully passed preliminary bench tests, which, however, have revealed Wall thickness, mm Time value, 1/1000 sec. Infrastructures 2022, 7, 75 18 of 20 some problems with small diameter pipe overpassing and neural networks operation. In the future, it is planned to further develop the device operating with an improved model of neural networking input data processing and algorithms of its presentation to the user. Moreover, the following scheme of robot crawler working, which is shown in Figure 15, is supposed to be used. Figure 15. Organization plan for robotic survey. 1—transport case, 2—industrial Wi-Fi router, 3— operator’s tablet, 4—robotic device for pipeline inspection. As the robot has not started mass operation on industrial sites yet, it is impossible to give exact figures, but in spite of this it is estimated that the cost per 100 km of pipeline survey with the use of this robotic device is $25,000/year (operator’s work and depreciation charges) compared to the same 100 km survey by a group of two industrial climbers—94,000 $/year. Inspection with the help of the device does not require paperwork on admission to work at heights. At present, the tablet application and the quality improvement of the product are underway in development. The work in these areas will be continued and the authors hope to see a positive outcome in one year. Author Contributions: Conceptualization, V.P.; methodology, V.P.; software, A.R.; validation, A.L., A.S. and M.K.; formal analysis, V.P.; investigation, A.L.; resources, V.P.; data curation, A.S.; writing—original draft preparation, M.K.; writing—review and editing, M.K.; visualization, A.R.; supervision, A.L.; project administration, V.P. and A.L.; funding acquisition, V.P. All authors have read and agreed to the published version of the manuscript. Funding: This research was funded by Saint Petersburg Mining University, grant number FSRW- 2020-0014. Informed Consent Statement: Not applicable. Institutional Review Board Statement: Not applicable. Data Availability Statement: The data presented in this study are available on request from the corresponding author. Acknowledgments: The authors gratefully acknowledge the support of the Department of Transport and Storage of Oil and Gas, Saint Petersburg Mining University. Conflicts of Interest: The authors declare that they have no conflicts of interest. Infrastructures 2022, 7, 75 19 of 20 References 1. Jose, J.; Devaraj, D.; Mathanagopal, R.M.; Ramanathan, K.C.; Tokhi, M.O.; Sattar, T.P. INVESTIGATIONS ON THE EFFECT OF WALL THICKNESS ON MAGNETIC ADHESION FOR WALL CLIMBING ROBOTS. Int. J. Robot. Autom. 2021, 36, doi:10.2316/J.2021.206-0441. 2. Trujillo, M.Á.; Martínez-de Dios, J.R.; Martín, C.; Viguria, A.; Ollero, A. Novel Aerial Manipulator for Accurate and Robust Industrial NDT Contact Inspection: A New Tool for the Oil and Gas Inspection Industry. Sensors 2019, 19, 1305, doi:10.3390/s19061305. 3. Jimenez-Cano, A.E.; Braga, J.; Heredia, G.; Ollero, A. Aerial Manipulator for Structure Inspection by Contact from the Underside. In Proceedings of the 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany, 28 September–2 October 2015; pp. 1879–1884. 4. SAIR–Arabian Robotics Company. Available online: http://arabianbots.com/sair/ (accessed on 22 May 2022). 5. Aкycтичecкиe Kонтpольныe Cиcтeмы-Cкaнep-Дeφeктоcкоп A2072 IntroScan. Available online: https://acsys.ru/skaner- defektoskop-a2072-introscan/ (accessed on 22 May 2022). 6. Nguyen, S.; La, H. Development of a Steel Bridge Climbing Robot. In Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China, 3–8 November 2019, doi:10.1109/IROS40897.2019.8967748. 7. Viktor BIKE–Inspection Robotics. Available online: https://inspection-robotics.com/bike/ (accessed on 22 May 2022). 8. Wang, R.; Kawamura, Y. An Automated Sensing System for Steel Bridge Inspection Using GMR Sensor Array and Magnetic Wheels of Climbing Robot. J. Sens. 2016, 2016, 1–15, doi:10.1155/2016/8121678. 9. Past Projects. Available online: https://www.isr.uc.pt/index.php/projects/past- projects?task=showprojects.show%28%29&idProject=13 (accessed on 22 May 2022). 10. Burmeister, A.; Pezeshkian, N.; Talke, K.; Ostovari, S.; Everett, H.; Hart, A.; Gilbreath, G.; Nguyen, H. Design of a Multi- Segmented Magnetic Robot for Hull Inspection. In Proceedings of the ASNE Mega Rust 2014: Naval Corrosion Conference, San Diego, CA, USA, 24 June 2014. 11. Trekker, D. DT340L Pipe Crawler Package. Available online: https://www.deeptrekker.com/shop/products/dt340l-pipe- crawler-package (accessed on 22 May 2022). 12. Robot System: Magnet Crawler-Marine Inspection Robotic Assistant System. Available online: https://robotik.dfki- bremen.de/en/research/robot-systems/magnet-crawler/ (accessed on 22 May 2022). 13. EMAT Thickness Measurement RobotRover Inspectioning Technology Co., Ltd. Available online: http://www.ritinspection.com/products/287.html (accessed on 22 May 2022). 14. Tang, Y.; Song, H.; Yu, Y.; Zhang, J.; Hu, W.; Guo, X. Dynamic Simulation Analysis and Experiment of Large-Caliber Self- Propelled Pipeline Crawler Based on ADAMS. J. Phys. Conf. Ser. 2021, 2095, 012049, doi:10.1088/1742-6596/2095/1/012049. 15. Khan, M.; Chuthong, T.; Do, C.; Thor, M.; Billeschou, P.; Larsen, J.; Manoonpong, P. ICrawl: An Inchworm-Inspired Crawling Robot. IEEE Access 2020, 8, 1, doi:10.1109/ACCESS.2020.3035871. 16. Magnetic Drive Wheel for Wall Climbing Robot-Faizeal. Available online: https://www.fzmag.com/magnetic-drive-wheel-for- wall-climbing-robot/ (accessed on 22 May 2022). 17. Zhang, Y.; Dai, Z.; Xu, Y.; Qian, R. Design and Adsorption Force Optimization Analysis of TOFD-Based Weld Inspection Robot. J. Phys. Conf. Ser. 2019, 1303, 012022, doi:10.1088/1742-6596/1303/1/012022. 18. Mahmood, S.; Bakhy, S.; Tawfik, M. Magnetic–Type Climbing Wheeled Mobile Robot for Engineering Education. IOP Conf. Ser. Mater. Sci. Eng. 2020, 928, 022145, doi:10.1088/1757-899X/928/2/022145. 19. Lawrence, K.H. Design of Permanent Multipole Magnets with Oriented Rare Earth Cobalt Materials. Nucl. Instrum. Methods 1980, 169, 1–10. 20. Bjørk, R.; Bahl, C.; Smith, A.; Pryds, N. Optimization and Improvement of Halbach Cylinder Design. J. Appl. Phys. 2008, 104, 013910, doi:10.1063/1.2952537. 21. Zhang, M.; Zhang, X.; Li, M.; Cao, J.; Huang, Z. Optimization Design and Flexible Detection Method of a Surface Adaptation Wall-Climbing Robot with Multisensor Integration for Petrochemical Tanks. Sensors 2020, doi:10.3390/s20226651. 22. Eto, H.; Asada, H. Development of a Wheeled Wall-Climbing Robot with a Shape-Adaptive Magnetic Adhesion Mechanism. In Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France, 31 May–31 August 2020. https://doi.org/10.1109/ICRA40945.2020.9196919. ® TM 23. Intel RealSense LiDAR Camera L515. Available online: https://www.intelrealsense.com/lidar-camera-l515/ (accessed on 22 May 2022). 24. Yang, P.; Bai, H.; Xue, X.; Xiao, K.; Zhao, X. Vibration Reliability Characterization and Damping Capability of Annular Periodic Metal Rubber in the Non-Molding Direction. Mech. Syst. Signal Process. 2019, 132, 622–639, doi:10.1016/j.ymssp.2019.07.020. 25. Shen, G.; Li, M.; Xue, X. Damping Energy Dissipation and Parameter Identification of the Bellows Structure Covered with Elastic-Porous Metal Rubber. Shock Vib. 2021, 2021, 1–12, doi:10.1155/2021/8813099. 26. Xue; Ruan; Li; Bai; Xiao Nonlinear Dynamic Modelling of Two-Point and Symmetrically Supported Pipeline Brackets with Elastic-Porous Metal Rubber Damper. Symmetry 2019, 11, 1479, doi:10.3390/sym11121479. Infrastructures 2022, 7, 75 20 of 20 27. Mumtaz, M.; Mansoor, A.; Masood, H. A New Approach to Aircraft Surface Inspection Based on Directional Energies of Texture. In Proceedings of the 2010 20th International Conference on Pattern Recognition, Istanbul, Turkey, 23–26 August 2010; pp. 4404–4407. 28. Jahanshahi, M.; Masri, S. Effect of Color Space, Color Channels, and Sub-Image Block Size on the Performance of Wavelet-Based Texture Analysis Algorithms: An Application to Corrosion Detection on Steel Structures. In Proceedings of the Computing in Civil Engineering (2013), Los Angeles, CA, USA, 24 June 2013; pp. 685–692. 29. Ji, G.; Zhu, Y.; Zhang, Y. The Corroded Defect Rating System of Coating Material Based on Computer Vision. In Transactions on Edutainment VIII; Springer: Berlin/Heidelberg, Germany, 2012; Volume 7220, pp. 210–220. 30. Siegel, M.; Gunatilake, P.; Podnar, G. Robotic Assistants for Aircraft Inspectors. Instrum. Meas. Mag. IEEE 1998, 1, 16–30, doi:10.1109/5289.658190. 31. Bahaa, B.; Zaidan, A.; Alanazi, H.; Rami, A. Towards Corrosion Detection System. Int. J. Comput. Sci. Issues 2010, 7. 32. Ortiz, A.; Bonnin-Pascual, F.; Garcia-Fidalgo, E.; Company-Corcoles, J. Vision-Based Corrosion Detection Assisted by a Micro- Aerial Vehicle in a Vessel Inspection Application. Sensors 2016, 16, 2118, doi:10.3390/s16122118. 33. Lin, T.-Y.; Dollár, P.; Girshick, R.B.; He, K.; Hariharan, B.; Belongie, S.J. Feature Pyramid Networks for Object Detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017. https://doi.org/10.1109/CVPR.2017.106. 34. Albawi, S.; Abed Mohammed, T.; ALZAWI, S. Understanding of a Convolutional Neural Network. In Proceedings of the 2017 International Conference on Engineering and Technology (ICET), Antalya, Turkey, 21–23 August 2017. 35. Luo, Z.; Liu, H.; Wu, X. Artificial Neural Network Computation on Graphic Process Unit. In Proceedings of the 2005 IEEE International Joint Conference on Neural Networks, Montreal, QC, Canada, 31 July–4 August 2005; Volume 1, pp. 622–626. Sultana, F.; Sufian, A.; Dutta, P. Advancements in Image Classification Using Convolutional Neural Network|Request PDF. In Proceedings of the 2018 Fourth International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN), Kolkata, India, 22–23 November 2018. 37. Nwankpa, C.; Ijomah, W.; Gachagan, A.; Marshall, S. Activation Functions: Comparison of Trends in Practice and Research for Deep Learning. arXiv 2018, arXiv:1811.03378. 38. Ghosh, A.; Sufian, A.; Sultana, F.; Chakrabarti, A.; De, D. Fundamental Concepts of Convolutional Neural Network. In Recent Trends and Advances in Artificial Intelligence and Internet of Things; Springer: Cham, Switzerland, 2020; pp. 519–567, ISBN 978-3- 030-32643-2. 39. Шaклa, Hишaнт-Maшинноe Oбyчeниe & TensorFlow [Teкcт]: [16+]-Search RSL. Available online: https://search.rsl.ru/ru/record/01009872794? (accessed on 22 May 2022). 40. Gafarov, F.; Galimyanov, A. Artificial Neural Networks and Their Applications, 1st ed.; Kazan University: Kazan, Russia, 2018; pp. 25–28. 41. TeнзоpΦлоy Лaйт|TensorFlow Lite. Available online: https://www.tensorflow.org/lite/guide?hl=ru (accessed on 22 May 2022). 42. FlatBuffers: FlatBuffers. Available online: https://google.github.io/flatbuffers/(accessed on 22 May 2022). 43. Cпpaвочник по API TensorFlow Lite. Available online: https://www.tensorflow.org/lite/api_docs?hl=ru (accessed on 22 May 2022). http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Infrastructures Multidisciplinary Digital Publishing Institute

Robot Crawler for Surveying Pipelines and Metal Structures of Complex Spatial Configuration

Download PDF
20 pages

Loading next page...
 
/lp/multidisciplinary-digital-publishing-institute/robot-crawler-for-surveying-pipelines-and-metal-structures-of-complex-n0n8FgXdkJ

References

References for this paper are not available at this time. We will be adding them shortly, thank you for your patience.

Publisher
Multidisciplinary Digital Publishing Institute
Copyright
© 1996-2022 MDPI (Basel, Switzerland) unless otherwise stated Disclaimer The statements, opinions and data contained in the journals are solely those of the individual authors and contributors and not of the publisher and the editor(s). MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. Terms and Conditions Privacy Policy
ISSN
2412-3811
DOI
10.3390/infrastructures7060075
Publisher site
See Article on Publisher Site

Abstract

Article Robot Crawler for Surveying Pipelines and Metal Structures of Complex Spatial Configuration Vladimir Pshenin *, Anastasia Liagova, Alexander Razin, Alexander Skorobogatov and Maxim Komarovsky Department of Transport and Storage of Oil and Gas, Saint Petersburg Mining University, 199106 Saint Petersburg, Russia; lyagova_aa@pers.spmi.ru (A.L.); s180507@stud.spmi.ru (A.R.); s170506@stud.spmi.ru (A.S.); s200506@stud.spmi.ru (M.K.) * Correspondence: pshenin_vv@pers.spmi.ru Abstract: There is an obvious tendency towards increasing the information content of surveys of hard-to-reach objects at high altitudes through the use of remote-controlled robot crawlers. This can be explained by the reasonable desire of industrial objects owners to maintain their property: pipelines, containers, metal structures in operating technical condition, which contributes to reducing accident risks and increasing the economic efficiency of operation (optimization of repair planning, etc.) This paper presents the concept of a robotic device equipped with LIDAR and EMAT which can move over pipes from a diameter of 100 mm by using a special type of magnetic wheel. The robot uses convolutional neural networks to detect structural elements and classify their defects. The article contains information about tests held on a specially developed test rig. The results showed that the device could increase the information level of survey and reduce the labour intensity. In this work, we consider a prototype of the device which has not started mass operation Citation: Pshenin, V.; Razin, A.; at industrial facilities yet. Skorobogatov, A.; Komarovsky, M. Robot Crawler for Surveying Keywords: robot crawler; magnetic wheel; technical condition; LIDAR; EMAT; machine vision Pipelines and Metal Structures of Complex Spatial Configuration. Infrastructures 2022, 7, 75. https://doi.org/10.3390/ 1. Introduction infrastructures7060075 Nowadays, the most common way of condition monitoring of remote pipeline Academic Editor: Raffaele Landolfo sections and metal structures at altitude is rope access. These objects can be found both Received: 14 April 2022 on industrial enterprise (for example, pipeline overpass, see Figure 1) and within the city Accepted: 23 May 2022 (for example, gas pipeline to roof boiler room, see Figure 2). Published: 25 May 2022 Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. Copyright: © 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/license Figure 1. Gas pipeline overpass through an obstacle. Copyrighted by authors. s/by/4.0/). Infrastructures 2022, 7, 75. https://doi.org/10.3390/infrastructures7060075 www.mdpi.com/journal/infrastructures Infrastructures 2022, 7, 75 2 of 20 (a) (b) (c) Figure 2. (a) Pipeline overpasses and metal structures; (b) Reservoirs; (c) Gas pipeline to roof boiler room. Copyrighted by authors. Remote-controlled robotic devices are feasible to apply in order to minimize the risks of occupational injuries, reduce the cost of surveys, and increase the quality level of information content. The authors of the study propose the following steps to reach this goal: 1. To analyze spatial configuration of the most common objects and create the informational album of typical obstacles; 2. To review the world experience in surveying above-ground pipelines and metal structures at altitude; 3. To run an analysis of existing kinematic patterns of movement on vertical metal planes and pipelines of different configurations using magnetic field force for grip; 4. To analyze existing magnetic wheel structures; 5. To create a device capable of moving over high-situated above-ground gas pipelines and monitoring their technical condition; 6. To test the device on a test rig comprising generic obstacles of typical gas pipeline; 7. To make recommendations on the organization of work using the developed device. 2. Theoretical Study 2.1. Analysis of Spatial Configurations of the Most Common Objects Existing options for surface pipelines include vertical, horizontal, and, much less frequently, sloped sections. The most difficult part of a survey is connected with different types of sections in one fragment: for example, the presence of branched horizontal parts makes use of devices with power cable complex. T-junctions, bends, and concentric reducer fittings are the main shaped elements of overhead pipelines. The maximum height of the weld above the welded pipes depends on the type of connection, but generally is not more than 10 mm. A variety of supports are used for fixing pipelines to walls of buildings and metal structures. The most common of them are supports with U-bolt clamp and rubber inserts. As the diameter increases, the curvature of the surface decreases, so the pipes with small diameter about 57 mm … 108 mm (2″–4″) due to high curvature significantly complicate the survey process, increase the turning radius of the devices, or make it completely impossible. The thickness of the metal at the joint has a certain influence on the magnetic adhesion force. Thus, thin-shelled assembly bears the risk of uncontrolled fall [1]. 2.2. Development of an Experimental Test Rig Based on the established information base of typical objects in terms of above-ground pipeline, a list of the main obstacles was drawn up (see Table 1). The test rig comprises pipe supports, fittings, and specific types of obstacles such as an electric insulation joint, test site of bypass with rainwater pipes, not sealed tightly clamp, wide paronite gasket, Infrastructures 2022, 7, 75 3 of 20 and consists of three pipe sections: DN50, DN100, and DN200 (2″, 4″, 8″). The general view of the test rig with the main types of obstacles is shown in Figure 3. Table 1. Main types of obstacles on the pipeline for robotic examination. Pipe Supports Schematic Item Visual Representation Short Title A variety of options for 4 fixing pipelines to building walls and metal structures Specific types of obstacles Schematic item Visual representation Short title 8 Insulating flanged joint 9 Insulating monolithic sleeve Support with U-bolt clamp and rubber insert Test site of bypass with rainwater pipes Not sealed tightly on the saddle clamp 13 Faulty welded joint Fittings Schematic item Visual representation Short title Infrastructures 2022, 7, 75 4 of 20 14 Bend 90° 15 Bend 45° 16 Straight T-junction 17 Transition T-junction 18 Concentric reducer Figure 3. Construction of the test rig. 2.3. Review of the World Experience in Surveying Above-Ground Pipelines and Metal Structures of Complex Spatial Configuration In the oil and gas industry, there is an urgent need to find alternatives to manual inspection in case of reducing risks and costs. The use of drones is one of the recent technologies [2]. This method has a number of advantages, such as access to objects at altitude, technical diagnosis of pipes with nonferromagnetic surfaces, large viewing angle, and high resolution shooting [3]. The usage of drones can solve some problems connected with surveying of hard-to- reach objects, but it has a lot of disadvantages: 1. Generally, drones have a low battery charge, therefore due to the presence of special inspection equipment the duration of the examination is about 15–20 min; 2. As the battery capacity increases, the size of the drone and the number of screws grow, which negatively affects maneuverability; 3. There is a high risk of accident while surveying narrow areas; 4. It is not possible to inspect the complex pipe manifold due to advanced maneuvering. 5. Limited on-board computer selection caused by weight restriction; 6. High control complexity compared to land-based devices. Infrastructures 2022, 7, 75 5 of 20 This way, the use of drones is less informative and does not allow to reach the information content completeness of survey, which makes it suitable only for the initial assessment of large objects. Let us consider more advanced remote monitoring arrangements for above-ground pipelines and metal structures: Saudi Aramco [4], INTROSCAN [5], ARA Lab [6], Waygate technologies [7], University of Tsukuba [8], University of Coimbra [9], SSC Pacific [10], DEEP TREKKER [11], DFKI [12], and RIT [13]. Table 2 presents the technical characteristics of the proposed device. Table 2. Technical characteristics of robotic devices. Saudi INTROSC Waygate University of University of SSC DEEP Unit of ARA Lab DFKI RIT Parameter Aramco AN technologies Tsukuba Coimbra Pacific TREKKER measure [6] [12] [13] [4] [5] [7] [8] [9] [10] [11] Dimensions: - length 325 400 163 247 345 240 No 710 380 380 - width mm 180 270 145 190 210 240 informatio 406 280 130 - height 215 240 198 217 130 140 n 228 150 120 No Weight kg 9.5 18 3 9.6 2.3 1.12 informatio 16.6 0.67 6 No No Maximum speed mm/s 140 83,3 200 50 320 140 informatio 200 500 informatio n n Gas detector – CH4, CO2, O2 Absent Absent Absent Absent Absent Absent Absent Absent Absent Infrared Ultrasonic Ultrasonic Ultrasonic sensor and Ultrasonic wet Type of sensor – Hall transducer Absent Absent Absent Absent dry dry contact dry contact eddy current contact contact sensor Camera pcs 1 1 2 2 0 0 1 1 1 2 No No Operating No °C 0… +50 −20… +60 No information No information No information informatio 5… +40 informatio 10… +50 temperature information n n Obstacle – No No Partly Partly Partly No Yes Partly Partly No negotiation General view – An analysis of existing devices revealed the following «weak spots»: Outer diameter of 125 mm (5″) is the minimum diameter to survey the pipelines, most robot crawlers are not able to move over the pipes of smaller diameter or move erratically due to high surface curvature; Electrical power cable is most frequently used to power the robots. The use of this cable makes it impossible to survey metal structures of complex spatial configuration; These devices have no possibility to overcome specific obstacles. This leads to an uncontrolled fall. Considered robotic devices have the following types of kinematic configurations: Magnetic crawler. The possibility of a tank steering and solved problem of low surface contact are the pros [14]. Cons: high coefficient of friction and adhesion due to large contact surface resulting in increased energy consumption for moving, bad maneuverability need for caterpillar tension systems, etc. [15]. Magnetic circuits of different configurations [16]. Highly adhesive, simply structured, and cheaply produced [17]. Disadvantages connected with the risks of breaking away from the surface in case of «magnetic chain» disconnection. Magnetic wheel. Wheeled robots have the highest speed of movement, simple mechanics and control, and besides, the ability of land–wall transition [18]. However, they Infrastructures 2022, 7, 75 6 of 20 are not suitable for overcoming specific obstacles and have low surface contact, which can lead to failure. Wheel with magnets, located according to Halbach-Array [19]. While using a special configuration of permanent magnets—Halbach-Array—it is easy to get a significant increase of adhesion force (about two times, see Figure 4). The main purpose of the assembling is that the compensation of lower magnetic flux leads to strengthening of the upper one [20]. Figure 4. Magnetic wheel with Halbach-Array. However, Halbach-Array requires a rigid wheel design or presence of a specific mechanism [21], which rotates the shaft with the assembly when crossing certain types of obstacles. Wheel with swinging inside part [22]. If the inside part is in an incorrect position, there is a risk of losing adhesion and the following uncontrolled fall, see Figure 5. Figure 5. Wheel construction with Halbach-Array inside. 2.4. Design of Wireless Mobile Robot Crawler System for Pipe Inspection During the engineering development, the design of the device presented in Figure 6 was proposed. The robot crawler has a LIDAR system [23] as well as an EMAT on a telescopic retractable rod. Infrastructures 2022, 7, 75 7 of 20 Figure 6. Design of the proposed robot crawler. The special flexible shape of the wheel with the magnet inside makes it possible to overcome obstacles (Figure 7). Figure 7. Special design of flexible rubber tire allows to overcome obstacles without separation from the ferromagnetic surface. Copyrighted by authors. The characteristics of the device and its components are presented in Table 3. Table 3. Technical characteristics of the developed robot crawler. LiDAR Intel RealSense L515 Parameters Type of tracking Laser scanning Operating range 0.25–9 m Depth camera resolution and FPS 1024 × 768; 30 FPS RGB camera resolution and FPS 1920 × 1080; 30 FPS Color depth camera resolution and FPS 1920 × 1080; 30 FPS Depth accuracy 5 mm Depth camera coverage 70 × 55 degrees RGB camera coverage 70 × 43 degrees Color depth camera coverage 69 × 42 degrees IMU sensor model Bosch BMI085 IMU sensor number of degrees of freedom 6 Speed of accelerometer data output 100 Hz/200 Hz/400 Hz Speed of gyroscope data output 100 Hz/200 Hz/400 Hz Infrastructures 2022, 7, 75 8 of 20 Operating temperature range of the −20…+70 °C environment EMAT parameters Range of thickness measured for steel 2–80 mm Thickness measurement uncertainty 0.08 mm Permissible gap between sensor and unit up to 4 mm under test Permissible misalignment of sensor ±25 degrees relatively to surface normal Minimum permissible radius of surface ≥10 mm curvature Device operating frequency 4 MHz Operating temperature range of the testing −20…+80 °C object surface Robot crawler parameters Width 180 mm Length 180 mm Height 165 mm Mass (without accumulator) 1.8 kg Kinematics 4WD, fully rotatable Above-ground gas pipelines are subject to vibrations that are potentially hazardous processes. A large number of studies are underway to explore it and minimize its negative impact [24–26]. With some modifications, the device will be able to evaluate the vibration parameters along the length of the gas pipeline. In this work we consider only the prototype device (as in many other robotic works [4–6], and therefore the indicator of reliability, durability, and maintainability of the robot cannot be precisely determined. However, the following may be noted: 1. We have used the most suitable constructive materials that will ensure sufficient durability (Table 4); 2. Maintainability is provided with the possibility of large-unit repair. In addition, the sensors are easily removable, this allows them to be «hot» replaced in the field. Individual elements (fasteners, gears) are made of unified standard sizes—this allows them to achieve good interchangeability; 3. Overall metrics of reliability of the device are still difficult to assess, as there is no extensive field experience. Table 4. Materials used in the design of the device. № Constructive Part Material Durability 1 Spur gear Nylon 5 years 2 Body ABS up to 10 years 3 Wheel tire Polyurethane 5 years 4 Wheel shaft Titanium 30 years Infrastructures 2022, 7, 75 9 of 20 2.5. Neural Network Classification of Objects While surveying hard-to-reach objects, it is important to identify the obstacle and to estimate its main parameters. The detection of complication signatures (traces of corrosion, cracks, misalignment of supports) is also important [27–32]. Damage caused by incorrect identification of an obstacle may entail the risk of uncontrolled fall of the device and occurrence of emergency, untimely complications, and detecting may result in extra material costs for their separate investigation and liquidation. Therefore, the use of machine vision and the prediction of complications in the surveying pipelines and metal structures of complex spatial configuration is a crucial task, which, being realized, will improve quality of the surveying hard-to-reach objects and will help to avoid contingency, resulting in safe operation. The application of machine vision technology involves the automated objects classification and helps the engineer to take into account the possible risk of emergency. As the objects classification task is flexible and varies according to the field of application, it was decided to use artificial intelligence technology with the possibility of overfitting to the necessary databases of obstacles and complications. The input data obtained by the robotic device in the surveying pipelines and metal structures of complex spatial configuration are characterized by the following features: 1. Axial displacement, change of the angle, rotations, other distortions; 2. Fast staff turnover, the need for high data processing rate; 3. A wide variety of different types of objects (elements of pipe manifold, supporting structures, defects, leaks); 4. The use of high-resolution cameras results in a large amount of input data; 5. Updating the database for the new survey. For the project realization, the authors used convolutional neural network with extractor of FPN functions (Feature Pyramid Network) [33], which has the following advantages: 1. Decreased amount of learnable parameters and increased speed of learning in comparison with fully connected neural network [34]; 2. Ability to implement computations and network learning algorithms on graphic processors (GPU) [35]; 3. Displacement stability of input data [36]; 4. The use of convolutional kernels helps to avoid generalization of the displayed information. Scanning by parts allows to take into consideration a larger number of properties of the object, which improves the quality of recognition. The architecture of the neural network consists of: 1. Number of layers; 2. Number of sites (neurons) in each layer; 3. Type of activation function. Convolutional neural networks are constructed from the following types of layers: 1. Convolutional—performs convolution, which is characterized by the following parameters:  Filters: number of output channels;  Kernel size: convolutional kernel, is a local receptive field that specifies the width and height of the 2D convolution window;  Padding: function that allows to create a zero-fill around the perimeter of the input image, so that the output has the same width and height;  Activation: activation function;  Input shape: dimension of the input signal. 2. Pooling—this layer works in a similar way to the convolutional layer, but it does not have the convolutional kernel, but the pooling layer calculates the maximum or average values of the input data; Infrastructures 2022, 7, 75 10 of 20 3. Reshaping layers—change the dimension the input data; 4. Dense—fully connected layer; 5. Dropout—regularization technique that allows to avoid overfitting by keeping neurons in a state of activity (not zero) with a given probability. Figure 8 presents a typical topology of a convolutional neural network containing input layer, convolutional layers, pooling layers, and standard fully connected layer. Figure 8. Convolutional Neural Network topology. Since this study addresses two classification challenges, namely, the identification of obstacles on the path of the robotic device and the detection of complication signatures, it was agreed to use two convolutional neural networks with different topologies trained in different databases, the architectures of which are presented in Table 5. Table 5. Architectures of applied neural networks. CNN for Obstacle Identification CNN for Detecting Complication Signatures Number of Layer Output Number of Layer (Type) Output Shape Parameters (Type) Shape Parameters 250 × 250 Input 250 × 250 × 1 0 Input 0 × 3 Convolutional 250 × 250 × 128 1280 Convolutio 250 × 250 Convolutional 250 × 250 × 128 147,584 nal × 16 MaxPooling 125 × 125 × 128 0 Convolutio 250 × 250 Dropout 125 × 125 × 128 0 nal × 16 Convolutional 125 × 125 × 128 147,584 125 × 125 MaxPooling 0 Convolutional 125 × 125 × 128 147,584 × 32 MaxPooling 62 × 62 × 128 0 125 × 125 Dropout 0 Dropout 62 × 62 × 128 0 × 32 Convolutional 62 × 62 × 128 147,584 Convolutio 125 × 125 Convolutional 62 × 62 × 128 147,584 nal × 32 MaxPooling 31 × 31 × 128 0 Convolutio 125 × 125 18,496 Dropout 31 × 31 × 128 0 nal × 32 Convolutional 31 × 31 × 128 147,584 62 × 62 × MaxPooling 0 Convolutional 31 × 31 × 128 147,584 64 MaxPooling 15 × 15 × 128 0 62 × 62 × Dropout 0 Dropout 15 × 15 × 128 0 64 Flatten 28,800 0 Flatten 246,016 0 Dense 128 3,686,528 Dense 256 6,2980,352 Dropout 128 0 Dropout 256 0 Dense 11 1419 Dense 2 514 Infrastructures 2022, 7, 75 11 of 20 Total Total parameters: 4,722,315 63,013,698 parameters: Input layer receives data in the format of the image with dimension of WxHxCin pixels, where W = 1920—the width of the image, H = 1080—the height of the image, Cin = 3—the number of image channels. In this layer of the neural network there is a compression to dimension of 250 × 250 × 1 in case of identifying the obstacles and 250 × 250 × 3 in case of detection of complication signatures as the number of image channels (color) has no informative value for the first task, but for detection of complication signatures color is an important characteristic, for example for detecting signs of corrosion. Next, the data is normalized to a range (−0.5:1) for further processing by subsequent layers: ( ) , , = − 0,5, (1) where () —normalization function; —pixel color value; —pixel maximum value—255; —pixel minimum value—0. Convolutional layer is a set of feature maps that slide across the entire data region of the previous layer and highlight certain features of objects. The convolutional layer can be considered as a special case of a fully connected layer, provided that weights outside the local receptive field are equal to zero for each neuron, and the parameters of the convolutional kernel are distributed among the neurons. = ( ∙ + ), (2) where –j—feature map (previous input layer output); –k layer shift coefficients for the j—feature map; –j map, k layer convolutional kernel; ()—activation function, LeakyReLU activation (() = (, )) is used in both architectures. The choice of LeakyReLU activation function is explained by the fact that it has a number of advantages:  Fast in computation 1. Gradients do not disappear for > 0; 2. Provides fast convergence in practice; 3. Works if < 0, which ensures continuous computing, as opposed to function ReLU (() = (0, )) [37]. MaxPooling minimizes the size of the previous layer maps by selecting maximum local features: ( ( ) ) (3) = ∙ + , where —layer k outlet; , —k layer shift coefficients; () —local maximum feature sampling operation. Dropout layer reduces the process of retraining the neural network. In case of using this layer, the learning process affects only part of the parameters on each iteration. All neurons are present during testing, but their outputs are multiplied by a given probability to maintain the scale of input data (Figure 9). Infrastructures 2022, 7, 75 12 of 20 training testing pw Present with Always present probability Figure 9. Dropout technology, where p—given probability value, w—neural network sites weight. The flatten layer smooths input data without affecting size. When receiving input data in 15 × 15 × 128 dimension, output data dimension after conversion is 28,800 × 1. Dense layer is a fully connected layer that classifies an object, simulating a non-linear function, whose gradual optimization increases the efficiency of recognition. The neurons of each map of the pooling are interconnected with one neuron of that layer. The value of the neuron can be calculated according to the following formula [38]: = ( ∙ + ), (4) where –j—feature map (previous k layer output); () —LeakyReLU activation function; – − 1 layer shift coefficient; – − 1 layer weighting matrix. The output layer is connected to all the neurons of the previous fully connected layer. The number of neurons in this layer corresponds to the number of identified objects (classes) for a classification task. In each architecture of the used neural networks an additional Dense layer was added, which performed the object detection task, and the number of neurons of this layer matched the bounding box that coordinates to highlight objects. An error backpropagation algorithm was chosen to teach the neural network—it is the terminology of the neural network to minimize the cost function (a function of calculating the error value or the «cost of a given target function») as well as gradient descent in logistic or linear regression [39]. Teaching by this method involves two passes across all layers of the network: forward pass and backward pass. The purpose of the method is to calculate: ( ) (5) where ()—cost function. Thus, it is necessary to minimize the cost function J using the optimal set of parameters in theta. Let us introduce the following notation: —input vector, —output vector, — i-th weight coefficient of the j-th neuron of the k-th layer, —i-th neuron limit of the k-th layer, —reference output value of the i-th neuron [40]. The output value of the j-th neuron of the k-th layer is calculated by the formula: = ∙ − (6) The output of the j-th neuron of the output layer is calculated by the formula: Infrastructures 2022, 7, 75 13 of 20 = ∙ − (7) Network error functional is equal: = − , (8) where = − —error of the j-th neuron of the output layer. Error of the j-th element of the k-th hidden layer: = = = = (9) = − = , , Error gradients are equal: = = , , , = = − , (10) = = . , , The weight coefficients and displacement of the neurons are calculated by the following formulae: ( + 1) = − , , , (11) ( + 1) = − . After teaching the neural network model, a decision was accepted to use TensorFlow Lite technology—a tool set that provides machine learning on the device, helping developers run their models on mobile, built-in devices and devices of the Internet of things [41]. The acceleration sequence of the standard neural network model is shown in Figure 10. Training CNN on a Database SavedModel NN TFLite Converter TFLite Flatbuffer Figure 10. Sequencer for converting the neural network model to an accelerated TFLite model. Infrastructures 2022, 7, 75 14 of 20 Thus, the pre-trained convolutional neural network was converted to an accelerated model using Flatbuffer—an effective cross-platform library for serialization (the process of converting the data structure into a sequence of bytes) [42], which helped to achieve the following benefits: 1. Optimization for machine learning on the device, excluding 5 key constraints: delay (no return to server), confidentiality (no personal data leaving the device), connectivity (no Internet connection required), size (reduced model and binary size), and energy consumption (efficient output and lack of network connections, possibility to reduce the weight of the used computer in the robotic device) [43]; 2. Support for multiple platforms including Linux devices, microcontrollers, and microcomputers (if there is a need to overfit to a new data set, the process can be performed directly on a robotic device); 3. High performance with hardware acceleration and model optimization. 2.6. Modelling of Wheel Magnetic Fields The modelling of the magnetic field of wheels was implemented in the Comsol Multiphysics software based on Maxwell’s equation: (12) ∇ × = + ; (13) ∇ × = − ; ∇ × = ; (14) ∇ × = 0, (15) where D—dielectric density; J—current density; H—magnetic field strength; B—magnetic induction; E—electric field strength; —electric foreign charge volume density. Since the magnetostatics problem was solved in the absence of electrical currents, it is permissible to use one equation ∇ × H = 0, which is equal to putting in a magnetic scalar potential Vm, which is determined from H = −∇Vm. The design of the wheel has neodymium magnets of N38 class, and their calculation was carried out in an improved way with the properties’ assignment by the remanence method. 3. Experimental Apparatus and Procedure Description of Experimental Device Survey The experimental program evaluated the device’s ability to pass over pipelines, as well as to perform its functions of LIDAR scanning and measuring metal thickness using EMAT (see Figure 11). Figure 11. Test rig shot with LIDAR. Copyrighted by authors. Infrastructures 2022, 7, 75 15 of 20 In addition to the EMAT and LIDAR studies, there were tests conducted on the detachable forces and moments that occur on the device drives using the PCE-FM200 dynamometer (the characteristics are shown in the Table 6). Table 6. Technical characteristics of the dynamometer. Model PCE-FM200 General view of device Measurement range 0…20 kg/0…200 N Resolution 0,05 kg/0,2 N Accuracy ±0.5% Unit gram/newton Extreme overload 50% (max. up to 150 kg) Measurement of compression and tensile Metering function forces 4. Results and Discussion The developed device demonstrated the successful passing over the surveyed above- ground pipelines, including overcoming obstacles. During the testing of the robotic device and its embedded neural networks a pilot database was established, containing 937 elements of above-ground pipelines, a fragment of which is presented in Table 7. Table 7. Database fragment. Processed Image Object Object Bbox Bbox Bbox Bbox № Image Array Image Object Array Id Id Name xmin ymin ymax xmax Array [[202, 200, [[202, 200, [[[255, 255, 200, 206, 205, 200, 206, 205, Insulating 255, 255, 255, 0 0.0 0.0 84.0 25.0 225.0 265.0 207, 204, 204, 207, 204, 204, flanged joint 255, 255, 255, 200, …]] 200, …]] 255, …]]] Support [[202, 200, [[223, 230, [[[255, 255, with U-bolt 200, 206, 205, 229, 218, 222, 255, 255, 255, 1 0.0 1.0 clamp and 243.0 3.0 250.0 336.0 207, 204, 204, 221, 214, 213, 255, 255, 255, rubber 200, …]] 212, …]] 255, …]]] insert [[208, 202, [[208, 202, [[[255, 255, 202, 199, 199, 202, 199, 199, 255, 255, 255, 2 1.0 2.0 Pipe clamp 215.0 97.0 227.0 313.0 202, 199, 198, 202, 199, 198, 255, 255, 255, 200, …]] 200, …]] 255, …]] … … … … … … … … … … … [[68, 70, 69, [[68, 70, 69, [[[255, 255, 68, 69, 68, 65, 68, 69, 68, 65, 255, 255, 255, 936 846.0 936.0 Bend 90° 5.0 4.0 252.0 321.0 63, 62, 62, 62, 63, 62, 62, 62, 255, 255, 255, …]] …]] 255, …]]] Table 8 details the process of input processing, classification, and detection of pipeline constructive elements, which is a visualization of row 2 in Table 7. Infrastructures 2022, 7, 75 16 of 20 Table 8. Step-by-step visualization of the obstacle classification process. Copyrighted by authors. Output Data After Initial Processing CNN Processing on Isolated Data of Input Data (Data Dimension Obstacle Element Discovered Change) Detection and Object Classification Figure 12a,b illustrates the results of data processing by the neural network for detection of complication signatures on elements of above-ground pipelines affected by coating destruction and/or corrosion. On the left, there are original data before processing by the neural network, on the right there are data after processing in the mode of applying the red contour with shading of the silhouette of discovered objects. (a) (b) Figure 12. The result of data processing by the neural network on detection of complication signatures on the example of corrosion identification. (a) Original data before processing by the neural network; (b) data after processing in the mode of applying the red contour with shading of the silhouette of discovered objects. Copyrighted by authors. To obtain experimental data representing the result of a robotic device working in a mode of classification of obstacles and complications after learning the neural network, based on the NVIDIA Jetson AGX Xavier processor, 36 successful runs were performed on the test bench shown in Figure 3. The work collected statistical data on the classification of obstacles. The robotic device proposed by the authors correctly identified each obstacle presented on the test bench. Due to input data convolutional technique and the use of an accelerated neural network model, an effective object classification speed on the average of 0.0025 s. was achieved. Figure 13 presents statistics on the data processing speed of the neural network, the results of each test, reduced to the average for each of the 36 iterations. The use of the Infrastructures 2022, 7, 75 17 of 20 additional component FPN (Feature Pyramid Network) by the neural network, which improves the method of target detection, allowed us to achieve maximum efficiency of object classification (see Figure 14). 3.2 2.8 2.6 2.4 2.2 1.8 1.6 1.4 1.2 0 5 10 15 20 25 30 35 40 Experience number Figure 13. Neural network object classification speed diagram. 7.20 7.15 7.10 7.05 7.00 6.95 6.90 6.85 6.80 0 2 4 6 8 10 Experiment measurement EMAT measurements real thickness Figure 14. Results of the comparison of EMAT thickness measurements with their real values. The comparison of the 219 × 7 mm wall thickness measurement data obtained by EMAT with their real values measured by a wet contact high-precision thickness gauge showed convincing convergence. Thus, it is shown that in an existing configuration the device is able to accurately measure the thickness of the elements, while magnetic wheels with their existing configuration have little effect on the accuracy of measurement. The results of the tests showed, in the simulation of magnetic force in the software complex Comsol Multiphysics (9.8 kg on one wheel), that the forces values obtained using the dynamometer (9.6 kg) and the calculated values differ no more than 5%, which is a very good approximation. 5. Conclusions The result of the work was the development of a robot crawler prototype capable of moving on complex curvilinear surfaces and evaluating the thickness of pipe metal. The device has successfully passed preliminary bench tests, which, however, have revealed Wall thickness, mm Time value, 1/1000 sec. Infrastructures 2022, 7, 75 18 of 20 some problems with small diameter pipe overpassing and neural networks operation. In the future, it is planned to further develop the device operating with an improved model of neural networking input data processing and algorithms of its presentation to the user. Moreover, the following scheme of robot crawler working, which is shown in Figure 15, is supposed to be used. Figure 15. Organization plan for robotic survey. 1—transport case, 2—industrial Wi-Fi router, 3— operator’s tablet, 4—robotic device for pipeline inspection. As the robot has not started mass operation on industrial sites yet, it is impossible to give exact figures, but in spite of this it is estimated that the cost per 100 km of pipeline survey with the use of this robotic device is $25,000/year (operator’s work and depreciation charges) compared to the same 100 km survey by a group of two industrial climbers—94,000 $/year. Inspection with the help of the device does not require paperwork on admission to work at heights. At present, the tablet application and the quality improvement of the product are underway in development. The work in these areas will be continued and the authors hope to see a positive outcome in one year. Author Contributions: Conceptualization, V.P.; methodology, V.P.; software, A.R.; validation, A.L., A.S. and M.K.; formal analysis, V.P.; investigation, A.L.; resources, V.P.; data curation, A.S.; writing—original draft preparation, M.K.; writing—review and editing, M.K.; visualization, A.R.; supervision, A.L.; project administration, V.P. and A.L.; funding acquisition, V.P. All authors have read and agreed to the published version of the manuscript. Funding: This research was funded by Saint Petersburg Mining University, grant number FSRW- 2020-0014. Informed Consent Statement: Not applicable. Institutional Review Board Statement: Not applicable. Data Availability Statement: The data presented in this study are available on request from the corresponding author. Acknowledgments: The authors gratefully acknowledge the support of the Department of Transport and Storage of Oil and Gas, Saint Petersburg Mining University. Conflicts of Interest: The authors declare that they have no conflicts of interest. Infrastructures 2022, 7, 75 19 of 20 References 1. Jose, J.; Devaraj, D.; Mathanagopal, R.M.; Ramanathan, K.C.; Tokhi, M.O.; Sattar, T.P. INVESTIGATIONS ON THE EFFECT OF WALL THICKNESS ON MAGNETIC ADHESION FOR WALL CLIMBING ROBOTS. Int. J. Robot. Autom. 2021, 36, doi:10.2316/J.2021.206-0441. 2. Trujillo, M.Á.; Martínez-de Dios, J.R.; Martín, C.; Viguria, A.; Ollero, A. Novel Aerial Manipulator for Accurate and Robust Industrial NDT Contact Inspection: A New Tool for the Oil and Gas Inspection Industry. Sensors 2019, 19, 1305, doi:10.3390/s19061305. 3. Jimenez-Cano, A.E.; Braga, J.; Heredia, G.; Ollero, A. Aerial Manipulator for Structure Inspection by Contact from the Underside. In Proceedings of the 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany, 28 September–2 October 2015; pp. 1879–1884. 4. SAIR–Arabian Robotics Company. Available online: http://arabianbots.com/sair/ (accessed on 22 May 2022). 5. Aкycтичecкиe Kонтpольныe Cиcтeмы-Cкaнep-Дeφeктоcкоп A2072 IntroScan. Available online: https://acsys.ru/skaner- defektoskop-a2072-introscan/ (accessed on 22 May 2022). 6. Nguyen, S.; La, H. Development of a Steel Bridge Climbing Robot. In Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China, 3–8 November 2019, doi:10.1109/IROS40897.2019.8967748. 7. Viktor BIKE–Inspection Robotics. Available online: https://inspection-robotics.com/bike/ (accessed on 22 May 2022). 8. Wang, R.; Kawamura, Y. An Automated Sensing System for Steel Bridge Inspection Using GMR Sensor Array and Magnetic Wheels of Climbing Robot. J. Sens. 2016, 2016, 1–15, doi:10.1155/2016/8121678. 9. Past Projects. Available online: https://www.isr.uc.pt/index.php/projects/past- projects?task=showprojects.show%28%29&idProject=13 (accessed on 22 May 2022). 10. Burmeister, A.; Pezeshkian, N.; Talke, K.; Ostovari, S.; Everett, H.; Hart, A.; Gilbreath, G.; Nguyen, H. Design of a Multi- Segmented Magnetic Robot for Hull Inspection. In Proceedings of the ASNE Mega Rust 2014: Naval Corrosion Conference, San Diego, CA, USA, 24 June 2014. 11. Trekker, D. DT340L Pipe Crawler Package. Available online: https://www.deeptrekker.com/shop/products/dt340l-pipe- crawler-package (accessed on 22 May 2022). 12. Robot System: Magnet Crawler-Marine Inspection Robotic Assistant System. Available online: https://robotik.dfki- bremen.de/en/research/robot-systems/magnet-crawler/ (accessed on 22 May 2022). 13. EMAT Thickness Measurement RobotRover Inspectioning Technology Co., Ltd. Available online: http://www.ritinspection.com/products/287.html (accessed on 22 May 2022). 14. Tang, Y.; Song, H.; Yu, Y.; Zhang, J.; Hu, W.; Guo, X. Dynamic Simulation Analysis and Experiment of Large-Caliber Self- Propelled Pipeline Crawler Based on ADAMS. J. Phys. Conf. Ser. 2021, 2095, 012049, doi:10.1088/1742-6596/2095/1/012049. 15. Khan, M.; Chuthong, T.; Do, C.; Thor, M.; Billeschou, P.; Larsen, J.; Manoonpong, P. ICrawl: An Inchworm-Inspired Crawling Robot. IEEE Access 2020, 8, 1, doi:10.1109/ACCESS.2020.3035871. 16. Magnetic Drive Wheel for Wall Climbing Robot-Faizeal. Available online: https://www.fzmag.com/magnetic-drive-wheel-for- wall-climbing-robot/ (accessed on 22 May 2022). 17. Zhang, Y.; Dai, Z.; Xu, Y.; Qian, R. Design and Adsorption Force Optimization Analysis of TOFD-Based Weld Inspection Robot. J. Phys. Conf. Ser. 2019, 1303, 012022, doi:10.1088/1742-6596/1303/1/012022. 18. Mahmood, S.; Bakhy, S.; Tawfik, M. Magnetic–Type Climbing Wheeled Mobile Robot for Engineering Education. IOP Conf. Ser. Mater. Sci. Eng. 2020, 928, 022145, doi:10.1088/1757-899X/928/2/022145. 19. Lawrence, K.H. Design of Permanent Multipole Magnets with Oriented Rare Earth Cobalt Materials. Nucl. Instrum. Methods 1980, 169, 1–10. 20. Bjørk, R.; Bahl, C.; Smith, A.; Pryds, N. Optimization and Improvement of Halbach Cylinder Design. J. Appl. Phys. 2008, 104, 013910, doi:10.1063/1.2952537. 21. Zhang, M.; Zhang, X.; Li, M.; Cao, J.; Huang, Z. Optimization Design and Flexible Detection Method of a Surface Adaptation Wall-Climbing Robot with Multisensor Integration for Petrochemical Tanks. Sensors 2020, doi:10.3390/s20226651. 22. Eto, H.; Asada, H. Development of a Wheeled Wall-Climbing Robot with a Shape-Adaptive Magnetic Adhesion Mechanism. In Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France, 31 May–31 August 2020. https://doi.org/10.1109/ICRA40945.2020.9196919. ® TM 23. Intel RealSense LiDAR Camera L515. Available online: https://www.intelrealsense.com/lidar-camera-l515/ (accessed on 22 May 2022). 24. Yang, P.; Bai, H.; Xue, X.; Xiao, K.; Zhao, X. Vibration Reliability Characterization and Damping Capability of Annular Periodic Metal Rubber in the Non-Molding Direction. Mech. Syst. Signal Process. 2019, 132, 622–639, doi:10.1016/j.ymssp.2019.07.020. 25. Shen, G.; Li, M.; Xue, X. Damping Energy Dissipation and Parameter Identification of the Bellows Structure Covered with Elastic-Porous Metal Rubber. Shock Vib. 2021, 2021, 1–12, doi:10.1155/2021/8813099. 26. Xue; Ruan; Li; Bai; Xiao Nonlinear Dynamic Modelling of Two-Point and Symmetrically Supported Pipeline Brackets with Elastic-Porous Metal Rubber Damper. Symmetry 2019, 11, 1479, doi:10.3390/sym11121479. Infrastructures 2022, 7, 75 20 of 20 27. Mumtaz, M.; Mansoor, A.; Masood, H. A New Approach to Aircraft Surface Inspection Based on Directional Energies of Texture. In Proceedings of the 2010 20th International Conference on Pattern Recognition, Istanbul, Turkey, 23–26 August 2010; pp. 4404–4407. 28. Jahanshahi, M.; Masri, S. Effect of Color Space, Color Channels, and Sub-Image Block Size on the Performance of Wavelet-Based Texture Analysis Algorithms: An Application to Corrosion Detection on Steel Structures. In Proceedings of the Computing in Civil Engineering (2013), Los Angeles, CA, USA, 24 June 2013; pp. 685–692. 29. Ji, G.; Zhu, Y.; Zhang, Y. The Corroded Defect Rating System of Coating Material Based on Computer Vision. In Transactions on Edutainment VIII; Springer: Berlin/Heidelberg, Germany, 2012; Volume 7220, pp. 210–220. 30. Siegel, M.; Gunatilake, P.; Podnar, G. Robotic Assistants for Aircraft Inspectors. Instrum. Meas. Mag. IEEE 1998, 1, 16–30, doi:10.1109/5289.658190. 31. Bahaa, B.; Zaidan, A.; Alanazi, H.; Rami, A. Towards Corrosion Detection System. Int. J. Comput. Sci. Issues 2010, 7. 32. Ortiz, A.; Bonnin-Pascual, F.; Garcia-Fidalgo, E.; Company-Corcoles, J. Vision-Based Corrosion Detection Assisted by a Micro- Aerial Vehicle in a Vessel Inspection Application. Sensors 2016, 16, 2118, doi:10.3390/s16122118. 33. Lin, T.-Y.; Dollár, P.; Girshick, R.B.; He, K.; Hariharan, B.; Belongie, S.J. Feature Pyramid Networks for Object Detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017. https://doi.org/10.1109/CVPR.2017.106. 34. Albawi, S.; Abed Mohammed, T.; ALZAWI, S. Understanding of a Convolutional Neural Network. In Proceedings of the 2017 International Conference on Engineering and Technology (ICET), Antalya, Turkey, 21–23 August 2017. 35. Luo, Z.; Liu, H.; Wu, X. Artificial Neural Network Computation on Graphic Process Unit. In Proceedings of the 2005 IEEE International Joint Conference on Neural Networks, Montreal, QC, Canada, 31 July–4 August 2005; Volume 1, pp. 622–626. Sultana, F.; Sufian, A.; Dutta, P. Advancements in Image Classification Using Convolutional Neural Network|Request PDF. In Proceedings of the 2018 Fourth International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN), Kolkata, India, 22–23 November 2018. 37. Nwankpa, C.; Ijomah, W.; Gachagan, A.; Marshall, S. Activation Functions: Comparison of Trends in Practice and Research for Deep Learning. arXiv 2018, arXiv:1811.03378. 38. Ghosh, A.; Sufian, A.; Sultana, F.; Chakrabarti, A.; De, D. Fundamental Concepts of Convolutional Neural Network. In Recent Trends and Advances in Artificial Intelligence and Internet of Things; Springer: Cham, Switzerland, 2020; pp. 519–567, ISBN 978-3- 030-32643-2. 39. Шaклa, Hишaнт-Maшинноe Oбyчeниe & TensorFlow [Teкcт]: [16+]-Search RSL. Available online: https://search.rsl.ru/ru/record/01009872794? (accessed on 22 May 2022). 40. Gafarov, F.; Galimyanov, A. Artificial Neural Networks and Their Applications, 1st ed.; Kazan University: Kazan, Russia, 2018; pp. 25–28. 41. TeнзоpΦлоy Лaйт|TensorFlow Lite. Available online: https://www.tensorflow.org/lite/guide?hl=ru (accessed on 22 May 2022). 42. FlatBuffers: FlatBuffers. Available online: https://google.github.io/flatbuffers/(accessed on 22 May 2022). 43. Cпpaвочник по API TensorFlow Lite. Available online: https://www.tensorflow.org/lite/api_docs?hl=ru (accessed on 22 May 2022).

Journal

Infrastructures – Multidisciplinary Digital Publishing Institute

Published: May 25, 2022

Keywords: robot crawler; magnetic wheel; technical condition; LIDAR; EMAT; machine vision

There are no references for this article.