**4. A novel route in developing wearables for human motor-skill learning and biomechanical feedback training**

Currently, the most reliable methodology for quantifying complicated human motor skills is the full-body biomechanical modeling based on 3D motion capture [24–27]. The biomechanical body model consists of 15 segments. The 15 segments are the head, upper trunk, lower trunk, upper arms, lower arms, hands, thighs, shanks, and feet. For establishing the model, about 40 body-surface markers are needed to supply 3D coordinate inputs for mechanically determining joint kinematics in order to reveal the motor-control/limbs' coordination. The model is widely applied in the current 3D motion capture technologies for demystifying and optimizing complex motor skills in sports and arts performance [4, 15, 17, 28–36]. This video-based technology uses multi-cameras to track ~40 reflective markers (their weights are negligible) attached on the body surface. Technically, the tracking can be equivalently done by using 40 wearable IMUs, a sensing technology that measures linear and angular motion with a triad of gyroscopes and triad of accelerometers [21, 37–40]. As such, motion analysis could switch from labs (multi-camera environment) to the field (wearables) [4], i.e., quantification of limbs' coordination would be no more restricted to labs and become an effortless daily routine for researchers and practitioners. Practically, it is not so easy.

It is wise to induce the success of the current biomechanical body model into wearable applications. Nevertheless, it is unrealistic and impractical to use ~40 IMUs for rebuilding the body and its movement. Markers used in motion capture are small (9 mm in diameter) and almost weightless [41–43], whereas the volume and weight of current IMUs are still significantly larger. The ~40 IMUs can cause unknown experimental artifacts. Obviously, we have to search a new route. Based on the current development [4, 20, 21, 44], a novel approach for a potentially successful transition to wearable applications will be introduced here.

The innovative approach will be built on previous studies on anthropometry [12, 13, 45], 3D motion analysis [25, 46–49], sensing technology [21, 37–40, 50], and artificial intelligence (AI) [44, 50–54]. This multidisciplinary approach provides a new route to develop a wearable-based method for data analysis and interpretation (motor-control depiction) as well as to distill and package new findings from various areas in realizing the real-time biomechanical feedback training in practice.

#### **4.1 A two-chain model as a general full-body biomechanical model for realizing wearable application in human motor-skill training**

In 3D motion capture, the rebuilding of an individual 15-segment model is achieved by tracking selected body-surface markers in 3D space. Alternatively, an equivalent model can be built via anthropometrical approach. Previous studies show that, using variables such as body weight (BW), body height (BH), gender, and race, one can statistically determine segmental masses and lengths to build an individual body model [12, 45]. The difference of the two approaches is that the former is "born-to-move" (video-based) and the latter has to "learn-to-move" (wearablebased). Currently, the most challenging for wearable application in sports and arts performances is practicality. Wearables attached to human body will create certain constraints for human movement and alternate the movement control in a way that may not reach the training goal. Therefore, the less wearables applied, the more practical the feedback system is. Aiming at the development of practicality, future researches/developments should focus on innovative designs of the body model that will minimize the number of wearables required yet still supply equivalent, if not

**47**

**Figure 1.**

*generated in Shan's biomechanics lab.*

*Challenges and Future of Wearable Technology in Human Motor-Skill Learning and Optimization*

better, accuracy of the current 15-segment biomechanical model. Such a novel body

Based on numerous previous 3D motion studies [15, 28–31, 37, 55–63], multitudinous complicated human movements from both sports activities and arts performances can be generally represented by using a model system with two mechanical chains: upper-body chain and lower-body chain (**Figure 1**). The upper-body chains consist of a base (i.e., upper trunk and head) and two sub-chains (i.e., arms) that are linked to the base. The lower-body chain has an equivalent structure, the base is the lower trunk, and the two sub-chains are the legs. With this novel design, human motor skills could be tracked by using much fewer IMUs. Theoretically, three IMUs on each chain (one on the base, one on each distal end of the chain) would likely track the movement of a chain (**Figure 1a**), i.e., six IMUs would be able to determine the segments'/joints' motion and coordination as well as the orientation relationship between the two bases of the two chains. As such, researchers and practitioners could quasi-naturally track human motor skills (i.e., six wearables would minimally encumber human motor control) in learning and training. This would help the development of the real-time biomechanical feedback training. Only the six IMUs' inputs are not

*The two-chain model of human motor skills. (a) the possible locations of the six wearables for human motor-skills' tracking; (b) grand jeté in ballet; (c) an Indian dance skill; (d) golf swing; (e) jumping side volley (an acrobatic kick) in soccer; and (f) baseball pitch. Note: All the three-dimensional motion data were* 

model is introduced below for potential breakthroughs in the future.

*DOI: http://dx.doi.org/10.5772/intechopen.91356*

#### *Challenges and Future of Wearable Technology in Human Motor-Skill Learning and Optimization DOI: http://dx.doi.org/10.5772/intechopen.91356*

better, accuracy of the current 15-segment biomechanical model. Such a novel body model is introduced below for potential breakthroughs in the future.

Based on numerous previous 3D motion studies [15, 28–31, 37, 55–63], multitudinous complicated human movements from both sports activities and arts performances can be generally represented by using a model system with two mechanical chains: upper-body chain and lower-body chain (**Figure 1**). The upper-body chains consist of a base (i.e., upper trunk and head) and two sub-chains (i.e., arms) that are linked to the base. The lower-body chain has an equivalent structure, the base is the lower trunk, and the two sub-chains are the legs. With this novel design, human motor skills could be tracked by using much fewer IMUs. Theoretically, three IMUs on each chain (one on the base, one on each distal end of the chain) would likely track the movement of a chain (**Figure 1a**), i.e., six IMUs would be able to determine the segments'/joints' motion and coordination as well as the orientation relationship between the two bases of the two chains. As such, researchers and practitioners could quasi-naturally track human motor skills (i.e., six wearables would minimally encumber human motor control) in learning and training. This would help the development of the real-time biomechanical feedback training. Only the six IMUs' inputs are not

#### **Figure 1.**

*Sports Science and Human Health - Different Approaches*

**and biomechanical feedback training**

researchers and practitioners. Practically, it is not so easy.

cessful transition to wearable applications will be introduced here.

**wearable application in human motor-skill training**

**4. A novel route in developing wearables for human motor-skill learning** 

Currently, the most reliable methodology for quantifying complicated human motor skills is the full-body biomechanical modeling based on 3D motion capture [24–27]. The biomechanical body model consists of 15 segments. The 15 segments are the head, upper trunk, lower trunk, upper arms, lower arms, hands, thighs, shanks, and feet. For establishing the model, about 40 body-surface markers are needed to supply 3D coordinate inputs for mechanically determining joint kinematics in order to reveal the motor-control/limbs' coordination. The model is widely applied in the current 3D motion capture technologies for demystifying and optimizing complex motor skills in sports and arts performance [4, 15, 17, 28–36]. This video-based technology uses multi-cameras to track ~40 reflective markers (their weights are negligible) attached on the body surface. Technically, the tracking can be equivalently done by using 40 wearable IMUs, a sensing technology that measures linear and angular motion with a triad of gyroscopes and triad of accelerometers [21, 37–40]. As such, motion analysis could switch from labs (multi-camera environment) to the field (wearables) [4], i.e., quantification of limbs' coordination would be no more restricted to labs and become an effortless daily routine for

It is wise to induce the success of the current biomechanical body model into wearable applications. Nevertheless, it is unrealistic and impractical to use ~40 IMUs for rebuilding the body and its movement. Markers used in motion capture are small (9 mm in diameter) and almost weightless [41–43], whereas the volume and weight of current IMUs are still significantly larger. The ~40 IMUs can cause unknown experimental artifacts. Obviously, we have to search a new route. Based on the current development [4, 20, 21, 44], a novel approach for a potentially suc-

The innovative approach will be built on previous studies on anthropometry [12, 13, 45], 3D motion analysis [25, 46–49], sensing technology [21, 37–40, 50], and artificial intelligence (AI) [44, 50–54]. This multidisciplinary approach provides a new route to develop a wearable-based method for data analysis and interpretation (motor-control depiction) as well as to distill and package new findings from various areas in realizing the real-time biomechanical feedback training in practice.

**4.1 A two-chain model as a general full-body biomechanical model for realizing** 

In 3D motion capture, the rebuilding of an individual 15-segment model is achieved by tracking selected body-surface markers in 3D space. Alternatively, an equivalent model can be built via anthropometrical approach. Previous studies show that, using variables such as body weight (BW), body height (BH), gender, and race, one can statistically determine segmental masses and lengths to build an individual body model [12, 45]. The difference of the two approaches is that the former is "born-to-move" (video-based) and the latter has to "learn-to-move" (wearablebased). Currently, the most challenging for wearable application in sports and arts performances is practicality. Wearables attached to human body will create certain constraints for human movement and alternate the movement control in a way that may not reach the training goal. Therefore, the less wearables applied, the more practical the feedback system is. Aiming at the development of practicality, future researches/developments should focus on innovative designs of the body model that will minimize the number of wearables required yet still supply equivalent, if not

**46**

*The two-chain model of human motor skills. (a) the possible locations of the six wearables for human motor-skills' tracking; (b) grand jeté in ballet; (c) an Indian dance skill; (d) golf swing; (e) jumping side volley (an acrobatic kick) in soccer; and (f) baseball pitch. Note: All the three-dimensional motion data were generated in Shan's biomechanics lab.*

sufficient to apply the class mechanics to quantitatively determine the model system. Currently, AI could alleviate this challenge due to its "learning" ability [44, 64–66].

#### **4.2 AI for motor-control quantification**

Since the inputs of the limited IMUs cannot mechanically determine the twochain model, AI technologies are the alternative ways for the two-chain model quantification. Studies have shown that AI techniques have become a powerful tool for helping to solve many challenging problems in human motor-skill evaluations and analyses [44, 52, 53, 67].

The basic idea of AI prediction is to find a way to learn general features of existing data in order to make sense of new data [64, 65]. This description highlights the central role of data for establishing implicit knowledge. The amount of data must be sufficiently large to provide many training examples from which a large set of parameters can be extracted. In the past decades, AI techniques have experienced a resurgence following concurrent advances in computer power, large amounts of data (big data), and theoretical understanding.

Among the AI technologies, deep learning is considered as a powerful tool that percolates through to all application areas of AI, such as image identification, speech recognition, natural language processing, and, indeed, biofeedback support [68–70]. The success of deep learning networks encourages their implementation in further applications for the enhancement of human physical activities [52, 54, 67]. Recently, *Nature Neuroscience* has published the latest developments in the area of markerless, video-based motion tracking, indicating that the power of deep learning will enable motion tracking to human-like accuracy [53]. This study confirms that motion capture/quantification of limbs' coordination will move from an expensive and difficult task restricted to the laboratory to an effortless daily routine for researchers and practitioners.

From motor learning point of view, wearables would have much higher potential than video shooting in the future practice. This is not only because of the fast advance in miniature of wearables but also due to three inherited drawbacks of video-shooting approach, i.e., (1) the limited capture space, (2) the complexity of capture systems (from setup, calibration, to operation), and (3) the time-consuming nature of data processing (high cost of data processing). Reliable biomechanical feedback should be obtained from accurate quantification of human movement in field, with some requiring large space. Even with a multi-camera setting, unexpected environmental factors (e.g., interactions among athletes) will create a data gap. Further, it is true that we are already sitting on massive movement data (e.g., YouTube, Flickr) for training of deep learning models; but the video datasets are uncalibrated and have very little information on the hardware and conditions used to capture particular videos, which can bias the deep learning recognition algorithms [71]. Currently, the availability of reliable motion capture data for developing deep learning models is significantly limited.

In summary, the combination of the two-chain full-body model with six wearable IMUs and the deep learning prediction based on IMUs' data shows great potential in developing real-time biomechanical feedback training for an efficient human motor-skill learning and optimization. The missing piece for testing the potential is reliable massive training data.

#### **4.3 The key for raising the reliability of wearables: creating a diversification of 3D training big data**

Two factors revealed by previous studies strongly influence deep learning performance [65, 66, 72–74]. One is the massive data, and the other one is the

**49**

*Challenges and Future of Wearable Technology in Human Motor-Skill Learning and Optimization*

diversity of the massive data. A systematical review article has examined 53 studies published before 2018. The scope of the review is the deep learning applications of the physiological data or signals in healthcare. The article has revealed that both the amount of data and the diversity of data would influence the prediction's reliability [65]. This result would signify that deep learning algorithms would perform well

Judging from the current knowledge, a massive and diverse 3D motion capture big data, collected from sports and arts activities, is indispensable for developing the reliable biomechanical wearables. It is well known that sports and arts skills exhibit the most diverse and complicated motor controls among all human physical activities. If such big data are available for training deep learning models, the reliability of the trained model will be raised due to the depth and specialization from training the deep learning algorithms [65, 66, 72–74]. Therefore, at present, the vital step for developing real-time biomechanical feedback tool is to apply the two-chain model in simultaneous collections of a large amount of motion data, i.e., synchronized measurements using both 3D motion capture with ~40 markers and 6 wearable IMUs [35]. The synchronized data collection should cover large variety of sports skills and arts performances. As such, the 3D motion capture data can be served as a "supervisor" for training deep learning model to map IMU data to joints' kinematic data. Such a deep learning model could be reliably and universally

applied in motor learning and the training of sports and arts skills.

Retrospectively, the current knowledge of anthropometry, biomechanical modeling, and deep learning and the technology for miniaturizing IMUs supply an almost perfect environment for the development of the real-time biomechanical feedback tool in human motor-skill learning and training, especially in learning complicated skills in sports and arts. The missing piece is the massive and diverse

This chapter highlights the challenges and future of wearable technology in human motor-skill learning and optimization. It introduces a novel two-chain biomechanical body model with six IMUs that are powered with deep learning technology. The framework can serve as a basis for developing real-time biomechanical feedback training in practice. In order to create a universal biomechanical feedback device for learning and training of any human motor skill, the massive and diverse big data of multifarious human motor skills have to be created first. One realistic way for obtaining the big data is through a synchronized measurement from 3D motion capture and IMUs. Evidently, gaining high-quality, full-body motion data across sports and arts performances would currently be the vital step for the real-

The realization of the methodological breakthrough will allow us to transform the human motor learning paradigm from a largely subjective art into a precise scientific method. The potentials would be to (1) take scientific monitoring of motor skills from a lab-based environment into the field; (2) simplify a scientific movement quantification, transitioning from using a complicated motion capture system to easily applied wearables; and (3) transfer the vital biomechanical feedback in real time to prevent the worst/movement errors from happening while finding individual compensation/optimization. This methodology is the culmination of research programs in biomechanics, anthropometry, computer sciences, pedagogy, and equipment development. It aims to build innovative technologies for generating new knowledge as well as practical and definitive scientific methods for

*DOI: http://dx.doi.org/10.5772/intechopen.91356*

with large and diverse datasets.

motor-skill big data for deep learning.

time biomechanical feedback development.

**5. Conclusion**

#### *Challenges and Future of Wearable Technology in Human Motor-Skill Learning and Optimization DOI: http://dx.doi.org/10.5772/intechopen.91356*

diversity of the massive data. A systematical review article has examined 53 studies published before 2018. The scope of the review is the deep learning applications of the physiological data or signals in healthcare. The article has revealed that both the amount of data and the diversity of data would influence the prediction's reliability [65]. This result would signify that deep learning algorithms would perform well with large and diverse datasets.

Judging from the current knowledge, a massive and diverse 3D motion capture big data, collected from sports and arts activities, is indispensable for developing the reliable biomechanical wearables. It is well known that sports and arts skills exhibit the most diverse and complicated motor controls among all human physical activities. If such big data are available for training deep learning models, the reliability of the trained model will be raised due to the depth and specialization from training the deep learning algorithms [65, 66, 72–74]. Therefore, at present, the vital step for developing real-time biomechanical feedback tool is to apply the two-chain model in simultaneous collections of a large amount of motion data, i.e., synchronized measurements using both 3D motion capture with ~40 markers and 6 wearable IMUs [35]. The synchronized data collection should cover large variety of sports skills and arts performances. As such, the 3D motion capture data can be served as a "supervisor" for training deep learning model to map IMU data to joints' kinematic data. Such a deep learning model could be reliably and universally applied in motor learning and the training of sports and arts skills.

Retrospectively, the current knowledge of anthropometry, biomechanical modeling, and deep learning and the technology for miniaturizing IMUs supply an almost perfect environment for the development of the real-time biomechanical feedback tool in human motor-skill learning and training, especially in learning complicated skills in sports and arts. The missing piece is the massive and diverse motor-skill big data for deep learning.
