2.1.2.4 Validity of the ultrasound acupuncture course

The course validity was calculated using the content validity index (CVI). The CVI method determines the ratio of experts who are in agreement with one another, and allows several raters to independently review the test items and evaluate the performance of the trainees. Briefly, for each test item, a scale of 4 was used for the rater response, responses of 1 and 2 indicating items that are 'invalid', and responses of 3 and 4 indicating 'valid' items. During the analysis, the four ordinal response rankings were then collapsed into two dichotomous categories of responses (score of invalid item = 0; score of valid item = 1), and the CVI of individual items was obtained. The CVI of the overall scale (S-CVI) was then calculated as:

$$\text{S}-\text{CVI}=\frac{\text{CVI}\_i}{N} \tag{2}$$

where CVIi is the sum of individual item CVIs and N is the total number of items. An S-CVI of 0.8 or higher indicated an acceptable validity. This study used IBM SPSS version 25 for quantitative statistical analysis.

#### 2.1.3 Effectiveness assessment

#### 2.1.3.1 Evaluation process


Ultrasound Detection Acupuncture Needling Training: Description of the Method DOI: http://dx.doi.org/10.5772/intechopen.82802


## 2.1.3.2 Analyses of the results

Where R <sup>2</sup>

Figure 3.

evaluated; K = number of raters (experts).

2.1.2.4 Validity of the ultrasound acupuncture course

than 0.8 indicated good reliability.

2.1.3 Effectiveness assessment

2.1.3.1 Evaluation process

52

<sup>i</sup> = the total sum of the squares of the scores given by the raters; ð Þ Ri

the square of the sum of the scores from each rater; N = number of trainees being

Acupuncture simulator model of GB21 (ASM21) equipped with a sensor detector light alarm.

Acupuncture - Resolving Old Controversies and Pointing New Pathways

We analyzed the W values of the trainees in the four classes. W values greater

The course validity was calculated using the content validity index (CVI). The CVI method determines the ratio of experts who are in agreement with one another, and allows several raters to independently review the test items and evaluate the performance of the trainees. Briefly, for each test item, a scale of 4 was used for the rater response, responses of 1 and 2 indicating items that are 'invalid', and responses of 3 and 4 indicating 'valid' items. During the analysis, the four ordinal response rankings were then collapsed into two dichotomous categories of responses (score of invalid item = 0; score of valid item = 1), and the CVI of individual items was

<sup>S</sup> � CVI <sup>¼</sup> CVIi

where CVIi is the sum of individual item CVIs and N is the total number of items. An S-CVI of 0.8 or higher indicated an acceptable validity. This study used

1. Pre-test: the trainees conducted acupuncture at the GB21 acupoint using the ASM21 model without ultrasound, and the frequency of occurrence of

pneumothorax (needle puncture of the lung) was recorded on the DOPS form.

2. Pre-test interview: interviews were conducted with the trainees, which focused on acupuncture clinical skills and recorded their thoughts on and difficulties

3. The trainees attended four classes, totaling an eight-hour course. They were asked to complete a satisfaction survey, and undertook two acupuncture

<sup>N</sup> (2)

obtained. The CVI of the overall scale (S-CVI) was then calculated as:

IBM SPSS version 25 for quantitative statistical analysis.

in performing acupuncture at the GB21 acupoint.

practice sections with ultrasound.

2 =

The pre-test and post-test data were compared. Trainee feedback was also analyzed in order to evaluate the efficacy of the course using the methods described below:


#### 2.2 Results

#### 2.2.1 Trainee recruitment

The study recruited 17 trainees, all of whom were residents at the Chinese Medicine Department of our hospital. One of the trainees was not able to attend all the classes and complete the test; therefore, a total of 16 participants, 8 males and 8 females (aged 31.63 4.46 years), completed the program and were included in

this study. Of them, one was a dual-licensed Chinese and Western medical physician, and the remaining 15 were all licensed Chinese medical practitioners (Table 2).

2.2.4 Assessment of student learning effectiveness

DOI: http://dx.doi.org/10.5772/intechopen.82802

14, and 12 completed questionnaires were received.

S-CVI values obtained from the five experts as raters in this study.

Comparison of pre- and post-test scores by the Mann-Whitney U test (two-tailed).

2.2.6 Correlations between course attendance and post-test results

2.2.5 Pre- and post-test interviews

as listed below (Figure 4).

included for analysis.

Table 3.

Table 4.

55

In the pre-test, the trainees had not learned the ultrasound technique, and therefore item 2—"Ultrasound operation skills" was not included for evaluation on the DOPS form. The average DOPS score in the pre-test was 3.0 0.6. After the 16 trainees had attended the four classes, the average post-test score, which included item 2, was 3.8 0.3. The Mann-Whitney U test (two-tailed) showed that the scores differed significantly between pre- and post-test (P < 0.05; Table 4). Overall, the use of ultrasound effectively helped the trainees to avoid the complication of

The pre-test interviews indicated that most of the trainees did not have experience in performing acupuncture at the GB21 point prior to taking this course, and were afraid of causing pneumothorax when performing acupuncture at acupoints near to the chest. To assess the satisfaction of the trainees following the course, they were asked to complete a questionnaire after each class. For the four classes, 8, 10,

Feedback was also obtained from the trainees during the post-test interviews, and some useful suggestions were collected as a reference to improve the program,

In this program, the trainees were free to participate in the classes according to their individual schedules. Due to the fact that the working hours and locations of the hospital residents might change, some trainees were unable to attend the entire course. The attendance rate and frequency of practice using the ultrasound instrument are presented in Table 5. When a trainee was not able to attend a class, video recordings and slides were provided for self-learning. Of the original 17 trainees recruited to this study, one withdrew; therefore, the data of 16 trainees were

Expert no. S-CVI value 1 1 2 1 3 1 4 0.9 5 1 Average 0.98

Average score 3.0 0.6 3.8 0.3 0.00054\*

Pre-test (n = 16) Post-test (n = 16) P-value

pneumothorax when performing acupuncture at the GB21 acupoint.

Ultrasound Detection Acupuncture Needling Training: Description of the Method
