**3.3 Assessment system**

The innovation PAM (Process Assessment Model) was imported to the Capability Adviser assessment system [7, 29–32] supporting process capability assessment of ISO 56000 processes using the ISO 33020 process measurement framework. The Capability Adviser assessment tool is already used by major automotive and electronics industry for Automotive SPICE, ISO26262 (functional safety), and Automotive SPICE for Cybersecurity (ISO 21434) assessments. This infrastructure was reused for the innovation process capability assessment in the TIMS project.

The TIMS project lead is a national representative of the ISO 56000 working group, which allows an interchange of ideas. TIMS objectives include the establishment of a European innovation assessment and benchmarking system. To support this concept, the assessment portal includes a registration for the self-assessment function.

One of the TIMS project partners is the coordinator of the EuroSPI initiative [47–64], which provides a platform to run the ISO 56000 assessment services. The system is available at https://iso56000.eurospi.net.

Innovation agents can register in the system (see **Figure 4**) for self-assessment. The system supports both self-assessment and an independent expert assessment. In case of an expert assessment, an extra account for an external assessor is required. After the registration, users have a user id and a password and can login later again with the LOGIN-Assessor function as an assessor. **Figure 5** shows the tree of processes and that level 1 to level 5 practices are configured. **Figure 6** shows that once the level 1 practices are selected the practices can be rated according to ISO 33020 with Not/ Partially/Largely/Fully.

The capability levels of processes and related practices are based on the ISO 33020 process measurement framework (see **Figures 5** and **6**). And capability level 1 represents the base practices that were configured with the PAM (Process Assessment Model) for innovation management. Per process at level 1, the base

#### **Figure 4.**

*Registration at the TIMS assessment portal (ISO 56000).*

*Innovation Management System Assessment and Benchmarking DOI: http://dx.doi.org/10.5772/intechopen.112556*


**Figure 5.** *The tree of ISO 56000 processes with level 1–5 practices.*

#### **Figure 6.**

*Not/partially/largely/fully rating based on ISO 33020.*

practices, the outcomes, and also the relationship to the ISO 56000 norm are shown in the tool (see **Figure 7**).

Since the system is built on the basis of the ISO 33020 process measurement framework, the system allows to generate process capability level profiles (**Figure 8**) and process attribute profiles (**Figure 9**).

The methods and algorithms for calculating process attribute ratings are specified in ISO 33020. In industry, currently, an average algorithm is used to aggregate single ratings to an average percentage and then map the average onto the scale published

#### **Figure 7.**

*Showing related ISO 56000 clauses per base practice.*


#### **Figure 8.**

*Capability level profile for innovation processes based on ISO 33020.*

in ISO 33020, with N between 0 and 15%, P greater than 15 and up to 50%, L greater than 50 and up to 85%, and F greater than 85%. However, an assessor can overrule this average algorithm.

Based on that assessment system each organization can analyze and generate its own (private) innovation capability profile. After more than a sufficient number of assessments so that single assessment results cannot be extracted (to keep the single organizations anonymous) an average benchmarking profile is generated. This is done with a filter per country.
