**5.2 Models and tools supporting system architecture assessment and multi-criteria decision support system**

The available MS&A models and tool implemented in Matlab14 for system architecture assessment presented in this section are collected from [18, 19, 21–24]. The Matlab models implemented static Bayesian games with (i) complete information games and associated pure and mixed games, and (ii) incomplete information games and associated mixed games. The Matlab models also incorporated both brute force and multi-criteria decision approaches. The brute force approach iterates the PCFs adjusting USG and contractors gains and losses until the contactors' architecture solutions converge to UGS solution. The brute-force's criterion is set to a minimum of two contractors' solutions are required to converge to USG solution [16, 24]. The multi-criteria decision approach implemented advanced ELECTRE II with five evaluation criteria, including market uncertainty, technological

#### **Figure 12.** *Matlab GUI for SOSE CONOPS assessment.*

<sup>14</sup> The Matlab tools were developed jointly by Aerospace team, University of Hawaii (UH) team, and North Carolina State University (NCSU) team. NCSU team includes Paul Vienhage, Heather Barcomb, Karel Marshall, William Black, and Amanda Coons under the Industry Collaboration (IC) program between NCSU and The Aerospace Corporation. NCSU IC program director was Prof. Hien Tran. UH team led by Prof. Tung Bui.

#### *Systems-of-Systems MS&A for Complex Systems, Gaming and Decision for Space Systems DOI: http://dx.doi.org/10.5772/intechopen.100007*

**Figure 13.** *Matlab GUI for system architecture assessment.*

uncertainty, technical and performance risk, cost and schedule risks, and payoffs and costs [17]. **Figure 13** depicts the Matlab GUI for evaluating system architectures under both USG and contractor perspectives [16, 24]. The figure shows a notional case assuming Pure game, four potential contractors bidding, with and without enterprise databases. Practically, enterprise database includes program of records (i.e., past programs data from open sources). Non-enterprise open source database includes only survey data collected from the potential bidding contractors. Detailed description of the models and tool can be found in [15–17, 24]. It should be noted that the MS&A models and tool presented in this section are not intended to predict what contractor has the winning system architecture solution. The intention is to gain insight into the winning architecture solution based on contractors' supplied information for the development and selection of the USG reference architecture for Request for Proposal (RFP) preparation.
