Software Quality Measurement for Functional Suitability, Performance Efficiency, and Reliability Characteristics Using Analytical Hierarchy Process

— The quality model used in this paper is ISO 25010. Functional Suitability, Performance Efficiency, and Reliability are the characteristics to be used. The case study used is the ITS Academic Information System, and the method used for the basis of calculation is the AHP (Analytical Hierarchy Process) method. The initial stage is to make a list of questionnaire questions, which are then filled out by three stakeholders: experts, students, and developers. With the AHP method, experts will analyze the questionnaire results to determine the required weight. This weight is used to calculate the quality of the software. There are two types of software measurements: student questionnaires and developer questionnaires. These two questionnaires become data input. Automatic measurements are carried out on Time Behavior aspects, namely Response Time Testing. In the automatic measurement stage, the URL to be tested by the tester is used as data input. From this automatic measurement, we experimented with the response time of the destination URL to respond to requests and conversion results on a scale of one hundred. The final value of these two types of measurements will be used in several equations to get the final value of the quality of the software. The study results are in the form of automatic measuring instruments of software quality. The measurement results can be used as feedback in making improvements so that the quality value increases when measured. Regarding Functional Suitability, the ITS Academic Information System has provided features according to user needs. In the aspect of Performance Efficiency, the ITS Academic Information System can provide performance and performance according to user needs. Meanwhile, regarding reliability, the ITS Academic Information System can carry out a function under certain conditions and times.


I. INTRODUCTION
Software needs to be measured for quality.One standard that can be used is ISO 25010.ISO 25010 is the latest ISO standard for assessing software quality.ISO is a standard model of assessment and evaluation of software products [1].ISO-25010 is a software quality model that has been widely used.Quality of operation has a quality attribute that focuses on the output of interaction when the software is used.ISO-25010 is a quality model which is used to assess the quality of software products.There are eight characteristics of quality attributes: functional suitability, reliability, performance efficiency, usability, security, compatibility, maintainability, and portability.Each characteristic has sub-attributes due to its wide scope [2].
ISO 25010:2011 contains eight characteristics and 38 subcharacteristics.Improvements from previous ISOs, such as usability, further emphasize the issue of Accessibility, and there are additional quality attributes, efficiency, freedom from risk, and context scope, as well as defining lower levels [3].An essential aspect of the software is functionality; the estimated value of the software agreed upon by the end-user and the development team must be expressed in a certain amount, one of which is in terms of functional size measurement (FSM) [4].Fungsionalitas adalah fungsi sistem utama atau layanan yang disediakan oleh komponen perangkat lunak [5].In the ISO/IEC 25030 standard, functional requirements define software quality requirements that determine how well software performs.So, the quality requirements indicate how much the software can provide and maintain the specified service [6].
Quality Criteria Aspects of Function have sub-criteria of Conformity, Accuracy, and Security.Usability has subcriteria Learnability, User Error Protection, and User Interface Aesthetics.Reliability has sub-criteria of Maturity, Availability, and Recoverability.Portability has sub-criteria Adaptability, Instability, and Replaceability.Finally, security has sub-criteria of Confidentiality and Non-repudiation [7].Functional suitability refers to the software's completeness, Correctness, and suitability to achieve specific purposes.In this context, evaluation calculates the completeness of the software to provide the necessary functions with the correct and appropriate output for use by the user [8].
The finished software can be measured for quality based on the ISO 25010 model.It involves functional suitability, usability, performance efficiency, portability, and security analysis.This model can be used for web-based software [9]-the software quality, functional suitability, usability, performance efficiency, portability, and security aspects.In the functional suitability aspect, all functions in the system ran well [10].Functional suitability represents the extent to which the software product provides the entire user.These characteristics include functional Correctness, completeness, and appropriateness [11].

A. MyITS Single Sign-on
MyITS Single Sign-on is a web-based university information system at the Sepuluh Nopember Institute of Technology.This system is used as an information service and manages academic data to facilitate ITS management and decision-making in the university environment.

B. ISO 25010
ISO 25010 is an international standard published by the International Organization for Standardization to evaluate software quality, which is another part of the Software Product Quality Requirements and the development of the previous software quality model, ISO 9126.In ISO 25010, a metric-based approach is used to assess the quality of the software.This standard is divided into eight quality characteristics, each of which has several sub-characteristics [8].The total number of characteristics that exist in ISO 25010 reaches eight characteristics with thirty-one subcharacteristics.This study presents three software quality characteristics: functional suitability, performance efficiency, and reliability [3].As for automatic testing, the subcharacteristic that is presented is time behavior.

1)
Functional suitability is the ability of software to provide functionality that meets stated and implied needs when used under certain conditions [11].Functional suitability consists of 3 sub-characteristics, namely:  Functional completeness is the ability of software to provide functions that cover all tasks and specific user goals. Functional Correctness is the software's ability to provide precise and correct results according to user requirements. Functional Appropriateness is the ability of software to provide functions that can facilitate the completion of certain tasks and goals.

2)
Performance Efficiency is the ability of software to provide appropriate performance relative to the number of resources used under certain conditions.Performance Efficiency consists of 2 sub-characteristics, namely [12]:  Time Behavior is the ability of the software to provide response and processing time [13]. Resource Utilization is the ability of software to use its resources when performing specified functions [14]. Capacity is the ability of the software to meet the needs under the maximum limit or system parameters [15].

3)
Reliability is the ability of software to perform specified functions under specified conditions for a specified period.Maintain a certain level of software performance.Reliability consists of 4 sub-characteristics, namely [16]:  Maturity is the ability of software to meet requirements reliably under normal circumstances [17]. Availability is software's ability to be operated and accessed when needed [18]. Fault Tolerance is the software's ability to run and maintain its performance if there is an error in hardware or software [19]. Recoverability is software's ability to rebuild the performance level when a system failure occurs, including data and network connections [20].

C. Analytical Hierarchy Process (AHP)
Analytical Hierarchy Process adalah metode pengambilan keputusan yang dikembangkan oleh Thomas L. Saaty.Model pendukung keputusan ini menangkap masalah dengan faktor dan kriteria yang kompleks.According to Saaty (1993), hierarchy represents a complex problem in a multilevel structure.The initial step is the goal, followed by factors, criteria, sub-criteria, and so on, until the last alternative level (Saaty, 1993).In this study, the AHP method was used as the basis for weighting characteristics and sub-characteristics in ISO 25010 on the grounds.
 AHP has a hierarchical structure, so it is very suitable to be used in ISO 25010, which has many sub-criteria. AHP pays attention to validity at the limit of acceptance of inconsistencies as criteria and alternatives chosen by decision-makers.The weighting steps using the AHP method in this study are as follows:  Create a pairwise comparison matrix between quality characteristics or sub-characteristics.
 Provide an assessment of the quality characteristics or sub-characteristics compared in the matrix.The intensity of interest used for the assessment process can be seen in Table 1.The value between the values above  Calculating matrix normalization.
 Calculating eigenvector/weight.=  Determine the relative weight for each of the existing quality sub-characteristics.

D. Calculation of Total Software Quality
To calculate the total value of software quality, the absolute weight is first calculated by multiplying the characteristic weight by the relative weight of the sub-characteristics.Then, the value of the quality subfactor is calculated by multiplying the average questionnaire data per sub-characteristic by twenty-five.This is because the questionnaire is filled in on a scale of zero to four.Thus, to convert the data to a scale of one to one hundred, the data in the questionnaire was multiplied by twenty-five.After that, the absolute value is calculated by multiplying the absolute weight by the value of the quality sub-characteristics.The total software quality is obtained by adding up the absolute values of all subcharacteristics.In this calculation, the applicable equation is as follows:

E. Response Time Testing
Response time testing measures the time that passes between a user's request and a response from the server, application, website, or device.In this software measurement tool, an automatic testing feature automatically allows users to find out the value of a sub-characteristic.The subcharacteristic that was used as an automatic testing feature is Time Behavior.Time behavior can be measured by conducting response time testing, which tests the response time, which refers to the time required for the system to respond to requests.Response time begins when the user sends a request and ends when the application responds to the request.Response Time Testing has three assessment criteria which are shown in Table 2.

second
This is the most preferred response time.If the response time is 0.1, the user always feels that the application or system responds instantly and does not experience any disturbance.1.0 second This is defined as the maximum acceptable response time.Users are unlikely to experience any disturbance, although they may experience some delays.Response times of more than 1 second may interfere with the user experience.10 second This is the maximum after the response time exceeds the acceptable limit.

F. AHP Algorithm Design
The characteristic weight calculation algorithm used in this tool serves to determine the characteristic weight to be used based on the results of the expert questionnaire using the AHP method.The following is the pseudocode of the AHP algorithm.

G. Architecture Design
The architecture used on this research web platform uses the Laravel framework with the Model-View-Controller or MVC design pattern, shown in Figure 1.In the MVC architecture, the client requests data, and then routing will receive and direct the request to the controller associated with the request given.The controller will interact with the required model, and the model will perform queries against the database.The model returns the required data to the controller.Then, the controller calls the corresponding view to display the results requested by the user via the browser.

H. Use Case Diagram
A software tool was created to support automatic calculation, and the requirement functional is shown in the Use Case Diagram (Fig 2).

I. Data Design
In making an application in an information system, analysis is needed in the form of database design.In doing this research, the database used is MySQL because it is widely used in general and easy to use.The database design is displayed in the form of CDM (Conceptual Data Model) and PDM (Physical Data Model) (Fig 3 and

A. Automatic Testing Algorithm Design
This tool's response time testing algorithm serves to get the time needed for the web to respond to requests and convert it to a scale of one to one hundred to get the value of the Time Behavior quality subfactor.In this study, the equation used to convert the results of response time testing is as follows: The above equation is obtained assuming that the three Response Time Testing assessment criteria must be converted to a scale of one hundred so that they are under other subcharacteristic values and can be added to calculate the total value of software quality.In obtaining this equation, the hundredth scale divided into three according to the number of existing criteria, and the median values are one hundred, sixty-seven, and thirty-four.After that, the following rules will apply:  If the response time is less than equal to 0.1 seconds, then the conversion value is 100. If the response time is more than 0.1 seconds and less than 1 second, the conversion value is 67. If the response time is more than 1 second and more than equal to 10 seconds, then the conversion value is 34.The following is the pseudocode for the Response Time Testing algorithm:

B. Creation of Measurement Aids
This research implements software quality measurement tools using the PHP programming language, Laravel framework, and MySQL database.Admin adds the weight of characteristics and sub-characteristics of Functional Suitability, Performance Efficiency, and Reliability.Then, the software tester will create an application measurement project.The software tester can choose to do custom weights or use the weights entered by the admin.If we choose to do custom, the software tester replaces the benchmark weight that has been provided.Then, the data from the questionnaire is entered, and the toolkit will display the measurement results of the application.

C. Automatic Testing Implementation
Automatic testing is implemented using curl multi, which is used to make requests to URLs.In this study, a response time function is used to make requests to the destination URL, which is inputted by the software tester, and get the response time required by the destination URL in response to requests or requests.The implementation steps for Response Time Testing are as follows:  Get the targeted automatic testing sub-characteristics and the URL inputted by the software tester. Determine the number of requests to the destination URL. Run curl and get the total response time. Get the response time for each request and perform the conversion according to the equation that has been made. Calculate absolute weight, absolute value, characteristic value, and application value based on the Response Time Testing results that have been carried out.

D. Trial and Evaluation
This section will discuss the testing process in the use cases used.Testing is carried out using the black box testing method to test each functionality that has been designed.In the process of testing the software measurement tools, the results were as expected.
In this study, case study testing was carried out using questionnaire data regarding the ITS Academic Information System.This measurement aims to assess the quality of the ITS Academic Information System based on the quality model that has been created.The following are the steps to carry out the measurement process on the ITS Academic Information System:  Distributing questionnaires containing statements regarding the ITS Academic Information System based on ISO 25010 sub-characteristics filled out by students and DPTSI developers. Measure the software's quality using a tool created by entering the details of the ITS Academic Information System data in the form of application names, URLs, test files in php format, and custom weights if needed.
After that, the software tester and the DPTSI developer entered the results of the student questionnaire. The results of measuring the quality of the ITS Academic Information System were displayed in the form of a report. The ITS Academic Information System quality measurement report can be downloaded in PDF format.

E. Analysis of Test Results
The measurement results of the ITS Academic Information System on the characteristics of Functional Suitability, Performance Efficiency, and Reliability can be seen in Table 3.The test results on the characteristics of Functional Suitability get a total absolute value of 26.74.The weight of the Functional Suitability characteristic is 0.33.If converted, the maximum value of the Functional Suitability characteristic is 33.It can be concluded that the value of the ITS Academic Information System case study test for the Functional Suitability characteristic is 81.03.
The test results on the characteristics of Performance Efficiency get a total absolute value of 6.56.The weight of the Performance Efficiency characteristic is 0.07.If converted, the maximum value of the Performance Efficiency characteristic is 7.It can be concluded that the value of the ITS Academic Information System case study test and myITS Single Sign-on Performance Efficiency characteristic is 93.71.
The test results on the reliability characteristics get a total absolute value of 6.48.The reliability characteristic weight is 0.09.If converted, the maximum value of the Reliability characteristic is 9. So, it can be concluded that the value of the ITS Academic Information System case study test of Reliability characteristics is 72.00.
The minimum quality rating standard for web applications is 70 [6].So, it can be concluded that the ITS Academic Information System has met the quality standards on the characteristics of Functional Suitability, Performance Efficiency, and Reliability.