Application of Moderated Remote Usability Testing Method on Agrovest Website

This article is intended to improve the user experience on the Agrovest website, with the aim that users continue to use the site and website developers do not miss out on revenue opportunities from existing sources. Agrovest is a platform that provides information about agriculture, from plant types to fertilization. The site comes with various features, such as information about crops and fertilizers, fertilizer calculators, as well as chat rooms. The method used in this study is moderated remote usability testing which is one method of usability testing. The results of the research study revealed that (1) there were 16 findings, consisting of two positive findings, eight neutral findings and six negative findings on Agrovest features (2) the need to improve the Agrovest website to improve user experience. This study also provides recommendations for improving the Agrovest website based on the results of moderated remote usability testing conducted on five participants.


INTRODUCTION
The definition of usability is a measure used to determine how effectively users can access the functionality of a system.Usability serves as a quality measure of the user experience when interacting with a product or system, whether it is a website, software application, mobile technology, or other user-operated devices (Nielsen, 2012).Usability is defined as the ability of users to use a product to successfully perform specific tasks accurately and quickly, and it is considered an important concept for evaluating system adoption, where satisfaction plays the most crucial role (A. Generosi,2022).Usability testing is actually more about the method used to assess the user experience of existing products (Nathaniel, 2023).There are ten techniques in the usability testing method that can be used to conduct usability testing evaluations, including: Thinking-Aloud Protocol, Shadowing Method, Co-Discovery Learning, Coaching Method, Question-Asking Protocol, Teaching Method, Retrospective Testing, Performance Measurement, Remote Testing, and Eye Tracking (Wedayanti, 2019).
Based on the testing location, usability testing can also be conducted in two ways: inperson usability testing and remote usability testing (Moran, 2019).Remote usability testing is divided into two types: moderated and unmoderated usability testing.In this study, moderated usability testing is used as the usability evaluation method, where test evaluators are separated in space and/or time from the test subjects and accompanied by a moderator.Remote usability testing has several advantages over laboratory testing.One of them is cost savings, which include reduced travel costs for test participants, laboratory room rental costs, and the ability to access a larger sample size.In other words, through remote testing, it is possible to reduce the costs usually associated with testing in a laboratory environment (Alhadreti, 2022).Moderated remote usability testing involves a remote meeting between the researcher and the participants in a virtual space (KhayyatKhoshnevis, 2022).The process of evaluating UX using moderated remote usability testing shows significant difference in user completionrates.
Websites are information services capable of handling requests from many users effectively (Yumarlin, dkk., 2016).It contains interconnected topics, sometimes accompanied by files such as images, videos, or other documents (Ulum, 2018).In the current digital era, the need for easily accessible and efficient information is increasing.Therefore, a website should be designed in such a way that it can handle high user traffic without experiencing performance degradation.Every website is also expected to provide the necessary information to users so that they can access data quickly and stay updated (Hartawan, 2019).Features on a website should ideally be designed and equipped while considering user needs.This aims to facilitate users in accessing information, accelerate the data search process, and ensure the accuracy of the information received (Wahyudin,2020).
Agrovest is one of the agricultural websites that assists users in obtaining information about crops and fertilizers more easily and making accurate fertilizer measurements through the fertilizer calculator feature available on the website.As a widely used service by users, Agrovest should be able to interact with consumers.To create a good product or service, it is crucial to ensure that the product and service provide a good user experience (Schrepp, dkk., 2014).A website should have a user interface that captures Lutfi Riani, Asa Yuaziva, Muhammad Rafi' Rusafni, Amata Fami, Irma Rasita Gloria  attention without disturbing the user's vision and meets users' desires.User experience represents the interaction that occurs between users and the product, service, and company providing the product (Norman, 2016).Therefore, Agrovest needs to conduct user experience evaluation on the usability of the website to determine the extent of the quality of the site's appearance and functionality.This evaluation is crucial so that users can interact with the Agrovest website easily and effectively, and user experience can be enhanced.
In a previous study conducted by (Sulistiya, 2021), which discussed the application of the Think Aloud method for usability evaluation on the website of the Education and Culture Office of City MNO, it was noted that providing seven task scenarios to eight respondents resulted in failures in completing task scenarios 2 and 3.This was because the respondents still felt unfamiliar with the features provided by the website of the Education and Culture Office of City MNO.Furthermore, (Fitriana, 2023) and (Iftadi, 2023) conducted research on the UNS Academic Information System (SIAKAD UNS) using the same method, namely questionnaires.They explained that the results of the user experience analysis recommendations led to the redesign of SIAKAD UNS.Additionally, (Dewa, 2023) revealed through remote usability testing method in his research that the design results of the RECALL website have an optimal user experience design and meet user needs.However, in this study, Moderated Remote Usability Testing method will be used by combining remote usability method with the presence of a moderator to encourage participants to think aloud.
Based on the background of the research above, the aim of this study is to enhance user experience to make interaction with the Agrovest website easier and more effective.Through the results of moderated remote usability testing analysis, recommendations can also be provided for addressing all forms of user complaints for a better user experience.

METHODS
This research employs the Moderated Usability Testing method achieved through nonexperimental analysis studies.Objects that have undergone intervention will be analyzed for their negative findings (Ranjit, 2011).Usability testing is defined as "the ability to recall how to perform interactive tasks without difficulty or errors" (Febriyanti, 2024).The modification in this method compared to previous research is that the results of usability testing are not compared with other methods but are used to follow up on improving user experience based on the results of usability testing.To address this situation, remote usability testing is used, where the evaluator and user are separated in space and/or time (Castillo et al., 1998).
The number of findings from usability testing obtained from this intervention is analyzed to make improvements to the Agrovest website.To achieve this goal, which is to compare the number of negative findings from usability testing between remote moderated usability testing alone and with additional interviews (Kelana, et al., 2023).
The steps to achieve the goal are divided into four steps.First, the design stage, which aims to prepare the sequence of Usability testing processes along with the tools that will be used in the implementation stage.Second, the implementation stage, which aims to implement the Usability testing process, namely the Remote Moderated Usability Testing method.With this method, testing is conducted by five participants using the Zoom Meeting communication tool.The participants are students of the Vocational School of IPB University in the Software Engineering Technology program, 59th generation.
Next, all data in the form of video recordings that have been monitored by the moderator are processed into documents (Ramli, et al., 2009).Subsequently, sentiment analysis is conducted on the documents to identify findings in three sentiment categories, which are positive, neutral, and negative sentiments.The number of findings obtained through the Remote Moderated Usability Testing method is then analyzed to identify which features require further action for improvement based on the usability testing results.The results of the analysis, namely negative findings, will be followed up in this research.Finally, improvement recommendations will be generated based on the results of this study's analysis.

RESULT AND DISCUSSION
The first stage is the design stage.In this stage, two steps are undertaken: creating task scenarios and conducting pilot testing.Task scenarios refer to the description of situations or tasks that will be given to participants on the Agrovest website.Table 1 shows the results of the task scenarios that have been created.The third stage is Analysis.The results from the Zoom recording by the five participants are observed by reviewing them and then transcribed verbatim for analysis.Table 3 shows the findings from the moderated remote usability testing process.The overall design of the website is good.

M.Adzka Fertilizer Calculator
Overall, it's good, but the fertilizer calculator part should be improved.
The appearance of the main page is good.

News
The navigation displayed in this feature is fairly easy .4 Jovanca Blessery

All
Navigation is pretty good.

Fertilizer gallery
The layout is easy to understand and simple. 5  Anggito Bagas

All features
There are no discernible differences in design or user experience between different features. 6  .P-ISSN 0852-1190 E-ISSN 2502-0781

Fertilizer calculator
The calculator is still difficult to use because there is no guide at the start.No guidance was given regarding how to use it so I was confused.Chat Room Cannot edit chats, delete and reply to chats from other people.
Nice and simple layout.
Limited interaction where you cannot send pictures, videos and videos. 3 Aisya Tyanafisya

All features
The website is responsive. 7  An attractive appearance adds plus value to this website because it complies with ESQ. 2 Fertilizer calculator Has limitations in terms of plant types or soil conditions that can be calculated. 4  In terms of appearance, the design is good.
The output results do not differ in color. 5 Instructions on how to use the calculator are not explained.
Chat Room Some fonts have inconsistent colors. 6  The scenario stage was executed without problems. 8There are no edit, reply and delete chat features.
Based on the results of the usability testing process conducted on the Agrovest website using the remote moderated usability testing method, a total of 16 findings were identified.Almost all of the findings were related to design issues on the Agrovest website.From these findings, it can be identified that two of them are categorized as positive findings, indicating that there are aspects of the website that function well and meet the Emotional Spiritual Quotient (ESQ) of users.Eight other findings are classified as neutral findings, indicating areas where the website can be improved without urgent needs.Meanwhile, six negative findings highlight issues that need to be addressed or Lutfi Riani, Asa Yuaziva, Muhammad Rafi' Rusafni, Amata Fami, Irma Rasita Gloria  fixed promptly to enhance the user experience.In practice, many websites still face various obstacles that make them less attractive to users, resulting in them not being able to operate optimally (Pangastuti, 2019).
Based on the findings from moderated usability testing, user experience plays a key role in providing valuable insights.User experience (UX) is one of the concepts of Human-Computer Interaction, and the term UX was introduced by Donald Norman in the 1990s (Al-Kkhairi, 2022).In the implementation stage, improvements made based on these findings can encompass various aspects, starting from enhancing features that received many negative feedback from users, then proceeding to neutral findings.It is hoped that the design solutions resulting from the testing can address issues and meet the needs of Agrovest website users (Aulia, 2020).
Improving user experience based on the findings of moderated usability testing conducted during the implementation stage involves several fixes that need to be addressed promptly, namely in the Fertilizer Calculator and Chat Room features.Because in both features, users encountered many negative findings that hindered them from using the Agrovest website.Figure 1 shows the display before the improvement, and Figure 2 shows the display after the improvement in the Agrovest website's Fertilizer Calculator feature.

CONCLUSION
This research is to improve the user experience of the Agrovest website as a source of information about agriculture.The Agrovest website is a form of modernization and digitalization of agriculture.This research applies a moderated usability testing method which is used to improve user experience.The moderated usability testing method that has been carried out on users shows that negative findings were found on several features of the Agrovest website.This shows that there is a need for improvement in several parts which are often found with negative results.In this way, it is hoped that this research can help improve a better user experience on the Agrovest website.
From the contributions that have been made, this research has limitations which create opportunities for further research.One of these limitations can be seen in the number of participants who carried out moderated usability testing, namely five people.It is hoped that in future research the number of participants will be greater so that the user experience results can be much more effective and accurate in improving the user experience of the Agrovest website than in the current research.Apart from that, a comparison of the moderated remote usability testing method can be carried out using two methods to see the effectiveness of this method, namely through think aloud and interviews.So that the results of the user experience level can be seen in more detail.What users complain about on the website can be immediately corrected and a more effective solution can be found.

Figure 3 .
Figure 3. Chat Room display Figure 4. Chat Room Improvements

Table 3 .
Moderated Remote Usability Testing Findings