Evaluation of User Experience on Digital Learning Platform Website Using System Usability Scale (Case Study: Pijar Mahir)

User experience is one of the most important factors of an application. Pijar Mahir is a digital learning platform to increase job seekers skill. This research evaluates usability of pijarmahir’s website using system usability scale (SUS). SUS consists of ten statements as an evaluation instrument. Based on the results of SUS evaluation of the 101 respondents, Pijar Mahir’s website has an average SUS score of 72,67. Based on the result, 72,67 is in an “acceptable” category.


Introduction
Unemployment is a problem that is often experienced by developing countries, including Indonesia. Unemployment is the main concern that every government in the world wants to solve, especially Indonesia. Unemployment is a state where someone who is in the workforce, who wants to find / getting a job but not getting a job (Sukirno, 1994). Unemployment has various adverse effects for the country, such as: a decrease in per capita income, a deep social gap of society, the swelling of social costs that must be borne by the government, instability of social and political conditions, and increasing the country's debt (Hasanah, 2016). Various efforts have been made by the Indonesian government to solve existing unemployment and employment problems. In Indonesia itself, the unemployment rate has started to decrease, although not yet reduced significantly, but the government continues to try to keep the pace of unemployment rates to decrease in Indonesia. It can be seen from fig. 1.1, the unemployment rate of Indonesia has steadily decrease in the past few years. The decrease from the unemployment rate cannot be separated from the work of the Indonesian government.
Recently, the government of Indonesia has focused on reducing the unemployment rate through increasing the competence of workers in the country. The government has made a program in developing work competences and entrepreneurship of Indonesian, through Kartu Prakerja. Kartu Prakerja is a program released by the government for develop the competences of job seekers and everybody that has affected by workers termination of employment rights.
Kartu Prakerja distributes their module online, so that everyone can access the contents provided easier. Kartu Prakerja held several partnership with digital learning platform such as: Pijar Mahir, Ruang Guru, Skill Academy, etc. This program is a form of partnership between the government and the private sector in developing better human resources. Pijar Mahir is a digital learning platform and certification that provides easy access for community in increasing their expertise and competence with current and future needs of the Industry. One of the most important things that must be considered by Pijar Mahir is user experience when using / interacting with a product, where it is subjective because it comes from perceptions and thoughts from each individual, based on how they feel. User Experience (UX) is the response and perception of each user that is caused by the use of a product or service. UX represents how user satisfaction and pleasure while using, see,and feel a product / service (International Organization for Standardization, 2010). One of the goals of creating a website is to provide good experience to its users, by presenting good informations effectively and easy to understand. To measure the level of ease with which users interaction with Pijar Mahir website, can be measured by the System Usability Scale (SUS). System Usability Scale is a questionnaire used to measure perception of usability. The purpose of this research is to evaluates user experience of Pijar Mahir's website.

Methodology 2.1. Research Object
Object for this evaluation is Pijar Mahir's website. Pijar Mahir's website can be accessed through "pijarmahir.id". opening up the website for the first time will show the website's home screen. In the home screen, as shown on fig. 2.1, there are banner, search field, course lists, wishlists, chart, accound and notification. In this website people can search through courses that they want to learn and buy it. All the proccess from searching courses to payment are accesed online.

Sample and Population
Population is a generalization of one area that has been determined by researchers to choose the samples which consist of objects / subjects which has certain characteristics and qualities (Sugiyono, 2018). Because the purpose of this website is to increasing competenses for job seekers and unemployment, then the populations for this research are residents of DKI Jakarta whose registered as job seekers. As shown on the fig. 2.2 total population of this research is 30.338.

Fig. 2.2. Job seekers in DKI Jakarta
And to determine the sample required in this research, the author will use Slovin formula. Slovin formula is a formula for calculating the minimum sample size if the behavior of the exact population is unknown. The slovin formula is commonly used in survey research where usually the number of samples is very large, so need a formula to get a small sample but also can represent the entire population. The sample for this research can be calculated as: where n is sample required, N is population, and e is error margin. The population for this research is 30.338, and for the error margin is 10%. So the sample required for this research is 99,67 and will be rounded to 100 person.

Methodology
Based on the fig. 2.2, this research will start from define the respondent scenario, what will they do regarding to evalute Pijar Mahir's website. Define the method to know how much the respondents needed and how to collect the data. After that, analyze the data gained from respondent. Last, researcher will give recomendation according to respondent's insights.

Fig. 2.2. Stages of research
This research uses qualitative method to gain deeper insight in what user feels about the website. The evaluation methodology for this research is system usability scale. System usability scale is a questionnaire to measure the perceived usefulness created by John Brooke in 1986. System Usability Scale (SUS) contains 10 questions where participants are given a choice of scale 1-5 to answer based on how much they agree with each of the statements given, against the products or features that will be tested. A value of 1 means strongly disagree and 5 means strongly agree with the statement given (Alathas, 2018). These are the list of the system usability scale statetements: 1. I think that I would like to use this website frequently. 2. I found the website unnecessarily complex. 3. I thought the website was easy to use. 4. I think that I would need the support of a technical person to be able to use this website. 5. I found the various functions in this website were well integrated. 6. I thought there was too much inconsistency in this website. 7. I would imagine that most people would learn to use this website very quickly. 8. I found the website very cumbersome to use. 9. I felt very confident using the website. 10. I needed to learn a lot of things before I could get going with this website.
System usability scale has its own way to calculate, these are the rules on how to calculate the system usability scale results: 1. For every odd numbered question, the questionnaire score will be reduced by 1 (X-1). 2. For every even numbered question, the questionnaire score will be reduced from 5 (5-X).
3. Sum all the even and odd numbered question. 4. Multiply the sum result with 2,5. 5. Calculate the average of SUS score based on the multiply result.
For the last proccess of evaluating using system usability scale is to determine the category of average SUS score. After researcher get the average SUS score calculated, then determine the score to know the system is in an acceptable category or not. To find out the SUS value that falls into the acceptable category, Aaron Bangor, Philip T. Kortum, and James T. Miller suggested that the system is said to be feasible, if it has an SUS score of at least 70. Then for the system can be categorized as good, has a SUS score of the 70s to 80s. And for the system which is in the very good category, has an SUS score above 90. And for the system those with a SUS score below 70 can be considered as a system that must be put under supervision for further development (Bangor et al., 2008).

Questionnaire Score from Each Number
The system usability scale questionnaire consists of 10 questions on a scale of 1-5. Where the numbers represent whether the respondent agrees or not based on the statement given. The smaller the value means the respondent strongly disagrees and the larger value, meaning that the respondent strongly agrees with the statement given. The following are the results of the questionnaire for the system usability scale question: 1. I think that I would like to use this website frequently.  3. I thought the website was easy to use. 4. I think that I would need the support of a technical person to be able to use this website.     Research Article Vol.12 No.6 (2021), [1595][1596][1597][1598][1599][1600][1601][1602][1603][1604][1605][1606] Following are the respondents' answers to question number 8 from a total of 101 respondents. A total of 25 respondents chose 1, 39 respondents chose 2, 17 respondents chose 3, 14 respondents chose 4, and 6 respondents chose 5. 9. I felt very confident using the website. Following are the respondents' answers to question number 9 from a total of 101 respondents. A total of 2 respondents chose 1, 3 respondents chose 2, 9 respondents chose 3, 31 respondents chose 4, and 56 respondents chose 5.
10. I needed to learn a lot of things before I could get going with this website.

SUS Score
To perform calculations on the system usability scale, it is necessary to see the results of the questionnaire from each respondent. Each respondent filled out a questionnaire totaling 10 numbers on a scale of 1-5. The following is the result of the recapitulation SUS questionnaire based on the answers of each respondent: __________________________________________________________________________________________ 1604

Interpreting Scores
To get the final value of system usability scale, several calculations are needed. The SUS value of odd questions minus 1(X-1) and for the SUS scores of even questions, the questionnaire scores were reduced the value by 5 (5-X). The rules applied to every respondent, so in order to get the final value from SUS, required calculations from all of the respondents that followed this research. The following is a table of the end results of SUS calculation. Research Article Vol.12 No.6 (2021), [1595][1596][1597][1598][1599][1600][1601][1602][1603][1604][1605][1606] To get the average SUS score from the system usability scale, it is necessary to add the values of questions number 1 to 10 of each respondent, then multiplied by 2.5 (Total score x 2.5). After all of the respondents score have been calculated, then the total score of each respondent is added and divided by the total number of respondents. From the table above, it is found that the total score is 7340, then that score will be divided by the total number of respondents (7340/101). Found the mean value of SUS in this research is 72,67.

System usability scale assessment
After getting the results of the questionnaire, researcher did the calculations according to the system usability scale method. And then found that the average SUS score in this research is 72,67. And then assess the SUS score using SUS score scale from Bangor. The following is an assessment of SUS according to Bangor To find out the SUS value that falls into the acceptable category, Bangor argues that the system can be said to be feasible, if it has an average SUS score atleast 70. Then for systems that can be categorized as good, have an average SUS score from the 70s to 80s. And for a system that falls into the very good category, has an average SUS score above 90. And for systems that have an average SUS score below 70 can be considered as a system that should be put under surveillance for further development (Bangor et al., 2008). In this research, the average SUS score value obtained was 72.67. So that the SUS value from website Pijar Mahir is in the category of acceptable. Based on the result, can be concluded that this website can be used normally without any major problem.

Conclusion
Based on the evaluation of the Pijar Mahir's website research that has been done, the author can conclude: • There is no previous research / publication on the Pijar Mahir's website, especially in the user experience.
So it is expected that through this research it can be useful for both the Pijar Mahir's website development team, and as well as people who are willing to research the Pijar Mahir's website . And this research can be continued either by reusing this study or by using a different approach of research model to cover more finding in the usability aspect. • After evaluating the Pijar Mahir's website, it can be concluded that this website has been in the acceptable category with a SUS score of 72.67. So this website is expected can be used for the all people without any major problems.