Evaluation of Implementation E-Government with Delone and Mclean

This research intends to analyze and test variables that influence implementation E-government, especially in Balikpapan city. The study uses the information system success model DeLone and McLean which has six main variables that can be used to measure the success rate of information systems. Variables that support the success of e-government that support this research include system quality and information quality as exogenous variables. Furthermore, the use and user satisfaction variables are endogenous variables that also affect the net benefits variable. Based on previous research, service quality variables have not been proven to affect endogenous variables, so the researchers omit these variables. Data collection is done by distributing questionnaires to users of e-government services in Balikpapan City as many as 100 respondents. Data processing methods with Structural Equation Modeling (SEM) using the Smart PLS 3.0 approach. This research proves the R-square value of the dependent variable user satisfaction is 62%, and the net benefit variable is 59.1%, which means that the dependent variable can be explained through independent variables in this research model. Based on the findings in the study, it shows that the quality of the system has an effect on user satisfaction but has no impact on use.


I. INTRODUCTION
Information Technology currently plays an essential role in e-government development efforts in the fulfillment of public services by using new methods that are more efficient and can prioritize the quality of the service itself. E-government as a whole becomes a platform for government management innovation, and the community becomes an alternative to get optimal public services. E-government is considered as the primary tool to facilitate citizens' access to various services, but the main challenge facing developing countries implementing Egovernment is the low level of service acceptance to the public [1]. The current condition of Balikpapan City's e-government is in the development phase of technology-based service innovations so as to improve the efficiency of bureaucratic performance. One-stop integrated service access implemented by the Balikpapan City Government through the Balikpapan.go.id website can help the community to find information about city government services. Existing services are divided into two main categories with each sub-service in it, the first is licensing services and the second is population services. SKPD services can be accessed using the web through the leading portal, although not all facilities are available and are only to direct each website to each department. The majority of web-based systems that are currently available are at the level of interaction using e-mail, whereas with the election of Balikpapan City to be one of 100 Smart Cities in Indonesia in 2019, it is time to improve services to the transaction stage.
The results of the study show that the challenge of developing industrial cities, especially the oil industry such as Balikpapan, is to anticipate changes in the era of the oil industry, which currently does not provide much benefit in terms of economic growth in society [2]. One form of anticipation that can be done is to transform public policies and regulations, where it can be realized into technology-based public services. If the transformation of public services is done in the right way, it will automatically increase public satisfaction as service users and encourage business investment through the creation of electronic transactions, such as e-procurement, where activities such as tenders, product catalogs, auctions and purchases are entirely based on automated systems. Currently, the City of Balikpapan has utilized e-government services both government-to-citizen and government-to-business, but the main problem is that there has never been a measurement of implementation evaluation that is able to investigate the success factors of e-government. This such evaluation is vital to know the real conditions and final expectations to be achieved so that if there is a gap, solutions and strategies can be easily found [3].
Balikpapan City Government will never know that e-government currently has run effectively before empirically carried out measurements using the right model. Based on the results of a brief observation, the services that are available up to this research can be said to still be web-based Based on the general problems above, if Balikpapan City Government is not severe in formulating the right strategy or policy, the final achievement of the implementation of the smart city will be increasingly difficult to realize. Ideally, the improvement strategy should also adjust from the results of a measurement of satisfaction level or based on factors that cause success and failure. Until now, many people have not utilized the IT-based services provided by the City Government of Balikpapan, even some people do not know about the existence of e-government services. Measurement by means of evaluation using an appropriate model has never been carried out on the implementation of e-government from the user side, so it is difficult to determine the initial strategic steps that need to be taken by Balikpapan City Government.
The success model of benefits. This model provides six variables that can help an organization or company implement an information system properly according to the expected end goal. This method of evaluation and use of models has proven conclusively in improving e-government services and local community democracy. Evaluation is done thoroughly about system suitability, system reliability, system security, system accuracy and expectations of users so that the system can continue to be used. This model is also able to provide an overview of the implementation of SI from the analysis result of the factors that influencing and inhibiting the success of the system. Several studies used the success method of SI Delone and Mclean [5] to test the success of online public grievance redressal systems (OPGRS) in India, evaluated virtual education systems at one of the Universities in Iran with LISREL analysis [6], measuring e-government success od Pekalongan [7] and assessing the Indian Government UDISE by comparing studies between the success models of the original SI D&M contained in Figure 1 and the updated model [8].  This research expects to analyze the factors that influence the success of e-government in Balikpapan and at the same time, become a recommendation for improvement, especially for services that are not felt to have a significant influence on society.

II. RESEARCH METHOD
The flow in this study begins by identifying the existing problems. Then proceed with the review of literature related to methods for solving problems and previous studies that have been done. The next step is to formulate a model and hypothesis, followed by compiling a questionnaire instrument that represents the constructor research variable. To prove the validity and reliability of all devices or research variables were tested by distributing questionnaires to respondents. The data is then tested using smart PLS software version 3 if the resulting value is under the rules or test parameters, the instrument is rearranged and the instrument under the parameter is removed. The next stage is to analyze data based on structural models to find out the significant level of constructs. The last step is to formulate conclusions based on the results of analysis and hypothesis testing. The following is the flow of research as shown in Figure 2.  In this study, researcher modified the D&M model by using the use variable as the observed variable because some researchers [9], [10], [11] used the use variable as an outcome after going through a series of input variables that affected the result (one of the rejects the measure is use), while Delone and McLean [4] argued that this is because the measurement of using variables is not enough just to be measured by the amount of the system time using. So that a conclusion can be drawn that the use is measured through the feelings and attitudes of all the combined benefits a person receives from interacting with SI. In this condition, the variables that influence the success of information systems are the quality of information as the output of the system and the quality of the system itself. User satisfaction will ultimately have an impact on net benefits, so the framework is as follows: H3: The quality of the system will positively impact usage H4: The quality of the system will positively affect user satisfaction H5: Usage will positively affect net benefits H6: User satisfaction will positively affect net benefits H7: User satisfaction will positively influence usage

A. Research Type
This study is conclusive (causal) to investigate the effect of system quality and information quality for user satisfaction on e-government websites and their impact on net benefits for measuring e-government success with a public value approach.

B. Research Variables
Information quality can be interpreted as system output characteristics, such as content, reports and dashboards. There are six scales of measuring information quality, including completeness, precision, reliability, updated-data (currency), and the form of output (format of production) and relevance [5]. Previous studies have shown that information quality influences user usage and satisfaction [11], [12].
System Quality. As a measure of success, the quality of the system considers the technical aspects of the system, including access convenience, system functionality, reliability, response time, sophistication, ease of navigation, and flexibility. This variable is used to measure the desired characteristics of the system [13]. Previous studies have shown that system quality has an influence on user satisfaction [11], [14].
Use. As mentioned above that use is not measured by a questionnaire. The variables about these dimensions are all taken from secondary data. It was stated that there are various ways and actions that were tried to capture the use of SI; it has the potential to cause mixed results between use and other construction in the D&M model.
User satisfaction is the individual's perception of the level of satisfaction with the system against the initial expectations of individuals using the system. Previous studies have shown that user satisfaction has an influence on usage [13], [15].
Net Benefits. Scott et al. [16] proposed a unique and essential adaptation of the information system success model [4] for the government context.

C. Questionnaire Compilation
The questionnaire used in this study serves as a tool to get primary data. The research questionnaire was arranged based on the indicators that make up the research variables in the form of closed questions. Questions of the dimensions of system success adopt the information system success model DeLone and McLean [4]. Whereas issues of e-government success adopt a public value approach to net benefits proposed by Scott [16]. Full research indicators can be seen in Table 1.

Validity test
A validity test is used to determine the validity of the measurement instruments used in research. Testing is done by correlating item scores with total scores. Convergent validity is related to the principle that the meters of a construct should be highly correlated [17].
Convergent validity tests on reflective indicators can be seen from the loading factor value for each construct indicator [18]. The rule of thumb of convergent validity parameters can be seen in Table 2. An indicator of questions will be considered valid if it has a correlation value above 0.70 [18].
But for loading values, 0.50 to 0.60 can be accepted by looking at the output correlation between the latent variable and the indicator questions. In this study, the values above are 0.60.

Reliability Test
The reliability test is used to test the consistency of the measuring instrument against the symptoms measured at different times with the same symptoms. Reliability testing can be done with Cronbach's alpha test and composite reliability. In this study, the reliability testing method will use the composite reliability test to ensure the instrument is free from random errors, as did previous researchers [19], [13]. The practical rule of the reliability test parameters can be seen in Table 3. Evaluation of structural models aims to predict relationships between variables. structural models are used to test causality (hypothesis testing). In PLS, the structural model of the study was evaluated using R 2 (R-square) for the dependent variable, the path coefficient, or t-values for each path for testing the significance of the constructs [17]. The higher the R-square value means the better the predictive power of the proposed research model. The R-square amount produced by PLS shows the number of variants of the construct explained by the research model [18].

A. Data Analysis
The questionnaire was distributed to 100 respondents consisting of 6 city districts in   where this is the ideal number recommended at least 10 times the amount of independent variables [17]. This research itself consists of 5 variables, namely 2 independent variables and 3 dependent variables. The characteristics of respondents consisted of 60% men and 40% women.
Based on the percentage of age at most age <20 years amount 56%, ages 21-30 years amount 36%, 31-40 years amount 5%, and the remaining ages 41-50 years amount 2%. Based on the level of education at most D3 amounts, 47%, SMA / SMK amount 31%, D4 / S1 amount 20%, and S2 amount 2%. According to the characteristics of the respondents' domiciles in this study, most of the districts are North Balikpapan 46%, West Balikpapan 13%, South Balikpapan 12%, East Balikpapan 11%, Balikpapan City 10% and Central Balikpapan 8%. At the characteristics of respondents as in Table 4, according to the level of education, it can be said that respondents who filled out the questionnaire had the ability to use internet-based information technology so that the data used in this study was feasible to use.

C. Convergent Validity Test
Validity tests intended to determine the suitability and adequacy of the questions raised in the questionnaire to be the basis for research. In this study, the loading factor threshold value used was 0.60. If the loading factor of the indicator is more than 0.60, then the indicator is declared valid. Table 5. shows the loading factor value of each indicator.

Table 5. LOADING FACTOR CALCULATION
The next convergent validity test is to examine the AVE and the communality value of the constructs that compose the research model. Table 6. shows that the AVE value and communality of all constructs are more significant than 0.50 so that all constructs are declared to meet the requirements of convergent validity.   In Table 7., the value of cross-loading correlations between constructs and their indicators is higher than the correlation values between indicators and other constructs. This is in accordance with the principle of discriminant validity so that all indicators are declared to meet the discriminant validity requirements in cross-loadings testing.

E. Reliability Test
This study uses composite reliability with a minimum value of 0.60 because it is an exploratory study. In Table 8., it shows that all variables produce composite reliability values > 0.60 so that it can be concluded that all indicators of this research variable meet the reliability test

IV. CONCLUSSION
Based on the research conducted, the results prove that from a total of 7 hypotheses, 4 hypotheses have a positive impact, and 3 hypotheses do not have a positive effect, the quality of the system has an influence on user satisfaction but does not have a control on usage. It can be concluded that e-government website users do not feel the quality of the system because the services contained in the system are not implemented optimally. Next is user satisfaction has an effect. There are net benefits but use does not have an impact on net benefits, which can be concluded that it takes ease in using the system so that users can quickly adapt and want to use it again. Based on the conclusions, the researcher suggests implementing the City of Balikpapan e-government development to add service features to the transactional stage so as to increase user interest in utilizing integrated services through the website. Subsequent research needs to be done by adding independent variables outside the research model so that specifically, it is able to increase the use of the system.

AKNOWLEGMENT
The researcher would like to thank the Kemenristekdikti for funding this research through the Beginner Lecturer DRPM research scheme 2019. Furthermore, thanks also to the Research and Service Center of the Balikpapan State Polytechnic Community for providing the opportunity to the researcher to participate in the selection of proposals so that this research can be carried out with well.