Comparative Study in Controlling Outliers and Multicollinearity Using Robust Performance Jackknife Ridge Regression Estimator Based on Generalized-M and Least Trimmed Square Estimator

Abstract

Regression analysis is one of the statistical methods used to determine the causal relationship between one or more explanatory variables to the affected variable. The problem that often occurs in regression analysis is that there are multicollonity and outliers. To deal with such problems can be solved using ridge regression analysis and robust regression. Ridge regression can solve the problem of multicollinearas by assigning a constant k to the matrix Z′Z. But in this method the resulting bias value is still high, so to overcome this problem, the jackknife ridge regression method is used. Meanwhile, to overcome outliers in the data using robust regression methods which have several estimation methods, two of which are the Generalized-M (GM) estimator and the Least Trimmed Square (LTS) estimator. The aim of the study is to solve the problem of multicollinearity and outliers simultaneously using robust jackknife ridge regression method with GM estimators and LTS estimators. The results showed that the robust ridge jackknife regression method with LTS estimator can control multicollinearity and outliers simultaneously better based on MSE, AIC and BIC values compared to the robust ridge jackknife regression method with GM estimators. This is indicated by the value MSE = -6.60371, AIC = 75.823 and BIC = 81.642 on LTS estimators that are of lower value than GM estimators.

Keywords

• outliers
• multicollinearity
• robust
• ridge regression
• jackknife ridge regression
• generalized-m estimator
• least trimmed square estimator