Comparison of Optim, Nleqslv and MaxLik to Estimate Parameters in Some of Regression Models

Our main goal in this article is to present the approaches and examples of three functions in R consist of optim, nleqslv and maxLik function to detect the optimization solution of the estimating function in the regression models. We then compare the results with numerous sample sizes (n=150, 300 and 500), the execution time of R code, as well as Normal Q Q plots of three approaches through some of regression models such as the zeroin ated Binomial (ZIB) regression model, logistic regression model, the zero-in ated Poisson (ZIP) regression model and the zero-in ated Bernoulli (ZIBer) regression model. Finally, we discuss potential research directions in the coming times.