Diagnostic Tools for Distributional Negative Binomial Regression: Residuals, Component Plots, and Model Comparison

Main Article Content

Mohieddine Rahmouni

Abstract

Distributional negative binomial (NB) regression lets both the conditional mean and the overdispersion parameter depend on covariates, but applied work still lacks a compact, model-based diagnostic workflow for this additional flexibility. We develop three complementary post-fit tools. First, randomized quantile residuals (RQRs) provide a single normal-scale check of the fitted count distribution and mean equation: with known parameters they are exactly standard normal under correct specification, while with estimated parameters they are best interpreted as approximate graphical diagnostics. In a targeted simulation, the RQR QQ plot detects omitted mean structure (\(\mathrm{KS}\;D=0.042\), \(p=0.002\) at \(n=2000\)) and returns to the reference line when the mean is correctly specified (\(\mathrm{KS}\;D=0.010\), \(p=0.988\)). Second, we introduce score-based component-plus-residual plots for the dispersion equation, allowing analysts to identify slope misfit, nonlinear effects, and stratum-level departures in the log-dispersion predictor. Third, we compare AIC, BIC, and likelihood-ratio checks for choosing among candidate dispersion specifications. In the simulation design considered here, BIC and likelihood-ratio checks perform best once \(n\geq300\); at \(n=1000\) both select the true dispersion specification in 99% of replications, whereas AIC selects an overfitted specification in 15%. An application to NMES1988 physician-visit counts illustrates the full workflow and shows why global RQR diagnostics should be combined with targeted checks of the dispersion equation.

Article Details

References

  1. A.C. Cameron, P.K. Trivedi, Regression Analysis of Count Data, Cambridge University Press, 2013. https://doi.org/10.1017/CBO9781139013567.
  2. J.M. Hilbe, Negative Binomial Regression, Cambridge University Press, 2011. https://doi.org/10.1017/CBO9780511973420.
  3. G.K. Smyth, Generalized Linear Models with Varying Dispersion, J. R. Stat. Soc. Ser. B Stat. Methodol. 51 (1989), 47–60. https://doi.org/10.1111/j.2517-6161.1989.tb01747.x.
  4. R.A. Rigby, D.M. Stasinopoulos, Generalized Additive Models for Location, Scale and Shape, J. R. Stat. Soc. Ser. C Appl. Stat. 54 (2005), 507–554. https://doi.org/10.1111/j.1467-9876.2005.00510.x.
  5. M.D. Stasinopoulos, R.A. Rigby, G.Z. Heller, V. Voudouris, F. De Bastiani, Flexible Regression and Smoothing: Using GAMLSS in R, Chapman and Hall/CRC, 2017. https://doi.org/10.1201/b21973.
  6. P. Deb, P.K. Trivedi, Demand for Medical Care by the Elderly: A Finite Mixture Approach, J. Appl. Econom. 12 (1997), 313–336. https://doi.org/10.1002/(sici)1099-1255(199705)12:3<313::aid-jae440>3.0.co;2-g.
  7. J.F. Lawless, Negative Binomial and Mixed Poisson Regression, Can. J. Stat. 15 (1987), 209–225. https://doi.org/10.2307/3314912.
  8. P.K. Dunn, G.K. Smyth, Randomized Quantile Residuals, J. Comput. Graph. Stat. 5 (1996), 236–244. https://doi.org/10.1080/10618600.1996.10474708.
  9. S.N. Wood, Generalized Additive Models: An Introduction with R, CRC Press, 2017. https://doi.org/10.1201/9781315370279.