Modeling county level COVID-19 transmission in the greater St. Louis area: Challenges of uncertainty and identifiability when fitting mechanistic models to time-varying processes

We use a compartmental model with a time-varying transmission parameter to describe county level COVID-19 transmission in the greater St. Louis area of Missouri and investigate the challenges in fitting such a model to time-varying processes. We fit this model to synthetic and real confirmed case and hospital discharge data from May to December 2020 and calculate uncertainties in the resulting parameter estimates. We also explore non-identifiability within the estimated parameter set. We find that the death rate of infectious non-hospitalized individuals, the testing parameter and the initial number of exposed individuals are not identifiable based on an investigation of correlation coefficients between pairs of parameter estimates. We also explore how this non-identifiability ties back into uncertainties in the estimated parameters and find that it inflates uncertainty in the estimates of our time-varying transmission parameter. However, we do find that $R_0$ is not highly affected by non-identifiability of its constituent components and the uncertainties associated with the quantity are smaller than those of the estimated parameters. Parameter values estimated from data will always be associated with some uncertainty and our work highlights the importance of conducting these analyses when fitting such models to real data. Exploring identifiability and uncertainty is crucial in revealing how much we can trust the parameter estimates.