Assuming that a large majority of the population doesn't already have built-in / tcell immunity via cross-protection from other coronaviruses (potentially between 25-50%) + % of Population already infected - then yes those numbers would be concerning. I just highly doubt it given the trends around the world.
I'm specifically referring to the fatality rate though - cross-reactive T cell memory can reduce disease severity, such that fewer people would become severely ill or die from COVID-19. So, hoping for that + vaccine will really cut down numbers over the next year so that we can get back closer to normal.