Yes to both, the 1821 hurricane was known as the Norfolk and Long Island Hurricane, though how it maintained Cat 4 intensity to Cape May and Cat 3 intensity when it hit Manhattan, I have NO idea. If you look at the track, it looks a lot like Irene's (except slightly farther to the west-- which should mean even more land interaction!)
PreColumbine era yes-- there's also evidence of a high end supertsunami resulting from an asteroid impact (maybe the same one that formed Chesapeake Bay....which may have broken into two parts, the second of which landed just east of Toms River!)