What you can get away with for ISO settings totally depends on your camera. If you've got noise, it's set too high.
My camera is over a decade old and has horrible noise above ISO 200. New cameras supposedly maintain decent quality and go up to 1600 or even 3200.
Secret tip: Leave your camera outside. Excessive grain/noise issues can be caused by heat on your cameras sensor, so keeping it cold makes a big difference. You can really see this in action if you look at dendrites webcam in the winter vs summer.