It sounds like there may be another router close by or, someone who uses a cordless phone, or a microwave oven - all of which can interfere with wifi signals.
One other question - in network preferences > show Airport, do you have interference robustness On , and do you have it set to connect...