I've done it all.. noise sensitive and just plain don't like noise..
best tips as follows:
-speed controller.. but you will get a high pitch sound, but worth it over the raw noise
-duct mufflers.. very under-looked. not sure why but they work very very good. even one is better then nothing if you can't afford 2.
-box for the fan.. this can be anything from cardboard to wood with sound insulation. I've looked into finding a box for a fan, but never have come up with anything to just straight purchase to slip the fan into.. maybe someone knows though.. I couldn't find anything.
another tip is to size the fan correct, do not buy a bigger fan then needed. also fans are a big consumer of electric..
have fun in sorting out the noise issue..