I have this exact same noise. It happens every third or fourth time I press the brakes.
My car is currently in the shop for the 95,000 mile service (I bought it a couple years ago with 75,000 mile on it). I told them about the noise and asked them to look into it and check the break booster...