High speed optical modulation of THz radiation is of interest for information processing and communications applications. In this paper infrared femtosecond pulses are used to generate free carriers that reduce the THz transmission of silicon based waveguides over a broad spectral range. Up to 96 6 70 modulation is observed from 0.5 to 7 THz in an optical fiber with a 210 mu m diameter gold-doped silicon core. The observed carrier recombination time of 2.0 +/- 0.2 ns makes this material suitable for high speed all-optical signal processing. These results show both enhanced modulation depth and reduced carrier lifetime when compared to the performance of a high resistivity float zone silicon rectangular guide with comparable cross sectional area.