Kv3 channels have distinctive gating kinetics tailored for rapid repolarization in fast-spiking neurons. Malfunction of this process due to genetic variants in the KCNC1 gene causes severe epileptic disorders, yet the structural determinants for the unusual gating properties remain elusive. Here, we present cryo-electron microscopy structures of the human Kv3.1a channel, revealing a unique arrangement of the cytoplasmic tetramerization domain T1 which facilitates interactions with C-terminal axonal targeting motif and key components of the gating machinery. Additional interactions between S1/S2 linker and turret domain strengthen the interface between voltage sensor and pore domain. Supported by molecular dynamics simulations, electrophysiological and mutational analyses, we identify several residues in the S4/S5 linker which influence the gating kinetics and an electrostatic interaction between acidic residues in alpha 6 of T1 and R449 in the pore-flanking S6T helices. These findings provide insights into gating control and disease mechanisms and may guide strategies for the design of pharmaceutical drugs targeting Kv3 channels. Here, Chi et al. report cryo-EM structures of the human Kv3.1a channel, revealing a unique arrangement of the cytoplasmic T1 domain, which allows the interactions with the C-terminal axonal targeting motif and key components of the gating machinery. These findings provide insights into the functional relevance of previously unknown interdomain interactions in Kv3 channels and may guide the design of new pharmaceutical drugs.