Mid-infrared (MIR) fiber pulsed lasers are of tremendous application interest in eye-safe LIDAR, spectroscopy, chemical detection and medicine. So far, these MIR lasers largely required bulk optical elements, complex free-space light alignment and large footprint, precluding compact all-fiber structure. Here, we proposed and demonstrated an all-fiberized structured gain-switched Ho³⁺-doped ZBLAN fiber laser operating around 2.9 μm. A home-made 1146 nm Raman fiber pulsed laser was utilized to pump highly concentrated single-cladding Ho³⁺-doped ZBLAN fiber with different lengths of 2 m or 0.25 m. A home-made MIR fiber mirror and a perpendicular-polished ZBLAN fiber end construct the all-fiberized MIR cavity. Stable gain-switched multiple states with a sub-pulse number tuned from 1 to 8 were observed. The effects of gain fiber length, pump power, pump repetition rate and output coupling ratio on performance of gain-switched pulses were further investigated in detail. The shortest pulse duration of 283 ns was attained with 10 kHz repetition rate. The pulsed laser, centered at 2.92 μm, had a maximum average output power of 54.2 mW and a slope efficiency of 10.12%. It is, to the best of our knowledge, the first time to demonstrate a mid-infrared gain-switched Ho³⁺:ZBLAN fiber laser with compact all-fiber structure.