We investigate the generation of ultrabroadband femtosecond ultraviolet (UV) radiation via third-order harmonic generation in highly confined gas media. A dual-stage differential-pumping scheme integrated into a glass microfluidic chip provides an exceptional gas confinement up to several bar and allows the apparatus to be operated under high-vacuum environment. UV pulses are generated both in argon and neon with up to ∼0.8 μJ energy and 0.2% conversion efficiency for spectra that cover the UVB and UVC regions between 200 and 325 nm. Numerical simulations based on the unidirectional pulse propagation equation reveal that ionization plays a critical role for extending the spectral bandwidth of the generated third-harmonic pulse beyond the tripled 800 nm driving laser pulse bandwidth. By delivering UV supercontinua supporting Fourier transform limits below 2 fs, as well as comparable pulse energies with respect to capillary-based techniques that typically provide high spectral tunability but produce narrower bandwidths, our compact device makes a step forward towards the production and application of sub-fs UV pulses for the investigation of electron dynamics in neutral molecules.