Carbon molecular sieve (CMS) hollow fiber membranes (HFMs) are very promising for efficient gas separation. However, their gas separation performance was hindered by the thick selective skin layer. In this work, defect-free CMS HFMs with a very thin selective layer (about 1.5 mu m) were prepared successfully by the pristine porous fiber precursors. Furthermore, the porous fibers were thermally pretreated in different conditions (vacuum, N2 and air) near T g of the polyimide to stabilize the structure of the HFM precursors, and the CMS membranes derived from the pretreated porous fibers exhibited attractive enhanced gas separation properties. As a result, the CMS membranes which derived from the porous hollow fibers thermally treated in vacuum and N2 exhibited the obvious enhancement of gas permeance and the comparable H2/CH4, H2/N2, CO2/CH4, CO2/N2, and O2/N2 selectivity. When they were pretreated in air condition, the H2 (242 GPU), CO2 (57 GPU), and O2 (19 GPU) permeance values increased 158%, 300%, and 405% with the slightly decreased selectivity of H2/CH4 (64), H2/N2 (53), CO2/CH4 (15.7), CO2/N2 (12.9), and O2/N2 (4.3), respectively. The thermal pretreatment of the porous HFM precursors near T g was a very facile but effective way to enhance the gas separation properties.