The High Time Resolution Universe Pulsar Survey - XVI. Discovery and timing of 40 pulsars from the southern Galactic plane

We present the results of processing an additional 44 per cent of the High Time Resolution Universe South Low Latitude (HTRU-S LowLat) pulsar survey, the most sensitive blind pulsar survey of the southern Galactic plane to date. Our partially coherent segmented acceleration search pipeline is designed to enable the discovery of pulsars in short, highly accelerated orbits, while our 72-min integration lengths will allow us to discover pulsars at the lower end of the pulsar luminosity distribution. We report the discovery of 40 pulsars, including three millisecond pulsar-white dwarf binary systems (PSRs J1537-5312, J1547-5709, and J1618-4624), a black-widow binary system (PSR J1745-23) and a candidate black-widow binary system (PSR J1727-2951), a glitching pulsar (PSR J1706-4434), an eclipsing binary pulsar with a 1.5-yr orbital period (PSR J1653-45), and a pair of long spin-period binary pulsars which display either nulling or intermittent behaviour (PSRs J1812-15 and J1831-04). We show that the total population of 100 pulsars discovered in the HTRU-S LowLat survey to date represents both an older and lower luminosity population, and indicates that we have yet to reach the bottom of the luminosity distribution function. We present evaluations of the performance of our search technique and of the overall yield of the survey, considering the 94 per cent of the survey which we have processed to date. We show that our pulsar yield falls below earlier predictions by approximately 25 per cent. (especially in the case of millisecond pulsars), and discuss explanations for this discrepancy as well as future adaptations in RFI mitigation and searching techniques which may address these shortfalls.