In this paper, the covert communication is considered with a full-duplex (FD) receiver under covertness and reliability constraints in the finite blocklength regime. Conventional covert communication systems are restricted by the square root law. To break through this limitation, an FD receiver is introduced, generating artificial noise (AN) to confuse the warder's detection and achieving positive covert rates. To investigate the tradeoff among covertness, reliability, blocklength and throughput, the expressions of the warder's detection error probability and the receiver's decoding error probability in the finite blocklength regime are derived. Moreover, the asymptotic throughput is analyzed when the maximum transmit power of the FD receiver approaches infinity. Through the asymptotic analysis, we find that the blocklength's impact on the covertness performance vanishes, which is a reason for achieving positive covert rates. However, the AN will also cause harmful residual self-interference to the receiver for which the FD receiver should be carefully designed by making a tradeoff between the covertness and the effective throughput. Hence, an optimization problem is formulated and solved to maximize the covert throughput. Numerical results show that the proposed scheme is effective in the finite blocklength regime where positive covert rates can be obtained.