In this paper, we describe the structure of finite groups whose element orders or proper (abelian) subgroup orders form an arithmetic progression of ratio r >= 2. This extends the case r = 1 studied in previous papers [R. Brandl and W. Shi, Finite groups whose element orders are consecutive integers, J. Algebra 143 (1991) 388-400; Y. Feng, Finite groups whose abelian subgroup orders are consecutive integers, J. Math. Res. Exp. 18 (1998) 503-506; W. Shi, Finite groups whose proper subgroup orders are consecutive integers, J. Math. Res. Exp. 14 (1994) 165-166].