Fractional calculus is widely used to deal with nonconservative dynamics because of its memorability and non- local properties. In this paper, the Herglotz principle with generalized operators is discussed, and the Herglotz type equations for nonholonomic systems are established. Then, the Noether symmetries are studied, and the conserved quantities are obtained. The results are extended to nonholonomic canonical systems, and the Herglotz type canonical equations and the Noether theorems are obtained. Two examples are provided to demonstrate the validity of the methods and results.