Over the past few decades, the reception of Wittgenstein’s work has focused primarily on the central role that rules play in constituting a practice. Wittgenstein himself, however, always emphasises that a practice not only has rules, but also a “Witz” (i.e., a point). He even maintains that, “the problem of philosophy is the problem of Witz.” Despite Wittgenstein’s insistance on this matter, no systematic study has yet done full justice to the significance of Witz in Wittgenstein’s philosophy. By considering both the role of rules and Witz, the present study casts a new light on mathematics, language, and morals.