Gene expression changes during cell differentiation are thought to be coordinated by histone modifications, but still little is known about the role of specific histone deacetylases (HDACs) in cell fate decisions in vivo. Here we demonstrate that the catalytic function of HDAC2 is required in adult, but not embryonic neurogenesis. While brain development and adult stem cell fate were normal upon conditional deletion of HDAC2 or in mice lacking the catalytic activity of HDAC2, neurons derived from both zones of adult neurogenesis die at a specific maturation stage. This phenotype is correlated with an increase in proliferation and the aberrant maintenance of proteins normally expressed only in progenitors, such as Sox2, also into some differentiating neurons, suggesting that HDAC2 is critically required to silence progenitor transcripts during neuronal differentiation of adult generated neurons. This cell-autonomous function of HDAC2 exclusively in adult neurogenesis reveals clear differences in the molecular mechanisms regulating neurogenesis during development and in adulthood.