The inhibitors of DNA binding (ID) inhibit basic helix-loop-helix transcription factors and thereby guide cellular differentiation and proliferation. To elucidate the involvement of IDs in hematopoiesis and acute leukemias (AL), we analyzed ID2 and ID3 expression in hematopoiesis and leukemic blasts in bone marrow biopsies (BMB). BMB of healthy stem cell donors (n = 19) and BMB of patients with acute myeloid leukemia (AML) with myelodysplasia-related changes (AML-MD; n = 19), de novo AML (n = 20), B-acute lymphoblastic leukemia (B-ALL) (n = 23), T-ALL (n = 19), were immunohistochemically stained for ID2 and ID3 expression. The expression patterns were evaluated and quantified for each hematopoietic lineage and each leukemia subtype. In normal BMB, immature granulopoiesis showed weak ID2 and strong ID3 expression, which was lost during maturation (p < 0.001). Erythropoiesis remained negative for ID2/3 (p < 0.001). ID2/3 expression differed between immature granulopoiesis and leukemic blasts (p < 0.001). Moreover, differential ID2/3 expression was seen between AL subgroups: AML, especially AML-MD, had more ID2- (p < 0.001) and ID3-positive (p < 0.001) blasts than ALL. We show a comprehensive in situ picture of ID2/3 expression in hematopoiesis and AL. Morphologically, ID2/3 proteins seem to be involved in the granulopoietic maturation. Importantly, the distinct ID2/3 expression patterns in AL indicate a specific deregulation of ID2/3 in the various types of AL and may support subtyping of AL.