Cell fate decisions are achieved with gene expression changes driven by lineage-specific transcription factors (TFs). These TFs depend on chromatin remodelers including the Brahma-related gene 1 (BRG1)-associated factor (BAF) complex to activate target genes. BAF complex subunits are essential for development and frequently mutated in cancer. Thus, interrogating how BAF complexes contribute to cell fate decisions is critical for human health. We examined the requirement for the catalytic BAF subunit BRG1 in neural progenitor cell (NPC) specification from human embryonic stem cells. During the earliest stages of differentiation, BRG1 was required to establish chromatin accessibility at neuroectoderm-specific enhancers. Depletion of BRG1 dorsalized NPCs and promoted precocious neural crest specification and enhanced neuronal differentiation. These findings demonstrate that BRG1 mediates NPC specification by ensuring proper expression of lineage-specific TFs and appropriate activation of their transcriptional programs.