Anxiety disorders and substance abuse, including benzodiazepine use disorder, frequently occur together. Unfortunately, treatment of anxiety disorders still includes benzodiazepines, and patients with an existing comorbid benzodiazepine use disorder or a genetic susceptibility for benzodiazepine use disorder may be at risk of adverse treatment outcomes. The identification of genetic predictors for anxiety disorders, and especially for benzodiazepine use disorder, could aid the selection of the best treatment option and improve clinical outcomes. The brain-specific angiogenesis inhibitor I-associated protein 3 (Baiap3) is a member of the mammalian uncoordinated 13 (Munc13) protein family of synaptic regulators of neurotransmitter exocytosis, with a striking expression pattern in amygdalae, hypothalamus and periaqueductal gray. Deletion of Baiap3 in mice leads to enhanced seizure propensity and increased anxiety, with the latter being more pronounced in female than in male animals. We hypothesized that genetic variation in human BAIAP3 may also be associated with anxiety. By using a phenotype-based genetic association study, we identified two human BAIAP3 single-nucleotide polymorphism risk genotypes (AA for rs2235632, TT for rs1132358) that show a significant association with anxiety in women and, surprisingly, with benzodiazepine abuse in men. Returning to mice, we found that male, but not female, Baiap3 knockout (KO) mice develop tolerance to diazepam more quickly than control animals. Analysis of cultured Baiap3 KO hypothalamus slices revealed an increase in basal network activity and an altered response to diazepam withdrawal. Thus, Baiap3/BAIAP3 is gender specifically associated with anxiety and benzodiazepine use disorder, and the analysis of Baiap3/BAIAP3-related functions may help elucidate mechanisms underlying the development of both disorders.