Transposable elements (TEs) have been active in the mammalian genome for millions of years and the silencing of these elements in the germline is important for the survival of the host. Mice carrying reporter transgenes can be used to model transcriptional silencing. A mutagenesis screen for modifiers of epigenetic gene silencing produced a line with a mutation in Trim33; the mutants displayed increased expression of the reporter transgene. ChIP-seq of Trim33 in testis revealed 9,109 peaks, mostly at promoters. This is the first report of ChIP-seq for Trim33 in any tissue. Comparison with ENCODE datasets showed that regions of high read density for Trim33 had high read density for histone marks associated with transcriptional activity and mapping to TE consensus sequences revealed Trim33 enrichment at RLTR10B, the LTR of one of the youngest retrotransposons in the mouse genome, MMERVK10C. We identified consensus sequences from the 266 regions at which Trim33 ChIP-seq peaks overlapped RLTR10B elements and found a match to the A-Myb DNA-binding site. We found that TRIM33 has E3 ubiquitin ligase activity for A-MYB and regulates its abundance. RNA-seq revealed that mice haploinsufficient for Trim33 had altered expression of a small group of genes in the testis and the gene with the most significant increase was found to be transcribed from an upstream RLTR10B. These studies provide the first evidence that A-Myb has a role in the actions of Trim33 and suggest a role for both A-Myb and Trim33 in the arms race between the transposon and the host. This the first report of any factor specifically regulating RLTR10B and adds to the current literature on the silencing of MMERVK10C retrotransposons. This is also the first report that A-Myb has a role in the transcription of any retrotransposon.