More than 30% of eukaryotic proteins contain domains that must translocate across or integrate into the endoplasmic reticulum (ER) membrane. With few exceptions, protein translocation and transmembrane domain integration at the ER require the conserved Sec61 translocon. Decades of studies have established a clear mechanistic model for how the Sec61 translocon functions. The biosynthesis of distinct subsets of proteins at the ER also involves accessory factors that interact with the Sec61 translocon and translocating nascent proteins. However, assigning specific functions to many translocon accessory factors has been a persistent challenge in the field. This Perspective discusses recent insights into mechanisms that promote protein biosynthesis at the ER through accessory factors that directly regulate the Sec61 translocon or chaperone nascent proteins within the ER membrane. These translocon accessory factor functions, and more still to be discovered, are essential for producing a diverse and high-fidelity proteome at the ER.