After several notable clinical failures in early generations, antibody–drug conjugates (ADC) have made significant gains with seven new FDA approvals within the last 3 years. These successes have been driven by a shift towards mechanistically informed ADC design, where the payload, linker, drug-to-antibody ratio, and conjugation are increasingly tailored to a specific target and clinical indication. However, fundamental aspects needed for design, such as payload distribution, remain incompletely understood. Payloads are often classified as “bystander” or “nonbystander” depending on their ability to diffuse out of targeted cells into adjacent cells that may be antigen-negative or more distant from tumor vessels, helping to overcome heterogeneous distribution. Seven of the 11 FDA-approved ADCs employ these bystander payloads, but the depth of penetration and cytotoxic effects as a function of physicochemical properties and mechanism of action have not been fully characterized. Here, we utilized tumor spheroids and pharmacodynamic marker staining to quantify tissue penetration of the three major classes of agents: microtubule inhibitors, DNA-damaging agents, and topoisomerase inhibitors. PAMPA data and coculture assays were performed to compare with the 3D tissue culture data. The results demonstrate a spectrum in bystander potential and tissue penetration depending on the physicochemical properties and potency of the payload. Generally, directly targeted cells show a greater response even with bystander payloads, consistent with the benefit of deeper ADC tissue penetration. These results are compared with computational simulations to help scale the data from in vitro and preclinical animal models to the clinic.