Both estrogen receptor α (ERα) and histone deacetylases (HDACs) are valid therapeutic targets for anticancer drug development. Combination therapies using diverse ERα antagonists or degraders and HDAC inhibitors have been proven effective in endocrine-resistant ER + breast cancers based on the crosstalk between ERα and HDAC pathway. In this study, we reported the optimization of a series of methoxyphenyl- or pyridinyl- substituted tetrahydroisoquinoline-hydroxamates, which were optimized from 31, a dual ERα degrader/HDAC inhibitor previously reported by our group. Most of the synthesized compounds displayed potent ERα degradation efficacy and antiproliferative activity. Among them, A04 demonstrated the best anti-proliferation activity (MCF-7 IC50 = 1.96 µM) and HDAC6 inhibitory activity (HDAC6 IC50 = 25.96 nM), which is slightly more potent than the lead compound 31 (MCF-7 IC50 = 4.38 μM, HDAC6 IC50 = 63.03 nM). In addition, compound A04 exerted ERα-independent HDAC6-inhibiting effect without agonistic activity in endometrial cells. These results demonstrated that A04 is a novel and promising dual ERα degrader/HDAC inhibitor worthy of further development.