Bacterial pathogens can infect a wide range of hosts and pose a threat to public and animal health as well as to agriculture. The emergence of antibiotic-resistant strains has increased this risk by making the treatment of bacterial infections even more challenging. Pathogenic bacteria thrive in various ecological niches, but they can also be specifically targeted and killed by bacteriophages (phages). Lytic phages are now investigated and even used, in some cases, as alternatives or complements to antibiotics for preventing or treating bacterial infections (phage therapy). As such, it is key to identify factors responsible for phage specificity and efficiency. Here, we review recent advances in virulence-associated factors that are targeted by phages. We highlight components of the bacterial cell surface, effector systems, and motility structures exploited by phages and the effects of phages on cell aggregation and communication. We also look at the fitness trade-off of phage resistance.