Attention control, the ability to focus on task-relevant information while blocking out irrelevant information, is crucial for successful task completion throughout development. However, the neurodevelopment of attention control during tasks remains underexplored, particularly from an electrophysiogical perpective. Therefore, the present study investigated the developmental trajectory of frontal TBR, a well-established EEG correlate of attention control, in a large sample of 5, 207 children aged 5–14 during a visuospatial working memory task. Results revealed that frontal TBR in tasks exhibited a different developmental trajectory (quadratic) compared to the baseline condition (linear). More importantly, we found that the association between task-related frontal TBR and age was modulated by task difficulty, with the age-related decrease in frontal TBR being more pronounced in more challenging conditions. Overall, by demonstrating a fine-grained age-related change in the frontal TBR based on a large dataset covering continuous age groups, our study provided electrophysiogical evidence about the maturation of attention control, suggesting potentially distinct developmental paths for attention control across the baseline and task conditions.