Importance: Exposure to phthalates may affect fetal growth, but previous studies are inconsistent and have not explored the trimester-specific effects of phthalates on repeated measures of fetal growth. Objective: To assess the associations of maternal phthalate metabolites urine concentrations with fetal growth measures and birth outcomes and identify potential windows of vulnerability to exposure. Design: Population-based prospective cohort study, the Generation R Study (2002–2006). Data analysis was performed from November 2019 to June 2020. Setting: Rotterdam, the Netherlands. Participants: 1379 pregnant women. Exposures: Maternal phthalate metabolites urine concentrations in first, second and third trimester. Main outcomes and measures: Fetal head circumference, length and weight measured in the second and third trimester by ultrasound and at birth and preterm birth and small size for gestational age at birth. Results: Higher pregnancy-averaged phthalic acid, low molecular weight phthalate (LMWP), high molecular weight phthalate (HMWP) and di-2-ethylhexylphthalate (DEHP) concentrations tended to be associated with lower fetal weight SDS across gestation. The associations of phthalic acid and LMWP with fetal weight became stronger as pregnancy progressed (differences −0.08 (95% CI −0.14 to −0.02) SDS and −0.09 (95% CI −0.16 to −0.02) SDS at 40 weeks per interquartile range increase in phthalic acid and LMWP, respectively). Higher concentrations of specific LMWP, HMWP and DEHP metabolites were also associated with smaller head circumference and lower length SDS at birth and an increased risk of preterm birth and small size for gestational age at birth (p-values < 0.05). We observed differences by timing of exposure in these associations. Conclusions and relevance: Higher maternal phthalate metabolites urine concentrations seem to be related with fetal growth restriction and preterm birth. Phthalates may have trimester specific effects on fetal growth and birth outcomes. Further studies are needed to explore the underlying mechanisms and long-term consequences.