Background: Existing literature suggests that frequent consumption of sugar-sweetened drinks may be associated with lower semen quality. Studies performed in mice suggest a dose-response relationship between intake of saccharin or aspartame, two artificial sweeteners, and sperm and testis function. Methods: A cross-sectional study based on data from The Fetal Programming of Semen Quality (FEPOS) Cohort, including 1047 young men (mean age = 19 years) was performed. Each male participant completed an online questionnaire on health, health behavior and diet, and provided a semen sample. The associations between consumption of sugar-sweetened or artificially sweetened beverages (moderate ≥ 3 days/week; infrequent < 3 days/week) and semen quality were analyzed using a multivariable, negative, binomial regression model. Results: Sugar-sweetened or artificially sweetened beverage consumption was not strongly associated with either semen volume, sperm concentration, total sperm count or total motility in young men. The proportion of morphologically normal sperm was 11% lower (0.89 (95% CI 0.76, 1.04)) for moderate (≥3 days/week) consumption of artificially sweetened beverages relative to infrequent (<3 days/week). Conclusion: Consumption of sugar-sweetened or artificially sweetened beverages, at the levels present in this study had limited effect on the measured markers of semen quality in young men.