This study aims to investigate the prospective associations between fruit and vegetable (FV) intakes and their polyphenol content with subsequent sleep duration in UK women. In this study, 13,958 women with ~4 years of follow-up in the UK Women’s Cohort Study were included in the analyses. FV intakes were assessed at baseline using a food frequency questionnaire (FFQ), and average hours of sleep per day were self-reported in follow-up. Polyphenol intake was calculated by matching FV items from the FFQ with the Phenol-Explorer database. Linear regression models, adjusting for confounders, were used for the analyses. Consuming an additional portion of apples, kiwi, oranges, pineapple, and 100% pure juice were associated with shorter sleep. Similarly, an additional portion of cabbage, celery, aubergine, olives, and peppers were inversely associated with sleep duration. An additional gram of total polyphenols was associated with shorter sleep by 18 min (99% CI −31 to −4, p < 0.001). FV consumption and total polyphenol content were inversely associated with sleep duration; however, effect sizes were small, and polyphenol classes from FV intakes were not associated with sleep duration. Future intervention studies considering the time of FV consumption in relation to sleep are needed to clarify the underlying mechanisms.