Philip of Saint-Pol was the younger son of Duke Anthony of Brabant and Joan of Saint-Pol. He succeeded his brother John IV as duke of Brabant in 1427, while he had inherited Saint-Pol and Ligny as an appanage on the death of his maternal grandfather, Waleran III of Luxembourg, Count of Ligny, in 1415.