The Dursleys are less cardboard cutout evil, though they still manage to make Harry unable to have healthy relationships. As a result, Harry grows up less heroic (at least in his own mind) and becomes a Slytherin. But heroism is about what you do, not why you do it. Voldemort's resurrection is delayed until after Harry graduates Hogwarts & becomes a spy / operative for the DoM