Yes, but Dudley is still a thief, and gets punished for being a thief. Attempts to steal Harry's birthday cake = gets a pig's tail. Picks up a sweet and eats it without permission = gets a Ton-Tongue. Never mind the "sins of the fathers", what happens to Dudley in every case is payback for his immediate behaviour.