I've already said it but no, lol! Neglect is still a form of abuse (not just towards Penelope but also towards Reynold and Derrick). The main difference between him and most of the other rofan fathers is that he actively tries to redeem himself rather than count on the forgiveness of his children.

He says sorry multiple times, backs up his words with actions and doesn't expect forgiveness in return by prioriziting his children's happiness. And yes, grief (for his wife then for Ivonne) did play a role, he overworked himself as a coping mechanism but ended up neglecting his children.