First of all I’m really sorry to hear about the way you were treated as a child, and how much that has affected you as an adult.
You are not your father, and your capacity to love your own children is infinite. I have little patience for other’s children but I have all the time in the world for my own children.
There are two ways to think about it, or rather two paths.
The first is: you become your father. This is a horrible thing to think, after all, he sounds like a nightmare. However some abused children do grow up to be abusive parents. But wait a second…
The second is: the vast majority do not. Having experienced the worst that children should experience, it is true that there is an increased chance that these poor people become abusers themselves. The fact is, though, that most do not. Their formative experiences actually make them even better parents, as they wish to ensure that their children grow up in a loving home, something they themselves never experienced.
I believe that you want to be better than your father, and from your own words and actions it’s obvious you know that you need to work on yourself. Having a baby is a lifelong commitment, and a lifelong joy.
In the end, only you and your partner can decide, but her faith in you must tell you something that your low self esteem denies. You would be a loving, kind father and your children will be blessed because of that.