Yes, I would leave. He is harming/will harm my baby.
It depends on what you mean by "pin him down"
I'd need more information
p.s. I often get frustrated. That is normal for a parent
I would ask him to take some anger management classes before trusting him alone with the child...... and leave in the meantime.
yup. I'd be gone.
Um, yes. Leaving doesn't mean leaving the relationship for good though. He obviously needs help. If he were willing to accept help and work on his anger issues then we could go from there. But I would not leave the child alone with him, and I could not be in the same home living with him in the meantime.