Having a wife die in childbirth was common in the 1800s. So was a titled man that did not take care of babies but wanted to have an heir and a spare. Since Isabel was a girl, she would not inherit her father's title making her easy to ignore.
The arrival of titled thieves and the plot to kill the Duke was not unusual either sad to say. His deliverance and subsequent marriage not too realistic but a happy ending.