It absolutely doesn't matter how hard you try, you're going to end up a deadbeat parent in any Fable game. All that adventuring and real estate buying will always have you leaving your spouse and kid at home, wishing you'd come around more often.
Divorce seems inevitable, unless you really put in a lot of time at the dinner table. Fable 3 in particular lets you be pretty terrible on the parenthood front... by allowing devastating child labor to continue to run rampant in your home city.
Since the Fable series lets you keep marrying and having more children as often as you'd like (in fact, some achievements require you to be polygamous or kill previous spouses!), you can end up with a ridiculous number of children, as seen below.