Another thing that you would have to consider is how a future partner of yours would feel about this. Not only are you the man of their dreams, but you also have two children running around. I was thinking about this recently, through a problem a friend of mine had. They might feel that there is a big part of you that they can't be a part of. It's different when you have children with an ex, or take care of your own children. I don't think I'm explaining it as well as I could, because I'm worn out, but hopefully you understand what I'm trying to say.