If we are talking about fathering, we see recorded that Abraham had more than 2 (Genesis 25:2) - if we talk about promises, then he only had one - Isaac - and if we talk legally, he had sent Ishmael away at the time of offering Isaac, and so it depends on when you are speaking.