Going back to the 1901 census. Elizabeth, Alexandra and Alfred are together with no sign of Alfred Foster at that time so that would seem support your ruling out of him being the father.
Why did he choose to use the name Foster though if he wasn't one. He could have stuck with Pecchia, or gone...