He's obviously not a complete stranger... someone out of the past?
Why else would he call Milkman his beloved?