A former relationship with Swing’s mother at least explains how he knew Swing. Warner’s mother probably would have mentioned Swing being her granddaughter if Swing was Warner’s daughter.
Maybe Warner had convinced himself he was her father or just wished he had been. What a sad and lonely life.