You are right, Obama hardly spent any time at all with his Dad. In fact, it might be that the only time Obama ever met his purported Dad was just a few minutes at the airport.
Yet Obama sought out his Dad's heritage, and that does include his Dad's politics. He wrote (or more likely ghost wrote) a whole book about that search for his Dad's legacy. Dreams of My Father.