The absence of votes on one side of the tally does not increase the number of ballots cast on the other... unless you are doing "million mom", "million man" or democrat math.
For example:
Obama gets 40,000,000 votes.
I do not vote for McCain.
Obama still gets 40,000,000 votes.
My not voting for McCain did not result in Obama getting 40,000,001 votes, therefore, it was not a vote for Obama.
See how simple arithmetic really is?
I believe that JFK won by about one vote per district back in 1960. Heard it last week, no source or link, but it was close.