No, you don't leave the poll with the paper ballot. It's put into a box in case there is need for a recount.
That's one version. Another is you get a receipt that is yours to keep. The latter is your proof that you voted, but also can be misused.