Right.
An excuse to drink beer, and an interesting way to kill some time? Yes.
A sport?
No.
A former business partner posited that a pastime vs. a sport can be separated thusly: a pastime is something you can do while smoking a cigarette and drinking a beer. Curling, like golf, would be in the pastime category.