I've tried to like it. I really have. I've watched plenty of episodes but it always ends up vexing me, so I give up before the season is over.
I know a lot of people like the show, to the point that they tolerate no dissent. I just can't get into it. It's cool that so many do like it, but I shan't be one of them. I should mention that I have notoriously bad taste in TV shows.
If you started watching in the middle, I can understand the confusion--that's why I've never been into Alias or Lost. But if you could start from the very first episode of the first season you might have a better reaction.