He wasn't the only one. Clinton tried to get Tiger Woods to appear in Harlem with him and Jesse Jackson, Tiger politely refused, even after an advisor told him, "you just do not turn down the POTUS" He then went on vacation to Mexico.
It seems that Bill Clinton is the last person to figure out that most people don't treat him with the respect they would give any other president. The first hint of this attitude came very soon after he left office, when you started hearing stories from country clubs that refused to let him play golf at their courses -- even though many private country clubs have a long-standing tradition of allowing former presidents to play at any time.