The upper classes were, to some degree, moved to go there by "peer pressure". And religous issues entered into it, too - the more Puritan preachers regularly launched against "strolling players and vagabonds," so there was something of a reaction against that from the artsy types.
The groundlings just wanted to see the murders and the low comedy.