Biggest issue would be dealing with all the inspectors, FDA, etc. as an example, the City of Fort Worth has been trying to shut down a dairy that sells whole unpasteurized milk, even though they are not located in Fort Worth. The rationale is that the city prohibits the sale of such milk, and since people go out of the city, they are treating the dairy like a drug pushed.
Fortunately, I live in an area where I don’t need a business license nor does my profession require a license or inspections.
Those are certainly a concern when you are selling food.
The bookkeeping aspect keeps you “honest” and objective. By that I mean keeping your success or failure objective. Often times the most difficult part of running a business is to know when to call it quits. By the time most small business operators give up, it is way past too late.