This demonstrates that it's possible to have some things that are not sinful but also not be the best decision. These are the words of the Apostle Paul.
Paul also says that when something is done (or in this case, not done) that causes a brother to be offended, we sin against that brother.
So where do we draw the line?