The decision was already made at the Jerusalem council to let go of the dietetic law. That was done under St. Peter's leadership who had the vision (Acts 10) about it. St. Paul objected to Peter's personal behavior, but as we know from Scripture, it was Peter who initiated the reform. This was a doctrine that came from Peter and possibly John and James (Gal 1:9f, 2:1), so Paul could not be making a doctrinal point when he made his remark to Peter in Galatians 2:11f.
Peter was not called to the Jews in any exclusive sense -- it was Peter who opened the Chruch to the Gentiles (Acts 10) and converted the first Gentile (Acts 11).