I remember Samson died while killing a lot of Philistines in Gaza. I have no idea if that Gaza was the same as the modern one.
I believe Gaza was simply a city at that time, as it is today. The area called the Gaza Strip today has multiple towns/cities, with Rafah on the southern border.