I’m no geologist, but the “fortress” looks like natural geology.
http://www.anarchaeology.com/fortress/index.html
OTOH, one of the artifacts from the Texas site does indeed look like it could be Phoenician, or rather Carthaginian.
http://www.anarchaeology.com/quivira/artifact.htm
Lacking any scale, and going by appearance alone, I’d guess a concretion formed around a duck’s (or similar) head, rather than an artifact.
Computer chairs are almost as good as armchairs for that kind of ‘field work’.