What about all those Egyptian artifacts? Should they be returned too? What would have become of them in the last few weeks if they had?
There is no legitimate "collective ownership" and none of these museums should return anything unless a specific owner shows up and can prove his claim - not likely for the Parthenon Frieze.