You make an excellent point. Before WWII the sun never set on the British Isles. They had colonies all over the world, hence the name, the British Empire. Now they are simply Britain. If we are going to claim that Rome fell, then it stands to reason we must claim that Britain fell.
What happened would better be described as 'The Collapse of British Power', to use the name of one Corelli Barnett's books.