I had to clear out all my Recent files in order to get File Explorer to stop being dodgy.
I noticed similar locking after our Sys Admins moved some major network shares around and File Explorer hung trying to locate the missing/renamed shares.
I'm sure there's some sort of timeout value I could potentially alter in the ocean referred to as the Registry, but I don't have time to look for something that my company may have locked down through policy.
And many of those timeouts are hard-coded into the operating system functions. Even the Registry can’t touch them.