Losing that key card is going to finish him off, IMHO.
When Buchanan was trying to distract him so Audrey could help Chloe decript the files, did you hear that Buchanan said something about checking on a room/area that would require the key card? That's when Samwise really started going ballistic.
I wonder where they're gonna go with that part of the plotline.