I strongly advise staying with the 6. It is the classic, bulletproof XK120 engine. With all the other things to worry about you will never worry about the engine. There are lots of Xj6es around from the mid 90s that are gorgeous and amazingly affordable. (They terrify people...)
What is a Jaguar XK120 engine?