Absolutely. You cut straight across until you pickup a familiar lighthouse or landmark on the opposite coast. Much safer & quicker than hugging a coastline where a sudden storm or windshift might drive you up onto the rocks.
In order to sail across open ocean you need a method of navigation.