Was the USPHS part of the Navy, I think they wore naval uniforms.
No, while it grew out of the needs of the navy, by World War II it was independent.
You are correct, however, that the uniforms are generally based on Navy uniforms, and the ranks correspond.