I’m not sure what you mean by “would the momentum force me along with the rock”, but essentially you would go one way at some velocity, and the rock would go the other way at a much-smaller velocity.
You would eventually end-up floating out there in space until something else came by to gravitationaly attract you to it.
That answers the question, thanks. I probably got a little too defensive over the gravity stuff.