Nuts are one of the best plant based sources of protein. Legumes also. If you limit meat you have emphasize plant based sources of protein.
“I am a huge milk drinker”
You might want to try kefir. It’s expensive so if you find that you like it, get yourself some kefir grains and make your own.