Sure. Every brain cell in a male brain contains a "Y" chromosome. Every single cell.
Female brain cells do not have any "Y" chromosomes.
Apart from DNA, is there a discernible physical difference between male and female brains?