If I replaced them with vinyl windows, what would I do about the center piece?
Nice piece of lumber and paint it. Size it so you can get two “standard” windows.