Because they didn’t wear him around their necks?
Hmmmm. Maybe Harry is a “horcrux lite,” but even so, Ginny didn’t have the diary with her all the time. In fact, I think it continued to exert power over her even after Harry took it into his possession (after she tried to throw it away).