It is the green berries and leaves. Ripe berries are less toxic, at least sometimes.
I figure beets is the only honest vegetable. They come from dirt. They taste like dirt. Nuff said. ;-)