Lapis Lazuli would be ground fine, mixed with medium, and used to paint the Virgins blue veil. This was an artist who ingested a lot of blue pigment over a long time. Ive never heard whether its toxic. Manganese, cadmium are toxic.
Yes, ultramarine. One of the costliest if not the costliest pigment.