Will work.
That's how I start mine. Cheap and effective.
Use one paper cup as a seed starter cup. Prepare it by cutting holes in the bottom (I do the sides also), load it with potting mix, sprinkle on a few seeds, sprinkle a bit more potting mix on top, water it in and then place in a sunny window.
When the seedlings appear, transfer them to separate cups when they each have two sets of "adult" leaves.
/johnny