Thanks.
The new iPhoto that comes with the new Macs, or purchased as part of iLife, is supposed to be superb at doing this... and can handle video clips as well. Beyond that I don't know as I don't have too much call to manage such large numbers of media files.
Have you tried ViewIt? I just started playing around with it with some large photo files. http://www.hexcat.com/viewit/