Posted by Robert G Laurin on February 01, 2011 at 09:22:47:
In Reply to: Timings posted by Stephen Auerbach on February 01, 2011 at 05:42:03:
Well... here's the result: WOW !
Did a plain copy in Comet, file had 9.5 million records 450 bytes with a key of 9.
First Million records copied in about 20 minutes. Started at a 1,000 records a second by then had slowed down to 700/second.
I had to leave for my night class and completed the copy when I got home. I copied the file in 2 passes, first one was to get "recent" records and the 2nd did the older stuff (pre-2006).
I estimate that the file copied in over 5 hours, at an average of 500 records per second. That's 1.8 million per hour.
I was amazed by the result. I was expecting 12 to 24 hours to keybuild this baby. Needless say, people were happy when they got to work in the morning. Working without the master file is kind of pointless, makes for lots of paperwork.
Ran on Windows XP SP3 (Xeon 3.2 7yr old) Comet16 2008.398 with a gigalink to a Windows 2003 SP2 server (Dual Xeon 3.6 5yr old) running Comet Serve 9.03.
Each file can be a maximum of 1MB in length Uploaded files will be purged from the server on a regular basis.