PDA

View Full Version : really slow importing



auswalk
10-26-2009, 05:26 PM
I'm importing a gigantic amount of hands Postgres 8.3. I vacuumed the DB and it's getting like 16h/s. I've read several posts on this subject but can't seem to find a solution to this problem if there is one.

Any ideas?

fozzy71
10-26-2009, 09:27 PM
What are your PC specs? Desktop or laptop? Your hard drive speed and CPU are your 2 most limiting factors. Are you using the Import From Folder option when importing? Try breaking up the hands into smaller import groups.

Turning off logging would be somewhat helpful also. A reindex and defrag couldnt hurt either, imo.

I would suggest you do the majority of the things in this thread for general DB performance: http://www.holdemmanager.net/forum/showthread.php?t=11194

Some of the most important things, imo:

- Remove the WinnerName, WinnerCards and WinnerWon from the Hands View Column Selector
- Turning off logging and deleting existing logs
- Vacuum/Full/Analyze, then Reindex - http://www.holdemmanager.net/faq/afmviewfaq.aspx?faqid=163
- Defrag last and make sure you stop the postgresql service before you defrag. I personally use Smart Defrag.
- Do a Cold Boot (Shut Down > Start) before you use HM again

auswalk
10-26-2009, 09:32 PM
I did do a vacuum. I am importing 3000 files. 17h/s. Dual Core 6600 2gz, 4gb ram, SATA 3.0 HD.

What is a "good" hands/second?

fozzy71
10-26-2009, 10:39 PM
HD Speed and CPU are the 2 most important things. A separate (RAID0 pair of) SSD is optimal.

If you have an older laptop, you wont be able to get much more than you are, with a large DB and large import.

My last computer was 3 years old, desktop, amd 4200+ dual core witha single 72000rpm drive. It imported around 40 - 50 h/s

My new computer is a Ci7 920 CPU, and a similar OEM drive @ 7200rpm. It imports between 90 - 110 h/s