PDA

View Full Version : HM import is really slow on a monster machine



fiammaz
09-09-2009, 06:57 PM
As said in the title.
I got a Intel core i7, 6 gb of ram, 2 geforce 260 gtx, and postgres mounted on ssd.
The import proceed at 30 or maximum 50 hands per second.
If it can help, many time during the import, Microsoft netframe continue to show an error (sorry I didn't saved the screenshot) but It says "out of memory ...."

Can you help?
Best
Fiammaz

PS I'm running windows 7

Patvs
09-09-2009, 07:48 PM
There is a Microsoft .NET Framework 4 Beta 1 you can download at (here) (http://www.microsoft.com/downloads/details.aspx?FamilyID=ee2118cc-51cd-46ad-ab17-af6fff7538c9&displaylang=en) to fix the Framework error.

50 hands is pretty decent. Are you importing big .txt files (exported database) or many (thousands) of small files? (full ring cash game hands from Full Tilt/PokerStars?)
The max. I ever got was 90 hands/s (i7, 6 GB-DDR3-1600, 2x SSD in RAID0)

You also have Windows 7 on your SSD? Did you test the speed of your SSD with CrystalDiskMark (http://release.crystaldew.info/CrystalDiskMarkSetup)
If you have a OCZ Vertex, a firmware update, can make a big difference in performance. And did you "enable write caching" on the SSD?

fiammaz
09-09-2009, 08:06 PM
Yes I got OCZ vertez, and now, I got win7 installed on another hard disk...
Anyway I'm importing some big files (100+mb) and thounsands (14k) of small files...
I got PT3 too and it fastest :(
Anyway ty for the info, very very happy to hear that;)

EDIT: how to enable cache on the ssd (sorry I'm a complete donk on win7)

Patvs
09-09-2009, 08:31 PM
PT3 is a lot faster than HEM with "hands / second" import. (300-500 hands / second on SSD). However PT3 takes a ridiculous long time AFTER the import, to vacuum/analyse/optimise the database, so taking that into account they import with the same speed.

I'm not sure if this is true, but I think 6max hands (where the hand history is shorter) and non .txt hands from other poker networks (so not FT/PS) can also be imported faster.

How large is your Vertex? Consider also installing Windows 7 on the fast Vertex. Which firmware do you use? I have the latest beta firmware (I think 1.42B) but they pulled it from their website. Check out this link (http://www.ocztechnologyforum.com/forum/forumdisplay.php?f=186). They should release a FINAL version of the new firmware within 2 weeks. The final version has "garbage collecting" and all sorts of crazy things to improve performance.

Also there are a dozen SSD tweaks you can do to improve performance.
They include:
-Install Windows on the SSD (!)
-Turn on Write-Caching
-Align the partition
-DO NOT defrag the SSD
-DO NOT turn on "indexing" on the SSD
-Put your Windows SWAPfile on the SSD
-Run your computer in AHCI mode (and not in IDE mode - this can be changed in the BIOS)
-Underpartition the SSD
-WIPE the SSD clean with WIPER (TRIM)
-Turn off SuperFetch (Windows VISTA only)

http://img43.imageshack.us/img43/748/attachmentjpg.png
http://img134.imageshack.us/img134/2048/attachment1jpg.png

fiammaz
09-10-2009, 04:13 AM
Ty again for the elaborated post :D
I don't know what my firmware is, I'm looking for that. But don't bother yourself, I will asking in OCZ forums. You were very kind ;)