URGENT!!! hands importing 60h-70h/s

[Dom]

I bought last 2 weeks an incredible strong pc and still have low hands per second import rate

I have a big database with all my hands played since i started poker 6 years ago

over 9 million hands easy

i put all hand history in 4 folders each close to 7gb and i import one at a time

also i use note caddy to create huge notes everytime when a folder its imported

i have this pc setup
Intel Kaby Lake, Core i7 7700 3.60GHz box
ASUS PRIME H270-PRO [ PRIME H270-PRO ] (motherboard)
2x Kingston ValueRAM 16GB DDR4 2133MHz CL15 1.2v =32gb ram
SSD ADATA XPG SX930 120GB SATA-III 2.5 inch
SSD ADATA XPG SX930 240GB SATA-III 2.5 inch
HDD Seagate BarraCuda 1TB SATA-III 7200RPM 64MB
GPU Zotac GeForce GTX 1070 IceStorm 8GB DDR5 256-bit


all hands are on hdd and are imported in database to ssd 240gb, hm2, postgresql 9.4(9.5) are also here


What can i do to improve my importing?

i dont use that pc now, i have 2 pc's and this one with holdem working alone without disturbing from other programs

[Dom]

drop to 50-55h / s
388 file imported from 7141

[Husky110]

I don't think you can do much about it...
The problem here are 2 main things:
1.) HDD reads pretty slow and even slower if many files are involved.
2.) From what I saw so far, HM has to process those files single-threaded, since every hand that occurs involves some calculations which have to be processed after one-another (take a look at the DB-structure and you will see what I mean...), since they rely on the previous values which are provided so far. So in my oppinion they can not run multithreaded.

Guess you gonna hate me for this, but as a dev (not for hm! ) I would recommend you stick with the ongoing import, import the hands from the 2-3 days you've missed and do a complete export of the HM2-Database afterwards (via Database -> Backup) so whenever you have to reinstall HM2 you just import that backup and the handhistories you've gathered since the backup.
So in the backup you only have to fill in the values - see it like this: writing 4.294.967.296 onto a piece of paper is faster than calculate 2³² and write that down.

I see it on my setup (Intel I7-6700k) when I play a hand in PS HM2 needs like 2-3 seconds after the hand is done before the values change.

[Dom]

Thank you husky

I hate this situation, we pay over 50 millions in US dollars and nobody its here to help us a little.

When i try to figure out how to solve the problem alone, i waste days of poker and money.

Thats why im a bit angry.

[Husky110]

Yeah I was wondering too.
But I use HM2 since 2 days now, so I ain't sure if the community is just a bit salty or if those guys are.
But what wondered me was that the mods take ages to release my posts...
I've added you as friend so we can PM if you want.

[udbrky]

Import speed depends on the site, game type, file structure, and hard drive speed.

You don't need to export hands - use c:\hm2archive

If you continue to have problems, please reproduce the problem and zip/attach your HM2Logs folder with a detailed description of what you were doing and what problems you were experiencing - Hold'Em Manager 2 FAQs - Poker Software :: How Do I Send a Log File to Holdem Manager Support?

[Dom]

i did the ticket

[udbrky]

Please see our email.