PDA

View Full Version : Extremely slow auto import



Petes
01-28-2011, 08:03 PM
My database contains 4 million hands.
Recently the auto import speed decreased to 0.1/sec, so the HUD can display stats only with a huge delay.

My computer is a Dell Studio XPS 16 notebook with Core i7 720QM CPU, 4 GB RAM, my HDD is an SSD (Kingston V+ SNVP325-S2).

When i create a new database the auto import speed is good:
http://kepfeltoltes.hu/110129/import_speed_new_database_www.kepfeltoltes.hu_.jpg

When importing to my old 4M database it looks like this:
http://kepfeltoltes.hu/110129/auto_import_speed_4m_hand_db_www.kepfeltoltes.hu_. jpg

How can i solve this issue? I think my computer should be more than good for a normal speed auto import.

I attach my HM config file.

Thanks!

Patvs
01-28-2011, 08:56 PM
Vacuum/analyse + reindex the database in pgdminIII after every 100.000 new hands.

Read:
http://forums.holdemmanager.com/manager-general/11194-top-10-hem-performance-increase-tips.html

Petes
01-28-2011, 09:32 PM
Vacuum/analyse + reindex the database in pgdminIII after every 100.000 new hands.

Read:
http://forums.holdemmanager.com/manager-general/11194-top-10-hem-performance-increase-tips.html

I have already vacuum/analyse and reindexed my database, just forgot to mention in my previous post...

Patvs
01-29-2011, 09:03 AM
Run a CrystalDiskMark benchmark on your harddisk

Petes
01-29-2011, 02:07 PM
Run a CrystalDiskMark benchmark on your harddisk

Here's the results:

http://kepfeltoltes.hu/110129/crystaldiskmark_www.kepfeltoltes.hu_.jpg

Patvs
01-29-2011, 08:56 PM
Harddisk speeds look good. (it's fast)

Which SQL version are you running?


Which Firewall, and Anti-Virus are you using?

For W7 and Vista you must set \holdem manager\dbcontrolpanel.exe, holdemmanager.exe and hmhud.exe are started as administrator. Run the windows explorer and navigate to your Holdemmanager installation directory. Right click the executables and select properties... then select "Run as admin" from the compatibility tab.

Add exceptions for those files to the windows firewall, even if it is off. Including for postgres.exe

Turn off Windows Defender, and make sure no program (anti virus) is monitoring the SQL folder or port 5432.

Sethide
02-03-2011, 03:38 PM
I have the same problem here with HEM 1.11/Postgres 8.4:
I have Windows 7 Home Premium x64
ASUS notebook UL30VT CPU U7300 @ 1.3Ghz
4GB of Ram

Here is my CrystalDiskMark
http://img703.imageshack.us/img703/8520/cystaldiskmark.png

Here is what i have done so far:
Vacuum/analyse + reindex the database in pgdminIII
UAC is off
Avast! ignores HEM and Postgre
Windows FW is off
Windows Defender is off
\holdem manager\dbcontrolpanel.exe, holdemmanager.exe and hmhud.exe are started as administrator
HEM processes are set to high

Once in a while I have these errors:
http://img695.imageshack.us/img695/3497/hemlibrarydllerr.png

http://img29.imageshack.us/img29/2011/heminjectfail.png

The first import was long but ok.

Patvs
02-03-2011, 06:24 PM
@sethide, turn on the Windows Firewall and set \holdem manager\dbcontrolpanel.exe, holdemmanager.exe and hmhud.exe are started as exceptions.

Run a manual Windows Update and install all net framework updates.

Since you get those two errors. Reinstall HoldemManager using the 93 mb full installer @ http://www.holdemmanager.com/Downloads/Holdem_Manager_Setup.exe
(save your custom HUD before you reinstall!)


---

Do you have a multi million hand database?

Sethide
02-04-2011, 05:44 AM
Ok update Windows FW and did the windows update (>22 updates done) and then rebooted.
I didn't have time to reinstall yet but will do it later.
I jump from 0.1 hand/s to 2.4 hands/s.
Right now, I have it running without Wifi/Internet with no other programs.
I know my laptop is not a gaming laptop and I can't expect to insert @ >20 hands/s. I have no idea how fast one should expect in this case anyway.
I don't have a multi-million DB. I forgot to check (http://faq.holdemmanager.com/questions/115/Check+Total+Amount+of+Hands+in+Database+) how many I have exactly but I will.

PS: It looks good, I can see partial report, graph, HUD works...
Thank you.

Sethide
02-05-2011, 07:55 AM
I have 287K hands atm (still importing).

Daniel
03-18-2011, 02:58 PM
same thing for me. Auto import is 0.3 h/s, HUD is lagging enormously. Yesterday I had no problems, and I didn't install new software and did not bulk import hands. I'm not running more progs or tables than usual. What's wrong here?

olliepower
03-18-2011, 04:48 PM
For your HUD try this

Can you make sure your Opacity slider in HUD options > Player Preferences> Appearance TAB is 100% to the right and also do the same for the mucked cards Opacity

Also keep task manager running and have it sort by CPU in the Processes TAB and see what is using the most CPU when the lagging happens.

Try disabling as many programs as possible such as AHK scripts, Firewall, LimeWire, Mikogo etc. and Antiviruses and if they can't be disabled make sure you add all these programs to the exceptions list such as HMhud.exe, DBcontrol panel.exe and holdemmanager.exe from the Holdem Manager folder as well as any of the other programs that happen to be running, sometimes for example the antivirus/firewall etc. scan every file that's been processed and it can slow things down so running with as few programs as possible. This is the most common culprit and it's usually a combination of 2 or more programs that can cause the issue rather than 1 specific program.

Rule out corrupt config files as the problem
Sometimes a corrupt prefs.xml file or holdemmanager.config file can cause Holdem Manager or the HUD to crash. To rule this out we install the default prefs.xml file and holdemmanager.config file.

First close Holdem Manager and go to C:/Program Files/RVGSoftware/HoldemManager and make copies of the prefs.xml file and holdemmanager.config file, then delete the originals. Once you do this restart Holdem Manager and it will create default holdemmanager.config and prefs.xml files and if this fixes the crashing problem then we can assume it was one of those 2 files were corrupt. In that scenario we would need to re-configure our import folders and HUD settings and use the new default ones.

If however it doesn't fix the issue we can just replace the defaults with our copies by closing HM, deleting the prefs.xml file and the holdemmanager.config file and renaming the 2 copies to prefs.xml and holdemmanager.config and rebooting HM and all our settings will be returned.

Rule Out Firewalls/Antiviruses
Sometimes firewalls can prevent access to a file that HM needs to run and thus causing it to crash, unfortunately disabling the firewall doesn't always fix the issue. See these two FAQs on how to remedy that.
http://faq.holdemmanager.com/questions/339/Software+Security+Problems+%28Firewall%29
http://faq.holdemmanager.com/questions/275/Windows+Firewall+%7B47%7D+Defender+Problems
It can be easy to pass this off and say it didn't happen before but has been the cause on several occasions

Also going to control panel > Admin Tools > Event Viewer and copy and paste any description if there are any error or information events that coincide with the time of the lagging.

Go to Hud Options > Site Options and disable all the prefetch/track live hands options for all the sites.

Disable Aero and choose the standard/default theme On Vista or Windows 7
Disable Aero on Windows 7 or Vista - How-To Geek (http://www.howtogeek.com/howto/windows-vista/disable-aero-on-windows-vista/)

Disable or Reduce Hardware Acceleration
Hardware Acceleration can solve issues with graphics and crashing issues, depending on your graphics card driver Windows 7 and Vista users may not be able to disable this. Click here to see how to do this.

Lastly make sure your graphics driver is up to date as this can make a big difference to lagging even with a brand new PC.
http://faq.holdemmanager.com/questions/362/How+To+Update+Your+Graphics+Card+DriverOn

With all those tried if you still haven't found a solution Enable Logging
Please go to Hud Options > Table Preferences and enable logging. Then recreate the crash and then go to C:\Program Files\RVG Software\Holdem Manager\Logs and send us the log.txt file with details of what's happening to support@holdemmanager.net and a link to the thread you made detailing all the steps you tried and also be sure to send the log before restarting HM otherwise it will clear the log. Also try to provide as much detail as possible about what was happening at the time the crash happened, did you click a button, switch tab, hover over a stat etc.

olliepower
03-18-2011, 04:49 PM
Vacuum/analyse + reindex the database in pgdminIII after every 100.000 new hands.

Read:
Top 10: HEM performance increase tips