PDA

View Full Version : Hem running slow - npgsqlcommand object



Sirus
05-02-2010, 09:50 PM
My hem is running very slow - taking ages to stop importing. Reading files in a folder, running reports.

I get this error

http://img3.imageshack.us/img3/6241/61883848.jpg

rebooting doesnt seem improve matters. Im using vista 32 and 1.10.04b

tia

edit: notice hands per second import speed

http://img704.imageshack.us/img704/7856/81979892.jpg

netsrak
05-03-2010, 04:47 AM
You seem to have a Postgresql problem.
Is your harddisk full?
You should do a vacuum/full via pgadmin FAQ - Hold'em Manager Poker Tracking Software :: Vacuum Analyze Database (http://faq.holdemmanager.com/questions/88/Vacuum+Analyze+Database+)
After that run a reindex (same way).

And try our performance tips: FAQ - Hold'em Manager Poker Tracking Software :: Holdem Manager Performance & Speed Tweaks (http://faq.holdemmanager.com/questions/373/Holdem+Manager+Performance+%26+Speed+Tweaks)

Sirus
05-03-2010, 03:55 PM
after vacuuming do I analyse or reindex? and reindex options do i check force?

thx

netsrak
05-04-2010, 03:46 AM
After vacuum/full do a reindex. The Force option is obsolete (why does nobody read the help? :) )

Sirus
05-04-2010, 01:03 PM
after the vacuum and reindex my import speeds are like 2 hands per second. HELP!!!

morny
05-04-2010, 06:54 PM
If you create a new database and import a few thousand hands does your speeds still come in slow or what speed are you getting then?

Did you try all the tweaks Karsten linked to?

Sirus
05-06-2010, 09:26 PM
If you create a new database and import a few thousand hands does your speeds still come in slow or what speed are you getting then?

Did you try all the tweaks Karsten linked to?

Hi Morny,

Yeah Ive done probably all the tweaks a few times. Now I'm getting this error...

http://img696.imageshack.us/img696/773/76754212.jpg

I try and connect via PGADMIN but i get this error:
Server doesn't listen
The server doesn't accept connections: the connection library reports
could not connect to server: Connection refused (0x0000274D/10061) Is the server running on host "127.0.0.1" and accepting TCP/IP connections on port 5432?
If you encounter this message, please check if the server you're trying to contact is actually running PostgreSQL on the given port. Test if you have network connectivity from your client to the server host using ping or equivalent tools. Is your network / VPN / SSH tunnel / firewall configured correctly?
For security reasons, PostgreSQL does not listen on all available IP addresses on the server machine initially. In order to access the server over the network, you need to enable listening on the address first.
For PostgreSQL servers starting with version 8.0, this is controlled using the "listen_addresses" parameter in the postgresql.conf file. Here, you can enter a list of IP addresses the server should listen on, or simply use '*' to listen on all available IP addresses. For earlier servers (Version 7.3 or 7.4), you'll need to set the "tcpip_socket" parameter to 'true'.
You can use the postgresql.conf editor that is built into pgAdmin III to edit the postgresql.conf configuration file. After changing this file, you need to restart the server process to make the setting effective.
If you double-checked your configuration but still get this error message, it's still unlikely that you encounter a fatal PostgreSQL misbehaviour. You probably have some low level network connectivity problems (e.g. firewall configuration). Please check this thoroughly before reporting a bug to the PostgreSQL community.

what should I do? I dont mind doing a reinstall of hem and postgres but I would like to keep all my data/results somehow? Please press the powers that be to improve import speeds or database transfering.

thx

_Loki_
05-06-2010, 10:09 PM
It could be a simple fix

see basic postgreSQL troubleshooting section here: -
FAQ - Hold'em Manager Poker Tracking Software :: Can't Connect / Failed to Start PostgreSQL (http://faq.holdemmanager.com/questions/91/Can%27t+Connect+%7B47%7D+Failed+to+Start+PostgreSQ L+)

Sirus
05-07-2010, 12:42 AM
It could be a simple fix

see basic postgreSQL troubleshooting section here: -
FAQ - Hold'em Manager Poker Tracking Software :: Can't Connect / Failed to Start PostgreSQL (http://faq.holdemmanager.com/questions/91/Can%27t+Connect+%7B47%7D+Failed+to+Start+PostgreSQ L+)

thanks for that.

I deleted the .pib file and restarted hem and import speeds were initially at 250+per second. The folder hem was importing from had over 3k files in, of which most were duplicates. I'm now half way through the folder and import speeds have dropped to <85 per second, even though 99.9% of the hands imported are duplicates - is this normal?

_Loki_
05-07-2010, 12:59 AM
I don't know enough to comment on duplicate hands

with my ancient laptop running xp & with a 7200 hdd I get 35 hands/s if i'm importing non-duplicate 6max cash hands
The largest import I've done in one go is 60k hands split into files of a days play (say 60 small files) & it starts at 35 h/s & drops to about 28 h/s by the end of the import

tell me - just how large is your DB ?
are you regularly importing large numbers of hands ?
how large ?
why you on vista ? :)

you haven't said much about your system spec & setup.....

Sirus
05-07-2010, 09:05 AM
I don't know enough to comment on duplicate hands

with my ancient laptop running xp & with a 7200 hdd I get 35 hands/s if i'm importing non-duplicate 6max cash hands
The largest import I've done in one go is 60k hands split into files of a days play (say 60 small files) & it starts at 35 h/s & drops to about 28 h/s by the end of the import

tell me - just how large is your DB ?
are you regularly importing large numbers of hands ?
how large ?
why you on vista ? :)

you haven't said much about your system spec & setup.....

my db is huge - over 770k players'
60k per day
-
because i bought w7 ultimate and i cant use a certain software on the comp because of signed drivers.

morny
05-07-2010, 03:15 PM
Try any of the steps below you haven't already and if they dont work come back to me and well try a TV session to reconnect

This is usually a firewall or windows update issue.

First try to reboot.

If no help, try this:

Start > Programs > PostgreSQL > 8.x > Stop Service

Start > Programs > PostgreSQL > 8.x > Start Service

If that doesnt help delete the \postgresql\8.x\data\postmaster.pid file, if you see it.

Add exceptions to the windows firewall, even if it is off. If you have a 3rd party firewall, do the equivalent or uninstall it temporarily - FAQ - Hold'em Manager Poker Tracking Software :: Windows Firewall / Defender Problems (http://faq.holdemmanager.com/questions/275/Windows+Firewall+%7B47%7D+Defender+Problems) - Windows Firewall / Defender Problems

Please try following these FAQs, step by step:

1) FAQ - Hold'em Manager Poker Tracking Software :: Can't Connect / Failed to Start PostgreSQL (http://faq.holdemmanager.com/questions/91/Can't+Connect+%7B47%7D+Failed+to+Start+PostgreSQL+ ) Can't Connect / Failed to Start PostgreSQL
2) reinstall the same version of postgresql, using the same \data folder - FAQ - Hold'em Manager Poker Tracking Software :: Reinstall PostgreSQL Preserving Old Database (http://faq.holdemmanager.com/questions/71/Reinstall+PostgreSQL+Preserving+Old+DatabaseReinst all) PostgreSQL Preserving Old Database
3) Still Can't Connect to PosgreSQL? Try This! - Holdem Manager Forums (http://www.holdemmanager.net/forum/showthread.php?t=8261)

Sirus
05-07-2010, 04:17 PM
thanks for your response morny, yeah i deleted the pid file and i was able to connect to hem normally and import speeds increase initially and then decreased?

morny
05-08-2010, 12:11 AM
can you create a new database FAQ - Hold'em Manager Poker Tracking Software :: Create / Delete Database (http://faq.holdemmanager.com/questions/75/Create+%7B47%7D+Delete+Database) and do a test import and import a couple of thousand hands just to see if the performance speed increases and that should identify if its a setting/software issue or a database issue.

If your thinking of doing a clean reinstall you should consider the following.

Export and Import your Hand Histories
FAQ - Hold'em Manager Poker Tracking Software :: How to Import & Export Hands (http://faq.holdemmanager.com/questions/98/How+to+Import+%26+Export+Hands)

Export Your Notes
http://faq.holdemmanager.com/images/notes-02.jpg

Export Your Bonuses and Rakeback - Options > Rakeback & Bonuses http://faq.holdemmanager.com/images/rakeback-bonuses-01.jpg

Export any tourney summaries by selecting all your tournaments in the Data View Sub-Tab of the Tourney > Results Menu and choose Export Tourney Results and summaries

http://faq.holdemmanager.com/images/tourney-data-view-01.jpg

Sirus
05-08-2010, 01:12 PM
ive just created a new database and it has been stuck on 'found 75 files to process' for about 5 minutes. Does this mean that there is a fault with HEM and not Postgres?

_Loki_
05-08-2010, 06:06 PM
I am nowhere near well informed on this subject, but... I have a feeling that each of the files you are importing is BIG & that might be the trouble I have seen suggestions here on this forum before where the solution seems to be to divide the import job up over a few sessions & vacuum in between How big is each of those files ?? Do the import in your poker downtime over a few sleep periods

Sirus
05-08-2010, 07:35 PM
I am nowhere near well informed on this subject, but... I have a feeling that each of the files you are importing is BIG & that might be the trouble I have seen suggestions here on this forum before where the solution seems to be to divide the import job up over a few sessions & vacuum in between How big is each of those files ?? Do the import in your poker downtime over a few sleep periods

The files are not that big. Usually to import 75 files would take about 30-60minutes. Yesterday my import speeds were 0.5 hands per second - meaning completion would take over 16 hours.

_Loki_
05-08-2010, 08:09 PM
Really - I'm struggling because of lack of full info Morny had a diagnostic suggestion:
... If you create a new database and import a few thousand hands does your speeds still come in slow or what speed are you getting then?

My humble suggeston.... Why not create a UTF8 DB & import 5,000 hands & see what hands/second you're getting ?

If it's still crazy slow we then know for sure it's not file sizes etc etc

we have to diagnose this step-by-step...

Have you looked at task manager (or even better DL free 'Process Explorer' & use in place of task manager) while you're importing ?

Sirus
05-08-2010, 08:22 PM
Have you looked at task manager (or even better DL free 'Process Explorer' & use in place of task manager) while you're importing ?

for some reason my cpu was 100% and i looked in task manager and iirc hem was using a lot of my memory or something like that and i killed the process.

Sirus
05-08-2010, 08:59 PM
Really - I'm struggling because of lack of full info Morny had a diagnostic suggestion:

My humble suggeston.... Why not create a UTF8 DB & import 5,000 hands & see what hands/second you're getting ?

If it's still crazy slow we then know for sure it's not file sizes etc etc

we have to diagnose this step-by-step...

Have you looked at task manager (or even better DL free 'Process Explorer' & use in place of task manager) while you're importing ?

i created a new ascii db and import speeds were double that of a UTF8 db and both were faster than my current db - this wasnt the case earlier.

_Loki_
05-08-2010, 09:15 PM
i created a new ascii db and import speeds were double that of a UTF8 db and both were faster than my current db - this wasnt the case earlier.

OK...... if you NOW create a DB (ascii or utf8) & import 5,000 hands - what speed do you get ?

How big is your HDD ?

How much space is free ?

Sirus
05-08-2010, 09:23 PM
OK...... if you NOW create a DB (ascii or utf8) & import 5,000 hands - what speed do you get ?

How big is your HDD ?

How much space is free ?

ascii was 40 per second new db

UTF8 was 20 per second new db

current db importing 55 files at 7 per second.

hard drives are RAID 0 600gb 7200rpm with 50% free.

What are good import speeds per second?

Sirus
05-08-2010, 10:08 PM
http://img52.imageshack.us/img52/3900/gggrn.jpg

the above is process explorer. Now my hem is importing at 3 hands per second and completion time is longer than it was when it started.

Sirus
05-08-2010, 10:49 PM
Morny can we do a teamviewer session tomorrow?

morny
05-09-2010, 10:44 AM
Hi,

Please email me and we can do a teamviewer session, just download teamviewer from TeamViewer - Free Remote Access and Remote Desktop Sharing over the Internet (http://www.teamviewer.com) and let me know a suitable time GMT in advance. Teamviewer allows me to access your computer to fix the problem.

When we agree a suitable time you just need to send me the ID and password that Teamviewer creates to get access to your PC

Thanks
Morny
support@holdemmanager.com

Sirus
05-09-2010, 04:02 PM
Hi,

Please email me and we can do a teamviewer session, just download teamviewer from TeamViewer - Free Remote Access and Remote Desktop Sharing over the Internet (http://www.teamviewer.com) and let me know a suitable time GMT in advance. Teamviewer allows me to access your computer to fix the problem.

When we agree a suitable time you just need to send me the ID and password that Teamviewer creates to get access to your PC

Thanks
Morny
support@holdemmanager.com

email sent

Sirus
05-09-2010, 07:57 PM
can do it now if you have time

Sirus
05-09-2010, 08:38 PM
i updated to 1.11 and import speeds seem to be running at 30-40 hands per second which is reasonable:)