PDA

View Full Version : Less then 30K hands and over 10GB PostgreSQL file



Help_me
10-15-2008, 08:53 PM
Deleted (entire hand not just the histories, the stats also) down to this months hands and my PostgreSQL file is still over 10GB. It doesn't seem right. Anyone have any ideas and could help?

fabio
10-16-2008, 12:39 AM
Check the size of C:\Program Files\PostgreSQL\8.3\data\pg_log. You can delete all files in that folder

Jason82
10-17-2008, 02:50 AM
I have imported only 5k hands and pg_log folder size is almost 400MB. Are those files totally useless and if so, why they are not deleted automatically? Is there easy way to automatically delete them?

fabio
10-17-2008, 04:10 AM
Yes, the files are useless. Don't think that there is a way to delete them automatically

Help_me
10-17-2008, 05:13 AM
Great help. That worked a bit, but It's still over 8GB with less then 30K hands. That doens't seem right? What's the next step or why is it so large?

fabio
10-17-2008, 05:47 AM
Are those datamined hands?

bugmenot
10-17-2008, 12:54 PM
I have imported only 5k hands and pg_log folder size is almost 400MB. Are those files totally useless and if so, why they are not deleted automatically? Is there easy way to automatically delete them?

You can prevent them from growing that fast by changing

log_min_error_statement = error
to

log_min_error_statement = log
in your postgresql.conf file.

Help_me
10-18-2008, 01:18 AM
Are those datamined hands?

Used to have a larger database(played + datamined). Deleted down to only hands played this month. This really isn't fixable? Or are they supposed to be this large? That can' tbe true... million hand databases would be over 250 GBs..

fabio
10-18-2008, 06:33 AM
You can try vacuuming your database, that should decrease the size of the folder

ode
10-18-2008, 01:43 PM
I have about 1,8 million hands in database and database size is around ~7GB...

Jason82
10-20-2008, 02:38 AM
You can prevent them from growing that fast by changing

log_min_error_statement = error
to

log_min_error_statement = log
in your postgresql.conf file.

That helped, Thanks!!! :)

ffrllc
10-20-2008, 05:11 PM
You can prevent them from growing that fast by changing

log_min_error_statement = error
to

log_min_error_statement = log
in your postgresql.conf file.



I changed this code and haven't noticed anything. Will this just help over time or should I see an immediate reduction in hard drive space HM DB/postgres folder takes up?


Thanks.

Jason82
10-21-2008, 03:22 AM
Check that you don't have # -mark at start of the code line.
I think that # -mark means that line is "comment" or other words not in use.

You can also use pgAdminIII to modify postgresql.conf file. Go to start-> all programs-> postgresql -> pgAdmin III, in pgAdmin III go to File -> Open postgresql.conf and you probably have to manually look for postgresql.conf. It maybe easier to configurate and understand this way.

ffrllc
10-21-2008, 04:30 AM
Thanks,

I changed it by following these steps, but I still don't see anything different in the size of my postgres SQL folder. Should I click "enable" for the log_min_error_statement file while in the PG Admin tool?

morny
10-21-2008, 01:09 PM
Im presuming that code will prevent future database growth but dosent resize the current databases.

You might have several other databases, possible old HM or PT ones and you can delete them by following this FAQ http://208.109.95.123/faq/?f=21

bugmenot
10-21-2008, 01:50 PM
It actually doesn't do anything to your database. It just prevents HM from spamming your logfiles with megabytes of the same error over and over.

Check your pg_log directory, without the change it is growing at a ridiculous rate. Although you can safely delete all those files I found it to be annoying so I looked for a workaround until they fix what produces that error in the first place and even if they don't I won't have to worry about it anymore.

Michielvv
10-22-2008, 03:48 PM
My database is about 3.6GB for 1milj. hands, this is normal?

ffrllc
10-22-2008, 06:56 PM
BIG PROBLEM. Need help please !!!

I followed the tips suggested above and changed the log_min_error_statement = error to log_min_error_statement = log


Now I can't connect to my Postgres SQL Database at all.


When I try to open HM I get an error message letting me know it is unable to connect as seen by this screenshot:

http://i237.photobucket.com/albums/ff92/ffrllc/1.jpg



Then when I click OK, this window opens:

http://i237.photobucket.com/albums/ff92/ffrllc/F2.jpg


Then when I click connect, I get this window:

http://i237.photobucket.com/albums/ff92/ffrllc/F3.jpg


Then it says Holdem Mnagaer has started the service, please try again as seen here:

http://i237.photobucket.com/albums/ff92/ffrllc/F4.jpg



But when I try again, I start all over and get the first error message letting me know it can't connect.


I tried changing the log_min_error_statement = log back to log_min_error_statement = error, but I'm still having this issue.


Any clue why this is happening and what I can do to correct it?


Thansk in advance !!!

morny
10-22-2008, 07:03 PM
Please try the following and if it gives an error message when you do that please post it here http://208.109.95.123/faq/afmviewfaq.aspx?faqid=34 FWIW its very unlikely it has anything to do with changing that code.

ffrllc
10-22-2008, 07:49 PM
It is set to start automatically, but it was not started when I opened that folder. When I clicked on it to start it tried, but was unable. I got this error message:

http://i237.photobucket.com/albums/ff92/ffrllc/Error.jpg

morny
10-22-2008, 08:43 PM
Havent seen that error in a while, the last time i got it uninstalling and reinstalling PostgreSQL and then rebooting solved the issue however it came back. Please try it and let me know if it works.

Heres the related thread http://208.109.95.123/forum/showthread.php?t=1252&highlight=error+1053

fabio
10-23-2008, 04:39 AM
You should also install the latest PostgreSQL version: http://www.holdemmanager.com/downloads/postgresql.zip

ffrllc
10-23-2008, 01:24 PM
Ok, looks like I need some real help here.

I uninstalled postgres v8.2 and then reinstalled the latest version, v8.3.

The good news is I am able to open Holdem Manager fine now (no more connection issues).

The bad news is I've lost my entire DB. When HM opens now I have 0 players and 0 hands in the DB that opens.


Before I unistalled postgres I copied the postgres v8.2 data folder (47GB's).


Is there any way for me to get my DB back at this point?

ffrllc
10-23-2008, 06:39 PM
I spoke too soon about the connection issue being resolved. It seem I installed postgresql plus and not the basic postgresql. I ran into another connection issue after unistalling postgresql plus and installing the standard postgres 8.3.


When I try and open HM I get an error message letting me know it was unable to read the data as seen in the error message here:

http://i237.photobucket.com/albums/ff92/ffrllc/Unabletoreaddata.jpg


When I click ok, I go to this screen:

http://i237.photobucket.com/albums/ff92/ffrllc/F2.jpg


When I click connect on that screen I get this error message:

http://i237.photobucket.com/albums/ff92/ffrllc/ConnectionError.jpg


Any idea what I should do next?

morny
10-23-2008, 06:50 PM
To retrieve your database please do this. Stop the postgreSQL service by going to Control Panel > Admin Tools > Services and scroll to PostgreSQL and right click it and stop the service.

the go to C:\Program Files\PostgreSQL\PostgreSQL8.x\Data and delete everything in there assuming thats just a new blank database.

Then copy your files from your old PostgreSQL folder C:\Program Files\PostgreSQL\PostgreSQL8.x\Data into the new one and then restart the postgreSQL service and it should be fine.

morny
10-23-2008, 06:51 PM
Did you reinstall a firewall/antivirus after you got it running again? This is another program causing conflicts with postgeSQL. Please follow this FAQ for solutions: http://208.109.95.123/faq/afmviewfaq.aspx?faqid=164

ffrllc
10-23-2008, 07:25 PM
I've had the same McAfee anti-virus/firewall for some time without any change.


To retrieve your database please do this. Stop the postgreSQL service by going to Control Panel > Admin Tools > Services and scroll to PostgreSQL and right click it and stop the service.

the go to C:\Program Files\PostgreSQL\PostgreSQL8.x\Data and delete everything in there assuming thats just a new blank database.

Then copy your files from your old PostgreSQL folder C:\Program Files\PostgreSQL\PostgreSQL8.x\Data into the new one and then restart the postgreSQL service and it should be fine.

I did this and still ran into the same problem of not being able to connect.




Did you reinstall a firewall/antivirus after you got it running again? This is another program causing conflicts with postgeSQL. Please follow this FAQ for solutions: http://208.109.95.123/faq/afmviewfaq.aspx?faqid=164

I also followed these troubleshooting tips to disable UAC, unistall Postgres, reinstall and try and open HM. I still can't get the connection with HM. When i try this time I get this error message:

http://i237.photobucket.com/albums/ff92/ffrllc/HM-1.jpg


Any idea what in the world is going on? What should I try next?



I've heard sometimes a teamviewer session can be set up for tricky issues. If this is one where a meeting can be set I will make sure I'm available whenever you are open.



Thanks for all the help so far.

morny
10-23-2008, 08:00 PM
The problem is i would doing the exact same thing i just described in that link above, ist always a problem with firewalls/antiviruses/defenders and usually if it dosent work its because someone jusrt disabled the antivirus instead of uninstalled it or didnt add all the HM .exe files to the exceptions list of programs that cannot be uninstalled like Windows Firewall for example.

Its very late now so i wont have time for a teamviewer but if you follow that FAQ exactly and it still dosent work let me know and ill have a look tommorrow but ill probably just be repeating everything in the FAQ

ffrllc
10-24-2008, 12:27 AM
I'm not sure what to do next. If you would be open to doing a teamviewer session just let me know whenever would work for you and I'll try and make sure I'll be available.



Just let me know what time would work for you.


Thanks.

morny
10-24-2008, 10:53 AM
Contact me by email morny@holdemmanager.net with a suitable time, before we do a teamviewer ill need you to uninstall any firewalls/antiviruses/spyware programs where possible through control Panel > Add & Remove programs and also uninstall PostgreSQL