exporting hand speed

[urbanati]

I just realized that with the last few beta versions (I don't know since when) exporting hands is extremely slow. 35k hands took 150 minutes to export! I reinstalled 1.08.04 and it did the same job in a minute...

[netsrak]

Thanks for the info, i'll forward it to the developers.

[fozzy71]

I just realized that with the last few beta versions (I don't know since when) exporting hands is extremely slow. 35k hands took 150 minutes to export! I reinstalled 1.08.04 and it did the same job in a minute...

I export often, my own hands as well as customer's during support sessions, and I have never had it take more than 5 minutes to export my 300k hand DB. Typically I would say it probably takes 2 or 3 minutes at the most. I am always using the latest beta, and always have.

[urbanati]

I export often, my own hands as well as customer's during support sessions, and I have never had it take more than 5 minutes to export my 300k hand DB. Typically I would say it probably takes 2 or 3 minutes at the most. I am always using the latest beta, and always have.
but both my laptop and my desktop has the same problem...

[fozzy71]

but both my laptop and my desktop has the same problem...

Do you perform regular maintenance on your DB and HD? Have you turned off the SQL Logging, deleted the logs, and performance tuned your pg_postgresql.conf file to best work for your machine?


My desktop is almost 3 years old: AMD 4200+, 2gb RAM. $700 gateway in Januyary of '07.

I just exported 234k hands in ~40 seconds.


I would suggest you try the majority of the things in this thread: http://www.holdemmanager.net/forum/showthread.php?t=11194

Some of the most important things, imo:

- Turning off logging and deleting existing logs
- Vacuum/Full/Analyze, then Reindex
- SQL Tuning Wizard - http://www.holdemmanager.net/faq/afmmain.aspx?faqid=172
- Defrag last and make sure you stop the postgresql service before you defrag. I personally use Defraggler.
- Do a Cold Boot (Shut Down > Start) before you use HM again

[urbanati]

Do you perform regular maintenance on your DB and HD? Have you turned off the SQL Logging, deleted the logs, and performance tuned your pg_postgresql.conf file to best work for your machine?


My desktop is almost 3 years old: AMD 4200+, 2gb RAM. $700 gateway in Januyary of '07.

I just exported 234k hands in ~40 seconds.


I would suggest you try the majority of the things in this thread: http://www.holdemmanager.net/forum/showthread.php?t=11194

Some of the most important things, imo:

- Turning off logging and deleting existing logs
- Vacuum/Full/Analyze, then Reindex
- SQL Tuning Wizard - http://www.holdemmanager.net/faq/afmmain.aspx?faqid=172
- Defrag last and make sure you stop the postgresql service before you defrag. I personally use Defraggler.
- Do a Cold Boot (Shut Down > Start) before you use HM again

well, I maintain my database regularly but my main problem is probably that I have postgresql 8.0, and I don't know how to upgade it:(

[fozzy71]

well, I maintain my database regularly but my main problem is probably that I have postgresql 8.0, and I don't know how to upgade it:(

That is likely your biggest problem.


Vista: Turn off UAC - http://www.holdemmanager.net/faq/afmviewfaq.aspx?faqid=73

Turn off Windows Firewall for installing HM and PostgreSQL. Once you get those installed you can add exceptions to the firewall. If you have a 3rd party firewall, uninstall it completely before installing HM/SQL - http://www.holdemmanager.net/faq/afmviewfaq.aspx?faqid=171


Before you uninstall SQL 8.0:

Just to be overly protective of your data, I suggest you pretend you are also reinstalling HM, even though you do not have to reinstall HM to update to SQL 8.3.

I want to re-install Holdem Manger without losing all of my settings and preferences. Can this be done? (http://www.holdemmanager.net/faq/afmviewfaq.aspx?faqid=98)

You want to make sure you backup your Processed/Archived hand histories, your entire \config folder, and your exportednotes file. (http://www.holdemmanager.net/faq/?f=119) I usually just copy my entire \Holdem Manager directory.

I would also make sure you manually export the database to hand history text files:

HM > Options > Database Management > Connect > Export Hands

How do I export or import hands into and from Holdem Manager? (http://www.holdemmanager.net/faq/afmviewfaq.aspx?faqid=173)


Make sure you copy that folder as well as the other stuff I mentioned.

This helps to insure that if anything goes wrong with the backup/restore, you can manually import the exported files to rebuild.




For uninstalling SQL please follow these steps:

-Uninstall PostgreSQL from the Windows Control Panel.

- manually delete the Program Files\Postgresql folders
- run the command - start > run > cmd >


net user postgres /delete

- reboot.
- install PostgreSQL again, with your firewall uninstalled or turned off if windows firewall, using these directions and postgresql.zip version.

http://www.holdemmanager.net/faq/afmviewfaq.aspx?faqid=176


Logging:

I would suggest you turn off logging on your new SQL installation as well as these other performance improvements - Top 10: HEM performance increase tips
(http://208.109.95.123/forum/showthread.php?p=62613&posted=1#post62613)

To turn off logging, follow these instructions. This is the first thing I do anytime I install SQL for someone.

- Start > My Computer > Tools > Folder Options > View > UnCheck 'Hide Extensions for known file types' > OK

- C:\Program Files\PostgreSQL\data\postgresql.conf > Right-Click > Open With.. > NotePad > Check 'Always use this program'

- Scroll about half way down to ~Lines 245 - 260:

- The last line of this block of code, for the 'logging_collector', must be changed from On to Off.


------------------------------------------------------------------------------
# ERROR REPORTING AND LOGGING
#------------------------------------------------------------------------------

# - Where to Log -

log_destination = 'stderr' # Valid values are combinations of
# stderr, csvlog, syslog and eventlog,
# depending on platform. csvlog
# requires logging_collector to be on.

# This is used when logging to stderr:
logging_collector = off # Enable capturing of stderr and csvlog

File > Save; File > Close

Start > Programs > PostgreSQL 8.3 > Reload Configuration.



Now you should be ready to do a bulk Import From Folder

Make sure you have the latest HM Beta installed:

HM > Import From Folder > point at your exported text files folder you made earlier.

\RVG Software\Holdem Manager\HandHistoryExport_YourDataBaseName

[urbanati]

thanks, I hope I can do it :)