PDA

View Full Version : Top 10: HEM performance increase tips



Pages : [1] 2 3

Patvs
05-24-2009, 12:46 AM
**If you are using HM2 please see this thread (http://forums.holdemmanager.com/general-support/494402-hm2-performance-tips.html).**

I just thought it would be helpful to post this list. The HEM FAQ has most of this information, but it's quite cluttered to find it in so many FAQs.

Please post here, if you can think of other tips that will help increase the performance of HEM, HM Import, Table Scanner, HUD and postgreSQL. Specifically for those that have a HUGE database. Ask questions, and HEM users can discuss about their experiences using these tips here.


Top 10 tips:

Upgrade your HARDWARE*:
1 to 3

-1 Get a fast harddisk! (= more important than having a QuadCore over a DualCore processor!)
---x Preferably a fast SSD harddisk (fastest) for your database and Windows (Intel or OCZ Vertex 2/3)
---x A new 5400/7200 RPM IDE/SATA harddisk (slowest)
The SSD not only wins on Sequential Read/Write speeds (of big files), they win the most with access time, 4K Read/Write speeds (small files) and just "overall" I/O operations per second.
A Western Digital VelociRaptor used to be easily twice as fast as the best 7200 RPM harddisk. However it currently only is about 10% faster than the latest Seagate Barracudas, Hitachi Deskstars, Western Digital Caviar Blacks and Samsung Spinpoints F1/F3. The VelociRaptor does not justify its price difference anymore.

Note: a brand new $60 high-end 2012 model 7200 RPM harddisk will be twice as fast as your 3-4+ yrs old 7200 RPM harddisk!...

LAPTOP: ALL 5400 RPM laptop harddisks are slow (favoring being energy efficient over performance. Try to find one with a SSD.
-make sure the Control Panel-->Power Options are set to HIGH PERFORMANCE on your computer
-Expert Users only: overclock your CPU!

An alternative to a SSD SATA harddisk: are the new PCI-Express cards like the OCZ RevoDrive. And if you have a USB 3.0 mainboard the SuperTalent RAIDDrive)

-2 Get lots of RAM (at least 2+ GB RAM recommended if you have a 10+ GB database) (note: when using more than 3 GB RAM, use a 64-bit version of Windows)
-3 PostgreSQL loves multiple CPUs, so the more CPUs the better. (Intel i5 / i7 or AMD Phenom) Also "Holdem Manager will be adding improvements that will take advantage of quad core/64 bit versions."

-Change Processes Priority. Start the Windows Task Manager, processes tab--> and while running an auto import in HoldemManager---> rightclick on HoldemManager.exe, HMHud.exe, HMimport.exe---> set priority to HIGH (not real time!), set affinity to use all your CPUs. (click for more detailed info) (http://forums.holdemmanager.com/manager-general/28054-tips-increase-speed-importing-purchased-hands-general-hud-performance.html#post135649)

Update your SOFTWARE:

-4 Always use the latest version of Holdem Manager (http://www.holdemmanager.net/forum/forumdisplay.php?f=11), and use the most current version of PostgreSQL (http://www.postgresql.org/). We support 8.4.x by default.

Advanced Users: You are allowed to use 9.0/9.2 (64 bit). They will work just fine*, but they're not officially supported. *Some features (like using the internal backup/restore tool may not work. You can manually use pgadminIII instead: http://faq.holdemmanager.com/questions/72/Backup%26RestoreDatabase (this is for HM1!)

How to install HEM + PostgreSQL 8.4. (http://www.holdemmanager.net/forum/showthread.php?t=12925)
Update your Windows (use Microsoft Update, and make sure you have the latest Service Pack (SP2 for Vista, SP3 for XP)) and update all system drivers (including your mainboard and videocard driver! and .net framework updates).


-5 Remove the WinnerName, WinnerCards and WinnerWon from the Hands View Column Selector (http://img179.imageshack.us/img179/2655/removewwwxg8.jpg)

-6 Defrag your non-SSD harddisk, using Defraggler by Piriform (http://www.defraggler.com/download/). Or you can use Disk Defrag by Auslogics (http://www.auslogics.com/en/software/disk-defrag/download) or Power Defragmenter (http://www.softpedia.com/progDownload/Power-Defragmenter-Download-20185.html) (all FREE software and better than the Windows included Defrag)
It is recommended to stop postgreSQL from running before you use defrag! (To stop and start the service: Start > All Programs > PostgreSQL > Stop Service / Start Service)

PostgreSQL:

-7 Edit your PostgreSQL.conf file in the SQL 8.x/data folder. (you need to reboot after you've made the changes)
Do not use the Tuning Wizard. On some systems it will make changes to the postgresql.conf it shouldn't, resulting in being unable to connect to the database!
If you experience this problem--> simply go to the 8.4/data folder, undo the changes you made and reboot.
Recommended changes:
shared_buffers = <number> MB (set it to 20% of your system's memory, but not higher than 512 MB)
effective_cache_size = <number> MB (set this to 4x the size of the shared_buffers)

Change at your own risk: (change them back to default if postgresql stops running, or your performance decreases)
wal_buffers = 8MB
temp_buffers = 24MB #(wal_buffers x3)
work_mem = 128MB
maintenance_work_mem = 512MB
commit_delay = 10000
checkpoint_segments = 128
checkpoint_completion_target = 0.9


Remove the # at the beginning of the line after making the changes you want otherwise PostgreSQL will still ignore them (lines with a # at the front are not interpreted).


Decrease the SIZE of your database:

-8 How to optimize the database size in 3 steps: -1/2 Vacuum + Analyse, -3 Reindex (http://www.linuxinsight.com/optimize_postgresql_database_size.html)
--8.1/8.2 VACUUM + Analyse: VACUUM Analyse your database regularly (http://faq.holdemmanager.com/questions/88/Vacuum+Analyze+Database+) (How to do a manual VACUUM)
--8.3 REINDEX (see 8.1 for instructions, but choose Reindex instead of Vacuum in pgAdmin)

-9 Purge hand histories (http://faq.holdemmanager.com/questions/196/Observed+Hand+History+Configuration) (It will free up disk space without losing stats, but you lose the option to see the HH or view the hand in the replayer). This is only for HM1! In HM2 a purge deletes the stats too.

-10 How to make PostgreSQL stop making those big log files (http://www.holdemmanager.net/forum/showthread.php?t=8423) (I had 8 GB of logfiles before I realized you're allowed to delete the content of the data/pg_log directory!)

-11
--11.1 A near-empty harddisk is faster than a near-full harddisk, so delete your crap! CrapCleaner by Piriform (http://www.ccleaner.com/download) and Windows Disk Cleanup can help.
--11.2 Turn off indexing and turn off "compress this drive to save disk space" in your harddisk properties.
--11.3 Optimize Windows for "best performance" (in Control Panel/System/Advanced/Performance/Setting/Visual Effects).
--11.4 Advanced users only: save space by turning off System Restore (System/System Protection). *not recommended*

-12 Windows 7 + SSD
Windows 7 users, General Windows 7 Performance Tweaks guide (http://www.ocztechnologyforum.com/forum/showthread.php?t=63273)*
(If you already have a SSD harddisk also do all the SSD Tweaks in that guide.. though don't disable hibernation!, don't completely disable your page file!, and don't disable AERO!)
*Services to disable in that guide: also don't disable Secondary Logon, Hibernation, and SuperFetch.

Anyone can think of #13 and other tips?</number></number>

morny
05-24-2009, 10:54 AM
Thanks for this, were updating the FAQs at the moment so ill give this a few days and see if theres any more suggestions and ill forward it to the guy we have updating the FAQ, if it drops down over the next week feel free to bump it to remind me to add it

mksmipalla
05-24-2009, 12:09 PM
Good list. All important things. On number 6 I recommend using Defragler I have had good luck with it overall and does a nice job with postgre. Only thing I would add is that it seems to work better if you stop Postgre from running before you defrag. If your not sure how here is a few pics.

Open your control panel, then click on "Administrative tools"

http://img195.imageshack.us/img195/2458/controlpanel.jpg


After opening tools then click on " Services" and the service window will open with all of the running services. Scroll down until you see PostgreSQL and click on it.

http://img195.imageshack.us/img195/2098/stoppost.jpg

Now just click on the " Stop the service" and you will see it change to "Stopped" in the Status list.

Then perform your defrag. After it's done just come back and click on "Restart the service". Done

morny
05-24-2009, 12:29 PM
A quicker way to stop and start the service is Start > All Programs > PostgreSQL > Stop Service, either works though

PCP Poker
05-24-2009, 01:09 PM
How to optimize PostgreSQL database size (http://www.linuxinsight.com/optimize_postgresql_database_size.html) (I haven't tried the reindexing and dump/restore. Can anyone confirm it's save to do that to your HEM database?)



Anyone can think of #11 and other tips?


I habitually do the dump/restore. It cuts the db size by at least 70% on average and greatly improves performance. Sometimes it just doesn't work though. You can do everything perfect, and it just doesn't work. This is one of the reasons i'm really starting to hate postgre. Stuff always decides just not to work. It's like a built in AI that know how to mess with you....

Patvs
05-25-2009, 12:35 AM
I tried reindex (for my whole database). The size decreased from 16.4 GB to 15.8 GB (only 4%, but still a useful 600 MB more free space and smaller database)

The two greatest posts on the forum I found this week, were -1 the post by mksmipalla (Want to stop Postgre from creating those large log files, here's how). Morny added a link to that post in the FAQ (http://www.holdemmanager.net/faq/afmviewfaq.aspx?faqid=185). I noticed every FAQ entry has tags. For example, this FAQ entry has: "pg_log postgreSQL large log files save space reduce logs postgresql"

However when I click on "PostgreSQL" to see ALL the FAQ entries with that tag, it shows me:

15 FAQs Found
Page 1 of 2

It shows 10 FAQ entries on page 1. And I'm unable to view page 2! (where I'm guessing this new entry is)
I tried different browsers. The Go to Page 2 button is javascript, but it doesn't seem to work. (does it work for you?) Since I've been using the tags mostly to browse through the FAQ it seems this is the main problem why there are some posts I know that exist, I just cannot find.

(-second great post I found was how to change the colors of all the lines in the graphs, including the EV line, hopefully that will be back in the FAQ soon)

----

Also I was hoping a similar post like this one (Top 10: HEM performance increase tips) could be made about Backuping-Restoring a Database / Migrating a Database to a New Computer-Harddisk / Backuping your HEM settings (ALL of those combined in one simple overview, using a similar layout as this topic) since those are currently spread all over the FAQ in seperate topics and I would need all the info if I wanted to re-install HEM on a new computer.

And the FORUM could benefit from a general Anthology Thread topic (http://forumserver.twoplustwo.com/32/beginners-questions/anthology-thread-340027/) listing the most usefull forum posts by category.


I'll update the main post as much as possible with all of your input.

stretch00
05-25-2009, 02:59 PM
My question really is more of a concern and to possibly put a little more info out for the people like me that really know nothing about how computers,or databases work.
After reading this great thread,I thought maybe I would try the suggestions. Having a few concerns about my HM Data;
Do any of these steps affect the actual HHs?
Will any of the players info in HM be altered?
Will it change any folder views or how say; How an Archive folder is viewed? ex; MM/DD/YY
And these would be just a few concerns for someone like me who understands a little. While I like the idea of this thread, maybe if an "Anthology/Wisdom" does get made and supported, I think it has to be made very clear what these changes/tweaks will accomplish, and more importantly what they will change if anything or nothing at all.Some of these tweaks are not for novice and even for the intermediate PC user could be quite intimidating.

Patvs
05-27-2009, 07:55 PM
I believe, all of the steps above (and the 10 steps in the HEM FAQ) don't affect the HH, player info, folder views, etc. EXCEPT: #9 Purge hand histories (which will keep the player stats, but delete the handhistory)

Which of these tweaks do you find intimidating? I find 7.1 (and 7.2) and 8.3 really intimidating. In fact I'm reluctant to even try them. :-)
(I'll try 7.2 as soon as I have a new computer with 6 GB RAM, I only have 1 GB now, so it seems pointless to try 7.2 now)
But most others (like Defrag, or making sure you have the most current version of all your software/drivers) are things you should be doing anyway, just for regular Windows maintenance.
And the rest is there to make your database SMALLER.

stretch00
05-28-2009, 02:23 PM
The ones that did intimidate me were the 7.1/7.2 and 8.0,8.3. The latter being the most.The blog that 8.0/8.3 connect to is so dated I would never do it to my database running SQL8.3. I noticed that all of the responses received to that blog date back to 2007 even the the original blog date.

So since most users of HM are currently running at minimum SQL8.0, how relevant can any of those tweaks really be? Have you done them, and did they really increase the performance or compact the database size? What version SQL are you using?
I definitely agree with 10 and did that one myself as soon as MK posted it and have never had an issue.

It's just really the SQL stuff that's intimidating,all the normal PC maintenance I have no problem with.One question for you though is I see you use Defragler from Piriform, DO you defrag your SQL database with it?

I'm just above a novice pc user so delving into certain stuff like SQL that runs such an important program to me like HM,always scares me a little.I like this thread though and hope we can keep it going and get more input from other users with more knowledge and good info. I'm going to do some research on SQL, I never did it I only installed it,I need to find out more.

mug3n
06-07-2009, 10:03 PM
Okay, question. In the dump/restore instructions, how do you login as pmx and do all that command jargon? Anyone?

stretch00
06-08-2009, 02:29 PM
Okay, question. In the dump/restore instructions, how do you login as pmx and do all that command jargon? Anyone?

As far as I can tell from this post,MUG
You can just use PGAdmin to accomplish a dump/restore,but before dumping you need to make a back up of that DB and store it somewhere outside of SQL.
That link that refers to dump/restore is quite old 2006!So like I said in previous posts I am very careful about following outdated info like that!

mug3n
06-10-2009, 12:30 AM
Ohhh okay. Yeah that makes sense. I figured there has to be an easier way than entering all that stuff lol. Thanks.

stretch00
06-10-2009, 12:46 AM
I've been doing some research on sql the past day or so.And from what i can tell it really wont matter soon to do alot of the sql performance stuff with the newest version soon to be a full release,it's in a stable beta version now.So I would hold off if you can and wait for 8.4

Patvs
06-29-2009, 06:49 PM
Thanks for this, were updating the FAQs at the moment so ill give this a few days and see if theres any more suggestions and ill forward it to the guy we have updating the FAQ, if it drops down over the next week feel free to bump it to remind me to add it


bump... what is the status of the updated FAQs?

fozzy71
06-29-2009, 06:59 PM
They are still being worked on. Morny no longer works for HM. I have taken over his forum responsibilities, and I believe Mike has taken on the bulk of the responsibility for the FAQs. I am starting work on re-writing one of them now, to try and lighten Mike's load. I have no way of knowing an ETA at this point. Mike might be better informed, but not sure if he could give an accurate ETA either yet. :(

All Apologies
06-30-2009, 03:39 AM
Curious how often should someone do these to free up space?

pr0wler
06-30-2009, 05:18 AM
I'm really confused how to do the vacuum and stuff. It keeps saying to do these commands...but where/how? Do you just login to postgreSQL? If so how do you do that?

fozzy71
06-30-2009, 07:38 AM
Curious how often should someone do these to free up space?

I do maintenance once a month at least.


I'm really confused how to do the vacuum and stuff. It keeps saying to do these commands...but where/how? Do you just login to postgreSQL? If so how do you do that?

Click the link where it says 'how to do a manual Vacuum'.


..............

-8 How to optimize the database size in 3 steps: -1 Vacuum, -2 Reindex, -3 dump/restore (http://www.linuxinsight.com/optimize_postgresql_database_size.html)
--8.1 VACUUM: VACUUM Analyse your database regularly (http://www.holdemmanager.net/faq/afmmain.aspx?faqid=163) (How to do a manual VACUUM)
--8.2 REINDEX (see 8.1 for instructions, but choose Reindex instead of Vacuum in pgAdmin)
--8.3 Dump/restore (for advanced users) Step by step how to dump/restore the database (http://www.linuxinsight.com/optimize_postgresql_database_size.html#comment-538)
.....

LeCopain
07-23-2009, 05:14 PM
Got a question about the solid states,
The solid state disks are dropping in price now, so it's a nice option.

The space on them is limited, so which program would you put on the ssd?
- PostgresSQL + underlying files
- HoldemManager root map (I noticed it's big)
- Operating system
- HH archive (the location to which HEM writes the files after importing).

Where does the SSD contribute most? (assuming 80 / 120GB)

netsrak
07-23-2009, 05:48 PM
I recommend to put only the Postgresql data folder (the cluster) to the SSD. Leave the rest on a ordinary harddisk

Bohonos
08-10-2009, 10:50 PM
why #5 Remove the WinnerName, WinnerCards and WinnerWon from the Hands View Column Selector

??????????

netsrak
08-11-2009, 04:31 AM
Because for displaying this 3 fields in the report the database statement is more sophisticated and needs more cpu time.

Patvs
08-13-2009, 12:44 PM
I fixed all the links in the mainpost (linking to the proper FAQ links)

And added a Buying a New Computer Guide: Buying/Building a New Computer optimized for HoldemManager + PostgreSQL.
Ranging from mid-end <$1000 (incl. monitor) - to high-end $2700)

It might be fun to also further discuss HARDWARE UPGRADE recommendations in this topic to improve HEM performance.

fozzy71
08-13-2009, 01:29 PM
Thx.

I am planning (hoping) to build a hi-performance PC this fall. Something similar to this. :D




1 - Intel Core i7 920 Nehalem 2.66GHz LGA 1366 130W Quad-Core Processor Model BX80601920

1 - GIGABYTE GA-EX58-UD3R LGA 1366 Intel X58 ATX Intel Motherboard

2 - OCZ Vertex Series OCZSSD2-1VTX30G 2.5" MLC Internal Solid state disk (SSD)

1 - Western Digital Caviar Black WD5001AALS 500GB 7200 RPM SATA 3.0Gb/s 3.5

1 - Western Digital Caviar Black WD1001FALS 1TB 7200 RPM SATA 3.0Gb/s 3.5

1 - MSI N9600GT-MD1G GeForce 9600 GT 1GB 256-bit GDDR3 PCI Express 2.0 x16 HDCP Ready SLI Supported Video Card

1 - Patriot Viper 6GB (3 x 2GB) 240-Pin DDR3 SDRAM DDR3 1333 (PC3 10666) Desktop Memory Model PVT36G1333ELK

1 - CORSAIR CMPSU-850TX 850W ATX12V 2.2 / EPS12V 2.91 SLI Ready CrossFire Ready Active PFC Power Supply

1 - Antec Nine Hundred Black Computer Case With Side Panel Window

1 - PLEXTOR 24X DVD/CD Writer Black SATA Model PX-880SA LightScribe Support

1 - Microsoft Windows Vista Home Premium SP1 64-bit for System Builders

Grand Total: $1,501.90

Patvs
08-13-2009, 07:54 PM
Thx.

1 - Western Digital Caviar Black WD5001AALS 500GB 7200 RPM SATA 3.0Gb/s 3.5

1 - Western Digital Caviar Black WD1001FALS 1TB 7200 RPM SATA 3.0Gb/s 3.5



There is a new Western Digital Caviar Black 1.5TB!



I recently build:

(Really Happy with)
Intel i7 920 CPU
Scythe Mugen-2 CPU cooler
OCZ Platinum XTC 6GB - CAS7 DDR3 RAM
Sapphire VAPOR-X HD 4870 1GB GDDR5 PCI-E videocard
2x OCZ Vertex 30 GB SSD harddisks RAID0 (new firmware was released yesterday, they just keep getting faster with every new OCZ firmware tweak.... so happy I didn't get a Intel X25-M G1 which Intel will no longer support after only 12 months. They will not release TRIM for the X25-M G1, only for the G2 Postville)
Samsung 223B DVDburner
Logitech G15 v2 Keyboard and Logitech G9 Mouse
Windows 7 ULTIMATE build 7600 x64

(Would Have Bought Something Else, Had I Known...)
MSI X58 Pro-E mainboard: I would have bought the GIGABYTE GA-EX58-UD3R had I known the MSI mainboard has a horrible IOH (that's the Intel Northbridge chip) heatsink. I had to buy a separate Thermalright HR-05 and change the heatsink.
Samsung Spinpoint F1 1TB SATA harddisk: great harddisk, but Samsung released an even better F3 series, two weeks after I bought mine.

Antec Sonata Plus 550 case (incl. 550w power supply): I bought this case for its clean looks and its supposedly QUIET fan, and QUIET power supply. The great thing about the case is the unique way how it mounts the 2.5 inch SSD harddisks (withouth the need for any 2.5-->3.5 bracket, I was impressed) and its removable dust filter. BUT.... it's not THAT quiet, it has no removable mainboard tray, the "workspace" inside is a bit too small (found out that really sucks, since I had to remove the mainboard twice to change the IOH heatsink) And it's a bit expensive.

Also my Intel i7 920 is never really used. My computer (running HEM + PostgreSQL + multitabling + internet browser + downloading + MSN, etc.) only uses 10% of its processor power. The i7 comes with expensive X58 mainboards. I might have bought a AMD Phenom x4 instead and spend the saved $100 on.... another 30GB Vertex? Or towards 2x Intel Postville :)

fozzy71
08-17-2009, 06:27 PM
You are running SQL on the RAID with the OS? How is bulk import speed?

You are making me consider the same now, but I think I want my SQL DB on it's own SSD, independent of the OS, for speed and data security.

Patvs
08-17-2009, 07:30 PM
You are running SQL on the RAID with the OS? How is bulk import speed?

You are making me consider the same now, but I think I want my SQL DB on it's own SSD, independent of the OS, for speed and data security.

I had 3 options with my 2x SSD.
-1 use one for OS and one for SQL (non-RAID)
-2 running SQL on the RAID with the OS on one partition (RAID)
-3 OS and SQL each on their own partition (RAID)

I've only tried #2, thinking RAID would be fastest and the data is really secure (despite RAID, because the SSDs are really reliable).

---

Bulk import speed test:
Test 1: 3x 40 MB txt files (total 84.000 hands). (the 3 largest files from a once "export hands" database, each 40 MB text file contains 28.000 hands)
This took 14 minutes to import, 90 hands /s. (it took about 30 seconds of analysing the files before the actual importing began)

Test 2: 1000 handhistory files in 25 subfolders (total 120 MB, each file ranging from 1Kb-500Kb: average filesize 120Kb) (50.000 total number hands)
This took 18 minutes (half of the time spend on the last 250 files!), 45 hands /s (it was importing with 70 hands /s for the first 750 files, but after that the importing would often freeze for a minute and the "files imported 750 of 1000" would suddenly JUMP to "770 of 1000" instead of to 751. After each "freeze" the hands xx / s would drop.

(CPU max 10%, RAM max 30%, FullTilt poker handhistories all Full Ring Cash (9 handed), used IMPORT from folder, NO duplicate hands)


I'm guessing you can get a lot higher speeds if OS and SQL are installed on separate drives? But lets suppose I add 2 drives. Will 2 drives for OS in RAID + 2 drivers for SQL in RAID,..... be faster than just OS + SQL on 4 drives in RAID?

fozzy71
08-17-2009, 08:03 PM
..

I'm guessing you can get a lot higher speeds if OS and SQL are installed on separate drives? But lets suppose I add 2 drives. Will 2 drives for OS in RAID + 2 drivers for SQL in RAID,..... be faster than just OS + SQL on 4 drives in RAID?

http://i207.photobucket.com/albums/bb176/fozzy71/Avatars/HeadExplode-Scrubs-new.gif

dipstikdave
08-21-2009, 08:49 PM
i followed the steps to purge hh, but i am still able to view/replay hands that should have been deleted.:confused:

Patvs
08-21-2009, 08:58 PM
I'm guessing you can get a lot higher speeds if OS and SQL are installed on separate drives? But lets suppose I add 2 drives. Will 2 drives for OS in RAID + 2 drivers for SQL in RAID,..... be faster than just OS + SQL on 4 drives in RAID?


Lets rephrase that.... If you have 2x SSD harddisks in RAID0.... and 2x "normal" 7200 RPMs in RAID0 (or 2x VelociRaptors), would it still make sense to install Windows on one RAID array and your PostgreSQL database on the other SSD RAID array. Or should BOTH simply be installed on the FASTEST array?

Any idea what causes my import speeds to freeze/lag (resulting in a big hands/s drop) after 750 files if I import 1000 files at once?

fozzy71
08-21-2009, 09:00 PM
I am a hardware ignoramus. I can't be of any help with questions that technical. :o

tommyrobin
08-22-2009, 10:47 AM
Wow, sure is a difference in defragging between windows and Pirilon I just have another 17GB free space.

Manual vacuum works good

Since 8.3 still works fine atm I can't be bothered installing 8.4 with all the problems I see posted.
I am not a big wizzard.
But boy am I impressed with the defragging thing.

Behnoush
08-22-2009, 10:33 PM
Can someone recommend an appropriate stripe size for an array containing four 7200rpm drive?


Thanks,
B

netsrak
08-23-2009, 02:57 PM
I suggest you ask this question in a postgresql forum where you find the experts.
http://pugs.postgresql.org/

I'm interested in the answer too.

dipstikdave
08-25-2009, 07:26 PM
can anyone help with this please? i am getting the same error message when i try to either purge hh or vacuum my database: (using beta 26 and then beta 28)

http://img405.imageshack.us/img405/1760/60739196.jpg (http://img405.imageshack.us/i/60739196.jpg/)

edit: purging tourney hh worked fine

netsrak
08-26-2009, 01:17 PM
Your database is corrupt. You can try to reindex everything via pgadmin maintenance but its safer to start with a new database http://www.holdemmanager.net/faq/afmviewfaq.aspx?faqid=146

and you should check your computer hardware (at least chkdsk your harddisk).

dipstikdave
08-27-2009, 11:33 PM
thanks net. fwiw, i had created a new database using backup/restore. when i recreated a new database i used export/import hh and that fixed the problem.

smf
10-29-2009, 02:58 PM
euhm was the faq linked in 7.1 deleted?! when i click the link im redirected to the faq mainpage

fozzy71
10-29-2009, 03:16 PM
Yes, it was. That has become a 'Registration Required Add-On' and I dont necessarily like to suggest people have to register on another site. I went thru the registration required process, a month or 2 ago. This was right after StackBuilder updated to v2.0. Just a week ago, I got a call from the owner/admin at the postgresql forum that I had to register on. :( I cant rightfully suggest you do something that is going to get you a solicitation phone call.

http://i207.photobucket.com/albums/bb176/fozzy71/HEM/sql84/hem-sql84tuningwiz-regreqaddon.png


If you want to see a thread about manually tuning some of the settings, check out this thread:

http://forumserver.twoplustwo.com/28/internet-poker/postgresql-optimization-tips-speed-up-yo-slow-ass-computer-362568/

smf
10-29-2009, 03:20 PM
thx, that thread you linked is very helpful

Pummi81
10-31-2009, 05:22 AM
I like sharing my db between my desktop and laptop and easiest way to do that imo is to install db data directory on a portable HD. Now I have it installed on a 160Gb WD My Passport Essential (Usb 2.0) but I'm not too happy with its speed.

Does anybody have experience on portable eSata SSDs?

shuman
12-06-2009, 05:24 AM
-4 Always use the latest version of Holdem Manager, use the most current version of PostgreSQL Currently that's 8.4. How to install HEM + PostgreSQL 8.4.
Update your Windows (use Microsoft Update) and update all system drivers (including your mainboard and videocard driver!).

I read somewhere else (I believe it was under FAQ's) that you shouldn't necessarily update to the latest version 8.4 of PostgreSQL if your computer is older. Is this true? I was hesitant to do so, and have just stuck with 8.3 after I did as many of these tips as I could.

I get a popup everytime my computer starts up that asks me if I want to verify that my computer is running a certified copy of Windows XP. I have just ignored it for a while. It says that I may miss out on the updates is I don't click it and/or don't have a certified copy. Do you think there are updates I am missing because I have not clicked this?

How exactly do I update all system drivers (including my mainboard and videocard driver)? Do I go somewhere in my computer that will direct me to a website? Or do I have to call DELL?

I am not a computer expert, so any advice would be greatly appreciated.

Thank you.

netsrak
12-06-2009, 08:00 AM
Postgresql updates have nothing to do with windows updates.

You should activate all windows updates. This will not affect postgresql (although some reboots will be necessary after installing the updates).

So just leave Postgresql 8.3 as it is and update your Windows by activating Windows Update

shuman
12-14-2009, 05:54 AM
-8 How to optimize the database size in 3 steps: -1 Vacuum, -2 Reindex, -3 dump/restore
--8.1 VACUUM: VACUUM Analyse your database regularly (How to do a manual VACUUM)
--8.2 REINDEX (see 8.1 for instructions, but choose Reindex instead of Vacuum in pgAdmin)


Few questions:
1) When I manually Vacuum/Analyze/Reindex, should I "Stop Service" for PostgreSQL beforehand?

2) Is it helpful to my computer's performance to Analyze every time that I "Vacuum"?

3) Is it helpful to my computer's performance to Reindex every time that I "Vacuum"?

4) When I Reindex, should I check the box "Force" under Reindex options?

5) When I manually Vacuum/Analyze/Reindex, should I keep the "Verbose messages" box checked?

Thank you.

netsrak
12-14-2009, 07:53 AM
1) The Postgresql service is required to run this
2) The Analyze is included in the Vacuum
3) Yes
4) This Option is obsolete (there is a Help button)
5) As you like it

shuman
12-14-2009, 08:18 AM
2) The Analyze is included in the Vacuum

To clarify, if you look at the snapshot file I've attached to this post, is the ANALYZE option in the top-middle under "Maintenance operation" unnecessary for me to perform by itself, since ANALYZE under "VACUUM options" is already "checked" during "Maintenance operation">VACUUM?

6) When I do "Maintenance operation">VACUUM, should I always "check" FULL under "VACUUM options"? I have been "checking" FULL every time.

7) What about FREEZE? I've never "checked" that before.

Thank you.

_Loki_
12-14-2009, 12:13 PM
Could someone rewrite the FAQ on how to vacuum etc ? - I'm not sure I've carried out the process correctly using the available instructions

netsrak
12-14-2009, 12:33 PM
To clarify, if you look at the snapshot file I've attached to this post, is the ANALYZE option in the top-middle under "Maintenance operation" unnecessary for me to perform by itself, since ANALYZE under "VACUUM options" is already "checked" during "Maintenance operation">VACUUM?

6) When I do "Maintenance operation">VACUUM, should I always "check" FULL under "VACUUM options"? I have been "checking" FULL every time.

7) What about FREEZE? I've never "checked" that before.

Thank you.

I was talking about the same ANALYZE. Its not necessary because in current Postgresql Version the autovacuum daemon takes care of this. And the VACUUM/FULL does the rest.

Freeeze is an obsolete option too.

netsrak
12-14-2009, 12:34 PM
Could someone rewrite the FAQ on how to vacuum etc ? - I'm not sure I've carried out the process correctly using the available instructions

The FAQ for the Vacuum seems to be uptodate. What problems did you have with it?
http://www.holdemmanager.net/faq/afmviewfaq.aspx?faqid=163

shuman
12-26-2009, 10:17 PM
Top 10: HEM performance increase tips

--------------------------------------------------------------------------------

-6 Defrag your non-SSD harddisk, using Defraggler by Piriform. Or you can use Disk Defrag by Auslogics or Power Defragmenter (all FREE software and better than the Windows included Defrag)

>>Do you recommend one of the 3 above defragmenters, or Smart Defragmenter (which I read about in another thread), as being a better program than the other 3, or will they all pretty much have the same defrag performance?

Patvs
12-27-2009, 02:21 AM
All (including Smart Defragmenter) are pretty much the same.
I know Defraggler has the ability: to only defrag one folder (your PostgreSQL folder!) and schedule defrags (weekly/bi-weekly/monthly) which are very useful. The others probably have similar features.

ProsperousOne
01-03-2010, 09:03 PM
I've got a 4 year old laptop with a 50GB Drive, and I'm maxed. I can't afford a new desktop yet, so I've got to make this one last a few months.

I'm playing about 30K hand/mo, plus I'm importing data mines, and my Postgres DB is 15GB.

I've vacuumed and reindexed, and even tried the drop/restore (which did nothing, although I see above that it dosesn't always work), I'll try that again.

I've also ran defraggler.

I'm also going to move all of my non-HM data to an external Drive.

Any other suggestions?

Edit: DOOH>..... Just emptied recycle bin and reduced size of recycle bin... solved my problem....

BTW, my desk top I plan on building will have 2 RAID 0 SSDs, one for my postgress db, and one for my OS and programs. I'll use the Standard HD for non postgres data storage. ANd I'm getting 4-8GB RAM, depending on price.

Hoping to keep it all under $1K lol....

Can I install the postgres program on the SSD with the OS and other programs, and the just the data for the HM on the other SSD? (I"m trying ot maximize the HM DB capacity, as it looks like I can get a ~80GB SSD for ~$150, so 2 would run ~$300.

Patvs
01-04-2010, 02:46 AM
You also already deleted the logfiles? (make sure it doesn't create new logfiles)

You mention 2 SSDs in RAID0... yet state, one for postgres and one of the OS. In RAID0 the two SSDs will become one drive. So technically you could only make two partitions. Not install OS and postgres each on their own drive in RAID0.

The plus side to RAID0 is: almost 2x as fast in theory
The down side: NO TRIM support

ProsperousOne
01-18-2010, 02:34 PM
Meh,

After much research, I'm building one with a single 64GB SSD for the OS and Programs, and then 2 1TB 7200RPM drives in a RAID 0 configuration for PostgreSQL and my HM DB.

I assume I can install HM on the SSD? No performance decrease because PostreSQL is on HD and HM is on SSD?

thx!

Patvs
01-18-2010, 03:59 PM
Of course you can install HEM (and all other important programs' ie. OFFICE) on the SSD.

But the database on the 2x 7200 RPM won't be as fast as the database on the SSD. (assuming it's a fast 64 GB SSD)

ProsperousOne
01-18-2010, 04:08 PM
Crap, figures, just ordered my computer from AVGdirect.com, an dordered 2 1TB hard drives in RAID0.

The reason I did't opt to put the DB on the SSD was size. MY DB now is taking up 75% of my 50GB hard drive on my laptop (4 year old dog....), and I wanted to be able to greatly expand the size of the db.

I guess when SSD prices come down in the future, I'll move my DB to a SSD.

thx for the help.

P1

fozzy71
01-21-2010, 09:58 PM
Crap, figures, just ordered my computer from AVGdirect.com, an dordered 2 1TB hard drives in RAID0.

The reason I did't opt to put the DB on the SSD was size. MY DB now is taking up 75% of my 50GB hard drive on my laptop (4 year old dog....),.......

Is logging off or on?


Logging:

I would suggest you turn off logging on your new SQL installation as well as these other performance improvements - Top 10: HEM performance increase tips


To turn off logging, follow these instructions. This is the first thing I do anytime I install SQL for someone.

- Start > My Computer > Tools > Folder Options > View > UnCheck 'Hide Extensions for known file types' > OK

- C:\Program Files\PostgreSQL\data\postgresql.conf > Right-Click > Open With.. > NotePad > Check 'Always use this program'

- Scroll about half way down to ~Lines 245 - 260:

- The last line of this block of code, for the 'logging_collector', must be changed from On to Off.



------------------------------------------------------------------------------
# ERROR REPORTING AND LOGGING
#------------------------------------------------------------------------------

# - Where to Log -

log_destination = 'stderr' # Valid values are combinations of
# stderr, csvlog, syslog and eventlog,
# depending on platform. csvlog
# requires logging_collector to be on.

# This is used when logging to stderr:
logging_collector = off # Enable capturing of stderr and csvlog


File > Save; File > Close

Start > Programs > PostgreSQL 8.3 > Reload Configuration.


- Start > My Computer > C:\Program Files\PostgreSQL\data\pg_log, or C:\Program Files (x86)\PostgreSQL\data\pg_log, if you have 64 bit Vista. Delete all files in that folder. And it might be a good idea to empty your recycle bin at that point, or use a 3rd party utility like CCleaner to clean up all your junk/temporary files. You want to do this before you get to the vacuum and defrag process.


You should regularly purge mined hands in your database, after purge vacuum / full analyze the database via pgadmin.
http://www.holdemmanager.net/faq/afmviewfaq.aspx?faqid=107
http://www.holdemmanager.net/faq/afmviewfaq.aspx?faqid=163

ProsperousOne
01-22-2010, 09:30 AM
Yea, I've done all the performance increasing steps, including turning off logging.

I also regularly vacuum and purge, but I'm still maxed :(

Can't WAIT for the new machine to arrive!!!!

brunowillis
01-27-2010, 12:44 AM
Do you use 2,5'' SSDs in your desktop computers? Are there cables available to plug them into desktops nowadays? Or do i still have to get a 3,5'' one?

Patvs
01-27-2010, 12:59 AM
Yes they're 2.5" in a regular desktop.
They all use regular SATA cables. (same for normal 3.5" drives)

The problem is installing the drive as a lot of cases only have 3.5" bays.
So often you need a 3.5" to 2.5" bracket or find the McGyver inside of you.

El Helado
02-07-2010, 02:18 PM
What will increase the perfomance best for the HUD? My HUD has crashed a few times and there is almost no lagg whatsoever without the HUD.

Patvs
02-07-2010, 05:57 PM
You should do most of the things: defrag, vacuum/analyse, purge, reduce size database etc.

When exactly does the HUD crash? Does it always happen playing a certain number of tables, a specific type of tables on a certain site?

El Helado
02-08-2010, 02:31 PM
You should do most of the things: defrag, vacuum/analyse, purge, reduce size database etc.

When exactly does the HUD crash? Does it always happen playing a certain number of tables, a specific type of tables on a certain site?

I think it is more likely to crash with the new ongame-client. No biggie thou, I can relaunch it quickly. Would be sweet thou to have the table manager WITHOUT the HUD as an option.

Btw, does it lag more then more stats you have visible? I know have around 20 stats on each player but would it be faster if I just have VP/PFR/AF and move the stats I want to popups?

Pilequinha
02-09-2010, 08:21 PM
-9 Purge hand histories (It will free up disk space without losing stats, but you lose the option to see the HH or view the hand in the replayer)

Is this so? If i purge i see the stats in reports and on the hud? And i just do not see them on the replayer?

morny
02-09-2010, 11:12 PM
Yes this is correct

The Minder
02-09-2010, 11:42 PM
With regards to purging, I selected this option for tournies... HM went whir click buzz and informed me 0 hands purged. I then selected 'cash games' for the purge and HM purged a couple of thousand hands.

Obvious questions, does purging work on tournie hands, if not why not?

netsrak
02-10-2010, 04:44 AM
Purging of tourneys is not working. This is a known bug which will hopefully be fixed soon

The Minder
02-10-2010, 05:31 AM
Purging of tourneys is not working. This is a known bug which will hopefully be fixed soon
What's the date on the bug report?

never mind

Pilequinha
02-10-2010, 07:44 AM
Yes this is correct

Even after purging and vacum?

netsrak
02-10-2010, 09:46 AM
yes

Bull_G8er
02-16-2010, 10:05 AM
So I have a new computer ariving tomorrow. Woo hoo. MOving up from a super old POS(piece of ****). That said, I have a 1TB 7200 RPM disk on it which I realize is not the fastest, but I was not about to buy what the manufacturer was offering. That said, I was considering going out and buying an SSD today to get a clean start with the new machine. Since I already have the OS installed on the current drive, is it worth it to wipe and reinstall on the SSD?? I think the answer is probably yes, but wanted to ask. What functions does the SSD inprove beyond loading larger sets of files. How big a difference does it make a difference when I want to analyze my game?? I get so frustrated waiting for my craputer to pull and present information.

I see
02-16-2010, 11:33 AM
Any reason to get the Intel SSD now vs something like?

Newegg.com - A-DATA AS596B-128GM-C 2.5" 128GB SATA II & MINI-USB MLC Internal / External Solid State Drive (SSD) - SSD (http://www.newegg.com/Product/Product.aspx?Item=N82E16820211442)

meh, bought the Intel.

Patvs
02-16-2010, 12:18 PM
Install the OS on the SSD.

The SSD: faster seq read speeds, faster 4K read/write speeds, doesn't generate heat, doesn't make any sounds, can't corrupt, you don't ever have to defrag the drive, low access times, less power consumption, etc.

Especially the low access times makes it faster than a regular drive.

El Helado
02-16-2010, 08:08 PM
Btw, does it lag more then more stats you have visible? I know have around 20 stats on each player but would it be faster if I just have VP/PFR/AF and move the stats I want to popups?

(Look above)

Patvs
02-16-2010, 08:45 PM
1-tabling with 4 or 20 stats, will make no difference.

24-tabling... with 4 or 20 stats on a slow computer... with 20 stats.. it gets the info of 480 (20x24) numbers from your database, so I think this can cause lag if the harddisk with that data is slow.

El Helado
02-17-2010, 10:21 AM
1-tabling with 4 or 20 stats, will make no difference.

24-tabling... with 4 or 20 stats on a slow computer... with 20 stats.. it gets the info of 480 (20x24) numbers from your database, so I think this can cause lag if the harddisk with that data is slow.

My computer is technically IMBAfast and I vacuum/defrag reguarly but I still thinks it lags disturbingly with the HUD playing 6 tables or more.

Patvs
02-17-2010, 12:24 PM
"IMBAfast"? (Imbalanced-fast?)

I have a SSD harddisk, so I can't duplicate any lag issues by increasing the number of HUD STATS.

El Helado
02-17-2010, 01:12 PM
"IMBAfast"? (Imbalanced-fast?)

I have a SSD harddisk, so I can't duplicate any lag issues by increasing the number of HUD STATS.

Imba means SUPER or perhaps Superior is a better word :). Nono, I was just asking if it is more demanding. Perhaps its still a little laggy with just 3 stats, just checking if that can be the issue.

Ajeto
02-20-2010, 12:32 PM
Install the OS on the SSD.

The SSD: faster seq read speeds, faster 4K read/write speeds, doesn't generate heat, doesn't make any sounds, can't corrupt, you don't ever have to defrag the drive, low access times, less power consumption, etc.

Especially the low access times makes it faster than a regular drive.

Patvs, maybe a dumm question, but you said instal Operating sistem in SSD. I guess that aslp means for PostgreSQL, right?

I have a big dilema should I buy 2 80GB x25 SSD's and put them in RAID0 or rather one 160GB x25 SD which will be able to use TRIM function in WIN7 (RAID does'n support it).

Any oppinions appreciated!

-Ajeto

Patvs
02-20-2010, 01:35 PM
Yes install SQL + OS on the SSD.
I actually have 2x 30 GB OCZ Vertex in RAID0.
I wanted to buy 1x 80 GB Intel X25-M G2 Postville, but the G2 was still unreleased when I bought my system.

I can argue for both 1x 160 GB and 2x 80 GB. Both have their pros and cons.
1x 160: supports TRIM, the write speeds of 1x 160 (100 MB/s) are higher than 1x 80 (70 MB/s).

But 2x 80 GB in RAID0 will result in write speeds of about 150 MB/s. Then again.... you don't need fast write speeds. Since you don't... putting 3x 40 GB (or 4x 40 GB) Intel X25-X is also a FUN alternative.

If I had to choose.... I'd just buy 1x 160 GB. Because the 160 GB model has higher 4KB writes speeds (8,600 IOPS)... vs 6,600 for the 80 GB model.
And 2x 80 GB in RAID has hardly any influence on the 4K read and write speeds. And you get TRIM.... so you don't have to worry over performance degradation.

Ajeto
02-20-2010, 03:34 PM
Thank you Patvs for your answer.

I was also more prone to 160GB option for few reasons (latest FW update improves Write speed significantly, and the TRIM function is probably the strongest pro, since i will be purging hands and vacuming th database). Also i can buy another 160 later when prices drop if needed and if they develop TRIM for RAID.

morello03
02-23-2010, 09:59 AM
Hi,

I am running Vista (32) and have some issues when mass multitabling in terms of performance -- it gets laggy and tableninja becomes somewhat slow/unresponsive when I run the HUD. Without the HUD, it is mostly ok.

I am thinking about an SSD drive. However, I really do not want to reinstall/ Vista/reformat my drive. Will I see a significant performance increase if I buy an SSD and install postgres to it, but leave windows/hem/everything else on my original HD (a raptor drive)?

If the answer to that is no, is there an easy way to get all of my data/programs/settings onto an SSD drive? or do I just have to download/reinstall/reconfigure everything I have?

Patvs
02-23-2010, 04:20 PM
SQL on the SSD... Windows on the RAPTOR.. will surely see a performance increase... though EVERYTHING on the SSD will see an even larger performance increase. (assuming it's a FAST SSD, read: Intel X25-M G2 Postville)

You could create Windows backup or Norton Ghost.. to create an image file of your C:drive.. then restore the image file to the SSD. Though, I've tried that two times now.... failed both times. Reinstalling Windows is a lot easier.

dtkodak123
02-26-2010, 11:27 AM
I fixed all the links in the mainpost (linking to the proper FAQ links)

And added a Buying a New Computer Guide: Buying/Building a New Computer optimized for HoldemManager + PostgreSQL.
Ranging from mid-end <$1000 (incl. monitor) - to high-end $2700)

It might be fun to also further discuss HARDWARE UPGRADE recommendations in this topic to improve HEM performance.

where can i see this Buying a new computer guide at?! i dont see it.. would like to see one..

Patvs
02-26-2010, 06:56 PM
I deleted the guide... since I could upgrade it almost daily.

I recommend reading Tom's Hardware: Hardware News, Tests and Reviews (http://www.tomshardware.com) and his monthly buying guide.

keijo777
03-10-2010, 10:34 PM
Hi!

One of my HDD's just crushed in my desktop computer and now I want to have a ssd where I put my windows 7 and some small programs on. I want to have HEM and Postgres seperatly on a VelociRaptor, I already own.

Now I have a few questions about this:

1. Does this make sense? Or is there a better (faster way) to do it (without paying double the money)?

2. Is there a special reason why you recommend a "Intel X25-M G2 Postville" in the first post? Because it seems like there are quite a few ohters who have faster write & read speeds!? Please tell me what the best ssd would be for my intent.

3. A size of 64 - 80 GB is enough for the ssd, isn't it?

4. Preety stupid question, but I never even saw a ssd: Has it the same plug and size as the VelociRaptor, so can I install it the same way? Or do I need sth like a module to get this working on my Gigabyte EP45 Ex mainboard?


I hope you can understand me, as english obv is not my first language.

Thank you very much.

wrapitup
03-11-2010, 03:16 AM
-8 How to optimize the database size in 3 steps: -1 Vacuum, -2 Reindex, -3 dump/restore
--8.1 VACUUM: VACUUM Analyse your database regularly (How to do a manual VACUUM)
--8.2 REINDEX (see 8.1 for instructions, but choose Reindex instead of Vacuum in pgAdmin)
--8.3 Dump/restore (for advanced users) Step by step how to dump/restore the database

OK, Vacuum and Reindex are straightforward, but the instructions on Dump/Restore are 3 years old and incomprehensible. Could someone explain how to do this last step ?

Patvs
03-11-2010, 08:18 AM
-1. Fastest would be everything (OS + programs + SQL database) on the SSD.

-2 The Intel X25-series is the only SSD with proper 4K read/write speeds.
When you copy a large +100 MB) file a harddisk needs sequential read/write speeds, (also video editing requires fast sequential write speeds where the VelociRaptors are the best)... but when you start Windows, start a program, or import a million handhistories, the average file that is being read is <512 KB. I have 2x OCZ Vertex in RAID0.... and 1x Intel X25-M is a LOT faster. (although I have much higher sequential read/write speeds)

-3 80 GB should be enough for Windows + Office (+other programs) + a 5 million hand database.

-4 It has the same SATA connector. But it's smaller than a regular desktop harddisk. It's the size of a laptop harddisk.

Spec
03-29-2010, 08:16 PM
Sorry if this was asked before in the tjread but I could not find it.

Is it better to do a Vacum followed by a disk defrag or the reverse ?

fozzy71
03-29-2010, 11:19 PM
The former.

This is the process I use:

1 - Close HM and Open PGAdmin

2 - connect to postgresql server and then to the DB. Password is postgrespass in case you ever need it.

3 - Right-Click > Maintenance on the DB.

4 - Vacuum, Full, Analyze > OK

Wait for it to finish and change the greyed out OK button to a Done button.

Do that ever 10 -30k hands.

Every 50 - 100k hands, after finishing the steps above:


A - Right-Click > Maintenance on the DB.

B - Reindex > OK

Wait for it to finish and change the greyed out OK button to a Done button.



Next we need to Stop the PostgreSQL service so the Defragmenter can Defrag the Database.

Start > Programs > PostgreSQL 8,4 > Stop Server


Open Smart Defrag > Select both drive letter checkboxes > Analyze

Pick suggested Defrag process > Start Defrag



After Smart Defrag finishes you should restart your computer.

If you need to use HM before you restart your PC, then you need to Start Server.

Start > Programs > PostgreSQL 8,4 > Start Server

cheesemyer
04-05-2010, 03:22 PM
What happens if you dont uninstall a 3rd party firewall and install HM beta and it works?

Patvs
04-06-2010, 02:24 AM
What happens if you dont uninstall a 3rd party firewall and install HM beta and it works?


That's what's supposed to happen. (HM working with firewall on)
Only when the firewall appears to cause problems, should you -1 set the exceptions, -2 completely uninstall it if #1 doesn't work.

DeepBlue
05-03-2010, 02:21 AM
I am wondering if my approach to database optimization might be useful to others - what I simply do is to run my database on my newer laptop so it's portable (note it has 4 GB of ram, dual core, and a special 10k hard drive) and discrete from my playing PC. It also runs under the Mac OS natively.

Then I connect to it via network from my playing PC. In fact my playing PC is a 7 year old PIII with 1.7 GB of RAM and PCI (yes, PCI) video cards!

Does anyone think I would gain much by upgrading the head (the playing PC), or by upgrading and moving everything (database and client) back to one PC? I can play 6 tables fine now, but 10 or more starts to get squirrely. Not sure if I should spend more time on optimizations (I already have transparency turned off and my playing PC is lean, no anti-virus for example) first or upgrade (and if I do upgrade, do I move everything back to one machine or keep the database discrete).

AVO|Ratatuj
05-05-2010, 08:35 AM
my config:

Gigabyte EP45-DS3
Q9400@3371Mhz (420FSB)
2Gb x 4 Corsair XMS6400C5 at 840MHz
(SSD) Kingston V+ SNVP325 64Gb for Win, HM and Postgre
Some other drives

Win 7 64 Ult, Postgre 8.4.2.1, HM last.

Postgre's config is tuned for the better memory usage, logs are off.
Anvivirus is set not to scan Postgre, poker-rooms and HM's activities.
HM has above normal priority, HMImport has a High one via Prio.
Pagefile is turned off. Indexing is off.

Ok. I have experimented a lot with hand import and my experience says the main speed gain you receive:

a) by placing a DB on a SSD drive (initial speeds were approx. 220 read 180 write - after a month of using Postgre I have smth like 153 to 75 at the part where Postgre is installed, though the the part with Windows has speeds close to initial).

b) by overclocking your CPU. Most of today's CPUs, both of AMD's and Intel's, have power saving functions. E.g., my CPU has 2.66GHz speed but worked as 2Ghz when imported hands (it thought it's an idle task for it). So sometimes you can turn them off to have just normal processor speed.

I also purge and Vacuum-An my DB every day. The speed now is smth like 150 and slows down to 90 by the end of the import.

So if you're thinking of upgrade - buy the fastest possible drives. SSD's at RAID0 will be cool! Then look at CPU's speed. RAM - 4Gbs at least for every day HH importing.

Those who use laptops - upgrade your drive to SSD.

DeepBlue
05-06-2010, 05:06 AM
I also purge and Vacuum-An my DB every day. The speed now is smth like 150 and slows down to 90 by the end of the import.

So even on your machine the speed slows down after a while, right? I am curious because after my latest optimizations, my tables are fairly snappy and responsive at first, then 40+ minutes into a session they get slower, and slower, and slower. Restarting the HUD makes it snappy for a few more hands but then it's so slow I just have to turn the HUD off (or restart HM completely).

Is there possibly some sort of memory leak occurring or some sort of temporary database table that keeps incrementing and getting bigger until HM restarts that could cause both of these behaviors? (HUD slowing down over time and mass hand import slowing down over time)

AVO|Ratatuj
05-06-2010, 09:45 AM
if you mean a playing session, no everything's ok with that. no need to restart HUD or smth. though I know some people with slower PCs do that.

Fritters
05-19-2010, 09:26 AM
Got a question about the solid states,
The solid state disks are dropping in price now, so it's a nice option.

The space on them is limited, so which program would you put on the ssd?
- PostgresSQL + underlying files
- HoldemManager root map (I noticed it's big)
- Operating system
- HH archive (the location to which HEM writes the files after importing).

Where does the SSD contribute most? (assuming 80 / 120GB)


I recommend to put only the Postgresql data folder (the cluster) to the SSD. Leave the rest on a ordinary harddisk

Just ordered the X-25 V (40 GB) for HEM and am not sure what the most efficient way is to make HEM work off of the SSD. Do I just do a fresh install of HEM and Postgres on the SSD? Make a backup w/ PGAdmin and restore it on the fresh install? Is there a way to save my HEM configuration information for a re-install? Should all of my poker related programs be there (table ninja, xpadder, HEM, pokerstars, etc...) or just HEM and Postgres (or just Postgres)?

I'm not planning on moving my OS or any other programs to the SSD - I don't use my computer for much other than poker so I don't think it's worth the trouble.

DeepBlue
05-19-2010, 04:05 PM
I just upgraded to a new computer, I have a performance question - if I run my poker software and HM client/importer on a virtual machine, would it be best to run the PostGreSQL server natively on the host (Windows 7), and address is via LAN from the client VM? Or just install it all inside the VM?

Also is it best to store the VM on a separate hard drive from the database, or they can share?

Finally, can anyone recommend or dissuade the use of Win7 for the VM for HM - would that help performance or hurt (and better to stay with WinXP)?

Patvs
05-19-2010, 07:03 PM
Just ordered the X-25 V

Just install PostgreSQL on the SSD. And backup your old database--> restore it to the SSD with pgAdmin.
To save your HM configuration: either use the NEW backup utility in HM that can save/restore EVERYTHING, or manually save your HUD/notes/bonus/rakeback settings, etc.

Just install every program you use a LOT on the SSD. Especially programs with a LONG startup time (such as PHOTOSHOP).

--


I just upgraded to a new computer, I have a performance question -

It's recommended to install SQL on the HOST.
Separate drives... I don't know. In theory separate drives would be better.
Read: HOWTO: Install Holdem Manager While Running Mac OS X | Mac Poker Dojo (http://www.macpokerdojo.com/2010/03/04/howto-install-holdem-manager-while-running-mac-os-x/)

Win7 vs XP. Which VM do you use? It all depends which OS runs better on the VM. Again in theory XP will need less memory/system resources so it will be faster. But the latest updates of bootcamp/Parallels/VMWare) may very well already be OPTIMIZED for Windows 7.

DeepBlue
05-19-2010, 07:20 PM
To be clear, I am now running on a native PC tower. (But I did run mysql on the host on my Mac as well, and am thinking of doing the same again - seems like you agree!)

As for running WinXP or 7, I guess I was hoping you could tell me if you know that HM will run better in the 64 bit environment (vs. 32 bit WinXP running as a VM on a Win7 64 bit host), or will be the same in Win32. If all else is same, I might just upgrade for the graphical niceties of W7 (or I might be lazy and just copy my existing VM over and run it as is, WinXP).

Also if you happen to know anything about whether Stars in general works better on Win7 (or not), that would be great! That's another part of my decision on whether or not to start a new VM with Win7 or use the existing one (but either way running on the new tower in Win7 natively).

Patvs
05-19-2010, 07:35 PM
HM has no improvements in a 64 bit environment.
But... they are trying to add more 64 bit specific code with every BIG update.
So it might have in future updates.

Stars.. I don't know. I use Stars in native W7 x64 (and in XP x32 before that) and never had any problems with Stars.

AVO|Ratatuj
05-19-2010, 09:44 PM
HM being a 32 bit application doesn't gain from running under 64 bit OS. so are Postgre and poker clients. but w7 64 is a cool OS, so why not use it? )

DeepBlue
05-19-2010, 10:42 PM
Cool, thanks for the feedback guys!

Also I guess from my Linux background I just assumed there was a 64 bit PostGreSQL build for Windows 7, but I see there is not (not yet anyway). (interesting reasoning on why maybe 32 bit version better anyway here: PostgreSQL vs 64-bit windows - Magnus Hagander's PostgreSQL blog (http://blog.hagander.net/archives/73-PostgreSQL-vs-64-bit-windows.html))

Ekstone
05-28-2010, 06:37 AM
Hello,

I would like to buy a new laptop only for poker.
Could you help me to choose the right one.

I would like to buy a laptop with minimum 17" display.

Now there are two laptops I am thinking about.

First:
HP-Compaq Pavilion dv7-3050ec
Intel Core i7 (720QM (6 MB L3 cache, DDR3 1333 MHz, 45 W) 1.60 GHz
4GB DDR3 1333MHz
500GB SATA 2.5" / 7200RPM

Second:
HP-Compaq Pavilion dv7-2260ef
Intel Core 2 Duo (P7450 (3MB L2 cache/ 1066MHz FSB) 2.13GHz )
4096 MB (DDR3 1333MHz)
2x 500GB SATA 2.5" / 7200RPM ProtectSmart

I read your HW recommendation here in the first post, and you spoke about the most important is the fast harddisk. So I should choose the 2260ef because of the two separate disk (it is not RAID, only two separate disk) or the 3050ec is better because the stronger CPU?

Yes, I know the SSD is the best choose, but it is very expensive.
Anyway, when I play poker on 4-6 tables, and use HM HUD with a very big database (datamined hands), how will be significant the harddisks tasks? I mean the harddisk is important when I import 10 million hands into HM DB, but when I play poker, only use few records from database in the RAM (very rare HD use).

I am not an expert (I think you can guess :) ), please tell me more about the hardisk, RAM, CPU.

DeepBlue
05-28-2010, 06:55 AM
Definitely do not buy the Core 2 Duo, it is dead technology. Have you considere AMD btw? I just upgraded my rig to an AMD quad core Phenom II 965 (it's a homebuilt desktop though) and now I can play as many tables I want to! I am just using two WD Black SATA drives, nothing too special except that I host my virtual machine on its own drive.

Also I suggest you get more RAM if you're going to run Windows Vista or 7. Like 6 GB or 8.

Finally, you can always just use an external eSata or FireWire drive, right, no matter which model you choose? I do think keeping database on its own hard drive is one of the best things you can do. (I keep my whole database server on separate machine in fact - but with quad core computing you are almost getting same effect by hosting locally and with dedicated drive.) To be honest unless you're running a virtual machine on the drive or doing anything else while playing, you might be fine with one drive to start.

Oh and make sure the graphics adapter is semi-decent, if only for the reason that you might want to connect a high res monitor later on. (and secondly because I believe that having a decent card still helps with Windows redraw performance - i.e., not having a card that ONLY uses main RAM for video memory is not good)

jahase
05-30-2010, 01:10 PM
http://img715.imageshack.us/img715/4659/auslastung.jpg (http://img715.imageshack.us/i/auslastung.jpg/)

my system is quite slow with the HEM database. so i thought about buying an external SSD for the databease. but now i discovered that my dual core processor seems to not beeing used properly.
this is the chart while refreshing the graph for my 225k hands i have played and while processor 1 is used by nearly 100%, processor 2 is almost idle.
is there a way to improve that? and would an ssd improve my performance altough the reas for the slowlyness seems to be the processor? its a intel core2 duo with 2GH?

AVO|Ratatuj
05-30-2010, 01:17 PM
afaik, hm import uses only one core, so the faster it is, the better. actually i don't know why guys can't add multythread support (i'd like to know the answer from them). though i guess, adding an ssd is a good idea. but not external cuz it's speed will be cut by the speed of interface it's connected to a pc. though eSATA will be ok, maybe. usb3 gives only 90mb/s

you can also try to overclock your CPU if it's not a laptop one. an adding some RAM will be a good choice too )

DeepBlue
05-30-2010, 01:39 PM
Separate drive will help a lot, whether SSD or not. Also I think maybe you should try to set the mysql server daemon to run on processor 2, that way it won't use up any of processor 1? I forget how to do this but seem to remember that is a possibility.

jahase
05-30-2010, 01:49 PM
well i have a laptop and i cannot upgrade more RAM. its already the maximum.

and for the SSD the OP says:
"The SSD not only wins on Sequential Read/Write speeds (of big files), they win the most with access time, 4K Read/Write speeds (small files) and just "overall" I/O operations per second."

doesn't that mean that the the usb limit of 90MB/s is not the important thing but the number of I/O operations? or did i get that wrong?

DeepBlue
05-30-2010, 01:53 PM
Yes but USB is slow at access as well as transfer. You can get an eSATA PCMCIA or ExpressCard controller though for your laptop!

TO be honest, I think just try setting the processor two to serve PostgreSQL's daemon, and try just using a separate drive just for the database - unless money is no object, then by all means, go SSD! :) (but please connect via eSATA, not via USB :eek: )

jahase
05-30-2010, 01:58 PM
ok! thx for the hint!

dtkodak123
06-04-2010, 10:57 PM
I plan on buying a new PC, can anyone tell me some specs of stuff i should buy.. or better yet, if someone knows of a good PC from cyberpowerpc.com (ill buy from them and thats about it for pre-built systems)


thanks.

Bennobal
07-21-2010, 06:46 AM
I ordered a SSD X-25 80GB and Win 7. I want to install windows, office, HM, SQL and poker programs on the SSD. What do you guys recommend regarding the installation proces of Win7? Did you make partitions? (if so, why and what sizes?)

Furthermore, what is my line with transferring my DB to the new Win7 install (coming from XP and sql 8.2). Do I have to backup/restore or export/re-import?

netsrak
07-21-2010, 10:29 AM
80 GB may not be enough for Windows, Office, HM and the hands database. you should calculate with roughly 10 GB of space you need for 1 Mio hands.

For transferring the database. Please make a backup via pgadminIII and export all your hands, notes and summaries as 2nd level backup.
I'm not sure whether Postgresql 8.4 supports importing a 8.2 backup.

Bennobal
07-23-2010, 10:54 AM
Well I actually want to install 8.3 as there where some difficulties for others installing 8.4 ánd the performance increase is not significant ( but from 8.2 to 8.3.11 it is) so I'll just install 8.3 on my new OS. I'm not to far from 1 MM hands but 2 MM is far far away so I think I can make it w/ 80GB, maybe just put office on regular HD.

Tranclugator
08-02-2010, 08:48 PM
That OCZ forum recommends to turn write caching on but others recommend to turn it off because of absence of write cache in SSDs. Mistake?

Patvs
08-02-2010, 11:31 PM
I think it depends on the SSD.
Most new SSDs (OCZ Vertex, Vertex 2, Intel X25-M do have write-cache)

If you install the Intel Matrix Storage manager you can also enable it there.

chris64
08-03-2010, 11:31 AM
Looking to spend between 60-70 bucks on a new internal HDD because the one i have now seems to have trouble handling my DB which has grown to a few gigs. My computer uses a sata connection what do you guys suggest?

chris64
08-03-2010, 11:40 AM
the thumbs down was an accident.

_Loki_
08-03-2010, 12:21 PM
###

Looking to spend between 60-70 bucks on a new internal HDD because the one i have now seems to have trouble handling my DB which has grown to a few gigs. My computer uses a sata connection what do you guys suggest?

"More & bigger" bombs is usually a poor answer
Why have you got gigs of data that's probably useless in play ?
Suggest you FIRST look at ways of making your poker playing DB smaller in 'performance tips' -

remove logs data
stop new logs data being made
purge hands you 'observed'
purge hands older than 3 months that you played in
vacuum/analyse
reindex
defrag

###
A playing DB should reach an optimum size & then remain roughly at that size

###
Archive hands (& archive DB if you like) can be be taken off your poker playing PC & stuck somewhere else

###

chris64
08-03-2010, 01:36 PM
###


"More & bigger" bombs is usually a poor answer
Why have you got gigs of data that's probably useless in play ?
Suggest you FIRST look at ways of making your poker playing DB smaller in 'performance tips' -

remove logs data
stop new logs data being made
purge hands you 'observed'
purge hands older than 3 months that you played in
vacuum/analyse
reindex
defrag

###
A playing DB should reach an optimum size & then remain roughly at that size

###
Archive hands (& archive DB if you like) can be be taken off your poker playing PC & stuck somewhere else

###

I'll try some of that stuff but i need a new hdd anyway. The one i have now is 4 years old and is starting to run really slow with or with out hem going and it makes scratching sounds sometimes. My comp will also just restart just because it feels like it sometimes. My power went out a couple times while my hdd was working and i know that is horrible for an hdd.

Most of my db is from hands i got from ptr. How am i suppose to use all the thousands of hands i've gotten from them if i delete them from my DB?

Patvs
08-03-2010, 03:45 PM
1+ TB Western Digital Caviar BLACK baby! (not the Caviar GREEN)
or the Samsung Spinpoint F1 or F3 (not the F2)

DeepBlue
08-03-2010, 05:54 PM
IMHO - Caviar for price - Spinpoint for a bit more speed. (I have Caviar as my system drive, but my DB runs on a 10k Hitachi drive.)

If it is making clicking sounds, I suggest you back up the data to another computer if possible immediately. Or minimize use until the new drive is in. Clicking is not good - have you tried running a S.M.A.R.T. utility to see if the drive is reporting any problems in its self-monitoring?

_Loki_
08-03-2010, 07:06 PM
###
'Purge' is not 'delete'. After you've got the new HDD sorted out & you've started using it to play it would do no harm to 'purge' observed hands

...How am i suppose to use all the thousands of hands i've gotten from them if i delete them from my DB?

>> FAQ - Hold'em Manager Poker Tracking Software :: Observed Hand History Configuration (http://faq.holdemmanager.com/questions/196/Observed+Hand+History+Configuration)

Purge Hand History Options - Observed Hands
The Purge Hand History Option here removes the Hand History, but keeps the stats.

For example, let’s say we have 100 hands on a player and purge them using this option. We can still see the players VPIP is 32 and his 3bet% was 10 etc., but we can’t review any of the Hand Histories in the Hand Replayer as those details have been deleted. The advantage to this is being able to keep the HUD stats while downsizing the overall size of your Holdem Manager database.
http://1.2.3.9/bmi/faq.holdemmanager.com/images/observed-hand-history-02.jpg
###

fozzy71
08-05-2010, 01:52 PM
1+ TB Western Digital Caviar BLACK baby! (not the Caviar GREEN)....

:mad:

ploldo
08-11-2010, 12:22 PM
any updates on how to do a dump and restore?


this link is a little old and over my head. is this done from cmd?

How to optimize PostgreSQL database size | LinuxInsight (http://www.linuxinsight.com/optimize_postgresql_database_size.html#comment-538)


my db is quite large if that changes anything.


edit: i also found this link

http://www.testdriveinteractive.com/files/Tutorial_All_PP_pgAdmin_Backup_Restore.pdf

im not a total computer n00b but i really dont want to mess up my db and would like clarification. thanks

Patvs
08-11-2010, 02:39 PM
Don't do the dump/restore.... it's an outdated trick to reduce the database size... the vacuum in 8.4 should fully cover it. I'll take it out of the main post.

AdamWK
09-01-2010, 05:11 PM
Hope I'm posting in the right thread for this, as apposed to starting a new thread. HEM runs annoyingly slow on my laptop that I currently play on. So I'm looking to do one of two things....upgrade my current set up (faster hard drive, new CPU, more ram, etc.) or just purchase a new rig. Ultimately, I could probably get about $250 for my current laptop. So if I can get a new laptop at the cost of new parts plus value of my current setup, it would obviously make sense for me to just get a new one. Hopefully I can get some good advice as to whether or not its worth updating my current laptop or not.....

Here is what I'm currently running: Its an Acer Aspire 9410 Acer Support - Aspire 9410 Series Specifications (http://support.acer.com/acerpanam/notebook/0000/Acer/Aspire9410/Aspire9410sp2.shtml)

It has a 1.6mhz processor with 1.99 Gig of ram.....and I assume the hard drive is slow. I honestly don't want to take it out to see.

If I'm in the wrong forum, I apologize. If so, can the moderator move it to right one.....

Thanks folks!

Patvs
09-01-2010, 11:06 PM
This is the perfect thread for these questions.

General laptop rule is.. ANY upgrade (or repair) will cost you half the price of a NEW laptop... and the NEW laptop will be twice as fast. (i.e. ANY upgrade is never never cost effective)

If you sell the laptop for $250--> that will be great, since you can buy a NEW laptop that is 2x as fast for $500.

Questions for you: What type of poker player / HoldemManager user are you?
1. A regular 1 tabling, B multi-tabling, C mass multi-tabling /damined/purchased handhistories
2. Do you really need the mobility of a laptop for poker?
3. Do you poker winnings, justify you spend (a lot) more $ on the computer's performance and stability?
(4.) play modern PC games?

AdamWK
09-02-2010, 10:37 AM
This is the perfect thread for these questions.

General laptop rule is.. ANY upgrade (or repair) will cost you half the price of a NEW laptop... and the NEW laptop will be twice as fast. (i.e. ANY upgrade is never never cost effective)

If you sell the laptop for $250--> that will be great, since you can buy a NEW laptop that is 2x as fast for $500.

Questions for you: What type of poker player / HoldemManager user are you?
1. A regular 1 tabling, B multi-tabling, C mass multi-tabling /damined/purchased handhistories
2. Do you really need the mobility of a laptop for poker?
3. Do you poker winnings, justify you spend (a lot) more $ on the computer's performance and stability?
(4.) play modern PC games?

Thanks so much for getting back to me.

1) I play 24 tables at a time, so I'm a mass-tabler
2) I do need the mobility of a laptop because I play on my lunch at work.
3) If HEM would function properly, I feel that I could increase my winrate exponentially....so that's why I want to upgrade, so I suppose it would be worth it.
4) I'm an old school Starcraft junkie, so if I do buy a new rig, I would want it to get a laptop that would support SC2.

Ultimately, if I go with a new laptop, I would want to cap the amount that I spend at $600.

Thanks for the help!

Adam

Patvs
09-02-2010, 04:26 PM
You should consider to upgrade the laptop with a SSD harddisk. For your SQL performance

But that will considerably increase the cost.
A 80 GB SSD will cost $200.

And a 80 GB will be rather small for Windows + SQL. (StarCraft II already is 8 GB)

Videocard speed is another issue. SCII doesn't have very high system requirements, but running it at HIGH DETAIL settings will require a videocard, budget laptops just don't offer.

grinding4$
09-06-2010, 11:05 PM
Hello, I have recently decided to make a switch from PT to HEM. I have used PT for years, but after giving HEM a fair trial, I firmly believe that it is a superior product.
My old PT dbase is 30+ mil hands and has been bogging down....but I have vowed to keep my new HEM dbases to no more than 5 or 6 mil hands.

I have a question regarding adding a SSD to my setup, but first I will provide you with some background info.....
My current computer system contains an AMD Phenom II X4 945 which is overclocked to about 3.4ghz....i am running the 64 bit Vista OS....HD = Samsung, which is similar to a Western Digital Black, it has 500GB, 7200 rpm, and 32 mb cache.....RAM = 8gb DDR 3 running at a very low latency of 7/7/21....with an overclock on the hyper-transport to optimal levels.
NOW for the question,
I am considering adding the following:

A-DATA S599 AS599S-128GM-C 2.5" 128GB SATA II Internal Solid State Drive (SSD):
2.5" 128GB SATA II Sequential Access - Read: up to 280MB/s
Sequential Access - Write: up to 270MB/s
Features: TRIM command support RAID support 4K write (Aligned): 50,000 IOPS
Parts: 3 years limited
Model #: AS599S-128GM-C

WHAT DO YOU THINK ABOUT THIS PRODUCT AS AN ADDITION? IS THERE ANYTHING SIGNIFICANTLY SUPERIOR? My IT friend compared it with the OCZ Vertex 2 and said that it was equally as good if not better and at a lower price. I ASSUMED THAT THE 128GB WOULD BE ENOUGH....AM I MOST LIKELY CORRECT?

I will also make the proper tweaks as outlined by the OP in steps 3 through 11, immediately following the SSD addition.

Finally, many thanks to all who have contributed to this fantastic thread and particularly the OP.

Thank you to any respondant (hopefully support) for taking the time to read and help.....it is appreciated.

Patvs
09-06-2010, 11:24 PM
128 GB for... Windows + 10 millions hands is enough.
Especially if you import the hands.. and then purge most of them (only keeping the stats)

Windows + a 3 million purged hands database is only 30 GB.
Two best SSDs are the 160 GB Intel X25-M G2 Postville, 120 GB OCZ Vertex 2. (I currently use 2x OCZ Vertex in RAID-0, the old Vertex model)

I'm unfamiliar with the A-DATA.
I googled some benchmarks for it. http://benchmarkreviews.com/images/reviews/storage/ADATA_S599/ADATA-S599-SSD-AHCI-1C.png

It seems the results are really good.
But definately not as fast as the (more expensive) Vertex 2.
(I'm only really interested in the 4K read speeds)

http://www.legitreviews.com/images/reviews/1299/vertex2_crystal.jpg

grinding4$
09-10-2010, 03:08 AM
Now that I installed a SSD, I took the HEM setup file and moved it to my SSD drive, which of course is now my main drive since the OS is now on it. I also have the OS on my other drive.....don't know if that will be a problem? Any ideas? Anyway, once I fired up the HEM setup program and installed a new postgres, I then executed the HEM program. Unfortunately, it would not take my registration. I then went in and tried unsuccessfully to deactivate both of my licenses....the button "RESET ALL PROFILES" shows up as a dead link. Also, when I go to the beta page for deactivating a license, it will not accept my user login???
I would really appreciate any help that you could provide me regarding both the general process of switching over programs to the SSD and what the cleanest way to do that would be, and also the HEM switch from my old spinning HD to the new SSD.
Also, I am assuming that I should install my Internet Security software on the new SSD as well, since that is where the OS is located......any tips?
THANK YOU VERY MUCH.

Patvs
09-11-2010, 01:32 PM
Please go to Registration Home Page (http://www.holdemmanager.net/registration) and signup with a new login name and password and then you can quickly add your serial code and reset it whenever you need to.


post the reg.log file if you still get an error when activation the license

grinding4$
09-11-2010, 02:31 PM
I cannot even get into log into the registration home page. I have used both my HEM login info as well as my HEM forum login info. Also, if I go to register and create a new account, it says that my e-mail address is already in use.
Please advise.

PS: I am using the correct info, because I can log into both my HEM account and obviously I am currently logged into the forum.

grinding4$
09-11-2010, 02:48 PM
Please go to Registration Home Page (http://www.holdemmanager.net/registration) and signup with a new login name and password and then you can quickly add your serial code and reset it whenever you need to.


post the reg.log file if you still get an error when activation the license

I also tried to have a new password sent to my e-mail, by using both my HEM username and my forum username. The system rejected both names.

Patvs
09-11-2010, 11:41 PM
Try creating a new account using a different email address

netsrak
09-12-2010, 05:56 AM
The registration system is no longer needed, please login to our homepage (Hold'Em Manager Poker Tracking and Analysis Software (http://www.holdemmanager.com)) or create a new account there and manage your keys there.

grinding4$
09-13-2010, 02:58 AM
The registration system is no longer needed, please login to our homepage (Hold'Em Manager Poker Tracking and Analysis Software (http://www.holdemmanager.com)) or create a new account there and manage your keys there.

OK....I am officially getting frustrated.

I have tried doing this multiple times and I just tried again. The "Reset All Profiles" button always is a dead link. I checked by right clicking it and there is not an option to "open link". Also, when I hit the question mark it says that I have one open license, but when I go to activate HEM I get an error message, and under details it says "No more activations allowed. You must first deactivate the software from the original machine before attempting to activate again."

I am at this moment asking you and HEM to make this problem go away by whatever means necessary. This is starting to become a real problem and is becoming costly.

Thank you for your help. Please reach me directly by e-mail if necessary.

grinding4$
09-13-2010, 03:06 AM
Try creating a new account using a different email address

I did this and I got this in return....
This License Code is already uploaded.

Please make this problem go away....I feel as though I am getting the run-around.

Patvs
09-13-2010, 04:37 AM
Email sales@holdemmanager.com and request them to manually reset your serial

ohoyt
09-14-2010, 09:28 AM
I did this and I got this in return....
This License Code is already uploaded.

Please make this problem go away....I feel as though I am getting the run-around.

I can help you out w/ this, but before I can, I either need your hm.com login (email) or your serial code so I can look it up. Please PM me either one of those. Also, I assume it is a HEM serial that you are having issues with? Can you please let me know which product you are having problems with if you have more than one serial tied to your account?

Thanks and I apologize for your inconvenience. It will be pretty quick once I have this info to get you back up and rolling again.

grinding4$
09-14-2010, 01:19 PM
Thank you for offering to help, but someone from support dealt with this for me last night. Problem solved.

steel108
09-25-2010, 12:39 AM
I think I'm going to take the plunge and get an SSD.

I am leaning towards the OCZ Vertex 2 120GB which comes out to $212 after rebates.

Can anyone make a list of everything I should put on the SSD... I will also have a second 1TB hard drive

Patvs
09-25-2010, 08:18 PM
Any important program that requires speed: Windows, PostgreSQL
Basically anything except media files (store movies, music and porn, on the 1 TB)

If you don't care much for startup speeds, also install all games and large programs to the regular drive.

steel108
09-26-2010, 04:39 AM
Any important program that requires speed: Windows, PostgreSQL
Basically anything except media files (store movies, music and porn, on the 1 TB)

If you don't care much for startup speeds, also install all games and large programs to the regular drive.

So Windows 7, PostgresSQL are mandatory.

How about Table Ninja, HoldemManager, TableScan, PokerStars, AHK scripts, Camtasia, etc....

Should I put everything I use to play poker on the SSD?

Patvs
09-26-2010, 11:36 AM
Yes, + Office, + Photoshop, etc. any program you don't want to lag

steel108
09-26-2010, 02:08 PM
Yes, + Office, + Photoshop, etc. any program you don't want to lag

So these are all the programs I will install on the SSD:

(1) HEM
(2) PokerStars
(3) Postgres
(4) TableNinja
(5) Camtasia
(6) Windows 7 OS
(7) Autohotkey
(8) 3 ahk scripts
(9) TableScan
(10) Excel and Word
(11) RocketDock

Is this too much? These are the things I use everyday

steel108
09-27-2010, 02:58 AM
Would this be good for what I need? There are a ton of SSD out there and this one seems to get great reviews across the board, but is it good for what I need and is 120gb big enough? I delete all hands that are older than 3 months fwiw

http://www.newegg.com/Product/Product.aspx?Item=N82E16820227590

Patvs
09-27-2010, 11:11 PM
OCZ Vertex 2 is the best.. and 120 GB should be enough for a 20+ million hand database + Windows, etc.

steel108
09-28-2010, 05:54 PM
I'm heading out in 2-3 hours to pick up an SSD for my desktop and laptop. From what I have read in this thread, the main focus of an SSD should be on 4k read/write times correct?

Patvs
09-28-2010, 09:25 PM
The regular harddisk vs SSD is: SSD has lower access time, higher 4K read speeds, etc.

What distinguishes the good, from the less good SSDs, is the best models have higher sequential read/write speeds, and higher 4K read/write speeds.
But even a crappy SSD, will still have 4K read speeds 10x faster than a regular drive. Though since you're already spending a lot of money on a SSD ($ per Gigabyte) just get the top models (Vertex 2, X25-M) with the highest speeds.

steel108
09-29-2010, 02:12 AM
Do I still need to vacuum/analyze my database on an SSD?

Patvs
09-29-2010, 04:43 AM
Vacuum/Analyse/Reindex: YES...

But you don't have to defrag the SSD

steel108
09-30-2010, 10:52 PM
I'm having problems with the ssd; might not be ssd related though. For some reason postgreSQL and hem are using 80% of my cpu. there are really random jumps and it causes my entire system to freeze when it hits 100%.

This never happened before installing an ssd. I followed all the tweak suggestions on the first page (shared buffers, etc) and the tweaks mentioned in the website linked on the first page for both Windows 7 and SSD.

Patvs
10-01-2010, 12:00 AM
Are you doing a massive import of ALL your old hands.... or just running the auto import, when playing?

If doing a big import, it's normal the CPU jumps to 100% for brief moments

steel108
10-01-2010, 12:34 AM
Are you doing a massive import of ALL your old hands.... or just running the auto import, when playing?

If doing a big import, it's normal the CPU jumps to 100% for brief moments

I'm just doing auto-import

Drew1
10-02-2010, 02:39 PM
Hey i have old inspiron dell laptop that is 5 years old and is 15.4'

Pentium 4 Processor
2GB RAM
5400 RPM
80GB Hard Drive

I been looking for laptops but it seem the ones i want like dell studio 1558 has problems.

My computer lags when i have 16 tables running with HEM and TN on. I want to know would it be a good idea to buy an ssd drive for this old computer? Would it make it real fast with HEM on even though its a pentium 4 and 5 years old? I really want to buy a new laptop but the ones i see either have problems or the resolution is 1366x768 and i know the table is smaller there than it is for 1280x800 resolution for my 15.4'.

Drew1
10-03-2010, 09:24 PM
Would getting a SSD for this old 5 year intel pentium 4 laptop i posted above make it faster than getting a brand new intel i5 4gb 7200rpm laptop?

Patvs
10-03-2010, 09:40 PM
the new i5 will be faster in most tasks.
SSD will only win when you have to vacuum/analyse your SQL database.

Drew1
10-03-2010, 11:41 PM
Would it be a good idea then to just not upgrade the new laptop and have it 320gb 5400 rpm and then buy ssd drive? I was going to upgrade the 320gb to 7200rpm. That would cost $50 from the website.

Patvs
10-04-2010, 03:48 AM
I can't really predict how fast/slow the laptop will be.
To be save: get the 7200 RPM upgrade. Maybe it'll be fast enough, you won't encounter ANY lag, and you don't need to buy the SSD. (<-- recommended)

If you're 100% certain you'll replace the harddisk with a SSD within a month, just get the cheapest harddisk they offer

AVO|Ratatuj
10-04-2010, 09:15 AM
it may happen that your old laptop has an ATA drive, so you even won't be able to install an ssd there. so I'd suggest buying a new laptop first. seems to me you'll have good overal performance even with a standard 7200 drive on it.

steel108
10-07-2010, 12:31 AM
I have been reading online and I keep seeing people write that the SSD has to be partitioned in a certain way to work optimally. Have you ever heard of this? FWIW, the SSD is working great; the cpu trouble was fixed when I changed the postgreSQL settings (shared buffers, etc...)

AVO|Ratatuj
10-07-2010, 10:29 AM
it's not about partitioning. they say about right aligment. but don't mind it if you use win7.

Patvs
10-07-2010, 02:06 PM
The alignment:

If a partition is unaligned, the operation system needs TWO read/write actions instead of ONE.

Windows Vista SP1 (and up) / Windows 7 ALWAYS create aligned partitions.
ONLY if you XP can this cause problems.

steel108
10-14-2010, 05:07 PM
The alignment:

If a partition is unaligned, the operation system needs TWO read/write actions instead of ONE.

Windows Vista SP1 (and up) / Windows 7 ALWAYS create aligned partitions.
ONLY if you XP can this cause problems.

I have no idea how I went so long without an SSD

AVO|Ratatuj
10-14-2010, 05:39 PM
liked it? ))

steel108
10-14-2010, 05:56 PM
liked it? ))

Yeah, I snapped bought a second one for my laptop after a few days

yeeluvspizza
10-18-2010, 05:18 PM
Yeah, I snapped bought a second one for my laptop after a few days

Why do u need a 2nd SSD? How many GB was the 1st one? Are you using the 2nd one externally? Inquiring minds have to know! LOL

Tranclugator
10-23-2010, 02:38 PM
I bought quite cheap JMicron-based SSD for my system, poker software and PostgreSQL. But when I play poker, my computer is LAGging (random freeses for 0.1 - 0.5 sec). There were no such problems with a system on HDD, SSD-installed system works way faster though. Looks like JMicron SSD controller cannot manage so many huge disk writes (HH from several poker clients, HEM Data, PostgreSQL Database, PostgreSQL Write-Ahead LOG). I am thinking about using simlinks to "dedicated" HDD for my pg_xlog or Data folders. Will it decrease overload of SSD controller ?

Maybe you can tell me which folder exactly should be simlinked (or which folder suffers more from huge disk writes)?

AVO|Ratatuj
10-23-2010, 02:42 PM
i'd suggest trying to switch priority of HMImport to a lower one first.

Tranclugator
10-23-2010, 03:13 PM
i'd suggest trying to switch priority of HMImport to a lower one first.

I think "priority" is a CPU load term, but that is not my problem because I had no LAGs with old HDD even with my old core2duo CPU and 2 GiB of RAM. Now I have core2quad and 4 Gib of RAM on tha same Win7x64.
But i'll try :)

noap_
10-25-2010, 04:39 AM
I can't find the "shared_buffers" entry in the postgresql.conf file.
I'm using PostgreSQL 8.4.

Patvs
10-25-2010, 05:44 AM
#------------------------------------------------------------------------------
# RESOURCE USAGE (except WAL)
#------------------------------------------------------------------------------

# - Memory -

shared_buffers = 512MB # min 128kB
# (change requires restart)
#temp_buffers = 8MB # min 800kB
#max_prepared_transactions = 0 # zero disables the feature
# (change requires restart)


----

search for "buffers"

Colin252
11-01-2010, 07:16 PM
SoI'm trying to follow all of the steps here to speed up my hem. I went to upgrade postgre and see 9.0 is now available, should I use this or 8.4?

AVO|Ratatuj
11-01-2010, 07:18 PM
9 works ok afaik

steel108
11-05-2010, 02:02 AM
Why do u need a 2nd SSD? How many GB was the 1st one? Are you using the 2nd one externally? Inquiring minds have to know! LOL

I had one for my desktop, after seeing how awesome it was, I got one for my laptop too.

Tranclugator
11-05-2010, 05:38 PM
i'd suggest trying to switch priority of HMImport to a lower one first.

That trick doesn't work for me :( . What soft can i use to monitor which folders has huge writes? Maybe i should reinstall postgre placing DATA folder onto a different HDD or can i just use a simlink?

AVO|Ratatuj
11-06-2010, 04:31 AM
you may make a backup of your base, reinstall postgre at HDD and restore your base. then test it.

Tranclugator
11-06-2010, 11:36 AM
Trying to find how to make HM Import faster )

Bins of postgre - system HDD, Tablespace - the 2nd HDD, pg_xlog (write ahead log) - the 3rd HDD :D

Bull_G8er
11-06-2010, 05:35 PM
Has anyone tried out the REVO or THE IBIS on Postgres & HEM??? Connecting through PCI seems like it is way faster, but I am not certain that it would be noticeable.

steel108
11-09-2010, 10:38 PM
Bins of postgre - system HDD, Tablespace - the 2nd HDD, pg_xlog (write ahead log) - the 3rd HDD :D

What is the pg_xlog?

Tranclugator
11-10-2010, 05:49 PM
What is the pg_xlog?

This is a working folder for Write Ahead Log. In that folder rewritable 16MB-checkpoint segments are stored. That checkpoints prevent DBs from being corrupted in case of power loss, BSODs and stuff. AFAIK
This folder have tonns of writings during massive hands import. Putting this folder by simlinking onto a separate spindle significally increases import speed if you need to import like 200k+ hands at once.

AVO|Ratatuj
11-10-2010, 05:50 PM
i'ts much easier just to turn logging off...

Tranclugator
11-10-2010, 08:12 PM
Logging collector and WAL are not the same (and different strings in conf file). WAL is needed for database integrity and resistance to system crushes. But maybe its not a good idea to turn WAL off for the time of initial import.

rowhousepd
11-16-2010, 06:35 PM
How often should we vacuum analyzing our databases? Do you suggest running it after we import a certain number of hands? Also, is there an indicator of some kind (outside of the db running very slowly) that tells you when the last time we ran a vac analyze? With a large database like mine, I'd rather do it only when I need to since it take a long time.

(I used to use Poker Tracker, and there is both a reccommended # of hands to run it on as well as something that told you what the cache status % is.)

Patvs
11-16-2010, 11:00 PM
As PokerTracker suggests, I'd run the vacuum/analyse/reindex every 50.000-100.000 hands.

We don't have some sort of indicator, but if you play 50.000 hands a month, just vacuum/analyse/reindex your database monthly. And also create a backup of your database.

rowhousepd
11-17-2010, 01:43 AM
As PokerTracker suggests, I'd run the vacuum/analyse/reindex every 50.000-100.000 hands.

And by reindexing you mean the procedure that you can only run through postgres (rather than just the vacuum/analyze optimization you can run from the Database Management feature in HEM), correct?

Patvs
11-17-2010, 09:16 AM
Yes... I would manually run vacuum/analyse/reindex in pgadminIII, until we've tweaked/fixed the new optimization tool

rowhousepd
11-17-2010, 03:24 PM
So just to be clear, you'd recommend doing all three (vac/analyze/reindex) every 50k hands, correct?


Yes... I would manually run vacuum/analyse/reindex in pgadminIII, until we've tweaked/fixed the new optimization tool
Also, is the optimization tool not working properly? I've run the full optimization a few times and didn't get any errors.

Patvs
11-18-2010, 01:24 AM
Yes, run all three (vac/analyze/reindex) every 50k hands.
But you can also use the optimization tool, since it works for you.

The optimization tool has some problems for some HM users, which is why I still recommended using pgadminIII

jdoury
12-21-2010, 12:24 AM
My Computer has run out of hard drive space, and I suspect HM to be the prob, as it looks like there are about 25G worth of files that look like:

c:\Program files\PostgreSQL\8.3\data\base\16403

About 25 of these at about 1G each. Can I get rid of some of these somehow? I surely can delete a lot of my hands, especially old ones, but don't want to do it wrong and mess up the whole database. Any advice?

Patvs
12-21-2010, 01:50 AM
Don't delete any files in the /data subfolders.
Only delete ALL log files from the /pg_log folder (don't delete the actual folder, just its content)

fozzy71
12-21-2010, 11:54 AM
Logging:

I would suggest you turn off logging on your SQL installation.

To turn off logging, follow these instructions. This is the first thing I do anytime I install SQL for someone.

- Start > My Computer > Tools > Folder Options > View > UnCheck 'Hide Extensions for known file types' > OK

- C:\Program Files\PostgreSQL\data\postgresql.conf > Right-Click > Open With.. > NotePad > Check 'Always use this program'

- Scroll about half way down to ~Lines 245 - 260:

- The last line of this block of code, for the 'logging_collector', must be changed from On to Off.



------------------------------------------------------------------------------
# ERROR REPORTING AND LOGGING
#------------------------------------------------------------------------------

# - Where to Log -

log_destination = 'stderr' # Valid values are combinations of
# stderr, csvlog, syslog and eventlog,
# depending on platform. csvlog
# requires logging_collector to be on.

# This is used when logging to stderr:
logging_collector = off # Enable capturing of stderr and csvlog


File > Save; File > Close

Start > Programs > PostgreSQL 8.3 > Reload Configuration.


- Start > My Computer > C:\Program Files\PostgreSQL\data\pg_log, or C:\Program Files (x86)\PostgreSQL\data\pg_log, if you have 64 bit Vista. Delete all files in that folder. And it might be a good idea to empty your recycle bin at that point, or use a 3rd party utility like CCleaner to clean up all your junk/temporary files. You want to do this before you get to the vacuum and defrag process.



Regarding database maintenance:

You should regularly purge mined hands in your database, after purge vacuum / full analyze the database via pgadmin. You do not want to purge any Hero hands so make sure your alias is properly configured before purging.
FAQ - Hold'em Manager Poker Tracking Software :: Purge Hands from Database (http://faq.holdemmanager.com/questions/100/Purge+Hands+from+Database)
FAQ - Hold'em Manager Poker Tracking Software :: Purge Hands (http://faq.holdemmanager.com/questions/197/Purge+Hands)

Then you can vacuum/analyze - FAQ - Hold'em Manager Poker Tracking Software :: Vacuum Analyze Database (http://faq.holdemmanager.com/questions/88/Vacuum+Analyze+Database+#manual)

Before you defragment you should stop the PostgreSQL service:

Start > Programs > PostgreSQL 8.x > Stop Server

Use your favorite defrag tool. I recommend Smart Defrag.

After defrag I recommend you reboot your PC. If you need to access the DB before rebooting you can start the PostgreSQL service.

Start > Programs > PostgreSQL 8.x > Start Server

czglory
01-04-2011, 07:33 PM
if I bought a SSD to add to my already existing HD, how would this be done? Would I have to format it with windows, re-format my computer, or something? Also, I have a really large database, do SSDs come in larger than 160gB?

AVO|Ratatuj
01-04-2011, 07:42 PM
you may buy up to 1Tb ssd now but they do cost a lot. you can install OS and base just like on a regular HDD. format with win7 is ok. you can also back up and then restore your base at ssd or you can use soft like Acronis. you can also purge hands and delite logs to reduce DB's size.

Patvs
01-04-2011, 07:56 PM
Ideally you reinstall Windows on the SSD. During the Windows install, it will automatically format the drive, creating a aligned partition, etc.
If you install Windows 7 it will also automatically turn off defrag, enable TRIM (if your SSD supports TRIM), etc.

Note: change your BIOS setting from IDE to AHCI, before you install Windows on the SSD.

Then you restore the backup of your database to the SSD. (Or you reimport all your hands into a new database)


----

The alternative would be... to keep using your old harddisk for Windows... and only use the SSD for your database. But Windows on a SSD is a blast: since it will be so much faster.

SSDs larger than 160 GB exist. You have 1 TB SSDs... but they are CRAZY expensive. And the 400+ GB ones usually are just 2x 200 GB SSD glued together with a inboard RAID chip. And RAID is NOT recommended since it doesn't support TRIM.


If you need 160+ GB, I'd recommend to WAIT on the Intel X25-M G3 Postville Refresh which will have a capacity of 80/160/300/600 GB. (note the 600 GB version will be really expensive)
Or buy a 180/200/240 GB OCZ Vertex 2 now.
A cheaper alternative is the Intel X25-m G2 80/160 GB, or smaller OCZ Vertex 2. It's probably a lot cheaper to just buy two. One for Windows. One for your database. But going crazy with SSDs is only something you should consider if you really need faster SQL queries (running a report, showing a graph, importing hands, etc.)

dad604
01-04-2011, 08:45 PM
Just a note of caution:

Format SSD's only with quick format and NOT the full format.
Quick format fills it with zero's, full format fills drive with 1's which will really slow the drive down. If you have full formatted it, use Secure Erase for OCZ SSD. You will have to look up program for other drives.

infurrrno
01-28-2011, 11:59 PM
I'm looking at transferring my db from a 1tb WD 7200 rpm sata hdd to a SSD.

Is it worth getting a premium ssd (eg OCZ revodrive pci-express ssd)
- This ssd has transfer rates of ~700mb/s while my current hd works at 128mb/s max.

My question is whether HEM will be able to properly utilize these speeds, and if I'm better off going with a general ssd (285mb/s)

Thanks!

AVO|Ratatuj
01-29-2011, 03:25 AM
I guess general 285 will be all right. Revo is great but because of it's "raid nature" can have some problems. You should also mind how fast is your CPU, to get all advantages of using an ssd.

Ajeto
01-29-2011, 05:39 AM
I'm looking at transferring my db from a 1tb WD 7200 rpm sata hdd to a SSD.

Is it worth getting a premium ssd (eg OCZ revodrive pci-express ssd)
- This ssd has transfer rates of ~700mb/s while my current hd works at 128mb/s max.

My question is whether HEM will be able to properly utilize these speeds, and if I'm better off going with a general ssd (285mb/s)

Thanks!

Something like Intel x25 will do just fine. I have one and it's working like a charm. I bought 160GB, and with whole system and database still have 100GB free (moved USERS to a HDD).

infurrrno
01-30-2011, 12:57 AM
I guess general 285 will be all right. Revo is great but because of it's "raid nature" can have some problems. You should also mind how fast is your CPU, to get all advantages of using an ssd.

What do you mean 'raid nature'? What kind of problems does this present? I have an Intel i7 950 3.07GHz processor. I'm not overly techy but I assume it would go ok on this as it isn't very old. What do you think?

I'm quite often downloading hand histories, and looking at making my db pretty big over a few sites that I play at. How many hands do you suppose a 256gb ssd will hold?

cheers

Patvs
01-30-2011, 04:47 PM
A SSD needs "TRIM" to maintain its fast speeds. (trim serves a similar function as "defrag" on regular hard-disks)
The first generation of SSD don't support trim (example: Intel X25-M G1).
And RAID setups don't support TRIM.

NOT having TRIM can lead to severe performance degradation over time.
Though it's all relative, a Revo x4 without TRIM that has degraded 50% will still be faster than a Intel X25-M G2 with TRIM.



10 GB is about 1 million hands.
So a 256 GB harddisk can hold a massive 25 million hand database.

AVO|Ratatuj
02-02-2011, 12:52 PM
infurrrno, mind that you have a possibility to purge your hands. That means that you can delete all unneeded hand hystories, though you'll have all your stats. This will save you a lot of place at your ssd. Also turn off logs.

miak
02-04-2011, 10:02 AM
hello, today i found in HM button something like "optimize my postgres" dont remember were. After that postgres dont up. I found in PostgreSQL configuration file Customized options. I comment checkpoint_completion_target = 0.9. And postgres up. But after reboot my PC, postgres down again, and now nothing help, I comment all Customized options but no changes. Plz help how can i back my default configuration?
Thx.

AVO|Ratatuj
02-04-2011, 10:04 AM
You can't just comment all options cuz, i guess, they are needed foк PSQL's normal work. You just need dtfault config back.

miak
02-04-2011, 10:13 AM
You can't just comment all options cuz, i guess, they are needed foк PSQL's normal work. You just need dtfault config back.
how?
what changes this button did?

AVO|Ratatuj
02-04-2011, 10:27 AM
well you surely did a backup copy of a config file, didn't you? :rolleyes:

ask smb to post it.

miak
02-04-2011, 10:34 AM
of course not, it's just 1 little button.
OMG why i click that button????? It was so stupid.
Ok i found HM backup config.

Plz delete this button from HM. thx

noap_
02-17-2011, 07:04 AM
Should the HMarchive be located on the SSD as well, or does it make no difference between storing it on the SSD compared to storing it on another HDD? I mean does it make a difference in performance/speed?
Because I don't really want HM to constantly write on my SSD (HMarchive-folder).

AVO|Ratatuj
02-17-2011, 07:54 AM
yes it'll be much better to store them at usuall drive as they're very heavy (if not zipped). and after been added to the base they are not needed actually, so there's no need to keep them at ssd.

Jedius
02-19-2011, 04:47 AM
Which version of PostgreSQL are we supposed to be using?

Version 8.4.7-1

or

Version 9.0.3-1

AVO|Ratatuj
02-19-2011, 05:05 AM
both work ok, and even 9x 64 bit too )

Jedius
02-19-2011, 05:46 AM
Is there any difference between the 2 versions? I am running Win 7 64-bit if that matters.

If I was to install the 9.0.3 (I just installed the 8.4 version)...would I just do it like the guide said when going from 8.3 to 8.4?

I'm hoping this takes care of my HUD issue of not coming up on random tables. If I'm still having troubles with that after I installed the latest HEM and Postgres...what forum should I ask about that in? Has anyone else been having this problem? HEM had been working great up until about 1-2 weeks ago...now sometimes the HUD just doesn't display on random tables...even if I restart HEM.

Thanks!

AVO|Ratatuj
02-19-2011, 05:50 AM
do you have the latest beta installed?

when I tried different versions of postgre I just made new databases every time not to have any problems. now I have 9x 32bit. I noticed no better speed with a 64 bit version.

Patvs
02-19-2011, 05:56 AM
I'm using 9.0.3 x64 on port 5433.
It's definitely not faster with import speeds. But vacuum/analyse does seem faster. And they (SQL team) claim it's more stable.

Note HoldemManager officially only supports SQL 8.4.
So with 9.0 installed you can't use the backup & restore utility. (but will manually have to use pgadminIII)

If you play on PokerStars, just wait for the next HM update. There are several PokerStars issues (with CAP, DEEP and Home Games tables)

noap_
02-19-2011, 06:02 AM
Why Port 5433? I'm using the same version but the by default set port 5432.

Jedius
02-19-2011, 06:22 AM
I'm using 9.0.3 x64 on port 5433.
It's definitely not faster with import speeds. But vacuum/analyse does seem faster. And they (SQL team) claim it's more stable.

Note HoldemManager officially only supports SQL 8.4.
So with 9.0 installed you can't use the backup & restore utility. (but will manually have to use pgadminIII)

If you play on PokerStars, just wait for the next HM update. There are several PokerStars issues (with CAP, DEEP and Home Games tables)

Ah...maybe that's it. I play on PokerStars. Any idea when the next HM update will be? It really throws me off my game when I get a few tables with no HUD.

I've been using 1.11.06a HEM and just now am installing PostgresSQL Version 8.4.7-1 .

DaWeef
02-20-2011, 05:29 PM
I have recently purchased a new system with an SSD boot drive (OZC Vertex2). To save space on the SSD, I moved the Program files directory to an additional hard drive with plenty of space.
I used 'mklink' create a symbolic link, which in a matter of speaking permanently changes the location of the program files directory to the slower drive. However, this means that PostgreSQL is (automatically) installed on the slow drive and not the SSD. To still reap the advantage of the SSD I moved the postgreSQL data-directory to the SSD drive. Does this suffice to get (close to) optimal performance from my SSD or do I need to take some more steps?

Ps. I am currently importing old hands, which is having a pace of 140 hands/s. Is that any good?

noap_
02-20-2011, 05:31 PM
I have recently purchased a new system with an SSD boot drive (OZC Vertex2). To save space on the SSD, I moved the Program files directory to an additional hard drive with plenty of space.
I used 'mlink' to permanently change the location of the program files directory. But this means that PostgreSQL is (automatically) installed on the slow drive and not the SSD. To still reap the advantage of the SSD I moved the postgreSQL data-directory to the SSD drive. Does this suffice to get (close to) optimal performance from my SSD or do I need to take some more steps?

Ps. I am currently importing old hands, which is having a pace of 140 hands/s. Is that any good?

phew... I hade like 6k/sec when I imported them a few days ago. (if I recall that rigt)

AVO|Ratatuj
02-20-2011, 05:40 PM
6k hands per second? was it holdem manager? was it supercomputer? was it in this reality?

yep 140 hands/sec is normal, depending on the CPU speed. I get the same @ my config below.

DaWeef
02-20-2011, 05:48 PM
6k hands per second? was it holdem manager? was it supercomputer? was it in this reality?

yep 140 hands/sec is normal, depending on the CPU speed. I get the same @ my config below.

Okay, thnx. probably my config is fine as it is then, because your setup seems more powerfull than mine (phenom 1055T with 4 Gigs memory).

AVO|Ratatuj
02-20-2011, 05:53 PM
my cpu imports hands at 2.6GHz, if you have a good cooler I'd advice you to overclock your cpu, surely if you import mined hands every day.

Patvs
02-21-2011, 05:32 AM
Port 5433. So it doesn't overlap with SQL 8.4 which I have on port 5432.
(don't install two versions of SQL using the same port)

Jedius
02-22-2011, 01:32 PM
If you play on PokerStars, just wait for the next HM update. There are several PokerStars issues (with CAP, DEEP and Home Games tables)

Is there any word or best guess as to when the next HM update will be? It was the deep tables that the HUD wasn't showing up on. I play on those all the time, so a working HUD would really be a great help.

Also, why is HEM version 1.11.06a and Table Manager 1.11.05fi? Is anything wrong here or is that what they're supposed to be?

Patvs
02-23-2011, 09:24 PM
1.11.06a and Table Manager 1.11.05fi is normal.

Next TableManager (with the DEEP fix) will be called 1.11.06

Bacco777
03-03-2011, 05:49 PM
Just for the record, I recently bought the i7 950, a Crucial C300 256GB SSD and 12GB of RAM to go along with it. My dbase has 8M+ hands now and I am still importing hands at 160 h/s.

Hope that helps.

AVO|Ratatuj
03-04-2011, 04:13 AM
have you turned logging off? have you changed postgres's config to use your memory?

the last and the most efficient advice will be to overclock your CPU to the max. surely I hope that you know how to do it and you know all the risks.

noap_
03-04-2011, 05:02 AM
^are you sure about that? In most cases the CPU isn't the bottleneck, RAM or HDD is.

AVO|Ratatuj
03-04-2011, 05:18 AM
it depends actually. when one has a slow hdd, cpu can't help a lot. but with a good ssd it may be a big difference.

noap_
03-05-2011, 05:09 AM
^Can you prove that with some hard facts, trustworthy articles or sth like that?

AVO|Ratatuj
03-05-2011, 05:12 AM
do I have a need to convince anybody? no. but feel free to try it yourself.

noap_
03-05-2011, 05:28 AM
No you haven't. I'm just that kinda guy who likes to know if it's really worth it before messing around with my system.

AVO|Ratatuj
03-05-2011, 05:35 AM
I don't know if it's worth messing or not. It depends on how many hands you import every day and if you want to make it faster or not. Only you can decide. But I guess it's not enoung for you if you're so curious about it.

so you have to: change settings in the config file, add all importing folders to trusted in your antivirus software, import from ssd (hand histories) to the DB (at ssd), overclock cpu.

noap_
03-05-2011, 05:38 AM
I don't know if it's worth messing or not. It depends on how many hands you import every day and if you want to make it faster or not. Only you can decide. But I guess it's not enoung for you if you're so curious about it.

so you have to: change settings in the config file, add all importing folders to trusted in your antivirus software, import from ssd (hand histories) to the DB (at ssd), overclock cpu.

thanks for your fast replies so far!

Right now I'm more curious about those points, because I haven't heard anything about them, nor read something in this threads initial post:
- change settings in the config file (which ones?)
- add all importing folders to trusted in your antivirus software

AVO|Ratatuj
03-05-2011, 05:49 AM
well from the 1st post of this thread:

-7 Edit your PosgreSQL.conf file in the SQL 8.x/data folder.
Do not use the Tuning Wizard. On some systems it will make changes to the postgresql.conf it shouldn't, resulting in being unable to connect to the database!
If you experience this problem--> simply go to the 8.4/data folder, undo the changes you made and reboot.
Recommended changes:
shared_buffers = MB (set this to 20% of your system memory, but not more than 1000 MB.... round it off to 128 MB, 256 MB, 512 MB or 768 MB)
effective_cache_size = MB (set this to 2x the size of the shared_buffers)

there are a couple of other possible settings (such as turning logging off). you can try and search for the same kind of FAQ in the pokertracker's forum.

what's concerning antiviruses - they can check any activity, so during the import some software will check every file. so you may want to add postgre folders and HM folder to trusted. anyway, this may not help. eg, I'm using avast internet security and you can't just set it not to check activity in such folders. otherwise you have to turn real time protection module off.

and make a copy of your ini file beforehand $)

noap_
03-05-2011, 06:14 AM
^thanks!
10chars

Patvs
03-05-2011, 03:04 PM
I wouldn't overclock my CPU, if it's already a fast CPU.
Harddisk will be the most likely bottleneck of any computer.
But if you have a fast SSD, it would never hurt performance to overclock CPU and RAM.

However more useful would be to make sure NO PROGRAM is monitoring:
your SQL folder, your SQL server connection (port 5432) and HoldemManager/HMHud.exe.

These programs include: anti-virus, Windows firewall, Windows Defender, 3rd party firewall, etc. If any such program doesn't give you the option to easily add exceptions uninstall it completely.

And edit postgresql.conf + turn off logging.

noap_
03-05-2011, 03:18 PM
turn off logging? I thought that is just decreasing the size of the database/log files, but not improving the performance?

Patvs
03-05-2011, 03:42 PM
Logging should be off by default if you install SQL 8.4/9.0.
It's on by default if you were using 8.2/8.3.

If it's on, turn it off.

When turned ON: it can slow down IMPORT speeds considerably, and creates useless very large log .txt files.

AVO|Ratatuj
03-05-2011, 07:04 PM
to my mind it's on even on 8.4 by default but I'm not sure

fozzy71
03-06-2011, 10:10 AM
to my mind it's on even on 8.4 by default but I'm not sure

Our 8.4.1.1 version in the combo installer disables it on install. 8.4.x from postgresql.org will have logging enabled, most likely.

AVO|Ratatuj
03-06-2011, 10:17 AM
ah, sure. as a true ... I never installed combo from you )

Jedius
03-13-2011, 02:08 PM
As far as Purge Hand History Options go...

When using a table tracker like TableScan Turbo for example...if you purge all your hand histories, will the table tracking program still function like normal?

Is the only thing that purging will affect going to be the ability to see the hands in a replayer? So, if you keep just your own hands (assuming you might want to review your own played hands), it won't really affect anything at all?

I just want to make sure I won't be hurting my table tracking ability. If you could maybe explain how exactly (or from where?) a table tracking program gets its stats, that would be awesome too.

AVO|Ratatuj
03-13-2011, 02:11 PM
Everything's right. All player stats will stay in the base, but you won't be able to replay the hands, only yours if you don't purge them either. So TST works very well after purging :)

Jedius
03-14-2011, 01:40 AM
When I go to purge them, it keeps looking like it's locking up. When I look at the task manager it says program not responding...now what?

Patvs
03-14-2011, 03:04 AM
When it shows "not responding", there usually is activity and you'll just have to wait (could take hours) until the task is complete and it unfreezes.

(the same thing happens if you backup/restore a database)

AVO|Ratatuj
03-14-2011, 05:28 AM
Probably, you just have a very slow PC...