PDA

View Full Version : Importing Error



Soneca1990
09-26-2008, 12:30 AM
I don't know what is going on, already have tried to reinstall postgre, reinstall HM, and don't know what problem is running on.
Just trying to evaluate the software, and can't import hands, can someone try to help me?
Here is a picture of the error:

http://img442.imageshack.us/img442/5149/hmerrorrj5.jpg

ebbingwaves
09-26-2008, 03:08 AM
Seems that you have already too much hands in your database of trial HM. As I know you can't import more then about 80k hands, after that your will receive exactly same effect.

DcJack
09-26-2008, 02:01 PM
Got the same problem, but have bought the program a long time ago. Trying to import hands from hhdealer.com for FTP 0.50/1 6max and only getting errors.

morny
09-26-2008, 03:45 PM
Are ye using this version http://www.holdemmanager.com/downloads/HmUpdate1.06.03h.exe if ye are please email me some of the HH that wont import morny@holdemmanager.net

myszkamiki
09-28-2008, 03:46 AM
Seems that you have already too much hands in your database of trial HM. As I know you can't import more then about 80k hands, after that your will receive exactly same effect.


Is it true? I have a trial version and I if I`am trying import hands I can import only a little part of all this hands.

morny
09-28-2008, 10:20 AM
No the trial is unlimited and only restriction is the amount of days which is 15. please make sure you have http://www.holdemmanager.com/downloads/HmUpdate1.06.03h.exe

pekaba
09-30-2008, 08:44 AM
I am using HoldemManager 1.06.03h and a week ago I was updating my Postgres to 8.2.7. No problems with auto import of my own hands. But when I am trying to import datamining hands from Pokerstars 0,25/0,50 I get Import Errors. The database has about 4,000,000 hands and I was running VACUUM / ANALYZE at pgAdmin3.

With Import // Import File(s) I get the message:

Imported 1 files.
Files Imported: 1 of 1
Hands imported: 0 Hands/s: 0.0/s
Duplicate Hands: 0
Import Errors: 300

When I was deleting about 70% of this file, then the import was working fine:

Imported 1 files.
Files Imported: 1 of 1
Hands imported: 86 Hands/s: 119.7/s
Duplicate Hands: 0
Import Errors: 0

With 161 hands I got the error message again.

morny
10-01-2008, 05:17 PM
Might be something wrong with the mined hands, can you email them to me morny@holdemmanager.net and a link to this thread

pekaba
10-02-2008, 07:15 AM
I was sending you the requested files and tried it with another file to import:

Imported 1 files.
Files Imported: 1 of 1
Hands imported: 0 Hands/s: 0.0/s
Duplicate Hands: 0
Import Errors: 100


Then I divided this file into three parts and the import of the three parts was no problem:

Imported 1 files.
Files Imported: 1 of 1
Hands imported: 38 Hands/s: 9.8/s
Duplicate Hands: 0
Import Errors: 0

Imported 1 files.
Files Imported: 1 of 1
Hands imported: 36 Hands/s: 26.8/s
Duplicate Hands: 0
Import Errors: 0

Imported 1 files.
Files Imported: 1 of 1
Hands imported: 26 Hands/s: 23.4/s
Duplicate Hands: 0
Import Errors: 0

pekaba
10-05-2008, 06:26 AM
I solved the problem. At first I tried to reindex my database but that did not work. Then I exported the 4,000,000 hands, which were about 5.25 GB. Then I made a new database and imported all my hands:

Imported 658 files.
Files Imported: 658 of 658
Hands imported: 4018220 Hands/s: 42.5/s
Duplicate Hands: 0
Import Errors: 0

That took about 24 h, but was faster than waiting for help.

Now everything is ok.

pekaba
11-01-2008, 05:59 AM
I have the same problem again!

I am now using HoldemManager 1.06.04 beta 17. When I am trying to import datamining hands from Pokerstars 0,25/0,50 I get Import Errors.

File: PokerStars#HoldemNoLimit#$0.25_$0.50#2008_10_26.tx t, 12930 kB
Imported 1 files.
Files Imported: 1 of 1
Hands imported: 0 Hands/s: 0.0/s
Duplicate Hands: 0
Import Errors: 9122


I deleted 99% of the hands and saved the file to
PokerStars#HoldemNoLimit#$0.25_$0.50#2008_10_26b.t xt, 115 kB

Imported 1 files.
Files Imported: 1 of 1
Hands imported: 0 Hands/s: 0.0/s
Duplicate Hands: 0
Import Errors: 81


I again deleted hands and saved the file to
PokerStars#HoldemNoLimit#$0.25_$0.50#2008_10_26c.t xt, 23 kB

Imported 1 files.
Files Imported: 1 of 1
Hands imported: 15 Hands/s: 16.0/s
Duplicate Hands: 0
Import Errors: 0

Now the import was ok.

I really do not want to export my hands and reimport them into a new database eyery 4 weeks. Perhaps someone can help me.

Dronto
11-01-2008, 06:28 AM
Hi.
I'm having similar problem. Using reg. version of http://www.holdemmanager.com/downloads/HmUpdate1.06.03h.exe
When importing hands into a 8.42Gb database containing aprox. 16m hands i get only errors. Importing same hands in another database works fine. Done vacuum, analyze and re-indexing. Still doesn't work.
Any suggestions other than creating a new database and import all hands from scratch?

morny
11-01-2008, 11:13 AM
Pekaba if your getting corrupted databases several times you may be doing something wrong like killing processes using the task manager or turning off your PC manually rahther than shutting it down or possibly might have a problem with your hard disks so google software to check your hard disks. I dont think theres much you can do when the database gets corrupted like this but giving the large amount of hands ill ask Roy if theres another possible solution

Rvg72
11-01-2008, 04:37 PM
Hi.
I'm having similar problem. Using reg. version of http://www.holdemmanager.com/downloads/HmUpdate1.06.03h.exe
When importing hands into a 8.42Gb database containing aprox. 16m hands i get only errors. Importing same hands in another database works fine. Done vacuum, analyze and re-indexing. Still doesn't work.
Any suggestions other than creating a new database and import all hands from scratch?

Dronto, please email me at support@holdemmanager.net and I could login with teamviewer on Monday between 9am and 6pm PST to see if I can correct this

Roy

Dronto
11-03-2008, 02:06 PM
Thanks Roy but i started a new database and imported the hands from scratch.

Btw i had a look at the logfile in pgAdmin. Seems like this is what causes the import error:
"ERROR: duplicate key value violates unique constraint "playerhandsflop_pkey"
Does that tell you anything?

Thank you and thanks for a great app.

morny
11-04-2008, 01:12 PM
if its a problem with the index we now have the option to fix it, please follow this FAQ if you need to use it in future http://www.holdemmanager.net/faq/afmviewfaq.aspx?faqid=168

CroqCroq
11-10-2008, 05:54 AM
I have the exact same problem.
I'm trying to import 1M datamined HH into a new db and after importing without error the 350 000 or so I get import errors for all of the others.
I tried fixing the index but it did not solve anything.
The same hands that are not importing can be imported fine into a new database, I only get the errors after importing 350k or so.
There is nothing wrong with the HH themselves. They are stored into .txt files of 1000 HH each. The fact that there is so many HH into a single files seem to play a role in the error. Files with only one HH import fine.

Please help :)

morny
11-10-2008, 02:07 PM
In this case the only solution is to create a new database and reimport all hands into that

http://www.holdemmanager.net/faq/afmviewfaq.aspx?faqid=173
http://www.holdemmanager.net/faq/afmviewfaq.aspx?faqid=146

CroqCroq
11-10-2008, 07:54 PM
I've already recreated a new db and it didn't work.
However I tried again today to import the 1M hh into my old db and it worked! almost all off the 650K hh that failed the first time were imported.
I have no clue as to why this happened...

pekaba
11-12-2008, 12:11 PM
I've had the same problem again and did some digging into Postgres. The problem looks like it's the same as one previous poster described:



2008-11-12 19:00:01 ERROR: duplicate key violates unique constraint "playerhandsflop_pkey"
2008-11-12 18:59:59 STATEMENT: EXECUTE PHCashKeyEXECUTE(5564487,426255,to_timestamp('10/26/2008 02:08:55','MM/DD/YYYY HH24:MI:SS'),1,194527,6,5,0,0,0,0,0,0,False,False, 3,0,0,0,0,0,0,0,0,0,False,F
EXECUTE PHCashMiscEXECUTE(426255,10555.00,4895.00,1,0,-1,False,-1,0,0,0,0,0,-1,-1,False,False,False,False,False,False,False,0,2);
EXECUTE PHCashKeyEXECUTE(5564487,426256,to_timestamp('10/26/2008 02:08:55','MM/DD/YYYY HH24:MI:SS'),1,77605,6,0,0,0,0,0,-25,0,False,False,3,0,0,0,0,0,0,0,0,0,False,False,F alse,False,-1,False,Fals
EXECUTE PHCashMiscEXECUTE(426256,3335.00,3335.00,2,5,-1,False,-1,0,0,25,0,0,-1,-1,False,False,False,False,False,False,False,0,2);
EXECUTE PVPExecute(77605,235317,5564487,-25 );
EXECUTE PHCashKeyEXECUTE(5564487,426257,to_timestamp('10/26/2008 02:08:55','MM/DD/YYYY HH24:MI:SS'),1,173461,6,1,0,0,0,0,-50,0,False,False,3,0,0,0,0,0,0,0,0,0,False,False,F alse,False,-1,False,Fal
EXECUTE PHCashMiscEXECUTE(426257,4895.00,4775.00,4,4,-1,False,-1,0,0,50,0,0,-1,-1,False,False,False,False,False,False,False,0,2);
EXECUTE PVPExecute(173461,235317,5564487,-50 );
EXECUTE PHCashKeyEXECUTE(5564487,426258,to_timestamp('10/26/2008 02:08:55','MM/DD/YYYY HH24:MI:SS'),1,204177,6,2,0,0,0,0,0,0,False,False, 0,0,0,0,0,0,0,0,0,0,False,False,False,False,-1,False,False
EXECUTE PHCashMiscEXECUTE(426258,12700,10555.00,6,3,-1,False,-1,0,0,0,0,0,-1,-1,False,False,False,False,False,False,False,0,0);


I snipped the statement (cut off at the right, it continues like this for about 1700 lines - actually one single line in the log, but I inserted line breaks), but there might be an indication to what the problem is: Are the consecutive INSERT statements which are obviously called by the SQL functions really reentrant? I've experienced the problems since I switched on a quad core system, which might explain why a possible race condition manifested since then.

Also, could we maybe test if it helps to split up the many many EXECUTE statements (~1700) into multiple PostgreSQL queries? Postgres might choke on a 250kB query payload...

Kind Regards,
pekaba

morny
11-12-2008, 10:00 PM
Maybe try reindexing playerhandsflop_pkey http://www.holdemmanager.net/faq/afmviewfaq.aspx?faqid=168