Notecaddy displays statistics with a huge delay.
Page 1 of 2 12 LastLast
Results 1 to 10 of 14
  1. #1
    Senior Member
    Join Date
    Jan 2013
    Posts
    243

    Default Notecaddy displays statistics with a huge delay.

    Hello.
    HM 2.0.0.8544, before this was some kind of 84xx, updated, because was hoped the problem would disappear.
    Notecaddy 2.6.0.14 (beta failed to start)

    PC - 12 cores, 32 gigabytes of RAM, hard disk - 256GB SSD, two poker bases: one base - 85 thousand hands, the second base - 20 thousand hands.
    Definitions is about ~400.

    The problem is this - even in an ordinary HM replayer, statistics and badges are displayed with a delay of tens of minutes.

    At first, the statistics of the pop-ups appear very slowly, then, perhaps, in tens of minutes, the badges appear. During the last gaming session, it took me probably 4 hours to load most of the statistics. Naturally, there is no reason to talk about any operational statistics. For example, if a person made a check / raise, maybe in 30 minutes he will be reflected in the pop-up. At the same time, in Tools - Player notes it is shown that the statistics is processed instantly, only displayed with hourly delays. I did everything - Reset notes, Vacuum-Full analyze, Backup> Restore database, nothing helps. What happens, where is the problem? Can there be a lack of memory, cache or something else, if I use HeatMaps to determine the hands that the player limps, raises, 3bet, coldcall? Help please, due to a similar problem, Notcaddy has now become almost useless. I play in two game rooms, I use different bases - one and the same problem.

  2. #2
    Moderator NotecaddyEdge's Avatar
    Join Date
    May 2012
    Location
    Florida, USA
    Posts
    1,466

    Default

    Do you use HM2 stats in any NoteCaddy Color Definitions? If so, switch the HM2 stats out for Compiled stats, or NC stats.

    It is really crazy to have this type of issue, it's not normal. There must be a bottleneck that we can fix.

    Have you always had this problem? Did the problem happen after installing any new security software?

    Which version of postgresql are you using? Did you make any changes to your postgresql config?
    Last edited by NotecaddyEdge; 02-26-2019 at 01:58 AM.

  3. #3
    Senior Member
    Join Date
    Jan 2013
    Posts
    243

    Default

    Quote Originally Posted by NotecaddyEdge View Post
    Do you use HM2 stats in any NoteCaddy Color Definitions?
    No.

    Quote Originally Posted by NotecaddyEdge View Post
    Have you always had this problem?
    No, i use NC already many years, from 1.xx versions and HM1, and never had this.

    Quote Originally Posted by NotecaddyEdge View Post
    Did the problem happen after installing any new security software?
    No, i don't install any new software. I have Kaspersky antivirus many years, only update, nothing more.


    Quote Originally Posted by NotecaddyEdge View Post
    Which version of postgresql are you using? Did you make any changes to your postgresql config?
    8.4, yes, i do this:

    shared_buffers = 512MB # min 128kB
    and this:
    logging_collector = off

    that's all.

    For the purity of the experiment, just in case, I can put a default version of postgresql.conf (suddenly I forgot something?), tell me how I can do it.

    Well, or act brazenly but faster and try this:

    Perhaps you immediately notice the problem.


    # - Connection Settings -

    listen_addresses = '*' # what IP address(es) to listen on;
    # comma-separated list of addresses;
    # defaults to 'localhost', '*' = all
    # (change requires restart)
    port = 5432 # (change requires restart)
    max_connections = 100 # (change requires restart)
    # Note: Increasing max_connections costs ~400 bytes of shared memory per
    # connection slot, plus lock space (see max_locks_per_transaction).
    #superuser_reserved_connections = 3 # (change requires restart)
    #unix_socket_directory = '' # (change requires restart)
    #unix_socket_group = '' # (change requires restart)
    #unix_socket_permissions = 0777 # begin with 0 to use octal notation
    # (change requires restart)
    #bonjour_name = '' # defaults to the computer name
    # (change requires restart)

    # - Security and Authentication -

    #authentication_timeout = 1min # 1s-600s
    #ssl = off # (change requires restart)
    #ssl_ciphers = 'ALL:!ADH:!LOW:!EXP:!MD5:@STRENGTH' # allowed SSL ciphers
    # (change requires restart)
    #ssl_renegotiation_limit = 512MB # amount of data between renegotiations
    #password_encryption = on
    #db_user_namespace = off

    # Kerberos and GSSAPI
    #krb_server_keyfile = ''
    #krb_srvname = 'postgres' # (Kerberos only)
    #krb_caseins_users = off

    # - TCP Keepalives -
    # see "man 7 tcp" for details

    #tcp_keepalives_idle = 0 # TCP_KEEPIDLE, in seconds;
    # 0 selects the system default
    #tcp_keepalives_interval = 0 # TCP_KEEPINTVL, in seconds;
    # 0 selects the system default
    #tcp_keepalives_count = 0 # TCP_KEEPCNT;
    # 0 selects the system default


    #------------------------------------------------------------------------------
    # RESOURCE USAGE (except WAL)
    #------------------------------------------------------------------------------

    # - Memory -

    shared_buffers = 512MB # min 128kB
    # (change requires restart)
    #temp_buffers = 32MB # min 800kB
    #max_prepared_transactions = 0 # zero disables the feature
    # (change requires restart)
    # Note: Increasing max_prepared_transactions costs ~600 bytes of shared memory
    # per transaction slot, plus lock space (see max_locks_per_transaction).
    # It is not advisable to set max_prepared_transactions nonzero unless you
    # actively intend to use prepared transactions.
    #work_mem = 64MB # min 64kB
    #maintenance_work_mem = 1024MB # min 1MB
    #max_stack_depth = 2MB # min 100kB

    # - Kernel Resource Usage -

    #max_files_per_process = 1000 # min 25
    # (change requires restart)
    #shared_preload_libraries = '' # (change requires restart)

    # - Cost-Based Vacuum Delay -

    #vacuum_cost_delay = 0ms # 0-100 milliseconds
    #vacuum_cost_page_hit = 1 # 0-10000 credits
    #vacuum_cost_page_miss = 10 # 0-10000 credits
    #vacuum_cost_page_dirty = 20 # 0-10000 credits
    #vacuum_cost_limit = 200 # 1-10000 credits

    # - Background Writer -

    #bgwriter_delay = 200ms # 10-10000ms between rounds
    #bgwriter_lru_maxpages = 100 # 0-1000 max buffers written/round
    #bgwriter_lru_multiplier = 2.0 # 0-10.0 multipler on buffers scanned/round

    # - Asynchronous Behavior -

    #effective_io_concurrency = 1 # 1-1000. 0 disables prefetching


    #------------------------------------------------------------------------------
    # WRITE AHEAD LOG
    #------------------------------------------------------------------------------

    # - Settings -

    #fsync = on # turns forced synchronization on or off
    #synchronous_commit = on # immediate fsync at commit
    #wal_sync_method = fsync # the default is the first option
    # supported by the operating system:
    # open_datasync
    # fdatasync (default on Linux)
    # fsync
    # fsync_writethrough
    # open_sync
    #full_page_writes = on # recover from partial page writes
    #wal_buffers = 8MB # min 32kB
    # (change requires restart)
    #wal_writer_delay = 200ms # 1-10000 milliseconds

    #commit_delay = 10000 # range 0-100000, in microseconds
    #commit_siblings = 5 # range 1-1000

    # - Checkpoints -

    #checkpoint_segments = 128 # in logfile segments, min 1, 16MB each
    #checkpoint_timeout = 5min # range 30s-1h
    #checkpoint_completion_target = 0.9 # checkpoint target duration, 0.0 - 1.0
    #checkpoint_warning = 30s # 0 disables

    # - Archiving -

    #archive_mode = off # allows archiving to be done
    # (change requires restart)
    #archive_command = '' # command to use to archive a logfile segment
    #archive_timeout = 0 # force a logfile segment switch after this
    # number of seconds; 0 disables


    #------------------------------------------------------------------------------
    # QUERY TUNING
    #------------------------------------------------------------------------------

    # - Planner Method Configuration -

    #enable_bitmapscan = on
    #enable_hashagg = on
    #enable_hashjoin = on
    #enable_indexscan = on
    #enable_mergejoin = on
    #enable_nestloop = on
    #enable_seqscan = on
    #enable_sort = on
    #enable_tidscan = on

    # - Planner Cost Constants -

    #seq_page_cost = 1.0 # measured on an arbitrary scale
    #random_page_cost = 2.0 # same scale as above
    #cpu_tuple_cost = 0.01 # same scale as above
    #cpu_index_tuple_cost = 0.005 # same scale as above
    #cpu_operator_cost = 0.0025 # same scale as above
    #effective_cache_size = 2048MB

    # - Genetic Query Optimizer -

    #geqo = on
    #geqo_threshold = 12
    #geqo_effort = 5 # range 1-10
    #geqo_pool_size = 0 # selects default based on effort
    #geqo_generations = 0 # selects default based on effort
    #geqo_selection_bias = 2.0 # range 1.5-2.0

    # - Other Planner Options -

    #default_statistics_target = 100 # range 1-10000
    #constraint_exclusion = partition # on, off, or partition
    #cursor_tuple_fraction = 0.1 # range 0.0-1.0
    #from_collapse_limit = 8
    #join_collapse_limit = 8 # 1 disables collapsing of explicit
    # JOIN clauses


    #------------------------------------------------------------------------------
    # ERROR REPORTING AND LOGGING
    #------------------------------------------------------------------------------

    # - Where to Log -

    log_destination = 'stderr' # Valid values are combinations of
    # stderr, csvlog, syslog and eventlog,
    # depending on platform. csvlog
    # requires logging_collector to be on.

    # This is used when logging to stderr:
    logging_collector = off # Enable capturing of stderr and csvlog
    # into log files. Required to be on for
    # csvlogs.
    # (change requires restart)



    In practice, it looks like this:
    I run a Hold'em manager. Start Import> Start HUD.
    Run Replayer.

    I wait until the white sheet changes to yellow "N" (it can take many minutes, sometimes very fast). I go and make sure that the player has a badge: (This two are a badge definition)
    03iKROf.png

    Than i wait other 5-10-20 minutes, and they appear:

    6t97w3X.png

    Sometimes it happens faster (as if everything is cached somewhere for a while), sometime badges appear as only as "N" is appear, sometimes it takes a lot of time - I don't know what it depends on.

    Check base size now - 93K hands, Notecaddy show me 105K notes, they create with speed ~500 in second.
    Last edited by FALOs; 02-26-2019 at 12:21 PM.

  4. #4
    Moderator NotecaddyEdge's Avatar
    Join Date
    May 2012
    Location
    Florida, USA
    Posts
    1,466

    Default

    I use PostgreSQL 9.0 and here is a link with my .conf file https://pastebin.com/aSC19r4g. Maybe you can try with my settings. My PC has 16gb RAM so you shouldn't have issues with these settings I hope. Be sure to back up your .conf file just in case there are issues.

  5. #5
    Senior Member
    Join Date
    Jan 2013
    Posts
    243

    Default

    Quote Originally Posted by NotecaddyEdge View Post
    I use PostgreSQL 9.0 and here is a link with my .conf file https://pastebin.com/aSC19r4g. Maybe you can try with my settings. My PC has 16gb RAM so you shouldn't have issues with these settings I hope. Be sure to back up your .conf file just in case there are issues.
    Ty, i downloaded and try to make changes in my .conf file.


    As only, as i change

    shared_buffers on more than 1024, like 2048 or 4096 Postgre server don't want to run. When i set 512 or 1024 back all is ok.
    I even "downgrade" my memory from 32GB to 16GB, like you have, but it not help.
    What can be reason for that behavior?

  6. #6
    Moderator NotecaddyEdge's Avatar
    Join Date
    May 2012
    Location
    Florida, USA
    Posts
    1,466

    Default

    I think this link might help you: https://wiki.postgresql.org/wiki/Tun...tgreSQL_Server

    If you go to the shared_buffers section there I think you may find some useful information that might pertain to your circumstances.

  7. #7
    Senior Member
    Join Date
    Jan 2013
    Posts
    243

    Default

    Quote Originally Posted by NotecaddyEdge View Post
    I think this link might help you: https://wiki.postgresql.org/wiki/Tun...tgreSQL_Server

    If you go to the shared_buffers section there I think you may find some useful information that might pertain to your circumstances.
    I have already read all this several times. But these articles do not answer, why any values ​​above 1024 do not work for me! I have 64 bit Windows 7, 32 GB Ram (lowed to 16 for test), and I can’t deliver> 1024. Well, ok, I left the Shared Buffer at 1024, but changed everything else like yours (you basically made these changes to the Poker Tracker as I can see). Any visible changes did not happen, maybe it became a little faster, but only a little. What to do? Previously, the creator of the program, Sreticentv, answered here, but now, as I can see, it has not been responding for months. You wrote - "bottle neck". Yes, but how can I understand where to look for him?

    Perhaps this is a clue: I have the result of an elementary formula that uses the HM2 statistics values (Composite definition which calculate HEM. "Total Hands" * (HEM. "Seen Flop Overall" / 100) * (HEM. "WTSD% (When Saw Flop) "/ 100) / HEM." Total Hands "* 100. So this figure may not appear for long minutes until NoteCaddy yellow" N "appears. After that, I wait for long minutes until the badges appear. But as i understand this easy formula must to be calculated instantly?
    Last edited by FALOs; 03-04-2019 at 12:25 PM.

  8. #8
    Moderator NotecaddyEdge's Avatar
    Join Date
    May 2012
    Location
    Florida, USA
    Posts
    1,466

    Default

    Ah yes, I think the issue is probably from your composite definitions which use HEM stats in them. Try making these stats inactive and see how it works for you. If it is fixed and you still want to use these stats, you will want to create NC stats to replace these HEM stats.

    I should have thought of this before. I knew that using HEM stats in Color Definitions causes issues like you were experiencing.. but also using HEM stats in Composite notes causes this problem too.

  9. #9
    Senior Member
    Join Date
    Jan 2013
    Posts
    243

    Default

    Quote Originally Posted by NotecaddyEdge View Post
    Ah yes, I think the issue is probably from your composite definitions which use HEM stats in them. Try making these stats inactive and see how it works for you. If it is fixed and you still want to use these stats, you will want to create NC stats to replace these HEM stats.

    I should have thought of this before. I knew that using HEM stats in Color Definitions causes issues like you were experiencing.. but also using HEM stats in Composite notes causes this problem too.
    Made inactive all Composit and Color Definitions - does not help.
    When I press start HUD, the Holdem Manager frieze often happens. Lasts about a minute. then HM stats and a small part of badges are shown. Then there is a very slow loading of the rest of the badges. Or does not happen at all. When i try to close the Hold'em manager, it closes, but the process remains to hang in the Task Manager. There it can hang from ~1 minute to 10 minutes. Then the process closes. In order to get a new portion of badges, I have to exit their Hold'em manager, then remove the process of Hold'em manager, then restart the PostGre service. After that, I start the Hold'em manager, start the HUD - and the new badges are loaded. And so many times - as if they are cached somewhere. After several such manipulations, the NC stats/badges on the long-open tables are displayed normally, the hold'em manager practically does not freeze, takes 1-3% of the processor's workload. If I close the Hold'em manager, then its process is unloaded instantly. But as soon as I open new tables, friezes begin, the Hold'em manager starts to constantly take ~ 9-10% of the processor (12 threads), and for the stats to load quickly, you need close HM and remove the HM task in Task Manager, well, or wait a lot of minutes, and then there is a small chance that the some portion of badges will appear. But this is not guaranteed, and they are definitely not relevant, information about the hands played is displayed in the badges with a delay of tens of minutes.
    Where could this bottle be? One thing is clear - this is due to Notcaddy, but what can cause such friezes?

  10. #10
    Moderator NotecaddyEdge's Avatar
    Join Date
    May 2012
    Location
    Florida, USA
    Posts
    1,466

    Default

    Hmm interesting, I was pretty sure taking the .HEM stats out of your composites/colors would fix it for you. What if you make inactive all definitions which use badges temporarily, do your HUD and Popups load faster then? Maybe we can try to narrow down the issue some more.

Similar Threads

  1. Delay display statistics on Zoom tables
    By fomikk in forum NoteCaddy
    Replies: 1
    Last Post: 03-31-2015, 03:24 PM
  2. Displays statistics
    By Yura in forum German Forum
    Replies: 1
    Last Post: 03-25-2012, 11:00 AM
  3. Replies: 7
    Last Post: 12-19-2011, 12:37 AM
  4. HAND REPLAYER shows stas with huge delay
    By PKRNemesis in forum Manager General
    Replies: 1
    Last Post: 06-22-2011, 05:02 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •