Bug #43828 rpl_heartbeat_basic, rpl_heartbeat_2slaves failed on the team tree
Submitted: 24 Mar 2009 11:02 Modified: 9 Feb 2011 19:21
Reporter: Andrei Elkin Email Updates:
Status: Closed Impact on me:
None 
Category:Tests Severity:S3 (Non-critical)
Version:6.0-rpl OS:Any
Assigned to: Serge Kozlov CPU Architecture:Any
Tags: disabled, pushbuild, sporadic, test failure
Triage: Triaged: D3 (Medium)

[24 Mar 2009 11:02] Andrei Elkin
Description:
wl#4641 patch required some attention as the synopsis tests indicates.
The test are set disabled in rpl suite on 6.0-rpl tree.

How to repeat:
See pb on 6.0-rpl.

Suggested fix:
Serge has fixes already. We push them right after the back merge rpl->main has been done.
[24 Mar 2009 11:10] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/70178

2833 Andrei Elkin	2009-03-24
      adding Bug #43828 for disabling rpl_heartbeat* in rpl suite
[24 Mar 2009 18:56] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/70253

2833 Serge Kozlov	2009-03-24
      Bug#43828. Fix for rpl_heartbeat_2slaves. Rewritten code for schema A->B->C
      modified:
        mysql-test/suite/rpl/r/rpl_heartbeat_2slaves.result
        mysql-test/suite/rpl/t/disabled.def
        mysql-test/suite/rpl/t/rpl_heartbeat_2slaves.cnf
        mysql-test/suite/rpl/t/rpl_heartbeat_2slaves.test
[16 Apr 2009 16:57] Bugs System
Pushed into 6.0.11-alpha (revid:alik@sun.com-20090416165424-s5jp8a50cqy9zghk) (version source revid:serge.kozlov@sun.com-20090324185458-ssgz97fe1unfpwvu) (merge vers: 6.0.11-alpha) (pib:6)
[1 Jun 2009 14:58] Jon Stephens
Change in tests only. Closed.
[11 Jun 2009 13:46] Lars Thalmann
These tests are still disabled.
Reopening the bug report.
[29 Jun 2009 20:24] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/77495

2814 Serge Kozlov	2009-06-30
      Bug#43828. The test cases rpl_heartbeat_basic.test and rpl_heartbeat_2slaves.test are already fixed.
      So patch just update the result file and disabled.def
      modified:
        mysql-test/suite/rpl/r/rpl_heartbeat_basic.result
        mysql-test/suite/rpl/t/disabled.def
[1 Jul 2009 8:21] Alexander Nozdrin
The patch above was queued into mysql-azalea-bugfixing.
[2 Jul 2009 8:30] Alexander Nozdrin
As discussed on IRC, I'm disabling rpl_heartbeat_basic,
since it's still failing sporadically.

Failures of rpl_hearbeat_2slaves have not been seen yet,
so it is left enabled.

Moving the bug report back to Verified.
[2 Jul 2009 8:48] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/77739

2821 Alexander Nozdrin	2009-07-02
      Bug#43828: disable rpl_heartbeat_basic
[3 Jul 2009 6:13] Bugs System
Pushed into 5.4.4-alpha (revid:alik@sun.com-20090702084644-k95gd2asolvz2zpu) (version source revid:alik@sun.com-20090702084644-k95gd2asolvz2zpu) (merge vers: 5.4.4-alpha) (pib:11)
[9 Jul 2009 7:35] Bugs System
Pushed into 5.4.4-alpha (revid:alik@sun.com-20090702084644-k95gd2asolvz2zpu) (version source revid:alik@sun.com-20090702084644-k95gd2asolvz2zpu) (merge vers: 5.4.4-alpha) (pib:11)
[5 Oct 2009 10:20] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/85722

3129 Serge Kozlov	2009-10-05
      WL#4641, Bug#43828: fix for rpl_heartbeat_basic.test:
      The issue appears when number of heartbeat events non-zero before start of test block.
      But really we need to check that no new events has received during test block.
      So I did following:
      1. Replace absolute values by diff of values
      2. Increase heartbeat period 1.5 to 5 sec against EVENT e1 on master that generates statements every 1 sec
      modified:
        mysql-test/suite/rpl/r/rpl_heartbeat_basic.result
        mysql-test/suite/rpl/t/rpl_heartbeat_basic.test
[7 Oct 2009 15:44] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/86037

3130 Serge Kozlov	2009-10-07
      WL#4641, Bug#43828: fix for rpl_heartbeat_basic.test:
      The issue appears when number of heartbeat events non-zero before start of test
      block. But really we need to check that no new events has received during test block.
      So I did following:
      1. Replace absolute values by diff of values
      2. Increase heartbeat period from 1.5 to 5 sec
      modified:
        mysql-test/suite/rpl/r/rpl_heartbeat_basic.result
        mysql-test/suite/rpl/t/rpl_heartbeat_basic.test
[8 Oct 2009 8:14] Luis Soares
Still fails with timeout on gcov:

- http://pb2.norway.sun.com/web.py?template=push_details&push=558431
- http://pb2.norway.sun.com/web.py?template=push_details&push=565931

Also, it showed in macosx other failure symptom:

- http://pb2.norway.sun.com/web.py?template=mysql_show_test_failure&test_failure_id=2372937
[27 Oct 2009 9:50] Bugs System
Pushed into 6.0.14-alpha (revid:alik@sun.com-20091027094604-9p7kplu1vd2cvcju) (version source revid:zhenxing.he@sun.com-20091026140226-uhnqejkyqx1aeilc) (merge vers: 6.0.14-alpha) (pib:13)
[5 Nov 2009 13:17] Vladislav Vaintroub
I have got a crash that  could be related and might be interesting on in this case.

Crash is on Windows, in heartbeat_basic, in mysql-next-mr based tree.

The crash is listed below, cdb analysis suggests that EnterCriticalSection (pthread_mutex_lock in MySQL lingo) is called with NULL parameter. Looking at the code around the crash,  LOCK_APPEND_BUFFER is likely candidate to blame, as it does in  pthread_mutex_lock(&(info)->append_buffer_lock). Quite possibly append_buffer_lock is NULL in this case.

Crash Listing:

ntdll!RtlpWaitOnCriticalSection
ntdll!RtlEnterCriticalSection
mysqld!my_b_flush_io_cache [g:\pb2\build\sb_2-934113-1257383317.12\mysql-5.5.0-beta-win-x86\mysys\mf_iocache.c @ 1724]
mysqld!flush_master_info [g:\pb2\build\sb_2-934113-1257383317.12\mysql-5.5.0-beta-win-x86\sql\rpl_mi.cc @ 440]
mysqld!handle_slave_io [g:\pb2\build\sb_2-934113-1257383317.12\mysql-5.5.0-beta-win-x86\sql\slave.cc @ 3051]
mysqld!pthread_start [g:\pb2\build\sb_2-934113-1257383317.12\mysql-5.5.0-beta-win-x86\mysys\my_winthread.c @ 64]
mysqld!_callthreadstartex [f:\dd\vctools\crt_bld\self_x86\crt\src\threadex.c @ 348]
mysqld!_threadstartex [f:\dd\vctools\crt_bld\self_x86\crt\src\threadex.c @ 326]
kernel32!BaseThreadInitThunk
ntdll!__RtlUserThreadStart
ntdll!_RtlUserThreadStart
[12 Nov 2009 8:22] Bugs System
Pushed into 5.5.0-beta (revid:alik@sun.com-20091110093229-0bh5hix780cyeicl) (version source revid:alik@sun.com-20091027095744-rf45u3x3q5d1f5y0) (merge vers: 5.5.0-beta) (pib:13)
[4 Jan 2010 9:25] Luis Soares
I have observed a new failure for heartbeat_basic in mysql-next-mr:

http://pb2.norway.sun.com/web.py?template=mysql_show_test_failure&search=yes&push_id=80545...

So far, this seems to affect only valgrind runs.
[28 Jan 2010 19:23] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/98508

2966 Serge Kozlov	2010-01-26
      Bug#43828
      Fix circular replication that removes error 'could not find next log'
      modified:
        mysql-test/suite/rpl/r/rpl_heartbeat_basic.result
        mysql-test/suite/rpl/t/rpl_heartbeat_basic.test
[13 Feb 2010 2:50] Luis Soares
FYI: I think this last patch is trying to fix something that was 
already fixed in BUG#50397!
[25 Feb 2010 10:30] Luis Soares
In [5 Nov 2009 14:17] Vladislav Vaintroub, there was a crash reported:

I think this has been fixed in BUG#50364.
[25 Feb 2010 10:35] Serge Kozlov
Fixed with BUG#50397. No need a separate patch for that
[15 Jun 2010 8:40] Bugs System
Pushed into mysql-next-mr (revid:alik@sun.com-20100615080558-cw01bzdqr1bdmmec) (version source revid:mmakela@bk-internal.mysql.com-20100415070122-1nxji8ym4mao13ao) (pib:16)
[4 Aug 2010 8:06] Bugs System
Pushed into mysql-trunk 5.6.1-m4 (revid:alik@ibmvm-20100804080001-bny5271e65xo34ig) (version source revid:mmakela@bk-internal.mysql.com-20100415070122-1nxji8ym4mao13ao) (merge vers: 5.1.47) (pib:18)
[4 Aug 2010 8:13] Bugs System
Pushed into mysql-trunk 5.6.1-m4 (revid:alik@ibmvm-20100804080001-bny5271e65xo34ig) (version source revid:mmakela@bk-internal.mysql.com-20100415070122-1nxji8ym4mao13ao) (merge vers: 5.1.47) (pib:18)
[4 Aug 2010 8:14] Bugs System
Pushed into mysql-trunk 5.6.1-m4 (revid:alik@ibmvm-20100804080001-bny5271e65xo34ig) (version source revid:mmakela@bk-internal.mysql.com-20100415070122-1nxji8ym4mao13ao) (merge vers: 5.1.47) (pib:18)
[4 Aug 2010 8:15] Bugs System
Pushed into mysql-trunk 5.6.1-m4 (revid:alik@ibmvm-20100804080001-bny5271e65xo34ig) (version source revid:mmakela@bk-internal.mysql.com-20100415070122-1nxji8ym4mao13ao) (merge vers: 5.1.47) (pib:18)
[4 Aug 2010 8:16] Bugs System
Pushed into mysql-trunk 5.6.1-m4 (revid:alik@ibmvm-20100804080001-bny5271e65xo34ig) (version source revid:mmakela@bk-internal.mysql.com-20100415070122-1nxji8ym4mao13ao) (merge vers: 5.1.47) (pib:18)
[4 Aug 2010 8:17] Bugs System
Pushed into mysql-trunk 5.6.1-m4 (revid:alik@ibmvm-20100804080001-bny5271e65xo34ig) (version source revid:mmakela@bk-internal.mysql.com-20100415070122-1nxji8ym4mao13ao) (merge vers: 5.1.47) (pib:18)
[4 Aug 2010 8:22] Bugs System
Pushed into mysql-trunk 5.6.1-m4 (revid:alik@ibmvm-20100804081533-c1d3rbipo9e8rt1s) (version source revid:mmakela@bk-internal.mysql.com-20100415070122-1nxji8ym4mao13ao) (merge vers: 5.1.47) (pib:18)
[4 Aug 2010 9:00] Bugs System
Pushed into mysql-trunk 5.6.1-m4 (revid:alik@ibmvm-20100804081533-c1d3rbipo9e8rt1s) (version source revid:mmakela@bk-internal.mysql.com-20100415070122-1nxji8ym4mao13ao) (merge vers: 5.1.47) (pib:20)
[18 Oct 2010 10:32] Sven Sandberg
The test case rpl.rpl_heartbeat_2slaves was marked experimental because of this bug. Please re-enable the test before closing the bug.
[2 Feb 2011 20:49] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/130278

3298 Serge Kozlov	2011-02-02
      Bug#43828, Bug#59494. 
      After introducing new way of initialization of replication the setting different heartbeat periods for slaves was missed.
      The patch fix it.
[4 Feb 2011 11:00] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/130388

3301 Serge Kozlov	2011-02-04
      Bug#43828, Bug#59494. 
      After introducing new way of initialization of replication the setting different heartbeat periods for slaves was missed.
      Added asserts
[4 Feb 2011 15:26] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/130440

3301 Serge Kozlov	2011-02-04
      Bug#43828, Bug#59494. 
      After introducing new way of initialization of replication the setting different heartbeat periods for slaves was missed.
      Added asserts
[4 Feb 2011 16:37] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/130458

3301 Serge Kozlov	2011-02-04
      Bug#43828, Bug#59494. 
      After introducing new way of initialization of replication the setting different heartbeat periods for slaves was missed.
      Added asserts
[4 Feb 2011 19:09] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/130477

3303 Serge Kozlov	2011-02-04
      Bug#43828, Bug#59494. 
      After introducing new way of initialization of replication the setting different heartbeat periods for slaves was missed.
      Added asserts
[4 Feb 2011 19:44] Bugs System
Pushed into mysql-trunk 5.6.2 (revid:serge.kozlov@oracle.com-20110204194042-uyruc8dx9maxhrun) (version source revid:serge.kozlov@oracle.com-20110204194042-uyruc8dx9maxhrun) (merge vers: 5.6.2) (pib:24)
[4 Feb 2011 19:45] Bugs System
Pushed into mysql-5.5 5.5.10 (revid:serge.kozlov@oracle.com-20110204190748-7klee4l972ybtxri) (version source revid:serge.kozlov@oracle.com-20110204190748-7klee4l972ybtxri) (merge vers: 5.5.10) (pib:24)
[7 Feb 2011 15:59] Paul Dubois
Changes for test suite. No changelog entry needed.