Bug #43828 rpl_heartbeat_basic, rpl_heartbeat_2slaves failed on the team tree
Submitted: 24 Mar 12:02 Modified: 23 Nov 14:18
Reporter: Andrei Elkin
Status: Verified
Category:Tests Severity:S3 (Non-critical)
Version:6.0-rpl OS:Any
Assigned to: Serge Kozlov Target Version:
Tags: test failure, pushbuild, sporadic, disabled
Triage: Triaged: D3 (Medium)

[24 Mar 12:02] Andrei Elkin
Description:
wl#4641 patch required some attention as the synopsis tests indicates.
The test are set disabled in rpl suite on 6.0-rpl tree.

How to repeat:
See pb on 6.0-rpl.

Suggested fix:
Serge has fixes already. We push them right after the back merge rpl->main has been done.
[24 Mar 12:10] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/70178

2833 Andrei Elkin	2009-03-24
      adding Bug #43828 for disabling rpl_heartbeat* in rpl suite
[24 Mar 19:56] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/70253

2833 Serge Kozlov	2009-03-24
      Bug#43828. Fix for rpl_heartbeat_2slaves. Rewritten code for schema A->B->C
      modified:
        mysql-test/suite/rpl/r/rpl_heartbeat_2slaves.result
        mysql-test/suite/rpl/t/disabled.def
        mysql-test/suite/rpl/t/rpl_heartbeat_2slaves.cnf
        mysql-test/suite/rpl/t/rpl_heartbeat_2slaves.test
[16 Apr 18:57] Bugs System
Pushed into 6.0.11-alpha (revid:alik@sun.com-20090416165424-s5jp8a50cqy9zghk) (version
source revid:serge.kozlov@sun.com-20090324185458-ssgz97fe1unfpwvu) (merge vers:
6.0.11-alpha) (pib:6)
[1 Jun 16:58] Jon Stephens
Change in tests only. Closed.
[11 Jun 15:46] Lars Thalmann
These tests are still disabled.
Reopening the bug report.
[29 Jun 22:24] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/77495

2814 Serge Kozlov	2009-06-30
      Bug#43828. The test cases rpl_heartbeat_basic.test and rpl_heartbeat_2slaves.test
are already fixed.
      So patch just update the result file and disabled.def
      modified:
        mysql-test/suite/rpl/r/rpl_heartbeat_basic.result
        mysql-test/suite/rpl/t/disabled.def
[1 Jul 10:21] Alexander Nozdrin
The patch above was queued into mysql-azalea-bugfixing.
[2 Jul 10:30] Alexander Nozdrin
As discussed on IRC, I'm disabling rpl_heartbeat_basic,
since it's still failing sporadically.

Failures of rpl_hearbeat_2slaves have not been seen yet,
so it is left enabled.

Moving the bug report back to Verified.
[2 Jul 10:48] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/77739

2821 Alexander Nozdrin	2009-07-02
      Bug#43828: disable rpl_heartbeat_basic
[3 Jul 8:13] Bugs System
Pushed into 5.4.4-alpha (revid:alik@sun.com-20090702084644-k95gd2asolvz2zpu) (version
source revid:alik@sun.com-20090702084644-k95gd2asolvz2zpu) (merge vers: 5.4.4-alpha)
(pib:11)
[9 Jul 9:35] Bugs System
Pushed into 5.4.4-alpha (revid:alik@sun.com-20090702084644-k95gd2asolvz2zpu) (version
source revid:alik@sun.com-20090702084644-k95gd2asolvz2zpu) (merge vers: 5.4.4-alpha)
(pib:11)
[5 Oct 12:20] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/85722

3129 Serge Kozlov	2009-10-05
      WL#4641, Bug#43828: fix for rpl_heartbeat_basic.test:
      The issue appears when number of heartbeat events non-zero before start of test
block.
      But really we need to check that no new events has received during test block.
      So I did following:
      1. Replace absolute values by diff of values
      2. Increase heartbeat period 1.5 to 5 sec against EVENT e1 on master that generates
statements every 1 sec
      modified:
        mysql-test/suite/rpl/r/rpl_heartbeat_basic.result
        mysql-test/suite/rpl/t/rpl_heartbeat_basic.test
[7 Oct 17:44] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/86037

3130 Serge Kozlov	2009-10-07
      WL#4641, Bug#43828: fix for rpl_heartbeat_basic.test:
      The issue appears when number of heartbeat events non-zero before start of test
      block. But really we need to check that no new events has received during test
block.
      So I did following:
      1. Replace absolute values by diff of values
      2. Increase heartbeat period from 1.5 to 5 sec
      modified:
        mysql-test/suite/rpl/r/rpl_heartbeat_basic.result
        mysql-test/suite/rpl/t/rpl_heartbeat_basic.test
[8 Oct 10:14] Luís Soares
Still fails with timeout on gcov:

- http://pb2.norway.sun.com/web.py?template=push_details&push=558431
- http://pb2.norway.sun.com/web.py?template=push_details&push=565931

Also, it showed in macosx other failure symptom:

-
http://pb2.norway.sun.com/web.py?template=mysql_show_test_failure&test_failure_id=2372937
[27 Oct 10:50] Bugs System
Pushed into 6.0.14-alpha (revid:alik@sun.com-20091027094604-9p7kplu1vd2cvcju) (version
source revid:zhenxing.he@sun.com-20091026140226-uhnqejkyqx1aeilc) (merge vers:
6.0.14-alpha) (pib:13)
[5 Nov 14:17] Vladislav Vaintroub
I have got a crash that  could be related and might be interesting on in this case.

Crash is on Windows, in heartbeat_basic, in mysql-next-mr based tree.

The crash is listed below, cdb analysis suggests that EnterCriticalSection
(pthread_mutex_lock in MySQL lingo) is called with NULL parameter. Looking at the code
around the crash,  LOCK_APPEND_BUFFER is likely candidate to blame, as it does in 
pthread_mutex_lock(&(info)->append_buffer_lock). Quite possibly append_buffer_lock is
NULL in this case.

Crash Listing:

ntdll!RtlpWaitOnCriticalSection
ntdll!RtlEnterCriticalSection
mysqld!my_b_flush_io_cache
[g:\pb2\build\sb_2-934113-1257383317.12\mysql-5.5.0-beta-win-x86\mysys\mf_iocache.c @
1724]
mysqld!flush_master_info
[g:\pb2\build\sb_2-934113-1257383317.12\mysql-5.5.0-beta-win-x86\sql\rpl_mi.cc @ 440]
mysqld!handle_slave_io
[g:\pb2\build\sb_2-934113-1257383317.12\mysql-5.5.0-beta-win-x86\sql\slave.cc @ 3051]
mysqld!pthread_start
[g:\pb2\build\sb_2-934113-1257383317.12\mysql-5.5.0-beta-win-x86\mysys\my_winthread.c @
64]
mysqld!_callthreadstartex [f:\dd\vctools\crt_bld\self_x86\crt\src\threadex.c @ 348]
mysqld!_threadstartex [f:\dd\vctools\crt_bld\self_x86\crt\src\threadex.c @ 326]
kernel32!BaseThreadInitThunk
ntdll!__RtlUserThreadStart
ntdll!_RtlUserThreadStart
[12 Nov 9:22] Bugs System
Pushed into 5.5.0-beta (revid:alik@sun.com-20091110093229-0bh5hix780cyeicl) (version
source revid:alik@sun.com-20091027095744-rf45u3x3q5d1f5y0) (merge vers: 5.5.0-beta)
(pib:13)