Bug #43082 mysqld 32 bit cannot use big buffers due to 2GB usermode address space limit

• Submitted: 21 Feb 2009 16:34
• Modified: 18 Mar 2009 15:53
• Reporter: Vladislav Vaintroub
• Status: Closed
• Category: MySQL Server: Compiling
• Severity: S3 (Non-critical)
• Version: 5.0,5.1
• OS: Windows
• Assigned to: Vladislav Vaintroub
• CPU Architecture: Any

[21 Feb 2009 16:34] Vladislav Vaintroub

Description:
Windows allows for more than 2GB virtual address space for 32 bit application
On 32 bit Windows, boot option /3GB would give application 3GB and kernel 1GB space. On 64 bit Windows, 32 bit application will get 4GB address space.

For this to happen, application should be linked with /LARGEADDRESSAWARE link option (meaning normally, that app does not cast addresses to signed int). Clearly MySQL is large address aware, since is already handles user space addresses > 2GB on Linux.

There are workarounds link using editbin to set LARGEADDRESSAWARE post build
(s. http://harrison-fisk.blogspot.com/2009/02/mysql-windows-32-bit-and-3gb.html)
but such workarounds  will tamper executable making digital signature invalid.

It is much better to provide the option by default (yes, it is even better if customer uses 64 bit mysqld.exe on 64 bit Windows, but buying new hardware/OS isn't always an option)

How to repeat:
Probably the simplest way to reproduce is trying to use 
innodb_buffer_pool_size=2G  win 32 bit mysqld.exe on 64 bit Windows.

Another way is to boot 32 bit Windows with /3GB and try innodb_buffer_pool_size=2G

Suggested fix:
use /LARGEADDRESSAWARE linker option when linking x86 mysqld

[23 Feb 2009 15:09] Harrison Fisk

It is possible to set this flag in the binary mysqld-nt.exe, see:

http://harrison-fisk.blogspot.com/2009/02/mysql-windows-32-bit-and-3gb.html

I imagine this would cause issue with signed executables however, so it isn't an ideal solution.

In addition, it requires you to have visual studio installed which is a bit of a pain for some users.

[23 Feb 2009 15:24] Vladislav Vaintroub

invalid signature after editbin /LARGEADDRESSAWARE mysqld.exe

Attachment: signature.png (image/x-png, text), 25.53 KiB.

[25 Feb 2009 11:33] Bugs System

A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/67517

2820 Vladislav Vaintroub	2009-02-25
      Bug#43082: mysqld 32 bit cannot use big buffers due to 2GB usermode address space limit
      
      Fix: use /LARGEADDRESSAWARE link option when linking 32 bit executables

[25 Feb 2009 15:58] Bugs System

A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/67572

2764 Vladislav Vaintroub	2009-02-25
      Bug#43082: mysqld 32 bit cannot use big buffers due to 2GB
      usermode address space limit.
      
      Fix: use /LARGEADDRESSAWARE link option when linking 32 bit
      executables

[9 Mar 2009 14:13] Bugs System

Pushed into 5.0.79 (revid:[e-mail]-20090309135922-a0di9ebkxoj4d4wv) (version source revid:[e-mail]-20090227160758-td4jot2la75f9zy1) (merge vers: 5.0.79) (pib:6)

[11 Mar 2009 2:00] Paul DuBois

Noted in 5.0.79 changelog.

On 32-bit Windows, mysqld could not use large buffers due to a 2GB 
user mode address limit.

Setting report to NDI pending push into 5.1.x/6.0.x.

[13 Mar 2009 19:08] Bugs System

Pushed into 5.1.33 (revid:[e-mail]-20090313111355-7bsi1hgkvrg8pdds) (version source revid:[e-mail]-20090225160234-cytgd3f8sdayslex) (merge vers: 5.1.33) (pib:6)

[13 Mar 2009 20:22] Paul DuBois

Noted in 5.1.33 changelog.

Setting report to NDI pending push into 6.0.x.

[18 Mar 2009 13:19] Bugs System

Pushed into 6.0.11-alpha (revid:[e-mail]-20090318122208-1b5kvg6zeb4hxwp9) (version source revid:[e-mail]-20090225161348-n1v5oo3ab5zw0jcx) (merge vers: 6.0.10-alpha) (pib:6)

[18 Mar 2009 15:53] Paul DuBois

Noted in 6.0.11 changelog.

[9 May 2009 16:47] Bugs System

Pushed into 5.1.34-ndb-6.2.18 (revid:[e-mail]-20090508185236-p9b3as7qyauybefl) (version source revid:[e-mail]-20090508100057-30ote4xggi4nq14v) (merge vers: 5.1.33-ndb-6.2.18) (pib:6)

[9 May 2009 17:43] Bugs System

Pushed into 5.1.34-ndb-6.3.25 (revid:[e-mail]-20090509063138-1u3q3v09wnn2txyt) (version source revid:[e-mail]-20090508175813-s6yele2z3oh6o99z) (merge vers: 5.1.33-ndb-6.3.25) (pib:6)

[9 May 2009 18:41] Bugs System

Pushed into 5.1.34-ndb-7.0.6 (revid:[e-mail]-20090509154927-im9a7g846c6u1hzc) (version source revid:[e-mail]-20090509073226-09bljakh9eppogec) (merge vers: 5.1.33-ndb-7.0.6) (pib:6)