Uptime: 1105 Threads: 20 Questions: 1156 Slow queries: 2 Opens: 220 Flush tables: 1 Open tables: 187 Queries per second avg: 1.46 mysqladmin Ver 8.42 Distrib 5.5.13, for linux2.6 on x86_64 Copyright (c) 2000, 2010, Oracle and/or its affiliates. All rights reserved. Oracle is a registered trademark of Oracle Corporation and/or its affiliates. Other names may be trademarks of their respective owners. Server version 5.5.13-debug-log Protocol version 10 Connection Localhost via UNIX socket UNIX socket /var/run/mysqld/mysqld.sock Uptime: 21 min 6 sec Threads: 21 Questions: 1158 Slow queries: 2 Opens: 220 Flush tables: 1 Open tables: 187 Queries per second avg: 0.914 +---------------------------------------------------+------------------------------------------------------------------------------------------------------------------------+ | Variable_name | Value | +---------------------------------------------------+------------------------------------------------------------------------------------------------------------------------+ | auto_increment_increment | 1 | | auto_increment_offset | 1 | | autocommit | ON | | automatic_sp_privileges | ON | | back_log | 50 | | basedir | /usr/local/mysql | | big_tables | OFF | | binlog_cache_size | 32768 | | binlog_direct_non_transactional_updates | OFF | | binlog_format | STATEMENT | | binlog_stmt_cache_size | 32768 | | bulk_insert_buffer_size | 67108864 | | character_set_client | latin1 | | character_set_connection | latin1 | | character_set_database | latin1 | | character_set_filesystem | binary | | character_set_results | latin1 | | character_set_server | latin1 | | character_set_system | utf8 | | character_sets_dir | /usr/local/mysql/share/charsets/ | | collation_connection | latin1_swedish_ci | | collation_database | latin1_swedish_ci | | collation_server | latin1_swedish_ci | | completion_type | NO_CHAIN | | concurrent_insert | AUTO | | connect_timeout | 10 | | datadir | /data/mysql/ | | date_format | %Y-%m-%d | | datetime_format | %Y-%m-%d %H:%i:%s | | debug | | | default_storage_engine | InnoDB | | default_week_format | 0 | | delay_key_write | ON | | delayed_insert_limit | 100 | | delayed_insert_timeout | 300 | | delayed_queue_size | 1000 | | div_precision_increment | 4 | | engine_condition_pushdown | ON | | event_scheduler | OFF | | expire_logs_days | 0 | | flush | OFF | | flush_time | 0 | | foreign_key_checks | ON | | ft_boolean_syntax | + -><()~*:""&| | | ft_max_word_len | 84 | | ft_min_word_len | 4 | | ft_query_expansion_limit | 20 | | ft_stopword_file | (built-in) | | general_log | OFF | | general_log_file | /data/mysql/netseg01.log | | group_concat_max_len | 1024 | | have_compress | YES | | have_crypt | YES | | have_csv | YES | | have_dynamic_loading | YES | | have_geometry | YES | | have_innodb | YES | | have_ndbcluster | NO | | have_openssl | DISABLED | | have_partitioning | YES | | have_profiling | YES | | have_query_cache | YES | | have_rtree_keys | YES | | have_ssl | DISABLED | | have_symlink | YES | | hostname | netseg01 | | ignore_builtin_innodb | OFF | | init_connect | | | init_file | | | init_slave | | | innodb_adaptive_flushing | ON | | innodb_adaptive_hash_index | ON | | innodb_additional_mem_pool_size | 1073741824 | | innodb_autoextend_increment | 8 | | innodb_autoinc_lock_mode | 1 | | innodb_buffer_pool_instances | 1 | | innodb_buffer_pool_size | 10737418240 | | innodb_change_buffering | all | | innodb_change_buffering_debug | 0 | | innodb_checksums | ON | | innodb_commit_concurrency | 0 | | innodb_concurrency_tickets | 500 | | innodb_data_file_path | ibdata1:10M:autoextend | | innodb_data_home_dir | | | innodb_doublewrite | ON | | innodb_fast_shutdown | 1 | | innodb_file_format | Antelope | | innodb_file_format_check | ON | | innodb_file_format_max | Antelope | | innodb_file_per_table | ON | | innodb_flush_log_at_trx_commit | 2 | | innodb_flush_method | O_DSYNC | | innodb_force_recovery | 0 | | innodb_io_capacity | 1000 | | innodb_lock_wait_timeout | 50 | | innodb_locks_unsafe_for_binlog | OFF | | innodb_log_buffer_size | 536870912 | | innodb_log_file_size | 536870912 | | innodb_log_files_in_group | 2 | | innodb_log_group_home_dir | ./ | | innodb_max_dirty_pages_pct | 75 | | innodb_max_purge_lag | 0 | | innodb_mirrored_log_groups | 1 | | innodb_old_blocks_pct | 37 | | innodb_old_blocks_time | 0 | | innodb_open_files | 300 | | innodb_purge_batch_size | 20 | | innodb_purge_threads | 0 | | innodb_read_ahead_threshold | 56 | | innodb_read_io_threads | 3 | | innodb_replication_delay | 0 | | innodb_rollback_on_timeout | OFF | | innodb_rollback_segments | 128 | | innodb_spin_wait_delay | 6 | | innodb_stats_method | nulls_equal | | innodb_stats_on_metadata | ON | | innodb_stats_sample_pages | 8 | | innodb_strict_mode | OFF | | innodb_support_xa | ON | | innodb_sync_spin_loops | 30 | | innodb_table_locks | ON | | innodb_thread_concurrency | 0 | | innodb_thread_sleep_delay | 10000 | | innodb_use_native_aio | ON | | innodb_use_sys_malloc | ON | | innodb_version | 1.1.7 | | innodb_write_io_threads | 3 | | interactive_timeout | 28800 | | join_buffer_size | 16777216 | | keep_files_on_create | OFF | | key_buffer_size | 25769803776 | | key_cache_age_threshold | 300 | | key_cache_block_size | 1024 | | key_cache_division_limit | 100 | | large_files_support | ON | | large_page_size | 0 | | large_pages | OFF | | lc_messages | en_US | | lc_messages_dir | /usr/local/mysql/share/ | | lc_time_names | en_US | | license | GPL | | local_infile | ON | | lock_wait_timeout | 31536000 | | locked_in_memory | OFF | | log | OFF | | log_bin | OFF | | log_bin_trust_function_creators | OFF | | log_error | /data/mysql/netseg01.err | | log_output | FILE | | log_queries_not_using_indexes | OFF | | log_slave_updates | OFF | | log_slow_queries | ON | | log_warnings | 2 | | long_query_time | 60.000000 | | low_priority_updates | OFF | | lower_case_file_system | OFF | | lower_case_table_names | 0 | | max_allowed_packet | 104857600 | | max_binlog_cache_size | 18446744073709547520 | | max_binlog_size | 1073741824 | | max_binlog_stmt_cache_size | 18446744073709547520 | | max_connect_errors | 10 | | max_connections | 151 | | max_delayed_threads | 20 | | max_error_count | 64 | | max_heap_table_size | 1073741824 | | max_insert_delayed_threads | 20 | | max_join_size | 18446744073709551615 | | max_length_for_sort_data | 1024 | | max_long_data_size | 104857600 | | max_prepared_stmt_count | 16382 | | max_relay_log_size | 0 | | max_seeks_for_key | 18446744073709551615 | | max_sort_length | 1024 | | max_sp_recursion_depth | 0 | | max_tmp_tables | 32 | | max_user_connections | 0 | | max_write_lock_count | 18446744073709551615 | | min_examined_row_limit | 0 | | multi_range_count | 256 | | myisam_data_pointer_size | 6 | | myisam_max_sort_file_size | 9223372036853727232 | | myisam_mmap_size | 18446744073709551615 | | myisam_recover_options | OFF | | myisam_repair_threads | 1 | | myisam_sort_buffer_size | 1073741824 | | myisam_stats_method | nulls_unequal | | myisam_use_mmap | ON | | net_buffer_length | 16384 | | net_read_timeout | 30 | | net_retry_count | 10 | | net_write_timeout | 60 | | new | OFF | | old | OFF | | old_alter_table | OFF | | old_passwords | OFF | | open_files_limit | 1048576 | | optimizer_prune_level | 1 | | optimizer_search_depth | 62 | | optimizer_switch | index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,engine_condition_pushdown=on | | performance_schema | ON | | performance_schema_events_waits_history_long_size | 10000 | | performance_schema_events_waits_history_size | 10 | | performance_schema_max_cond_classes | 80 | | performance_schema_max_cond_instances | 1000 | | performance_schema_max_file_classes | 50 | | performance_schema_max_file_handles | 32768 | | performance_schema_max_file_instances | 10000 | | performance_schema_max_mutex_classes | 200 | | performance_schema_max_mutex_instances | 1000000 | | performance_schema_max_rwlock_classes | 30 | | performance_schema_max_rwlock_instances | 1000000 | | performance_schema_max_table_handles | 100000 | | performance_schema_max_table_instances | 50000 | | performance_schema_max_thread_classes | 50 | | performance_schema_max_thread_instances | 1000 | | pid_file | /data/mysql/netseg01.pid | | plugin_dir | /usr/local/mysql/lib/plugin | | port | 3306 | | preload_buffer_size | 32768 | | profiling | OFF | | profiling_history_size | 15 | | protocol_version | 10 | | query_alloc_block_size | 8192 | | query_cache_limit | 1048576 | | query_cache_min_res_unit | 4096 | | query_cache_size | 134217728 | | query_cache_type | ON | | query_cache_wlock_invalidate | OFF | | query_prealloc_size | 8192 | | range_alloc_block_size | 4096 | | read_buffer_size | 67108864 | | read_only | OFF | | read_rnd_buffer_size | 8388608 | | relay_log | | | relay_log_index | | | relay_log_info_file | relay-log.info | | relay_log_purge | ON | | relay_log_recovery | OFF | | relay_log_space_limit | 0 | | report_host | | | report_password | | | report_port | 3306 | | report_user | | | rpl_recovery_rank | 0 | | secure_auth | OFF | | secure_file_priv | | | server_id | 1 | | skip_external_locking | ON | | skip_name_resolve | OFF | | skip_networking | OFF | | skip_show_database | OFF | | slave_compressed_protocol | OFF | | slave_exec_mode | STRICT | | slave_load_tmpdir | /tmp | | slave_net_timeout | 3600 | | slave_skip_errors | OFF | | slave_transaction_retries | 10 | | slave_type_conversions | | | slow_launch_time | 2 | | slow_query_log | ON | | slow_query_log_file | /data/mysql/netseg01-slow.log | | socket | /var/run/mysqld/mysqld.sock | | sort_buffer_size | 16777216 | | sql_auto_is_null | OFF | | sql_big_selects | ON | | sql_big_tables | OFF | | sql_buffer_result | OFF | | sql_log_bin | ON | | sql_log_off | OFF | | sql_low_priority_updates | OFF | | sql_max_join_size | 18446744073709551615 | | sql_mode | | | sql_notes | ON | | sql_quote_show_create | ON | | sql_safe_updates | OFF | | sql_select_limit | 18446744073709551615 | | sql_slave_skip_counter | 0 | | sql_warnings | OFF | | ssl_ca | | | ssl_capath | | | ssl_cert | | | ssl_cipher | | | ssl_key | | | storage_engine | InnoDB | | sync_binlog | 0 | | sync_frm | ON | | sync_master_info | 0 | | sync_relay_log | 0 | | sync_relay_log_info | 0 | | system_time_zone | EDT | | table_definition_cache | 524288 | | table_open_cache | 524207 | | thread_cache_size | 2 | | thread_concurrency | 8 | | thread_handling | one-thread-per-connection | | thread_stack | 262144 | | time_format | %H:%i:%s | | time_zone | SYSTEM | | timed_mutexes | ON | | tmp_table_size | 16777216 | | tmpdir | /tmp | | transaction_alloc_block_size | 8192 | | transaction_prealloc_size | 4096 | | tx_isolation | READ-COMMITTED | | unique_checks | ON | | updatable_views_with_limit | YES | | version | 5.5.13-debug-log | | version_comment | MySQL Community Server - Debug (GPL) | | version_compile_machine | x86_64 | | version_compile_os | linux2.6 | | wait_timeout | 28800 | +---------------------------------------------------+------------------------------------------------------------------------------------------------------------------------+ Uptime: 1372 Threads: 22 Questions: 1162 Slow queries: 2 Opens: 220 Flush tables: 1 Open tables: 187 Queries per second avg: 0.846 Status information: Current dir: /data/mysql/ Running threads: 20 Stack size: 262144 Current locks: lock: 0x11bb8960: lock: 0x118b7f20: lock: 0x1481b380: lock: 0x1347bfc0: lock: 0x1389d8d0: lock: 0x12c10ec0: lock: 0x12f40750: lock: 0x118cde30: lock: 0x12408d60: lock: 0x12770cd0: lock: 0x14210180: lock: 0x11bb7f30: lock: 0x120b5280: lock: 0x11bb4090: lock: 0x11bb5940: lock: 0x141f79f0: lock: 0x7f2aecaf6350: lock: 0x7f2aee1dcf70: lock: 0x1428e790: lock: 0x1428cb30: lock: 0x1428aed0: lock: 0x14289270: lock: 0x14287610: lock: 0x142859b0: lock: 0x14283d50: lock: 0x142820f0: lock: 0x14280490: lock: 0x1427e830: lock: 0x1427cbd0: lock: 0x1427af70: lock: 0x14279310: lock: 0x142776b0: lock: 0x14275a50: lock: 0x14273df0: lock: 0x14272190: lock: 0x14270530: lock: 0x1426e8d0: lock: 0x1426cc70: lock: 0x1426b010: lock: 0x142693b0: lock: 0x14267750: lock: 0x14265af0: lock: 0x14263e90: lock: 0x14262230: lock: 0x142605d0: lock: 0x1425e970: lock: 0x1425cd10: lock: 0x1425b0b0: lock: 0x14259450: lock: 0x142577f0: lock: 0x14255b90: lock: 0x14253f30: lock: 0x142522d0: lock: 0x14250670: lock: 0x1424ea10: lock: 0x1424cdb0: lock: 0x1424b150: lock: 0x142494f0: lock: 0x14247890: lock: 0x14245c30: lock: 0x14243fd0: lock: 0x14242370: lock: 0x14240710: lock: 0x1423eab0: lock: 0x1423ce50: lock: 0x1423b1f0: lock: 0x14239590: lock: 0x14237930: lock: 0x14235cd0: lock: 0x14234070: lock: 0x14232410: lock: 0x142307b0: lock: 0x1422eb50: lock: 0x1422cef0: lock: 0x1422b290: lock: 0x14229630: lock: 0x142279d0: lock: 0x14225d70: lock: 0x14224110: lock: 0x142224b0: lock: 0x14220850: lock: 0x1421ebf0: lock: 0x141f3420: lock: 0x141f17c0: lock: 0x141efba0: lock: 0x141ee030: lock: 0x141ec4c0: lock: 0x141ea950: lock: 0x141e8de0: lock: 0x141e7270: lock: 0x141e5700: lock: 0x141e3b90: lock: 0x141e2020: lock: 0x141e04b0: lock: 0x141de940: lock: 0x141dcdd0: lock: 0x141db260: lock: 0x141d96f0: lock: 0x141d7b80: lock: 0x141d6010: DB Table Version Thread Open Lock profiler sourcenetrep 1 7 1 Concurrent insert lock profiler sourcenetrep 1 8 1 Concurrent insert lock profiler sourcenetrep 1 10 1 Concurrent insert lock profiler sourcenetrep 1 9 1 Concurrent insert lock Current refresh version: 1 110608 15:47:33 [Note] /usr/local/mysql/bin/mysqld-debug: Normal shutdown 110608 15:47:33 [Note] Event Scheduler: Purging the queue. 0 events 110608 15:47:35 [Warning] /usr/local/mysql/bin/mysqld-debug: Forcing close of thread 42 user: 'xxxx' mysqld-debug: /export/home/pb2/build/sb_0-3314961-1305136713.18/mysql-5.5.13/sql/protocol.cc:522: void Protocol::end_statement(): Assertion `0' failed. Key caches: default Buffer_size: 25769803776 Block_size: 1024 Division_limit: 100 Age_limit: 300 blocks used: 207786 not flushed: 0 w_requests: 0 writes: 0 r_requests: 941949 reads: 207786 110608 16:43:08 - mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. key_buffer_size=25769803776 read_buffer_size=67108864 max_used_connections=23 max_threads=151 thread_count=20 connection_count=20 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 37537541 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x11cc5350 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7f28f2341e30 thread_stack 0x40000 /usr/local/mysql/bin/mysqld-debug(my_print_stacktrace+0x39)[0x7d4ff8] /usr/local/mysql/bin/mysqld-debug(handle_segfault+0x27c)[0x50130f] /lib/libpthread.so.0(+0xf8f0)[0x7f33db6c28f0] /lib/libc.so.6(gsignal+0x35)[0x7f33da899a75] /lib/libc.so.6(abort+0x180)[0x7f33da89d5c0] /lib/libc.so.6(__assert_fail+0xf1)[0x7f33da892941] /usr/local/mysql/bin/mysqld-debug(_ZN8Protocol13end_statementEv+0x1e5)[0x5116dd] /usr/local/mysql/bin/mysqld-debug(_Z16dispatch_command19enum_server_commandP3THDPcj+0x1335)[0x58cf2c] /usr/local/mysql/bin/mysqld-debug(_Z10do_commandP3THD+0x24f)[0x58d7b9] /usr/local/mysql/bin/mysqld-debug(_Z24do_handle_one_connectionP3THD+0x312)[0x62d5af] /usr/local/mysql/bin/mysqld-debug(handle_one_connection+0x55)[0x62d67a] /usr/local/mysql/bin/mysqld-debug(pfs_spawn_thread+0x61)[0x99de3c] /lib/libpthread.so.0(+0x69ca)[0x7f33db6b99ca] /lib/libc.so.6(clone+0x6d)[0x7f33da94c70d] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x120901c0): INSERT IGNORE INTO `profiler`.`sourcenetrep` SELECT '13939', `sid`, `src_ip` & 4294967295 AS `/24 subnet`, 4294967295, 0, sum(`src_bytes`), sum(`dst_bytes`), sum(`src_pkts` + `dst_pkts`), count(*) AS `count` FROM `profiler`.`resultset9` GROUP BY `sid`, `/24 subnet` Connection ID (thread ID): 9 Status: KILL_CONNECTION The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. Writing a core file Aborted 110608 16:43:10 mysqld_safe Number of processes running now: 0 110608 16:54:22 - mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. key_buffer_size=25769803776 read_buffer_size=67108864 max_used_connections=0 max_threads=151 thread_count=0 connection_count=0 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 37537541 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x0 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = (nil) thread_stack 0x40000 /usr/local/mysql/bin/mysqld-debug(my_print_stacktrace+0x39)[0x7d4ff8] /usr/local/mysql/bin/mysqld-debug(handle_segfault+0x27c)[0x50130f] /lib/libpthread.so.0(+0xf8f0)[0x7f3326b3d8f0] /lib/libc.so.6(gsignal+0x35)[0x7f3325d14a75] /lib/libc.so.6(abort+0x180)[0x7f3325d185c0] /usr/local/mysql/bin/mysqld-debug[0x8db77b] /usr/local/mysql/bin/mysqld-debug[0x87df3c] /usr/local/mysql/bin/mysqld-debug[0x8b65c5] /usr/local/mysql/bin/mysqld-debug[0x829200] /lib/libpthread.so.0(+0x69ca)[0x7f3326b349ca] /lib/libc.so.6(clone+0x6d)[0x7f3325dc770d] The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. Writing a core file Aborted