MySQL 5.7 Reference Manual】15.4.2 Change Buffer(变更缓冲)

15.4.2 Change Buffer(变更缓冲)

The change buffer is a special data structure that caches changes to secondary index pages when affected pages are not in the buffer pool. The buffered changes, which may result from INSERT, UPDATE, or DELETE operations (DML), are merged later when the pages are loaded into the buffer pool by other read operations.

变更缓冲是一个特殊的数据结构,当目标页不在缓冲池中时,变更缓冲负责缓存对二级索引页的变更。被缓冲的变更内容可能是INSERT,UPDATE,或DELETE操作(DML)的结果。在下一次读操作时这些页会被载入缓冲池,之后变更缓冲中的内容将被合并。

Unlike clustered indexes, secondary indexes are usually non-unique, and inserts into secondary indexes happen in a relatively random order. Similarly, deletes and updates may affect secondary index pages that are not adjacently located in an index tree. Merging cached changes at a later time, when affected pages are read into the buffer pool by other operations, avoids substantial random access I/O that would be required to read-in secondary index pages from disk.

与聚簇索引不同,二级索引通常不唯一,并且插入二级索引的顺序比较随机。删除和更新对二级索引页产生类似的影响,这是因为目标页在索引树上的位置并不相邻。被影响的页会通过某些操作被读入缓冲池,这个过程需要从磁盘上读取二级索引页,所以合并已缓存变更内容的操作的会在此过程之后执行,以避免大量的随机I/O。

Periodically, the purge operation that runs when the system is mostly idle, or during a slow shutdown, writes the updated index pages to disk. The purge operation can write disk blocks for a series of index values more efficiently than if each value were written to disk immediately.

清理操作发生在系统基本空闲或缓慢关闭期间,它会周期性的把更新过的索引页写入磁盘。清理操作可以把索引值批量写入磁盘,这样比把单个值直接写入磁盘更有效率。

Change buffer merging may take several hours when there are numerous secondary indexes to update and many affected rows. During this time, disk I/O is increased, which can cause a significant slowdown for disk-bound queries. Change buffer merging may also continue to occur after a transaction is committed. In fact, change buffer merging may continue to occur after a server shutdown and restart (see Section 15.21.2, “Forcing InnoDB Recovery” for more information).

当有许多二级索引要更新并且同时影响多行记录时,变更缓冲合并可能需要耗费数个小时。在此期间,磁盘I/O不断增加,这样会造成磁盘读取性能显著下降。变更缓冲合并可能会在事务提交后继续发生。事实上,变更缓冲合并也可能在服务关闭和重启后继续发生(更多信息,请参考15.21.2, “强制InnoDB恢复”)。

In memory, the change buffer occupies part of the InnoDB buffer pool. On disk, the change buffer is part of the system tablespace, so that index changes remain buffered across database restarts.

在内存中,变更缓冲占用了InnoDB缓冲池的部分空间。在磁盘上,变更缓冲是系统表空间的一部分,这使得索引变更即使在系统重启后仍然处于缓冲状态。

The type of data cached in the change buffer is governed by the innodb_change_buffering configuration option. For more information, see Section 15.6.5, “Configuring InnoDB Change Buffering”. You can also configure the maximum change buffer size. For more information, see Section 15.6.5.1, “Configuring the Change Buffer Maximum Size”.

变更缓冲中缓存的数据类型通过innodb_change_buffering配置项进行管理。更多信息,请看15.6.5,“配置InnoDB变更缓冲”。你也可以配置变更缓冲大小的上限。更多信息,请看15.6.5.1,“配置变更缓冲大小上限”。

Monitoring the Change Buffer(监控变更缓冲)

The following options are available for change buffer monitoring:

以下选项可用于变更缓冲监控:

  • InnoDB Standard Monitor output includes status information for the change buffer. To view monitor data, issue the SHOW ENGINE INNODB STATUS command.

在InnoDB标准监视器中会输出变更缓冲的状态信息。要查看监控数据,就输入“SHOW ENGINE INNODB STATUS ”命令。

mysql> SHOW ENGINE INNODB STATUS\G

Change buffer status information is located under the INSERT BUFFER AND ADAPTIVE HASH INDEX heading and appears similar to the following:

变更缓冲的状态信息位于“INSERT BUFFER AND ADAPTIVE HASH INDEX”标题栏的下方,如下所示。

-------------------------------------

INSERT BUFFER AND ADAPTIVE HASH INDEX

-------------------------------------

Ibuf: size 1, free list len 0, seg size 2, 0 merges

merged operations:

insert 0, delete mark 0, delete 0

discarded operations:

insert 0, delete mark 0, delete 0

Hash table size 4425293, used cells 32, node heap has 1 buffer(s)

13577.57 hash searches/s, 202.47 non-hash searches/s

For more information, see Section 15.17.3, “InnoDB Standard Monitor and Lock Monitor Output”.

更多信息,请参考15.17.3,“InnoDB标准监视器与锁定监视器输出”。

  • The INFORMATION_SCHEMA.INNODB_METRICS table provides most of the data points found in InnoDB Standard Monitor output, plus other data points. To view change buffer metrics and a description of each, issue the following query:

INFORMATION_SCHEMA.INNODB_METRICS表提供了在InnoDB标准监视器中输出的大部分数据点,以及其他数据点。要看变更缓冲的指标及其描述,输入以下查询:

mysql> SELECT NAME, COMMENT FROM INFORMATION_SCHEMA.INNODB_METRICS WHERE NAME LIKE ‘%ibuf%‘\G

For INNODB_METRICS table usage information, see Section 15.15.6, “InnoDB INFORMATION_SCHEMA Metrics Table”.

如何使用INNODB_METRICS表的信息,请参考15.15.6,“InnoDB INFORMATION_SCHEMA指标表 Table”。

  • The INFORMATION_SCHEMA.INNODB_BUFFER_PAGE table provides metadata about each page in the buffer pool, including change buffer index and change buffer bitmap pages. Change buffer pages are identified by PAGE_TYPE. IBUF_INDEX is the page type for change buffer
    index pages, and IBUF_BITMAP is the page type for change buffer bitmap pages.

INFORMATION_SCHEMA.INNODB_BUFFER_PAGE表提供缓冲池中每一页的元数据,包括变更缓冲索引页和变更缓冲位图页。变更缓冲页是通过一些标记来识别的,PAGE_TYPE. IBUF_INDEX表示页类型是变更缓冲索引页,IBUF_BITMAP表示页类型是变更缓冲位图页。

Warning

Querying the INNODB_BUFFER_PAGE table
can introduce significant performance overhead. To avoid impacting performance, reproduce the issue you want to investigate on a test instance and run your queries on the test instance.

For example, you can query the INNODB_BUFFER_PAGE table to determine the approximate number of IBUF_INDEX and IBUF_BITMAP pages as a percentage of total buffer pool pages.

例如,你可以查询INNODB_BUFFER_PAGE,通过计算占总缓冲池页的百分比来确认IBUF_INDEX页和IBUF_BITMAP页的大致数量。

SELECT

(SELECT COUNT(*) FROM INFORMATION_SCHEMA.INNODB_BUFFER_PAGE

WHERE PAGE_TYPE LIKE ‘IBUF%‘

) AS change_buffer_pages,

(

SELECT COUNT(*)

FROM INFORMATION_SCHEMA.INNODB_BUFFER_PAGE

) AS total_pages,

(

SELECT ((change_buffer_pages/total_pages)*100)

) AS change_buffer_page_percentage;

+---------------------+-------------+-------------------------------+

| change_buffer_pages | total_pages | change_buffer_page_percentage |

+---------------------+-------------+-------------------------------+

|                  25 |        8192 |                        0.3052 |

+---------------------+-------------+-------------------------------+

For information about other data provided by the INNODB_BUFFER_PAGE table, seeSection 23.31.1, “The INFORMATION_SCHEMA INNODB_BUFFER_PAGE Table”. For related usage information, see Section 15.15.5, “InnoDB INFORMATION_SCHEMA Buffer
Pool Tables”.

更多关于INNODB_BUFFER_PAGE表所提供的其他数据的信息,请参考23.31.1,“INFORMATION_SCHEMA INNODB_BUFFER_PAGE表”。相关用法,请参考 15.15.5,“InnoDB INFORMATION_SCHEMA缓冲池表”。

  • Performance Schema provides change buffer mutex wait instrumentation for advanced performance monitoring. To view change buffer instrumentation, issue the following query:

Performance Schema提供对变更缓冲互斥等待的检测信息以增强对于性能的监控能力。要看性能缓冲检测信息,输入以下查询:

mysql> SELECT * FROM performance_schema.setup_instruments

WHERE NAME LIKE ‘%wait/synch/mutex/innodb/ibuf%‘;

+-------------------------------------------------------+---------+-------+

| NAME                                                  | ENABLED | TIMED |

+-------------------------------------------------------+---------+-------+

| wait/synch/mutex/innodb/ibuf_bitmap_mutex             | YES     | YES   |

| wait/synch/mutex/innodb/ibuf_mutex                    | YES     | YES   |

| wait/synch/mutex/innodb/ibuf_pessimistic_insert_mutex | YES     | YES   |

+-------------------------------------------------------+---------+-------+

For information about monitoring InnoDB mutex waits, see Section 15.16.2, “Monitoring InnoDB Mutex Waits Using Performance Schema”.

更多关于监控InnoDB互斥等待的信息,请参考15.16.2,“使用Performance Schema监控InnoDB互斥等待”。

原文地址:https://www.cnblogs.com/DataArt/p/9961023.html

时间: 2024-07-29 21:15:36

MySQL 5.7 Reference Manual】15.4.2 Change Buffer(变更缓冲)的相关文章

Mysql InnDB 内存存储结构 -- Change Buffer

在InnoDB中,当对应的数据不存在与Buffer Pool中时,为了避免大量的随机磁盘I/O可能带来的性能瓶颈,InnoDB 在Buffer Pool 中划分出一部分内存,称为Change Buffer,由其负责缓存由DML操作引起的二级索引相关数据的变化.当对应的数据下次被读入Buffer Pool 中时,Change Buffer 中记录的变化信息会被合并到数据中.其结构如下图所示.简要的,使用Change Buffer有三个要点:a. DML操作, b. 涉及二级索引,c. 对应page

[MySQL Reference Manual] 7 备份和恢复

7. 备份和恢复 本章主要会介绍: 1.备份的类型:逻辑备份,物理备份,全备和增量4种 2.创建备份的方法 3.还原方法,包括还原到时间点 4.备份计划,压缩和加密 5.表维护,恢复损坏的表 7. 备份和恢复... 1 7.1备份和还原类型... 1 7.1.1 物理备份VS逻辑备份... 1 7.1.2 Online VS OFFLINE. 1 7.1.3 本地VS远程... 1 7.1.4 快照备份... 1 7.1.5 全备VS增量备份... 1 7.1.6 完全恢复VS时间点(增量)恢复

[MySQL Reference Manual] 6 安全性

6. 安全性 在Mysql安装配置时要考虑安全性的影响,以下几点: Ÿ   常规因素影响安全性 Ÿ   程序自身安全性 Ÿ   数据库内部的安全性,即,访问控制 Ÿ   网络安全性和系统安全性 Ÿ   数据文件的备份,日志文件和配置文件的安全性 6. 安全性... 1 6.1 常规安全性问题... 2 6.1.1安全性最佳实践... 2 6.1.2 保持密码安全性... 2 6.1.2.1终端用户密码安全性最佳实践... 2 6.1.2.2 密码管理方法... 3 6.1.2.3 密码和日志..

[MySQL Reference Manual]14 InnoDB存储引擎

14 InnoDB存储引擎 14 InnoDB存储引擎... 1 14.1 InnoDB说明... 5 14.1.1 InnoDB作为默认存储引擎... 5 14.1.1.1 存储引擎的趋势... 5 14.1.1.2 InnoDB变成默认存储引擎之后... 5 14.1.1.3 InnoDB表好处... 6 14.1.1.4 InnoDB表最佳实践... 6 14.1.1.5 InnoDB表提升... 6 14.1.1.6 InnoDB作为默认存储引擎测试... 6 14.1.1.7 验证In

[MySQL Reference Manual] 5 MySQL 服务管理

5. MySQL 服务管理 5. MySQL 服务管理... 1 5.1 The Mysql Server1 5.2 Mysql 服务日志... 1 5.2.1 选择General query log和slow query log 的输出方式... 1 5.2.2 Error Log. 1 5.2.3 General Query Log. 1 5.2.4 Binary Log. 1 5.2.4.1 binary log日志记录方式... 1 5.2.4.2设置binary log格式... 1

MySQL 5.6 Reference Manual-14.6 InnoDB Table Management

14.6 InnoDB Table Management 14.6.1 Creating InnoDB Tables 14.6.2 Moving or Copying InnoDB Tables to Another Machine 14.6.3 Grouping DML Operations with Transactions 14.6.4 Converting Tables from MyISAM to InnoDB 14.6.5 AUTO_INCREMENT Handling in Inn

【资源共享】完整版RK3399芯片手册《RK3399 Technical Reference Manual 1.4》

[资源共享]完整版RK3399芯片手册 <RK3399 Technical Reference Manual 1.4> 完整资料总共824页 详细的寄存器与操作资料 下载地址:http://developer.t-firefly.com/thread-12361-1-1.html

MySQL 5.6 Reference Manual-14.4 InnoDB Configuration

14.4 InnoDB Configuration 14.4.1 InnoDB Initialization and Startup Configuration 14.4.2 Configuring InnoDB for Read-Only Operation 14.4.3 InnoDB Buffer Pool Configuration 14.4.4 Configuring the Memory Allocator for InnoDB 14.4.5 Configuring InnoDB Ch

MySql 缓冲池(buffer pool) 和 写缓存(change buffer) 转

应用系统分层架构,为了加速数据访问,会把最常访问的数据,放在缓存(cache)里,避免每次都去访问数据库. 操作系统,会有缓冲池(buffer pool)机制,避免每次访问磁盘,以加速数据的访问. MySQL作为一个存储系统,同样具有缓冲池(buffer pool)机制,以避免每次查询数据都进行磁盘IO. 今天,和大家聊一聊InnoDB的缓冲池. InnoDB的缓冲池缓存什么?有什么用? 缓存表数据与索引数据,把磁盘上的数据加载到缓冲池,避免每次访问都进行磁盘IO,起到加速访问的作用. 速度快,