数据库管理系统(简称 DBMS)无疑是任何数据密集型应用程序当中最为重要的组成部分,其肩负着处理大量数据以及高复杂性工作负载的重任。然而,数据库管理系统本身却往往难于管理,因为其中通常包含数百种配置“旋钮”,用于控制诸如缓存内存分配量以及存储介质数据写入频率等要素。各类企业一般需要聘请专业人士以协助相关调配工作,但对于大多数企业而言,此类专业人才的开价亦相当高昂。而实际上,DBA所面临的挑战还远不止这些。
而今天一则名为“OtterTune”的机器学习DBMS系统刷爆了朋友圈。那么,这个由亚马逊和卡内基梅隆大学一起开发的DBMS系统究竟是什么呢?能提供什么服务呢?其实OtterTune并不是多么惊奇的系统,不过是自动化方式识别出最适当当前数据库管理系统配置需求的设置组合。OtterTune 与其它 DBMS 配置工具之间的主要差别在于,其能够利用自此前 DBMS 部署工作当中积累到的知识指导新系统的配置工作。这一设计思路显然降低了新 DBMS 部署方案在调整当中所需要的时间与资源投入。而为了实现这一目标,OtterTune 专门建立起一套数据库,用以收集从此前调节会话中提取到的重要信息。其利用这部分数据建立机器学习(简称 ML)模型,用以捕捉 DBMS 在面对不同配置方案时作出怎样的响应。OtterTune 还利用这些模型以指导新型应用程序的配置实验,并提供推荐设置以提升目标运作效果(例如减少延迟或者提高数据吞吐量)。
虽然OtterTune只是一个结合了机器学习(建模、调参数、获取系统反应、学习、产生最优参数;典型的临床学),可用于参数优化的小软件(实际上DBA的工作远不止这些),但是已经代表了一个方向,未来越来越多的活(枯燥的活)可能会被AI取代。但是现阶段很多DBA很多离不开人的干预。
人类DBA VS机器DBA
首先,我们看看DBA的工作有哪些?DBA的工作实际上都是围绕数据库展开,包含但不限于这些工作:
数据库、主机、操作系统、交换机、存储选型,预算,架构设计,部署,参数优化;
数据库备份、恢复、容灾、HA、新老硬件更替;
数据库SQL审计、SQL优化、异常问题诊断、性能优化、巡检、健康诊断;
数据库扩容、缩容、迁移;
数据库版本升级、补丁修复;
数据库开发规范、管理规范的指定和执行;
数据库监控、专家、审核系统的开发与建立;
数据库代码覆盖率测试、功能测试、建模、压测、profiling;
数据库读写分离、sharding、MPP系统的构建;
数据库开发、管理、设计、规范培训;
数据库在垂直行业应用的架构设计(例如OLAP、GIS、时序、流计算、图式搜索、文本搜索、图搜索、化学、基因、等);
异构数据、同构数据源的数据同步、ETL;
数据库与其他系统的联动;
数据库云产品化、Docker化、虚拟化等相关的工作;
数据库内核的研究、BUG上报、结合业务提出对内核的功能、性能提升等需求;
关注不同数据库产品的roadmap、优缺点、适应场景、不适应场景;
关注数据库行业的发展,进行预研性研究,储备技术;
与技术社区保持紧密联系,从参与、了解同行、到分享,从商业产品到开源社区;
技术为业务服务,从本质触发,深入行业,了解业务、行业的发展,抓住核心点,更好的服务于业务。
可以看到DBA的工作还是有蛮多的,AI要完全取代这些工作,还有非常漫长的过程。
http://bbs.guilinlife.com/thread-9114289-1-1.html
http://bbs.guilinlife.com/thread-9114290-1-1.html
http://bbs.guilinlife.com/thread-9114291-1-1.html
http://bbs.guilinlife.com/thread-9114293-1-1.html
http://bbs.guilinlife.com/thread-9114288-1-1.html
http://bbs.guilinlife.com/thread-9114292-1-1.html
http://bbs.guilinlife.com/thread-9114294-1-1.html
http://bbs.guilinlife.com/thread-9114296-1-1.html
http://bbs.guilinlife.com/thread-9114295-1-1.html
http://bbs.guilinlife.com/thread-9114297-1-1.html
http://bbs.guilinlife.com/thread-9114298-1-1.html
http://bbs.guilinlife.com/thread-9114299-1-1.html
http://bbs.guilinlife.com/thread-9114300-1-1.html
http://bbs.guilinlife.com/thread-9114301-1-1.html
http://bbs.guilinlife.com/thread-9114302-1-1.html
http://bbs.guilinlife.com/thread-9114303-1-1.html
http://bbs.guilinlife.com/thread-9114304-1-1.html
http://bbs.guilinlife.com/thread-9114305-1-1.html
http://bbs.guilinlife.com/thread-9114306-1-1.html
http://bbs.guilinlife.com/thread-9114307-1-1.html
http://bbs.guilinlife.com/thread-9114308-1-1.html
http://bbs.guilinlife.com/thread-9114311-1-1.html
http://bbs.guilinlife.com/thread-9114309-1-1.html
http://bbs.guilinlife.com/thread-9114310-1-1.html
http://bbs.guilinlife.com/thread-9114312-1-1.html
http://bbs.guilinlife.com/thread-9114313-1-1.html
http://bbs.guilinlife.com/thread-9114316-1-1.html
http://bbs.guilinlife.com/thread-9114317-1-1.html
http://bbs.guilinlife.com/thread-9114314-1-1.html
http://bbs.guilinlife.com/thread-9114315-1-1.html
http://bbs.guilinlife.com/thread-9114318-1-1.html
http://bbs.guilinlife.com/thread-9114319-1-1.html
http://bbs.guilinlife.com/thread-9114320-1-1.html
http://bbs.guilinlife.com/thread-9114321-1-1.html
http://bbs.guilinlife.com/thread-9114322-1-1.html
http://bbs.guilinlife.com/thread-9114324-1-1.html
http://bbs.guilinlife.com/thread-9114323-1-1.html
http://bbs.guilinlife.com/thread-9114325-1-1.html
http://bbs.guilinlife.com/thread-9114327-1-1.html
http://bbs.guilinlife.com/thread-9114326-1-1.html
http://bbs.guilinlife.com/thread-9114328-1-1.html
http://bbs.guilinlife.com/thread-9114330-1-1.html
http://bbs.guilinlife.com/thread-9114329-1-1.html
http://bbs.guilinlife.com/thread-9114331-1-1.html
http://bbs.guilinlife.com/thread-9114334-1-1.html
http://bbs.guilinlife.com/thread-9114333-1-1.html
http://bbs.guilinlife.com/thread-9114336-1-1.html
http://bbs.guilinlife.com/thread-9114332-1-1.html
http://bbs.guilinlife.com/thread-9114335-1-1.html
http://bbs.guilinlife.com/thread-9114337-1-1.html
http://bbs.guilinlife.com/thread-9114339-1-1.html
http://bbs.guilinlife.com/thread-9114341-1-1.html
http://bbs.guilinlife.com/thread-9114338-1-1.html
http://bbs.guilinlife.com/thread-9114342-1-1.html
http://bbs.guilinlife.com/thread-9114340-1-1.html
http://bbs.guilinlife.com/thread-9114343-1-1.html
http://bbs.guilinlife.com/thread-9114344-1-1.html
http://bbs.guilinlife.com/thread-9114345-1-1.html
http://bbs.guilinlife.com/thread-9114346-1-1.html
http://bbs.guilinlife.com/thread-9114347-1-1.html
http://bbs.guilinlife.com/thread-9114348-1-1.html
http://bbs.guilinlife.com/thread-9114349-1-1.html
http://bbs.guilinlife.com/thread-9114350-1-1.html
http://bbs.guilinlife.com/thread-9114351-1-1.html
http://bbs.guilinlife.com/thread-9114352-1-1.html
http://bbs.guilinlife.com/thread-9114353-1-1.html
http://bbs.guilinlife.com/thread-9114354-1-1.html
http://bbs.guilinlife.com/thread-9114355-1-1.html
http://bbs.guilinlife.com/thread-9114356-1-1.html
http://bbs.guilinlife.com/thread-9114357-1-1.html
http://bbs.guilinlife.com/thread-9114358-1-1.html
http://bbs.guilinlife.com/thread-9114359-1-1.html
http://bbs.guilinlife.com/thread-9114360-1-1.html
http://bbs.guilinlife.com/thread-9114361-1-1.html
http://bbs.guilinlife.com/thread-9114362-1-1.html
http://bbs.guilinlife.com/thread-9114363-1-1.html
http://bbs.guilinlife.com/thread-9114364-1-1.html
http://bbs.guilinlife.com/thread-9114365-1-1.html
http://bbs.guilinlife.com/thread-9114366-1-1.html
http://bbs.guilinlife.com/thread-9114367-1-1.html
http://bbs.guilinlife.com/thread-9114368-1-1.html
http://bbs.guilinlife.com/thread-9114369-1-1.html
http://bbs.guilinlife.com/thread-9114370-1-1.html
http://bbs.guilinlife.com/thread-9114371-1-1.html
http://bbs.guilinlife.com/thread-9114372-1-1.html
http://bbs.guilinlife.com/thread-9114374-1-1.html
http://bbs.guilinlife.com/thread-9114373-1-1.html
http://bbs.guilinlife.com/thread-9114375-1-1.html
http://bbs.guilinlife.com/thread-9114376-1-1.html
http://bbs.guilinlife.com/thread-9114377-1-1.html
http://bbs.guilinlife.com/thread-9114378-1-1.html
http://bbs.guilinlife.com/thread-9114379-1-1.html
http://bbs.guilinlife.com/thread-9114380-1-1.html
http://bbs.guilinlife.com/thread-9114381-1-1.html
http://bbs.guilinlife.com/thread-9114382-1-1.html
http://bbs.guilinlife.com/thread-9114383-1-1.html
http://bbs.guilinlife.com/thread-9114384-1-1.html
http://bbs.guilinlife.com/thread-9114386-1-1.html
http://bbs.guilinlife.com/thread-9114385-1-1.html
http://bbs.guilinlife.com/thread-9114387-1-1.html
http://bbs.guilinlife.com/thread-9114388-1-1.html
http://bbs.guilinlife.com/thread-9114389-1-1.html
http://bbs.guilinlife.com/thread-9114390-1-1.html
http://bbs.guilinlife.com/thread-9114391-1-1.html
http://bbs.guilinlife.com/thread-9114392-1-1.html
http://bbs.guilinlife.com/thread-9114393-1-1.html
http://bbs.guilinlife.com/thread-9114394-1-1.html
http://bbs.guilinlife.com/thread-9114395-1-1.html
http://bbs.guilinlife.com/thread-9114396-1-1.html
http://bbs.guilinlife.com/thread-9114397-1-1.html
http://bbs.guilinlife.com/thread-9114398-1-1.html
http://bbs.guilinlife.com/thread-9114399-1-1.html
http://bbs.guilinlife.com/thread-9114400-1-1.html
http://bbs.guilinlife.com/thread-9114401-1-1.html
http://bbs.guilinlife.com/thread-9114402-1-1.html
http://bbs.guilinlife.com/thread-9114403-1-1.html
http://bbs.guilinlife.com/thread-9114404-1-1.html
http://bbs.guilinlife.com/thread-9114405-1-1.html
http://bbs.guilinlife.com/thread-9114406-1-1.html
http://bbs.guilinlife.com/thread-9114407-1-1.html
http://bbs.guilinlife.com/thread-9114408-1-1.html
http://bbs.guilinlife.com/thread-9114409-1-1.html
http://bbs.guilinlife.com/thread-9114413-1-1.html
http://bbs.guilinlife.com/thread-9114410-1-1.html
http://bbs.guilinlife.com/thread-9114412-1-1.html
http://bbs.guilinlife.com/thread-9114411-1-1.html
http://bbs.guilinlife.com/thread-9114414-1-1.html
http://bbs.guilinlife.com/thread-9114415-1-1.html
http://bbs.guilinlife.com/thread-9114417-1-1.html
http://bbs.guilinlife.com/thread-9114416-1-1.html
http://bbs.guilinlife.com/thread-9114419-1-1.html
http://bbs.guilinlife.com/thread-9114418-1-1.html
http://bbs.guilinlife.com/thread-9114420-1-1.html
http://bbs.guilinlife.com/thread-9114421-1-1.html
http://bbs.guilinlife.com/thread-9114422-1-1.html
http://bbs.guilinlife.com/thread-9114423-1-1.html
http://bbs.guilinlife.com/thread-9114425-1-1.html
http://bbs.guilinlife.com/thread-9114424-1-1.html
http://bbs.guilinlife.com/thread-9114428-1-1.html
http://bbs.guilinlife.com/thread-9114427-1-1.html
http://bbs.guilinlife.com/thread-9114426-1-1.html
http://bbs.guilinlife.com/thread-9114429-1-1.html
http://bbs.guilinlife.com/thread-9114430-1-1.html
http://bbs.guilinlife.com/thread-9114431-1-1.html
http://bbs.guilinlife.com/thread-9114432-1-1.html
http://bbs.guilinlife.com/thread-9114434-1-1.html
http://bbs.guilinlife.com/thread-9114433-1-1.html
http://bbs.guilinlife.com/thread-9114435-1-1.html
http://bbs.guilinlife.com/thread-9114436-1-1.html
http://bbs.guilinlife.com/thread-9114437-1-1.html
http://bbs.guilinlife.com/thread-9114438-1-1.html
http://bbs.guilinlife.com/thread-9114439-1-1.html
http://bbs.guilinlife.com/thread-9114440-1-1.html
http://bbs.guilinlife.com/thread-9114441-1-1.html
http://bbs.guilinlife.com/thread-9114442-1-1.html
http://bbs.guilinlife.com/thread-9114445-1-1.html
http://bbs.guilinlife.com/thread-9114448-1-1.html
http://bbs.guilinlife.com/thread-9114444-1-1.html
http://bbs.guilinlife.com/thread-9114443-1-1.html
http://bbs.guilinlife.com/thread-9114447-1-1.html
http://bbs.guilinlife.com/thread-9114446-1-1.html
http://bbs.guilinlife.com/thread-9114449-1-1.html
http://bbs.guilinlife.com/thread-9114452-1-1.html
http://bbs.guilinlife.com/thread-9114453-1-1.html
http://bbs.guilinlife.com/thread-9114450-1-1.html
http://bbs.guilinlife.com/thread-9114451-1-1.html
http://bbs.guilinlife.com/thread-9114454-1-1.html
http://bbs.guilinlife.com/thread-9114455-1-1.html
http://bbs.guilinlife.com/thread-9114458-1-1.html
http://bbs.guilinlife.com/thread-9114459-1-1.html
http://bbs.guilinlife.com/thread-9114457-1-1.html
http://bbs.guilinlife.com/thread-9114460-1-1.html
http://bbs.guilinlife.com/thread-9114456-1-1.html
http://bbs.guilinlife.com/thread-9114461-1-1.html
http://bbs.guilinlife.com/thread-9114462-1-1.html
http://bbs.guilinlife.com/thread-9114464-1-1.html
http://bbs.guilinlife.com/thread-9114465-1-1.html
http://bbs.guilinlife.com/thread-9114463-1-1.html
http://bbs.guilinlife.com/thread-9114466-1-1.html
http://bbs.guilinlife.com/thread-9114468-1-1.html
http://bbs.guilinlife.com/thread-9114469-1-1.html
http://bbs.guilinlife.com/thread-9114467-1-1.html
http://bbs.guilinlife.com/thread-9114470-1-1.html
http://bbs.guilinlife.com/thread-9114471-1-1.html
http://bbs.guilinlife.com/thread-9114472-1-1.html
http://bbs.guilinlife.com/thread-9114473-1-1.html
http://bbs.guilinlife.com/thread-9114474-1-1.html
http://bbs.guilinlife.com/thread-9114475-1-1.html
http://bbs.guilinlife.com/thread-9114476-1-1.html
http://bbs.guilinlife.com/thread-9114477-1-1.html
http://bbs.guilinlife.com/thread-9114478-1-1.html
http://bbs.guilinlife.com/thread-9114480-1-1.html
http://bbs.guilinlife.com/thread-9114481-1-1.html
http://bbs.guilinlife.com/thread-9114479-1-1.html
http://bbs.guilinlife.com/thread-9114482-1-1.html
http://bbs.guilinlife.com/thread-9114483-1-1.html
http://bbs.guilinlife.com/thread-9114484-1-1.html
http://bbs.guilinlife.com/thread-9114485-1-1.html
http://bbs.guilinlife.com/thread-9114486-1-1.html
http://bbs.guilinlife.com/thread-9114487-1-1.html
http://bbs.guilinlife.com/thread-9114488-1-1.html
http://bbs.guilinlife.com/thread-9114489-1-1.html
http://bbs.guilinlife.com/thread-9114490-1-1.html
http://bbs.guilinlife.com/thread-9114493-1-1.html
http://bbs.guilinlife.com/thread-9114492-1-1.html
http://bbs.guilinlife.com/thread-9114491-1-1.html
http://bbs.guilinlife.com/thread-9114494-1-1.html
http://bbs.guilinlife.com/thread-9114495-1-1.html
http://bbs.guilinlife.com/thread-9114497-1-1.html
http://bbs.guilinlife.com/thread-9114496-1-1.html
http://bbs.guilinlife.com/thread-9114498-1-1.html
http://bbs.guilinlife.com/thread-9114499-1-1.html
http://bbs.guilinlife.com/thread-9114500-1-1.html
http://bbs.guilinlife.com/thread-9114501-1-1.html
http://bbs.guilinlife.com/thread-9114502-1-1.html
http://bbs.guilinlife.com/thread-9114503-1-1.html
http://bbs.guilinlife.com/thread-9114505-1-1.html
http://bbs.guilinlife.com/thread-9114504-1-1.html
http://bbs.guilinlife.com/thread-9114506-1-1.html
http://bbs.guilinlife.com/thread-9114507-1-1.html
http://bbs.guilinlife.com/thread-9114509-1-1.html
http://bbs.guilinlife.com/thread-9114508-1-1.html
http://bbs.guilinlife.com/thread-9114510-1-1.html
http://bbs.guilinlife.com/thread-9114511-1-1.html
http://bbs.guilinlife.com/thread-9114512-1-1.html
http://bbs.guilinlife.com/thread-9114513-1-1.html
http://bbs.guilinlife.com/thread-9114514-1-1.html
http://bbs.guilinlife.com/thread-9114515-1-1.html
http://bbs.guilinlife.com/thread-9114516-1-1.html
http://bbs.guilinlife.com/thread-9114517-1-1.html
http://bbs.guilinlife.com/thread-9114518-1-1.html
http://bbs.guilinlife.com/thread-9114519-1-1.html
http://bbs.guilinlife.com/thread-9114520-1-1.html
http://bbs.guilinlife.com/thread-9114521-1-1.html
http://bbs.guilinlife.com/thread-9114522-1-1.html
http://bbs.guilinlife.com/thread-9114523-1-1.html
http://bbs.guilinlife.com/thread-9114525-1-1.html
http://bbs.guilinlife.com/thread-9114524-1-1.html
http://bbs.guilinlife.com/thread-9114526-1-1.html
http://bbs.guilinlife.com/thread-9114527-1-1.html
http://bbs.guilinlife.com/thread-9114528-1-1.html
http://bbs.guilinlife.com/thread-9114529-1-1.html
http://bbs.guilinlife.com/thread-9114530-1-1.html
http://bbs.guilinlife.com/thread-9114534-1-1.html
http://bbs.guilinlife.com/thread-9114531-1-1.html
http://bbs.guilinlife.com/thread-9114535-1-1.html
http://bbs.guilinlife.com/thread-9114532-1-1.html
http://bbs.guilinlife.com/thread-9114533-1-1.html
http://bbs.guilinlife.com/thread-9114536-1-1.html
http://bbs.guilinlife.com/thread-9114538-1-1.html
http://bbs.guilinlife.com/thread-9114540-1-1.html
http://bbs.guilinlife.com/thread-9114539-1-1.html
http://bbs.guilinlife.com/thread-9114541-1-1.html
http://bbs.guilinlife.com/thread-9114537-1-1.html
http://bbs.guilinlife.com/thread-9114542-1-1.html