一、主机规划
操作系统版本为CentOS 7.2.1511
node1:172.17.0.1 gfs1
node2:172.17.0.2 gfs2
node3:172.17.0.3 gfs3
node4:172.17.0.4 gfs
client:172.17.0.5
二、安装:
1.在node1-4上安装glusterfs-server
yum install -y centos-release-gluster38
yum install -y glusterfs glusterfs-server glusterfs-fuse
设置开机自启动并启动
systemctl enable glusterd.service
systemctl start glusterd.service
2.在gfs1-gfs4节点上配置整个GlusterFS集群,把各个节点加入到集群
vim /etc/hosts
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
172.17.0.1 gfs1
172.17.0.2 gfs2
172.17.0.3 gfs3
172.17.0.4 gfs4
[[email protected] ~]# gluster peer probe gfs1
[[email protected] ~]# gluster peer probe gfs2
[[email protected] ~]# gluster peer probe gfs3
[[email protected] ~]# gluster peer probe gfs4
3.查看节点状态
[[email protected] ~]#gluster peer status
4.在gfs{1-4}上创建数据存储目录
# mkdir -p /usr/local/share/models
5.在gfs1上创建GlusterFS磁盘
注意:
加上replica 4就是4个节点中,每个节点都要把数据存储一次,就是一个数据存储4份,每个节点一份
如果不加replica 4,就是4个节点的磁盘空间整合成一个硬盘,
[[email protected] ~]#gluster volume create models replica 4 gfs1:/usr/local/share/models gfs2:/usr/local/share/models gfs3:/usr/local/share/models gfs4:/usr/local/share/models force
6.启动
[[email protected] ~]# gluster volume start models
客户端
1.部署GlusterFS客户端并mount GlusterFS文件系统
[[email protected] ~]# yum install -y centos-release-gluster38
[[email protected] ~]# yum install -y glusterfs glusterfs-fuse
[[email protected] ~]# mkdir -p /mnt/models
[[email protected] ~]# mount -t glusterfs -o ro gfs1:models /mnt/models/
2.查看效果
[[email protected] ~]# df -h
3.观察分布式文件系统的效果
umount /mnt/models
mount -t glusterfs -o rw gfs1:models /mnt/models/
[[email protected] ~]# cd /mnt/models/
[[email protected] mnt]# for i in `seq -w 10`; do mkdir $i ; done
[[email protected] models]# for i in `seq -w 10`; do mkdir $i ; done
[[email protected] models]# ll
total 40
drwxr-xr-x 2 root root 4096 Feb 14 21:56 01
drwxr-xr-x 2 root root 4096 Feb 14 21:59 02
drwxr-xr-x 2 root root 4096 Feb 14 21:56 03
drwxr-xr-x 2 root root 4096 Feb 14 21:56 04
drwxr-xr-x 2 root root 4096 Feb 14 21:56 05
drwxr-xr-x 2 root root 4096 Feb 14 21:56 06
drwxr-xr-x 2 root root 4096 Feb 14 21:59 07
drwxr-xr-x 2 root root 4096 Feb 14 21:56 08
drwxr-xr-x 2 root root 4096 Feb 14 21:56 09
drwxr-xr-x 2 root root 4096 Feb 14 21:59 10
分别在4台Server上查看新建的文件夹同步情况
[[email protected] ~]# ls /usr/local/share/models/ -l
total 0
drwxr-xr-x 2 root root 6 Feb 14 21:56 01
drwxr-xr-x 2 root root 6 Feb 14 21:59 02
drwxr-xr-x 2 root root 6 Feb 14 21:56 03
drwxr-xr-x 2 root root 6 Feb 14 21:56 04
drwxr-xr-x 2 root root 6 Feb 14 21:56 05
drwxr-xr-x 2 root root 6 Feb 14 21:56 06
drwxr-xr-x 2 root root 6 Feb 14 21:59 07
drwxr-xr-x 2 root root 6 Feb 14 21:56 08
drwxr-xr-x 2 root root 6 Feb 14 21:56 09
drwxr-xr-x 2 root root 6 Feb 14 21:59 10
可以看到4台服务器都同步过来了。
当单台Server出现故障,比如服务器断开连接的情况,创建一个文件需要比较长的时间。
但是当Server重新连上之后,文件可以及时的同步过来。