服务器常用工具说明[转]

get_cpu_mem_info.bat

该脚本适用于windows系统。会每10秒记录一次当前所有进程消耗的CPU和内存使用量。可以用于找出占用资源异常的进程。 该脚本会将日志记录到脚本当前目录下的get_cpu_mem_info.log里。

@rem This batch script to collect cpu and memory usage info.
@rem version 1.0 time:2014-3-9

set log=get_cpu_mem_info.log
set timeout=10
:check

@rem "The CPUusage and Memusage"
wmic path Win32_PerfFormattedData_PerfProc_Process get Name,PercentUserTime,WorkingSet >>%log%
wmic os get localdatetime >>%log%
ping -n %timeout% 127.0.0.1>nul

goto check

get_cpu_mem_info.sh

该脚本适用于linux系统。会每10秒记录一次当前所有进程消耗的CPU和内存使用量以及。可以用于找出占用资源异常的进程。日志名称和位置:/tmp/get_cpu_mem_info.sh.log。

#!/bin/bash
#When the free memory very less ,this script to collect CPU/memory usage information and dmessage information.
#Version 1.0 time:2014-03-11
#Version 2.0 time:2014-12-23
#Version 3.0 time:2015-04-21
#Version 4.0 time:2015-05-07

logfile=/tmp/$0.log

check_os_release()
{
  while true
  do
    os_release=$(grep "Red Hat Enterprise Linux Server release" /etc/issue 2>/dev/null)
    os_release_2=$(grep "Red Hat Enterprise Linux Server release" /etc/redhat-release 2>/dev/null)
    if [ "$os_release" ] && [ "$os_release_2" ]
    then
      if echo "$os_release"|grep "release 5" >/dev/null 2>&1
      then
        os_release=redhat5
        echo "$os_release"
      elif echo "$os_release"|grep "release 6" >/dev/null 2>&1
      then
        os_release=redhat6
        echo "$os_release"
      else
        os_release=""
        echo "$os_release"
      fi
      break
    fi
    os_release=$(grep "Aliyun Linux release" /etc/issue 2>/dev/null)
    os_release_2=$(grep "Aliyun Linux release" /etc/aliyun-release 2>/dev/null)
    if [ "$os_release" ] && [ "$os_release_2" ]
    then
      if echo "$os_release"|grep "release 5" >/dev/null 2>&1
      then
        os_release=aliyun5
        echo "$os_release"
      elif echo "$os_release"|grep "release 6" >/dev/null 2>&1
      then
        os_release=aliyun6
        echo "$os_release"
      elif echo "$os_release"|grep "release 7" >/dev/null 2>&1
      then
        os_release=aliyun7
        echo "$os_release"
      else
        os_release=""
        echo "$os_release"
      fi
      break
    fi
    os_release_2=$(grep "CentOS" /etc/*release 2>/dev/null)
    if [ "$os_release_2" ]
    then
      if echo "$os_release_2"|grep "release 5" >/dev/null 2>&1
      then
        os_release=centos5
        echo "$os_release"
      elif echo "$os_release_2"|grep "release 6" >/dev/null 2>&1
      then
        os_release=centos6
        echo "$os_release"
      elif echo "$os_release_2"|grep "release 7" >/dev/null 2>&1
      then
        os_release=centos7
        echo "$os_release"
      else
        os_release=""
        echo "$os_release"
      fi
      break
    fi
    os_release=$(grep -i "ubuntu" /etc/issue 2>/dev/null)
    os_release_2=$(grep -i "ubuntu" /etc/lsb-release 2>/dev/null)
    if [ "$os_release" ] && [ "$os_release_2" ]
    then
      if echo "$os_release"|grep "Ubuntu 10" >/dev/null 2>&1
      then
        os_release=ubuntu10
        echo "$os_release"
      elif echo "$os_release"|grep "Ubuntu 12.04" >/dev/null 2>&1
      then
        os_release=ubuntu1204
        echo "$os_release"
      elif echo "$os_release"|grep "Ubuntu 12.10" >/dev/null 2>&1
      then
        os_release=ubuntu1210
        echo "$os_release"
     elif echo "$os_release"|grep "Ubuntu 14.04" >/dev/null 2>&1
     then
        os_release=ubuntu1204
        echo "$os_release"
      else
        os_release=""
        echo "$os_release"
      fi
      break
    fi
    os_release=$(grep -i "debian" /etc/issue 2>/dev/null)
    os_release_2=$(grep -i "debian" /proc/version 2>/dev/null)
    if [ "$os_release" ] && [ "$os_release_2" ]
    then
      if echo "$os_release"|grep "Linux 6" >/dev/null 2>&1
      then
        os_release=debian6
        echo "$os_release"
      elif echo "$os_release"|grep "Linux 7" >/dev/null 2>&1
      then
        os_release=debian7
        echo "$os_release"
      else
        os_release=""
        echo "$os_release"
      fi
      break
    fi
    os_release=$(grep -i "opensuse" /etc/issue 2>/dev/null)
    os_release_2=$(grep -i "opensuse" /etc/*release 2>/dev/null)
    if [ "$os_release" ] && [ "$os_release_2" ]
    then
      if echo "$os_release"|grep "openSUSE 13.1" >/dev/null 2>&1
      then
        os_release=opensuse1301
        echo "$os_release"
      else
        os_release=""
        echo "$os_release"
      fi
      break
    fi
    break
    done
}

rhel56_fun()
{
  while true
  do
    vm_mem=$(free -m|grep "buffers/cache"|awk ‘{print $4}‘)
    cpu=$(top -bn2|grep "Cpu(s)"|awk ‘{print $5}‘|awk -F‘%‘ ‘{print $1}‘|tail -n1)
    check_cpu=$(echo "$cpu <20" |bc)
    echo "======================================================" >>$logfile
    date >>$logfile
    if [[ $vm_mem -le 100 ]]
    then
      echo "======================================================" >>$logfile
      echo "The memory is too less." >>$logfile
      free -m >>$logfile
      echo "=======================Memory info=====================" >>$logfile
      (ps aux|head -1;ps aux|sort -nrk6|grep -v "RSS") >>$logfile
      date >>$logfile
      echo "=======================Dmesg info=====================" >>$logfile
      dmesg >>$logfile
      dmesg -c
    elif [[ $check_cpu -eq 1  ]]
    then
      echo "======================================================" >>$logfile
      echo "The idle cpu is too less." >>$logfile
      echo "=======================CPU info========================" >>$logfile
      (ps aux|head -1;ps aux|sort -nrk3|grep -v "RSS") >>$logfiles
      echo "=======================Dmesg info=====================" >>$logfile
      dmesg >>$logfile
      dmesg -c
    fi
    sleep 10
  done
}

rhel7_fun()
{
  while true
  do
    vm_mem=$(free -m|grep "buffers/cache"|awk ‘{print $4}‘)
    cpu=$(top -bn2|grep "Cpu(s)"|awk -F, ‘{print $4}‘|awk ‘{print $1}‘|tail -n1)
    check_cpu=$(echo "$cpu <20" |bc)
    echo "======================================================" >>$logfile
    date >>$logfile
    if [[ $vm_mem -le 100 ]]
    then
      echo "======================================================" >>$logfile
      echo "The memory is too less." >>$logfile
      free -m >>$logfile
      echo "=======================Memory info=====================" >>$logfile
      (ps aux|head -1;ps aux|sort -nrk6|grep -v "RSS") >>$logfile
      date >>$logfile
      echo "=======================Dmesg info=====================" >>$logfile
      dmesg >>$logfile
      dmesg -c
    elif [[ $check_cpu -eq 1  ]]
    then
      echo "======================================================" >>$logfile
      echo "The idle cpu is too less." >>$logfile
      echo "=======================CPU info========================" >>$logfile
      (ps aux|head -1;ps aux|sort -nrk3|grep -v "RSS") >>$logfiles
      echo "=======================Dmesg info=====================" >>$logfile
      dmesg >>$logfile
      dmesg -c
    fi
    sleep 10
  done
}

debian_fun()
{
  while true
  do
    vm_mem=$(free -m|grep "buffers/cache"|awk ‘{print $4}‘)
    cpu=$(top -bn2|grep "Cpu(s)"|awk ‘{print $8}‘|awk -F‘%‘ ‘{print $1}‘|tail -n1)
    check_cpu=$(echo "$cpu <20" |bc)
    echo "======================================================" >>$logfile
    date >>$logfile
    if [[ $vm_mem -le 100 ]]
    then
      echo "======================================================" >>$logfile
      echo "The memory is too less." >>$logfile
      free -m >>$logfile
      echo "=======================Memory info=====================" >>$logfile
      (ps aux|head -1;ps aux|sort -nrk6|grep -v "RSS") >>$logfile
      date >>$logfile
      echo "=======================Dmesg info=====================" >>$logfile
      dmesg >>$logfile
      dmesg -c
    elif [[ $check_cpu -eq 1  ]]
    then
      echo "======================================================" >>$logfile
      echo "The idle cpu is too less." >>$logfile
      echo "=======================CPU info========================" >>$logfile
      (ps aux|head -1;ps aux|sort -nrk3|grep -v "RSS") >>$logfile
      echo "=======================Dmesg info=====================" >>$logfile
      dmesg >>$logfile
      dmesg -c
    fi
    sleep 10
  done
}

check_os_release

case "$os_release" in
aliyun5|centos5|centos6|aliyun6)
  yum install bc -y
  rhel56_fun
  ;;
centos7)
  yum install bc -y
  rhel7_fun
  ;;
ubuntu10|ubuntu1204|ubuntu1210|ubuntu1404|debian6|debian7)
  apt-get install bc -y
  debian_fun
  ;;
opensuse1301)
  echo "Can not support openSUSE."
  exit 1
  ;;
*)
  echo "Unknow OS system."
  exit 1
  ;;
esac

get_network_info.bat

该脚本适用于windows系统。会每5秒钟对目标地址进行ping检测，有丢包或不通时会搜集用户本地网络配置信息、路由表、ARP表并进行traceroute。这些信息都记录到脚本当前目录下的checknet.log文件里。

@rem this batch script to collect network information for analysis.
@rem version 2.0 time:2014-5-20

color 1f
set log=checknet.log
Set tm1=%time:~0,2%
Set tm2=%time:~3,2%
Set tm3=%time:~6,2%

set /p destip=目标IP地址:

:check_ping
@rem Get the client network infomation.
echo %date% %tm1%点%tm2%分%tm3%秒 >>%log%
echo —————————————————ping infomation————————————————————>>%log%
ping -n 10 -w 1 %destip% >>%log%
if %ERRORLEVEL% NEQ 0  goto check_trace
echo —————————————————interface infomation————————————————————>>%log%
ipconfig /all >>%log%
echo —————————————————route infomation————————————————————>>%log%
netstat -rn >>%log%
echo —————————————————arp infomation————————————————————>>%log%
arp -a >>%log%

:check_trace
echo —————————————————trace route infomation————————————————————>>%log%
tracert -d -w 2000 %destip% >>%log%

ping -n 5 127.0.0.1>nul

goto check_ping

check_destination_port.sh

该脚本适用于linux系统。该脚本每5秒检查目标地址端口可用性，当无法连接的时候搜集网络连接情况、路由探测信息和dmesg信息并保存到日志里。日志名称和位置:/tmp/check_destination_port.sh.log。

#!/bin/bash
#This script collect network information and check the destination port.
#Version 1.0 time:2014-3-11

logfile=/tmp/$0.log
dmesg_file1=/tmp/1
dmesg_file2=/tmp/2

read -p "Input the destination IP or URL: " ip
read -p "Input the destination PORT: " port

get_dmesg()
{
  echo "===================dmessages info==============================" >>$logfile
  dmesg >$dmesg_file2
  diff $dmesg_file1 $dmesg_file2 >>$logfile
  cat $dmesg_file2 >$dmesg_file1
}

dmesg -c
dmesg >$dmesg_file1

while true
do
if [ "X$ip" == "X" ] || [ "X$port" == "X" ]
then
  echo "Error:The IP or URL or PORT is not define.Will exit."
  exit 1
else
  echo "===================port info==============================" >>$logfile
  date >>$logfile
  nc -vzw 2 $ip $port >>$logfile
  if [ "$?" -ne 0 ]
  then
    get_dmesg
    echo "===================network connection info==============================" >>$logfile
    (netstat -antlp >>$logfile)
    echo "===================trace route info==============================" >>$logfile
    (traceroute -Tnp $port $ip >>$logfile)
  else
    sleep 5
  fi
fi
done

windows2003_drop_port.bat

该脚本适用于windows 2003系统，主要用于在云服务器被肉鸡后禁止对外攻击，留出时间进行分析和修复。该脚本将禁止对外发送UDP数据包和禁止对TCP的22、80、443、1314、3306、3433、3389、8080端口发送数据包。

@rem 配置windows2003系统的IP安全策略
@rem version 3.0 time:2014-5-12

netsh ipsec static add policy name=drop
netsh ipsec static add filterlist name=drop_port
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=21 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=22 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=23 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=25 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=53 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=80 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=135 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=139 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=443 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=445 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=1314 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=1433 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=1521 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=2222 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=3306 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=3433 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=3389 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=4899 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=8080 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any dstport=18186 protocol=TCP mirrored=no
netsh ipsec static add filter filterlist=drop_port srcaddr=me dstaddr=any protocol=UDP mirrored=no
netsh ipsec static add filteraction name=denyact action=block
netsh ipsec static add rule name=kill policy=drop filterlist=drop_port filteraction=denyact
netsh ipsec static set policy name=drop assign=y

windows2008_drop_port.bat

该脚本适用于windows 2008系统，主要用于在云服务器被肉鸡后禁止对外攻击，留出时间进行分析和修复。该脚本将禁止对外发送UDP数据包和禁止对TCP的22、80、443、1314、3306、3433、3389、8080端口发送数据包。

@rem 配置windows2008系统的IP安全策略
@rem version 3.0 time:2014-5-12

@rem 重置防火墙使用默认规则
netsh firewall reset
netsh firewall set service remotedesktop enable all

@rem 配置高级windows防火墙
netsh advfirewall firewall add rule name="drop" protocol=TCP dir=out remoteport="21,22,23,25,53,80,135,139,443,445,1433,1314,1521,2222,3306,3433,3389,4899,8080,18186" action=block
netsh advfirewall firewall add rule name="dropudp" protocol=UDP dir=out remoteport=any action=block

linux_drop_port.sh

该脚本适用于linux系统，主要用于在云服务器被肉鸡后禁止对外攻击，留出时间进行分析和修复。该脚本将禁止对外发送UDP数据包和禁止对TCP的22、80、443、1314、3306、3433、3389、8080端口发送数据包。

#!/bin/bash
#########################################
#Function:    linux drop port
#Usage:       bash linux_drop_port.sh
#Author:      Customer Service Department
#Company:     Alibaba Cloud Computing
#Version:     2.0
#########################################

check_os_release()
{
  while true
  do
    os_release=$(grep "Red Hat Enterprise Linux Server release" /etc/issue 2>/dev/null)
    os_release_2=$(grep "Red Hat Enterprise Linux Server release" /etc/redhat-release 2>/dev/null)
    if [ "$os_release" ] && [ "$os_release_2" ]
    then
      if echo "$os_release"|grep "release 5" >/dev/null 2>&1
      then
        os_release=redhat5
        echo "$os_release"
      elif echo "$os_release"|grep "release 6" >/dev/null 2>&1
      then
        os_release=redhat6
        echo "$os_release"
      else
        os_release=""
        echo "$os_release"
      fi
      break
    fi
    os_release=$(grep "Aliyun Linux release" /etc/issue 2>/dev/null)
    os_release_2=$(grep "Aliyun Linux release" /etc/aliyun-release 2>/dev/null)
    if [ "$os_release" ] && [ "$os_release_2" ]
    then
      if echo "$os_release"|grep "release 5" >/dev/null 2>&1
      then
        os_release=aliyun5
        echo "$os_release"
      elif echo "$os_release"|grep "release 6" >/dev/null 2>&1
      then
        os_release=aliyun6
        echo "$os_release"
      else
        os_release=""
        echo "$os_release"
      fi
      break
    fi
    os_release=$(grep "CentOS release" /etc/issue 2>/dev/null)
    os_release_2=$(grep "CentOS release" /etc/*release 2>/dev/null)
    if [ "$os_release" ] && [ "$os_release_2" ]
    then
      if echo "$os_release"|grep "release 5" >/dev/null 2>&1
      then
        os_release=centos5
        echo "$os_release"
      elif echo "$os_release"|grep "release 6" >/dev/null 2>&1
      then
        os_release=centos6
        echo "$os_release"
      else
        os_release=""
        echo "$os_release"
      fi
      break
    fi
    os_release=$(grep -i "ubuntu" /etc/issue 2>/dev/null)
    os_release_2=$(grep -i "ubuntu" /etc/lsb-release 2>/dev/null)
    if [ "$os_release" ] && [ "$os_release_2" ]
    then
      if echo "$os_release"|grep "Ubuntu 10" >/dev/null 2>&1
      then
        os_release=ubuntu10
        echo "$os_release"
      elif echo "$os_release"|grep "Ubuntu 12.04" >/dev/null 2>&1
      then
        os_release=ubuntu1204
        echo "$os_release"
      elif echo "$os_release"|grep "Ubuntu 12.10" >/dev/null 2>&1
      then
        os_release=ubuntu1210
        echo "$os_release"
      else
        os_release=""
        echo "$os_release"
      fi
      break
    fi
    os_release=$(grep -i "debian" /etc/issue 2>/dev/null)
    os_release_2=$(grep -i "debian" /proc/version 2>/dev/null)
    if [ "$os_release" ] && [ "$os_release_2" ]
    then
      if echo "$os_release"|grep "Linux 6" >/dev/null 2>&1
      then
        os_release=debian6
        echo "$os_release"
      else
        os_release=""
        echo "$os_release"
      fi
      break
    fi
    os_release=$(grep "openSUSE" /etc/issue 2>/dev/null)
    os_release_2=$(grep "openSUSE" /etc/*release 2>/dev/null)
    if [ "$os_release" ] && [ "$os_release_2" ]
    then
      if echo "$os_release"|grep "13.1" >/dev/null 2>&1
      then
        os_release=opensuse131
        echo "$os_release"
      else
        os_release=""
        echo "$os_release"
      fi
      break
    fi
    break
    done
}

exit_script()
{
  echo -e "\033[1;40;31mInstall $1 error,will exit.\n\033[0m"
  rm -f $LOCKfile
  exit 1
}

config_iptables()
{
  iptables -I OUTPUT 1 -p tcp -m multiport --dport 21,22,23,25,53,80,135,139,443,445 -j DROP
  iptables -I OUTPUT 2 -p tcp -m multiport --dport 1433,1314,1521,2222,3306,3433,3389,4899,8080,18186 -j DROP
  iptables -I OUTPUT 3 -p udp -j DROP
  iptables -nvL
}

ubuntu_config_ufw()
{
  ufw deny out proto tcp to any port 21,22,23,25,53,80,135,139,443,445
  ufw deny out proto tcp to any port 1433,1314,1521,2222,3306,3433,3389,4899,8080,18186
  ufw deny out proto udp to any
  ufw status
}

####################Start###################
#check lock file ,one time only let the script run one time
LOCKfile=/tmp/.$(basename $0)
if [ -f "$LOCKfile" ]
then
  echo -e "\033[1;40;31mThe script is already exist,please next time to run this script.\n\033[0m"
  exit
else
  echo -e "\033[40;32mStep 1.No lock file,begin to create lock file and continue.\n\033[40;37m"
  touch $LOCKfile
fi

#check user
if [ $(id -u) != "0" ]
then
  echo -e "\033[1;40;31mError: You must be root to run this script, please use root to execute this script.\n\033[0m"
  rm -f $LOCKfile
  exit 1
fi

echo -e "\033[40;32mStep 2.Begen to check the OS issue.\n\033[40;37m"
os_release=$(check_os_release)
if [ "X$os_release" == "X" ]
then
  echo -e "\033[1;40;31mThe OS does not identify,So this script is not executede.\n\033[0m"
  rm -f $LOCKfile
  exit 0
else
  echo -e "\033[40;32mThis OS is $os_release.\n\033[40;37m"
fi

echo -e "\033[40;32mStep 3.Begen to config firewall.\n\033[40;37m"
case "$os_release" in
redhat5|centos5|redhat6|centos6|aliyun5|aliyun6)
  service iptables start
  config_iptables
  ;;
debian6)
  config_iptables
  ;;
ubuntu10|ubuntu1204|ubuntu1210)
  ufw enable <<EOF
y
EOF
  ubuntu_config_ufw
  ;;
opensuse131)
  config_iptables
  ;;
esac

echo -e "\033[40;32mConfig firewall success,this script now exit!\n\033[40;37m"
rm -f $LOCKfile

weblogcheckutf8.sh & weblogcheckgbk.sh

该脚本适用于linux系统，用于分析web日志信息，详细用法见下面链接里的说明文档《web日志分析脚本.docx》，脚本分为utf8和gbk编码。

#!/bin/bash
############################################
# web日志分析脚本
#
#2013-12-30 by 金象
#version:1.0
#使用方法：
#./weblogcheck.sh [-c n] [-t n] -f FILE
#
#选项说明：
#-c(选填):设置IP、资源TOP榜显示量，默认显示前5名，参数需填写整数
#-t(选填):设置日志统计时段，默认统计最后6个时段，参数需填写整数
#-f(必填):指定日志文件，如果脚本与日志文件不在同一目录需填写绝对路径
#例：
#./weblogcheck.sh -f /alidata/log/httpd/access/phpwind.log
#./weblogcheck.sh -c 3 -t 3 -f /alidata/log/httpd/access/phpwind.log
############################################

##使用帮助
usage()
{
    echo -e "\nUsage:\n$0 [-c n] [-t n] -f FILE\n"
    echo -e "选项说明:"
    echo -e "-c(选填):设置IP、资源TOP榜显示量，默认显示前5名，参数需填写整数"
    echo -e "-t(选填):设置日志统计时段，默认统计最后6个时段，参数需填写整数"
    echo -e "-f(必填):指定日志文件，如果脚本与日志文件不在同一目录需填写绝对路径"
    echo -e "\n例：\n$0 -f /alidata/log/httpd/access/phpwind.log"
    echo -e "或：\n$0 -c 3 -t 3 -f /alidata/log/httpd/access/phpwind.log\n"
    exit
}
##华丽的分割线
split_line="--------------------------------------------------"
clear
##审核选项
while getopts ":hc:t:f:" script_opt
do
    case ${script_opt} in
        h)
        time_hz=half
        ;;
        c)
        if [[ ${OPTARG} =~ ^[1-9][0-9]*$ ]];then
            ip_row=${OPTARG}
        else
            echo -e "\033[31mErr: -c选项请填写整数TOP榜显示行\033[0m"
            usage
        fi
        ;;
        t)
        if [[ ${OPTARG} =~ ^[1-9][0-9]*$ ]];then
            log_time=${OPTARG}
        else
            echo -e "\033[31mErr: -t选项请填写整数时段\033[0m"
            usage
        fi
        ;;
        f)
        if [ -e "${OPTARG}" ];then
            log_path=${OPTARG}
        else
            echo -e "\033[31mErr: ${OPTARG}日志文件不存在，请核实！\033[0m"
            usage
        fi
        ;;
        :)
        echo -e "\033[31mErr: -${OPTARG}选项缺少参数，请核实！\033[0m"
        usage
        ;;
        ?)
        echo -e "\033[31mErr: 无法识别的选项，请核实！\033[0m"
        usage
        ;;
    esac
done
##检测日志文件是否可用
if [ -z "${log_path}" ];then
    echo -e "\033[31mErr: 请填写日志路径\033[0m"
    usage
fi
##检测日志文件大小
log_size=$(du -m "${log_path}"|awk ‘{print $1}‘)
if [ "${log_size}" -gt 50 ];then
    echo -e "日志文件:${log_path}\t大小:${log_size}MB\n日志文件体积较大，分析时间较长，是否继续?"
    read -p"yes[y] or no[n]:" -n 1 check_size
    if [ "${check_size}" = "y" ];then
    echo -e "\n正在分析，请稍等..."
    else
    echo -e "\n终止日志分析"
    exit
    fi
elif [ "${log_size}" -eq 0 ];then
    echo -e "日志文件:${log_path}\t大小:${log_size}MB\n\033[31m日志文件为空，请选择其他日志\033[0m"
    usage
fi
##设置时间分隔点
time_mark=$(awk ‘{print $4}‘ "${log_path}"|cut -c 2-16|uniq|tail -n ${log_time:-6})
##日志分析
for mark in ${time_mark}
do
    time_format=$(echo $mark|awk ‘BEGIN {FS="[/|:]"} {print $3"/"$2"/"$1"\t"$4":00-"$4":59"}‘)
    net_size=$(grep $mark "${log_path}"|awk ‘{if($10 ~ /[0-9]/) sum += $10} END {printf("%0.2f\n",sum/1024/1024)}‘)
    top_ip=$(grep $mark "${log_path}"| awk ‘{print $1}‘ |sort |uniq -c|sort -rn|head -n ${ip_row:-5})
    top_page=$(grep $mark "${log_path}"|awk ‘{if($10>0 )print $7}‘|sort|uniq -c|sort -rn|head -n ${ip_row:-5})
    echo -e "${split_line}\n${time_format}   本时段流量:${net_size} MB"
    echo -e "  次数 访问者IP"
    echo -e "${top_ip}"
    echo -e "  次数 访问资源"
    echo -e "${top_page}"
done

#!/bin/bash
############################################
# web日志分析脚本
#
#2013-12-30 by 金象
#version:1.0
#使用方法：
#./weblogcheck.sh [-c n] [-t n] -f FILE
#
#选项说明：
#-c(选填):设置IP、资源TOP榜显示量，默认显示前5名，参数需填写整数
#-t(选填):设置日志统计时段，默认统计最后6个时段，参数需填写整数
#-f(必填):指定日志文件，如果脚本与日志文件不在同一目录需填写绝对路径
#例：
#./weblogcheck.sh -f /alidata/log/httpd/access/phpwind.log
#./weblogcheck.sh -c 3 -t 3 -f /alidata/log/httpd/access/phpwind.log
############################################

##使用帮助
usage()
{
    echo -e "\nUsage:\n$0 [-c n] [-t n] -f FILE\n"
    echo -e "选项说明:"
    echo -e "-c(选填):设置IP、资源TOP榜显示量，默认显示前5名，参数需填写整数"
    echo -e "-t(选填):设置日志统计时段，默认统计最后6个时段，参数需填写整数"
    echo -e "-f(必填):指定日志文件，如果脚本与日志文件不在同一目录需填写绝对路径"
    echo -e "\n例：\n$0 -f /alidata/log/httpd/access/phpwind.log"
    echo -e "或：\n$0 -c 3 -t 3 -f /alidata/log/httpd/access/phpwind.log\n"
    exit
}
##华丽的分割线
split_line="--------------------------------------------------"
clear
##审核选项
while getopts ":hc:t:f:" script_opt
do
    case ${script_opt} in
        h)
        time_hz=half
        ;;
        c)
        if [[ ${OPTARG} =~ ^[1-9][0-9]*$ ]];then
            ip_row=${OPTARG}
        else
            echo -e "\033[31mErr: -c选项请填写整数TOP榜显示行\033[0m"
            usage
        fi
        ;;
        t)
        if [[ ${OPTARG} =~ ^[1-9][0-9]*$ ]];then
            log_time=${OPTARG}
        else
            echo -e "\033[31mErr: -t选项请填写整数时段\033[0m"
            usage
        fi
        ;;
        f)
        if [ -e "${OPTARG}" ];then
            log_path=${OPTARG}
        else
            echo -e "\033[31mErr: ${OPTARG}日志文件不存在，请核实！\033[0m"
            usage
        fi
        ;;
        :)
        echo -e "\033[31mErr: -${OPTARG}选项缺少参数，请核实！\033[0m"
        usage
        ;;
        ?)
        echo -e "\033[31mErr: 无法识别的选项，请核实！\033[0m"
        usage
        ;;
    esac
done
##检测日志文件是否可用
if [ -z "${log_path}" ];then
    echo -e "\033[31mErr: 请填写日志路径\033[0m"
    usage
fi
##检测日志文件大小
log_size=$(du -m "${log_path}"|awk ‘{print $1}‘)
if [ "${log_size}" -gt 50 ];then
    echo -e "日志文件:${log_path}\t大小:${log_size}MB\n日志文件体积较大，分析时间较长，是否继续?"
    read -p"yes[y] or no[n]:" -n 1 check_size
    if [ "${check_size}" = "y" ];then
    echo -e "\n正在分析，请稍等..."
    else
    echo -e "\n终止日志分析"
    exit
    fi
elif [ "${log_size}" -eq 0 ];then
    echo -e "日志文件:${log_path}\t大小:${log_size}MB\n\033[31m日志文件为空，请选择其他日志\033[0m"
    usage
fi
##设置时间分隔点
time_mark=$(awk ‘{print $4}‘ "${log_path}"|cut -c 2-16|uniq|tail -n ${log_time:-6})
##日志分析
for mark in ${time_mark}
do
    time_format=$(echo $mark|awk ‘BEGIN {FS="[/|:]"} {print $3"/"$2"/"$1"\t"$4":00-"$4":59"}‘)
    net_size=$(grep $mark "${log_path}"|awk ‘{if($10 ~ /[0-9]/) sum += $10} END {printf("%0.2f\n",sum/1024/1024)}‘)
    top_ip=$(grep $mark "${log_path}"| awk ‘{print $1}‘ |sort |uniq -c|sort -rn|head -n ${ip_row:-5})
    top_page=$(grep $mark "${log_path}"|awk ‘{if($10>0 )print $7}‘|sort|uniq -c|sort -rn|head -n ${ip_row:-5})
    echo -e "${split_line}\n${time_format}   本时段流量:${net_size} MB"
    echo -e "  次数 访问者IP"
    echo -e "${top_ip}"
    echo -e "  次数 访问资源"
    echo -e "${top_page}"
done

config_ntpclient.bat

该脚本适用于windows系统，将ntp时钟服务器配置为阿里云内部时钟源并将同步频率改为300秒。

@rem This batch script to config ntpclient.

@rem version 1.0 time:2014-6-5

@echo off

REG ADD HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\W32Time\TimeProviders\NtpClient /v SpecialPollInterval /t REG_DWORD /d 300 /f

w32tm /config /manualpeerlist:"ntp1.aliyun.com,0x1 ntp2.aliyun.com,0x1 ntp3.aliyun.com,0x1" /syncfromflags:manual /reliable:yes  /update

net stop w32time

net start w32time

转自：http://www.hellyhua.com/xuexi/server/893.html

时间： 2024-10-21 23:40:22

服务器常用工具说明[转]的相关文章

2015第30周三Spring常用工具类

文件资源操作 文件资源的操作是应用程序中常见的功能,如当上传一个文件后将其保存在特定目录下,从指定地址加载一个配置文件等等.我们一般使用 JDK 的 I/O 处理类完成这些操作,但对于一般的应用程序来说,JDK 的这些操作类所提供的方法过于底层,直接使用它们进行文件操作不但程序编写复杂而且容易产生错误.相比于 JDK 的 File,Spring 的 Resource 接口(资源概念的描述接口)抽象层面更高且涵盖面更广,Spring 提供了许多方便易用的资源操作工具类,它们大大降低资源操作的复杂度

测试工作中常用工具介绍

测试工作中的常用工具总结 SwitchHosts 这个软件可以存储多个Hosts配置方案并配有切换方案功能,以方便在测试的过程中,应对不同的测试环境实现自由切换Hosts方案的功效. OpenVPN 对于数据库的操作是建立在远程的基础上的,所以在公用网络上建立专用网络成了必要.OpenVPN GUI可以通过用户名和密码让用户连接到专用的VPN网络上,从而让用户远程访问服务器端应用成为可能. SecureCRT 用来连接服务器的虚拟终端,可以模拟远程服务器端的终端在对服务器进行操作,比如查看测试日

转 常用工具和技术

技术站点 Hacker News:非常棒的针对编程的链接聚合网站 Programming reddit:同上 MSDN:微软相关的官方技术集中地,主要是文档类 infoq:企业级应用,关注软件开发领域 OSChina:开源技术社区,开源方面做的不错哦 cnblogs,51cto,csdn:常见的技术社区,各有专长 stackoverflow:IT技术问答网站 GitHub:全球最大的源代码管理平台,很多知名开源项目都在上面,如Linux内核, OpenStack等免费的it电子书:http://

[C#] 常用工具类——文件操作类

/// <para> FilesUpload:工具方法:ASP.NET上传文件的方法</para> /// <para> FileExists:返回文件是否存在</para> /// <para> IsImgFilename:判断文件名是否为浏览器可以直接显示的图片文件名</para> /// <para> CopyFiles:复制指定目录的所有文件</para> /// <para> MoveFi

Python第三方常用工具、库、框架等

Python ImagingLibrary(PIL):它提供强大的图形处理的能力,并提供广泛的图形文件格式支持,该库能进行图形格式的转换.打印和显示.还能进行一些图形效果的处理,如图形的放大.缩小和旋转等.是用户进行图象处理的强有力工具. http://www.pythonware.com/products/pil/ matplotlib:一个Python的2D绘图库. http://matplotlib.org/ Pmw(Pythonmegawidgets):它是超级GUI组件集----一个利

服务器常用端口号

代理服务器常用以下端口: (1). HTTP协议代理服务器常用端口号:80/8080/3128/8081/9080 (2). SOCKS代理协议服务器常用端口号:1080 (3). FTP(文件传输)协议代理服务器常用端口号:21 (4). Telnet(远程登录)协议代理服务器常用端口:23 HTTP服务器,默认的端口号为80/tcp(木马Executor开放此端口): HTTPS(securely transferring web pages)服务器,默认的端口号为443/tcp 443/u

常用工具之zabbix

简介 zabbix(音同 z?bix)是一个基于WEB界面的提供分布式系统监视以及网 络监视功能的企业级的开源解决方案. zabbix能监视各种网络参数,保证服务器系统的安全运营:并提供灵活的通知机制以让系统管理员快速定位/解决存在的各种问题. zabbix由2部分构成,zabbix server与可选组件zabbix agent. zabbix server可以通过SNMP,zabbix agent,ping,端口监视等方法提供对远程服务器/网络状态的监视,数据收集等功能,它可以运行在Linu

Java常用工具类集合

数据库连接工具类 仅仅获得连接对象 ConnDB.java package com.util; import java.sql.Connection; import java.sql.DriverManager; /** * 数据库连接工具类——仅仅获得连接对象 * */ public class ConnDB { private static Connection conn = null; private static final String DRIVER_NAME = "com.mysql

服务器必备工具软件推荐

对于经验丰富的网站管理员来说,选用何种软件工具已经不是什么难题,但对一些经验尚浅的管理员而言,选用何种工具就显得非常重要.如何能从成百上千 的工具类软件中筛选出最合适的,无疑有很多方面的考虑.下面小编就给大家推荐一些老管理员经过层层筛选遴选出的十款服务器必备工具软件,供大家参考和分 享,这十款软件可以说是服务器必备之软件了,基本涵盖了服务器维护的各个方面. 1.远程桌面连接 Remote Desktop - 远程桌面连接(以前称为“终端服务客户端”)主要是用于对远程托管的服务器进行远程管理,使用