GPFS在Linux下安装过程简述

1.安装GPFS包

#rpm –ivh *.rpm

(gpfs.base-3.1.0-1.x86_64,gpfs.docs-3.1.0-1.noarch,gpfs.gpl-3.1.0-1.noarch,gpfs.msg.en_US-3.1.0-1.noarch)

2. 安装GPFS升级包

rpm –Uvh *.rpm

(gpfs.base-3.1.0-8.x86_64,gpfs.docs-3.1.0-8.noarch,gpfs.gpl-3.1.0-8.noarch,gpfs.msg.en_US-3.1.0-8.noarch)

3. 编译

#cd /usr/lpp/mmfs/src/config

#cp site.mcr.proto site.mcr

#vi site.mcr

参考 README 修改site.mcr

#cd /usr/lpp/mmfs/src

#export SHARKCLONEROOT=/usr/lpp/mmfs/src

#make Autoconfig

#make InstallImages

#cd /usr/lpp/mmfs/bin

/* Copy bin files to all the other nodes */

4. 系统优化：

mmchconfig pagepool=1000M （4M－1/2内存总量）

mmchconfig maxFilesToCache ＝1700（default,1-100000）

maxStatCache (4 × maxFilesToCache )

Aggregate network interfaces

Swap space (2 x total of mem)

updatedb considerations (skip gpfs) important

Suggested starting points are:

mmchconfig prefetchThreads=18

mmchconfig worker1Threads=24

Verify /proc/sys/net/ipv4/tcp_window_scaling is enabled. It should be by default.

Tune the TCP window settings by adding these lines to the /etc/sysctl.conf file:

# increase Linux TCP buffer limits

net.core.rmem_max = 8388608

net.core.wmem_max = 8388608

# increase default and maximum Linux TCP buffer sizes

net.ipv4.tcp_rmem = 4096 262144 8388608

net.ipv4.tcp_wmem = 4096 262144 8388608

# increase max backlog to avoid dropped packets

net.core.netdev_max_backlog=2500

A. Issue the sysctl -p /etc/sysctl.conf command to set the kernel settings.

B. Issue the mmstartup -a command to restart GPFS

5 .创建GPFS集群

#/usr/lpp/mmfs/bin/mmcrcluster -t lc -p io1 -s io2 -n

/tmp/gpfs.nodes -r /usr/bin/ssh -R /usr/bin/scp

List the GPFS cluster details using:

#/usr/lpp/mmfs/bin/mmlscluster

6. 启动 GPFS

mmstartup -a

7. 磁盘定义

cat /tmp/gpfs.disks

/dev/sda:io1::dataAndMetadata:-1

/dev/sdb:io2::dataAndMetadata:-1

....

#cp /tmp/gpfs.disks /tmp/gpfs.disks.bak

#/usr/lpp/mmfs/bin/mmcrnsd -F /dump/gpfs.disks -v yes

#mmlsnsd

8.创建GPFS文件系统

# mmcrfs /gpfs1 gpfs1 -F /tmp/gpfs.disks1 -A yes

9.增加GPFS客户端

#mmaddnode -N node1

#mmaddnode -N node2