Jstorm-------storm.yaml配置

之前把Jstorm配置好了，发现本地模式下面可以执行，但是，我想在集群模式下面执行的时候，老是报没有活的nimbus，仔细看书，终于知道在运行集群模式之前，要启动nimbus进程和supervisor进程，就是在nimbus节点上执行 jstorm nimbus命令就可以，然后在supervisor节点上执行 jstorm supervisor命令就可以了。然后提交jar包运行就可以了。下面来讲讲storm.yaml配置文件里面如何配置。

storm.yaml参数文件

下面是我的jstorm里面的配置文件内容:

########### These MUST be filled in for a storm configuration

storm.zookeeper.servers:

- “192.168.2.191”

- “192.168.2.169”

- “192.168.2.170”

storm.zookeeper.root: “/jstorm”#cluster.name: “default”

###nimbus.host/nimbus.host.start.supervisor is being used by $JSTORM_HOME/bin/start.sh

#it only support IP, please don’t set hostname

# For example

# nimbus.host: “10.132.168.10, 10.132.168.45”

nimbus.host: “192.168.2.191”

#nimbus.host.start.supervisor: false

#%JSTORM_HOME% is the jstorm home directory

storm.local.dir: “%JSTORM_HOME%/data”

# please set absolute path, default path is JSTORM_HOME/logs

# jstorm.log.dir: “absolute path”

# java.library.path: “/usr/local/lib:/opt/local/lib:/usr/lib”

#if supervisor.slots.ports is null, # the port list will be generated by cpu cores and system memory size

# for example,

# there are cpu_num = system_physical_cpu_num/supervisor.slots.port.cpu.weight

# there are mem_num = system_physical_memory_size/(worker.memory.size * supervisor.slots.port.mem.weight)

# The final port number is min(cpu_num, mem_num)

# supervisor.slots.ports.base: 6800

# supervisor.slots.port.cpu.weight: 1.2# supervisor.slots.port.mem.weight: 0.7

# supervisor.slots.ports: null

supervisor.slots.ports:

- 6800

- 6801

- 6802

- 6803

# Default disable user-define classloader

# If there are jar conflict between jstorm and application,

# please enable it

# topology.enable.classloader: false

# enable supervisor use cgroup to make resource isolation

# Before enable it, you should make sure:

# 1. Linux version (>= 2.6.18)

# 2. Have installed cgroup (check the file’s existence:/proc/cgroups)

# 3. You should start your supervisor on root

# You can get more about cgroup:

# http://t.cn/8s7nexU

# supervisor.enable.cgroup: false

### Netty will send multiple messages in one batch

### Setting true will improve throughput, but more latency

# storm.messaging.netty.transfer.async.batch: true

### if this setting is true, it will use disruptor as internal queue, which size is limited

### otherwise, it will use LinkedBlockingDeque as internal queue , which size is unlimited

### generally when this setting is true, the topology will be more stable,

### but when there is a data loop flow, for example A -> B -> C -> A

### and the data flow occur blocking, please set this as false

# topology.buffer.size.limited: true

### default worker memory size, unit is byte

# worker.memory.size: 2147483648

# Metrics Monitor

# topology.performance.metrics: it is the switch flag for performance

# purpose. When it is disabled, the data of timer and histogram metrics

# will not be collected.

# topology.alimonitor.metrics.post: If it is disable, metrics data

# will only be printed to log. If it is enabled, the metrics data will be

# posted to alimonitor besides printing to log.

# topology.performance.metrics: true

# topology.alimonitor.metrics.post: false

# UI MultiCluster

# Following is an example of multicluster UI configuration

ui.clusters:

- {

name: “jstorm.share”,

zkRoot: “/jstorm”,

zkServers:

[ “192.168.2.191”, “192.168.2.169”, “192.168.2.170”],

zkPort: 2181,

}

首先,我装了三个虚拟机，并且把他们的IP地址固定，分别是“192.168.2.191”, “192.168.2.169”, “192.168.2.170”.

storm.zookeeper.servers:就是配置节点信息

storm.zookeeper.root: 这个就直接使用默认配置即可，自己不用配置。

nimbus.host: 则是nimbus的主节点配置，我这里配置的是“192.168.2.191”作为nimbus节点。

storm.local.dir：这里我现在jstorm的文件夹里面建立了一个文件夹,data，然后进行配置

supervisor.slots.ports: 这里使用的直接是默认配置，把里面#去掉打开就行了。

ui.clusters:这里因为我用到了jstorm ui来显示信息，你配置的时候，只是改改地址就行了，把#去掉之后再改。

上面的配置好了之后，(UI部分选择性配置)，就可以运行jstorm程序了，不过你得在maven里面把代码写好，发布成jar包之后，提交运行。