您的位置:首页 > 编程语言 > Java开发

Ubuntu下HBase安装过程

2015-10-21 11:11 471 查看
一、安装需求安装java 1.7,Hadoop 1.2.1

ubuntu机上已安装Hadoop 1.2.1

此次安装的hbase版本为0.94.13。

安装成功并执行后,该虚拟机会有以下java进程:

NameNode

DataNode

SecondaryNameNode

TaskTracker

JobTracker

HMaster (hbase)

HRegionServer (hbase)

HQuorumPeer(hbase)

二、安装hbase

1、下载hbase

wget http://archive.apache.org/dist/hbase/hbase-0.94.13//hbase-0.94.13-security.tar.gz

其他版本下载地址(最好使用stable版本): http://mirror.tcpdiag.net/apache/hbase/

2、解压

tar -zxvf hbase-0.94.13-security.tar.gz


将解压后的hbase-0.94.13-security文件放在系统的/home/hadoop/中。

3、修改配置hbase的安装是基于hdfs的,hbase的配置主要涉及conf目录下的三个文件:hbase-env.sh,hbase-site.xml,regionservers。

①修改hbase-env.sh

#必修配置的地方为:

export JAVA_HOME=/home/java/jdk1.7.0_79

export HBASE_CLASSPATH=/home/hadoop/hadoop-1.2.1/conf

export HBASE_OPTS=”-XX:+UseConcMarkSweepGC”

export HBASE_MANAGES_ZK=true


其中,JAVA_HOME为java安装路径,HBASE_CLASSPATH为Hadoop安装路径。

②修改hbase-site.xml

修改其内容为:

<?xml version=”1.0″?>

<?xml-stylesheet type=”text/xsl” href=”configuration.xsl”?>

<configuration>
<property>

<name>hbase.rootdir</name>

<value>hdfs://127.0.0.1:9000/hbase</value>

<description>The directory shared by region servers.</description>

</property>

<property>

<name>hbase.master.port</name>

<value>60000</value>

</property>

<property>

<name>hbase.cluster.distributed</name>

<value>true</value>

</property>

<property>

<name>hbase.zookeeper.property.dataDir</name>

<value>/home/hadoop/data/zookeeperdir/zookeeper-data</value>

</property>

<property>

<name>hbase.zookeeper.property.clientPort</name>

<value>2181</value>

</property>

<property>

<name>hbase.zookeeper.quorum</name>

<value>127.0.0.1</value>

</property>
</configuration>


其中,hbase.rootdir这一项的配置必须与hdfs的fs.name.default项一致,还要为hbase指定根目录/hbase。hbase.zookeeper.property.dataDir属性来把ZooKeeper保存数据的目录地址改掉,默认值是/tmp (重启的时候会被操作系统删掉)。hbase.zookeeper.quorum指定了所有的zookeeper,此处的值为localhost(127.0.0.1),其已经在/etc/hosts文件中映射为127.0.0.1(本机),如果想指定多个zookeeper,可在此项中用逗号将不同的zookeeper隔开。

③修改regionservers

文件原先为空,在其中加入:

localhost

localhost已在/etc/hosts中映射为127.0.0.1。如果有多个regionserver,可继续添加regionserver,每行填写一个。

④为方便使用启动脚本,在/etc/profile中设置环境变量

在/etc/profile中添加以下内容:

export HBASE_HOME=/home/hadoop/hbase-0.94.13-security

PATH=$HBASE_HOME/bin:$PATH

export PATH


⑤配置完毕。若配置多台机器,可将此次配置的hbase目录拷贝到其他机器的相同目录下。当然,/etc/hosts也要做相应的改动。

三、启动并测试hbase

1、启动hbase

需要先启动hadoop,要不hbase某些进程会启动不了。

查看一些文档得知,直接执行./start-hbase.sh可先启动zookeeper,再启动master,最后启动regionserver。

root@xiehang-virtual-machine:/home/hadoop/hbase-0.94.13-security/bin# ./start-hbase.sh

127.0.0.1: starting zookeeper, logging to /home/hadoop/hbase-0.94.13-security/bin/../logs/hbase-root-zookeeper-xiehang-virtual-machine.out

starting master, logging to /home/hadoop/hbase-0.94.13-security/logs/hbase-root-master-xiehang-virtual-machine.out

localhost: starting regionserver, logging to /home/hadoop/hbase-0.94.13-security/bin/../logs/hbase-root-regionserver-xiehang-virtual-machine.out


2、输入jps命令查看进程

19835 TaskTracker

19439 DataNode

19585 SecondaryNameNode

19058 HRegionServer

19655 JobTracker

20417 Jps

18852 HQuorumPeer

19293 NameNode

20247 HMaster

3、测试hbase

①执行hbase shell进入hbase

root@xiehang-virtual-machine:/home/hadoop/hbase-0.94.13-security/bin# ./hbase shell

HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.94.13, r1536939, Wed Oct 30 04:26:25 UTC 2013

hbase(main):001:0>


②测试创建表的功能

0 row(s) in 2.9830 seconds

hbase(main):002:0> list ‘test’

TABLE

test

1 row(s) in 0.2440 seconds

hbase(main):003:0> put ‘test’, ‘row1′, ‘cf:a’, ‘value1′

0 row(s) in 1.2880 seconds

hbase(main):004:0> put ‘test’, ‘row2′, ‘cf:b’, ‘value2′

0 row(s) in 0.0400 seconds

hbase(main):005:0> put ‘test’, ‘row3′, ‘cf:c’, ‘value3′

0 row(s) in 0.0330 seconds

hbase(main):006:0> scan ‘test’

ROW                   COLUMN+CELL

row1                 column=cf:a, timestamp=1331369650710, value=value1

row2                 column=cf:b, timestamp=1331369678008, value=value2

row3                 column=cf:c, timestamp=1331369689414, value=value3

3 row(s) in 0.2880 seconds

hbase(main):007:0> get ‘test’, ‘row1′

COLUMN                CELL

cf:a                 timestamp=1331369650710, value=value1

1 row(s) in 0.1670 seconds

hbase(main):008:0> drop ‘test’

ERROR: Table test is enabled. Disable it first.’

Here is some help for this command:

Drop the named table. Table must first be disabled. If table has

more than one region, run a major compaction on .META.:

hbase> major_compact “.META.”

hbase(main):009:0> disable ‘test’

0 row(s) in 2.5160 seconds

hbase(main):010:0> drop ‘test’

0 row(s) in 1.8860 seconds

hbase(main):011:0> exit


4、停止hbase

执行stop-hbase.sh:

root@xiehang-virtual-machine:/home/hadoop/hbase-0.94.13-security/bin# ./stop-hbase.sh

stopping hbase………….
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签:  ubuntu hbase hadoop java