Hadoop CLI MiniCluster
2013-08-20 20:14
260 查看
CLI MiniCluster
Use the climonicluster, users can simply start and stop a single-node hadoop cluster witha single command, and without the need to set any environment variables ormanage configuration files. The cli monicluster starts both a mapreduce and hdfclusters. This is useful cases where users want to quickly experiment with areal hadoop cluyster or test non-java programs that rely on significant hadoopfunctionality.From inside theroot directory of the extracted tarball, you can tsrat the cli miniclusterusing the following command:
$ bin/hadoop jarhadoop-test-*.jar minicluster -jtport JT_PORT -nnport NN_PORT
In the example command above,JT_PORT and NN_PORT should be replaced by the user's choice of these portnumbers. If not specified, random free ports will be used.
$ bin/hadoop jarhadoop-test-*.jar minicluster -jtport JT_PORT -nnport NN_PORT
Unknown program'minicluster' chosen.
Valid program namesare:
DFSCIOTest: Distributed i/o benchmark oflibhdfs.
DistributedFSCheck: Distributed checkup ofthe file system consistency.
MRReliabilityTest: A program that tests thereliability of the MR framework by injecting faults/failures
TestDFSIO: Distributed i/o benchmark.
dfsthroughput: measure hdfs throughput
filebench: BenchmarkSequenceFile(Input|Output)Format (block,record compressed and uncompressed),Text(Input|Output)Format (compressed and uncompressed)
loadgen: Generic map/reduce load generator
mapredtest: A map/reduce test check.
mrbench: A map/reduce benchmark that cancreate many small jobs
nnbench: A benchmark that stresses thenamenode.
testarrayfile: A test for flat files ofbinary key/value pairs.
testbigmapoutput: A map/reduce program thatworks on a very big non-splittable file and does identity map/reduce
testfilesystem: A test for FileSystemread/write.
testipc: A test for ipc.
testmapredsort: A map/reduce program thatvalidates the map-reduce framework's sort.
testrpc: A test for rpc.
testsequencefile: A test for flat files ofbinary key value pairs.
testsequencefileinputformat: A test forsequence file input format.
testsetfile: A test for flat files of binarykey/value pairs.
testtextinputformat: A test for text inputformat.
threadedmapbench: A map/reduce benchmark thatcompares the performance of maps with multiple spills over maps with 1 spill
相关文章推荐
- Hadoop MapReduce Next Generation - CLI MiniCluster.
- Hadoop-2.2.0中文文档—— Common - CLI MiniCluster
- hadoop2.7.2学习笔记06-CLI MiniCluster
- Hadoop-2.2.0中文文档—— Common - CLI MiniCluster
- Hadoop-2.2.0中文文档—— Common - CLI MiniCluster
- Hadoop CLI MiniCluster
- hadoop CLI MiniCluster
- CLI Mini Cluster
- Common - CLI MiniCluster
- Hadoop Cluster Report File(11 DataNodes)
- Hadoop笔记五之--clusterID INcompatible(不相容)
- Hadoop Cluster 启动分析
- org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://mycluster/output alread
- How-to: transfer hbase data between two hadoop cluster
- CentOS6.4安装Hadoop2.0.5 alpha - Single Node Cluster
- hadoop 2.2.0 cluster setup-linux
- Untangling Apache Hadoop YARN, Part 1: Cluster and YARN Basics
- Windows下Eclipse提交MR程序到HadoopCluster
- hadoop 第二节 单节点集群配置 Setting up a Single Node Cluster