首页 > 其他 > 详细

Projects_System Administrator

时间:2016-02-01 09:32:15      阅读:153      评论:0      收藏:0      [点我收藏+]

Globus is a connected set of services for data management. It can be used for moving data between your local machine and the cluster. It is based on GridFTP.

Hadoop testing

TestDFSIO : Test how fast is your cluster in terms of I/O 

TeraSort: Basically, the goal of TeraSort is to sort 1TB of data (or any other amount of data you want) as fast as possible. It is a benchmark that combines testing the HDFS and MapReduce layers of an Hadoop cluster.

MRBenchMRBench (see src/test/org/apache/hadoop/mapred/MRBench.java) loops a small job a number of times. As such it is a very complimentary benchmark to the “large-scale” TeraSort benchmark suite because MRBench checks whether small job runs are responsive and running efficiently on your cluster. It puts its focus on the MapReduce layer as its impact on the HDFS layer is very limited.

Projects_System Administrator

原文:http://www.cnblogs.com/touchdown/p/5174292.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!