您的位置:首页 > 其它

is dfsclient caches the data block to local disk before writing?

2014-04-02 17:29 513 查看

Question:

Is staging still used in hdfs when writing the data? This doubt arose when I was going through the hdfs documents.
ref :http://hadoop.apache.org/hdfs/docs/current/hdfs_design.html#Staging

I believe dfsclient does not cache the datablock to local fs (as the document says) but it does streaming of 64KB packets to the datanode and caches the packets of current block only in memory via dataqueue and ackqueue.Is the document needs to be corrected or my understanding is wrong?


Answer:

DFS client does not write the data to local disk first. Instead, it streams data directly to the datanodes in the write pipeline. I will update the document.
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签: 
相关文章推荐