RunningMapReduceExampleTFIDF - hadoop-clusternet - This document describes how to run the TF-IDF MapReduce example against ascii books. - This project is for those who wants to experiment hadoop as a skunkworks in a small cluster (1-10 nodes) - Google Pro
2012-09-23 08:58
941 查看
RunningMapReduceExampleTFIDF - hadoop-clusternet - This document describes how to run the TF-IDF MapReduce example against ascii books. - This project is for those who wants to experiment hadoop as a skunkworks in a small cluster (1-10 nodes) - Google Project Hosting
// inverse document frequency quotient between the number of docs in corpus and number of docs the
// term appears Normalize the value in case the number of appearances is 0.
double idf = Math.log10((double) numberOfDocumentsInCorpus /
(double) ((numberOfDocumentsInCorpusWhereKeyAppears == 0 ? 1 : 0) +
numberOfDocumentsInCorpusWhereKeyAppears));
// term appears Normalize the value in case the number of appearances is 0.
double idf = Math.log10((double) numberOfDocumentsInCorpus /
(double) ((numberOfDocumentsInCorpusWhereKeyAppears == 0 ? 1 : 0) +
numberOfDocumentsInCorpusWhereKeyAppears));
相关文章推荐
- RunningMapReduceExampleTFIDF - hadoop-clusternet - This document describes how to run the TF-IDF MapReduce example against ascii books. - This project is for those who wants to experiment hadoop as a skunkworks in a small cluster (1-10 nodes) - Google Pro
- Unable to start debugging on the web server. You do not have permission to debug the application. The URL for this project is in
- This function has none of Deterministic,no sql,or reads sql data in its declaration and binary logging is enabled(you *might* want to use the less safe log_bin_trust_function_creators variable
- The goal you specified requires a project to execute but there is no POM in this directory...
- How to sort by a form that is not displayed in the document in MicroStrategy Desktop 8.x
- How to Run Hadoop in the Cloud
- This program is used to explain how PCA works and the idea behind the method.
- xib This file is set to build for a version older than the project deployment target解决方法
- 【Visual Studio】The project appears to be under source control, but the associated source control plug-in is not installed on this computer
- maven报错 the goal you specified requires a project to execute but there is no POM in this direct...
- The goal you specified requires a project to execute but there is no POM in this directory
- Here's an example that shows how to enumerate through the features of a selection set, returning the value of each field in the attribute table except for the geometry colum.
- 323. Nothing in the world is difficult for one who sets his mind to it. 世上无难事,只怕有心人
- “The execution of scripts is disabled on this system” … How to run your own PowerShell scripts
- Deleting a Mounted Folder The code example in this topic shows you how to delete a mounted folder by
- The service cannot be activated because it does not support ASP.NET compatibility. ASP.NET compatibility is enabled for this application. Turn off ASP.NET compatibility mode in the web.config or add the AspNetCompatibilityRequirements attribute to the ser
- How to solve "The installation source for this product is not available" problem?
- System error &H80004015 - This class is configured to run as a security id different from the caller.
- 启动hadoop报192.168.1.151: Address 192.168.1.151 maps to node1, but this does not map back to the address - POSSIBLE BREAK-IN ATTEMPT!
- How do I fix the linker error in project upgraded from VS2010 to VS2013 where the linker is looking