spark--actions算子--saveAsObjectFile
2017-07-13 09:28
344 查看
import org.apache.spark.{SparkConf, SparkContext} /** * Created by liupeng on 2017/6/16. */ object A_saveAsObjectFile { System.setProperty("hadoop.home.dir","F:\\hadoop-2.6.5") def main(args: Array[String]): Unit = { val conf = new SparkConf().setAppName("saveAsObjectFile_test").setMaster("local") val sc = new SparkContext(conf) //准备一下数据 val nameList: List[String] = List("c", "d", "a", "e", "f", "k") val numbers = sc.parallelize(nameList) //基于java序列化保存文件 numbers.saveAsObjectFile("str_test") var data = sc.objectFile[Array[String]]("str_test") .collect() } }
运行结果会生成一个目录:
相关文章推荐
- Spark算子:RDD行动Action操作(5)–saveAsTextFile、saveAsSequenceFile、saveAsObjectFile
- Spark算子[18]:saveAsTextFile、saveAsObjectFile 源码实例详解
- Spark算子:RDD行动Action操作(5)–saveAsTextFile、saveAsSequenceFile、saveAsObjectFile
- Spark算子:RDD行动Action操作(5)–saveAsTextFile、saveAsSequenceFile、saveAsObjectFile
- spark RDD算子(十一)之RDD Action 保存操作saveAsTextFile,saveAsSequenceFile,saveAsObjectFile,saveAsHadoopFile 等
- 【Spark Java API】Action(6)—saveAsTextFile、saveAsObjectFile
- Spark算子:RDD行动Action操作(7)–saveAsNewAPIHadoopFile、saveAsNewAPIHadoopDataset
- spark--actions算子--saveAsTextFile
- Spark算子-RDD Action(saveAsNewAPIHadoopFile)
- Spark算子:RDD行动Action操作(7)–saveAsNewAPIHadoopFile、saveAsNewAPIHadoopDataset
- Spark算子:RDD行动Action操作(6)–saveAsHadoopFile、saveAsHadoopDataset
- Spark算子[19]:saveAsHadoopFile、saveAsNewAPIHadoopFile 源码实例详解
- Spark算子:RDD行动Action操作(6)–saveAsHadoopFile、saveAsHadoopDataset
- Spark算子:RDD行动Action操作(7)–saveAsNewAPIHadoopFile、saveAsNewAPIHadoopDataset
- Spark算子:RDD行动Action操作(6)–saveAsHadoopFile、saveAsHadoopDataset
- Spark算子:RDD行动Action操作(7)–saveAsNewAPIHadoopFile、saveAsNewAPIHadoopDataset
- [大数据之Spark]——Actions算子操作入门实例
- 3.4 Spark RDD Action操作6-saveAsHadoopFile、saveAsHadoopDataset
- 3.4 Spark RDD Action操作7-saveAsNewAPIHadoopFile、saveAsNewAPIHadoopDataset
- Spark代码1之RDDparallelizeSaveAsFile