首页 > 其他 > 详细

Spark编程--WordCount

时间:2020-03-10 17:52:54      阅读:54      评论:0      收藏:0      [点我收藏+]
package com.zwq

import org.apache.spark.{SparkConf, SparkContext}

object WordCount {
  def main(args: Array[String]): Unit = {
    val conf = new SparkConf().setMaster("local").setAppName("wordCount")

    val sc = new SparkContext(conf)

    var input = sc.textFile("helloSpark.txt")
    val lines = input.flatMap(line => line.split(" "))
    val count = lines.map(word => (word, 1)).reduceByKey{case (x, y)=> x+y}
    val output = count.saveAsTextFile("helloSparkRes")
  }
}

  

Spark编程--WordCount

原文:https://www.cnblogs.com/conquorer/p/12456396.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!