{"id":815,"date":"2019-06-23T12:48:44","date_gmt":"2019-06-23T03:48:44","guid":{"rendered":"https:\/\/www.kwonline.org\/memo2\/?p=815"},"modified":"2021-05-25T11:02:23","modified_gmt":"2021-05-25T02:02:23","slug":"spark-scala-map-and-flatmap","status":"publish","type":"post","link":"https:\/\/www.kwonline.org\/memo2\/2019\/06\/23\/spark-scala-map-and-flatmap\/","title":{"rendered":"Spark Scala\u306emap\u3068flatMap\u306e\u52d5\u4f5c"},"content":{"rendered":"<p>Spark\u59cb\u3081\u305f\u521d\u671f\u306b\u3064\u307e\u3065\u3044\u305f\u306e\u3067\u30e1\u30e2\u3002<br \/>\n\u7d50\u679c\u306e\u9055\u3044\u3067\u899a\u3048\u305f\u3002<\/p>\n<p>\u307e\u305a\u306fRDD\u3092\u4f5c\u308b\u3002<\/p>\n<pre class=\"brush: scala; title: ; notranslate\" title=\"\">\r\nval seq = Seq(&quot;Some People Feel the Rain&quot;, &quot;Others Just Get Wet&quot;)\r\nval rdd = sc.parallelize(seq)\r\n<\/pre>\n<p>\u3053\u306eRDD\u306b\u5bfe\u3057\u3066map<\/p>\n<pre class=\"brush: scala; title: ; notranslate\" title=\"\">\r\nrdd.map(x =&gt; x.split(&quot; &quot;)).collect\r\n<\/pre>\n<p>\u7d50\u679c\u306f\u3053\u308c<br \/>\n<code>Array[Array[String]] = Array(Array(Some, People, Feel, the, Rain), Array(Others, Just, Get, Wet))<\/code><br \/>\n\u5165\u308c\u5b50\u306b\u306a\u3063\u3066\u308b\u3002<\/p>\n<p>\u3055\u3063\u304d\u306eRDD\u306b\u5bfe\u3057\u3066flatMap<\/p>\n<pre class=\"brush: scala; title: ; notranslate\" title=\"\">\r\nrdd.flatMap(x =&gt; x.split(&quot; &quot;)).collect\r\n<\/pre>\n<p>\u7d50\u679c\u306f\u3053\u308c<br \/>\n<code>Array[String] = Array(Some, People, Feel, the, Rain, Others, Just, Get, Wet)<\/code><br \/>\n\u30d5\u30e9\u30c3\u30c8\u306b\u306a\u3063\u3066\u308b\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Spark\u59cb\u3081\u305f\u521d\u671f\u306b\u3064\u307e\u3065\u3044\u305f\u306e\u3067\u30e1\u30e2\u3002 \u7d50\u679c\u306e\u9055\u3044\u3067\u899a\u3048\u305f\u3002 \u307e\u305a\u306fRDD\u3092\u4f5c\u308b\u3002 val seq = Seq(&quot;Some People Feel the Rain&quot;, &quot;Others  [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[21,9,10],"tags":[],"class_list":["post-815","post","type-post","status-publish","format-standard","hentry","category-data-engineering","category-scala","category-spark"],"_links":{"self":[{"href":"https:\/\/www.kwonline.org\/memo2\/wp-json\/wp\/v2\/posts\/815","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.kwonline.org\/memo2\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.kwonline.org\/memo2\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.kwonline.org\/memo2\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.kwonline.org\/memo2\/wp-json\/wp\/v2\/comments?post=815"}],"version-history":[{"count":1,"href":"https:\/\/www.kwonline.org\/memo2\/wp-json\/wp\/v2\/posts\/815\/revisions"}],"predecessor-version":[{"id":1462,"href":"https:\/\/www.kwonline.org\/memo2\/wp-json\/wp\/v2\/posts\/815\/revisions\/1462"}],"wp:attachment":[{"href":"https:\/\/www.kwonline.org\/memo2\/wp-json\/wp\/v2\/media?parent=815"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.kwonline.org\/memo2\/wp-json\/wp\/v2\/categories?post=815"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.kwonline.org\/memo2\/wp-json\/wp\/v2\/tags?post=815"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}