<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>bigdata on Rise-</title><link>https://madil.in/tag/bigdata/</link><description>Recent content in bigdata on Rise-</description><generator>Hugo</generator><language>en</language><lastBuildDate>Mon, 27 Jul 2020 12:48:05 +0000</lastBuildDate><atom:link href="https://madil.in/tag/bigdata/index.xml" rel="self" type="application/rss+xml"/><item><title>Setup Apache Spark and Initialize pyspark with ease</title><link>https://madil.in/setup-apache-spark-and-initialize-pyspark-with-ease/</link><pubDate>Tue, 08 Nov 2016 18:30:00 +0000</pubDate><guid>https://madil.in/setup-apache-spark-and-initialize-pyspark-with-ease/</guid><description>&lt;p&gt;Recently I started working on &lt;a href="https://spark.apache.org/"&gt;Apache Spark&lt;/a&gt; and was having a hard time configuring spark on my machine. It became all try and catch while setting up the environment. Then I came across this &lt;a href="https://gist.github.com/kalaidin/1e9114c3a649a9ebc5b9"&gt;gist&lt;/a&gt; which explains how to set up Apache Spark with IPython Notebook on MacOS. I love to work on IPython notebooks but most of the times I just need a simple ipython shell. So I skipped the IPython notebook portion of the setup.&lt;/p&gt;</description></item></channel></rss>