RDD Examples to Explore
Apache Spark is a vast subject and it is hard to cover in a single course. Hence, I have created a blog AIStudyLabs with hundreds of concepts.
So, to get a better understanding of Apache Spark core concepts and RDD, I would recommend reading the following articles that are carefully written by me.
Spark Fundamentals
- Start a history server
- Monitor your jobs using Web UI
- What is Spark Job
- What is Spark Stage? Explained
- What is Spark Executor
- What is Apache Spark Driver?
- What is DAG in Spark or PySpark
- What is Lineage Graph in Spark?
- How to use spark-shell with examples.
- Using spark-submit command
- How to Submit a Spark Job via Rest API?
RDD Programming Examples
- Spark RDD joins with Examples
- Spark RDD aggregate() operation example
- Spark RDD aggregateByKey()
- Spark sortByKey() with RDD Example
- Spark reduceByKey() with RDD Example
- Spark RDD fold() function example
- Spark RDD reduce() function example
- Spark Repartition() vs Coalesce()
- Spark SQL Shuffle Partitions
- Spark PairRDD Functions
- Spark Load CSV File into RDD
- Spark – Read multiple text files into single RDD?
- Spark – How to create an empty RDD?