Table of contents 1. Spark End-to-End Execution Flow 2. Understanding Spark Execution plan 2.1. EXPLAIN() modes: 2.2. Create DataFrame for demonstration 2.3. Unresolved Logical Plan 2.4. Resolved Logical Plan 2.5. Optimized Logical plan 2.6. Physical plans 3. Adaptive Query Execution 3.1 AQE in Spark-UI 4. Conclusion
