Learning Apache Spark
Introduction
How is spark job submitted?
How does Driver start working in YARN Cluster Mode
How do Driver and Executors communicate with each other
How does YarnAllocator allocate resources for executors
How does Driver schedule and run spark jobs
How does Broadcast work
How about different types of RDDs
How does Checkpoint work
How does Spark schedule Streaming Job
How does Shuffle work
How does Fair Scheduler work
How does Executor work
How does Spark run Python code
How about SparkContext
How does Metric, Accumulator and WebUI work
How is Memory managed in Spark
How about BlockManager
How does Persist work
How does GraphX work
How does Master recover from failover
How does Spark SQL work
How does Structured Streaming work
How about DStream?
How does Spark Kafka Input Stream work?

Powered by GitBook

How does Spark run Python code

spark-submit will launch a PythonGatewayServer, which is used to communicate with python code and Spark JVM process.

results matching ""

No results matching ""