Câu 53: Databricks Certified Associate Developer for Apache Spark

The default value of spark.sql.shuffle.partitions is 200. Which of the following describes what that means?

1. A. By default, all DataFrames in Spark will be spit to perfectly fill the memory of 200 executors.
2. B. By default, new DataFrames created by Spark will be split to perfectly fill the memory of 200 executors.
3. C. By default, Spark will only read the first 200 partitions of DataFrames to improve speed.
4. D. By default, all DataFrames in Spark, including existing DataFrames, will be split into 200 unique segments for parallelization.
5. E. By default, DataFrames will be split into 200 unique partitions when data is being shuffled. — đáp án hiện tại