Câu 78: Databricks Certified Associate Developer for Apache Spark

The code block shown below contains an error. The code block is intended to adjust the number of partitions used in wide transformations like join() to 32. Identify the error. Code block:spark.conf.set("spark.default.parallelism", "32")

1. A. spark.default.parallelism is not the right Spark configuration parameter – spark.sql.shuffle.partitions should be used instead. — đáp án hiện tại
2. B. There is no way to adjust the number of partitions used in wide transformations – it defaults to the number of total CPUs in the cluster.
3. C. Spark configuration parameters cannot be set in runtime.
4. D. Spark configuration parameters are not set with spark.conf.set().
5. E. The second argument should not be the string version of "32" – it should be the integer 32.