Câu 42: Databricks Certified Associate Developer for Apache Spark
The below code block contains a logical error resulting in inefficiency. The code block is intended to efficiently perform a broadcast join of DataFrame storesDF and the much larger DataFrame employeesDF using key column storeId. Identify the logical error. Code block:storesDF.join(broadcast(employeesDF), "storeId")
Nội dung câu hỏi
The below code block contains a logical error resulting in inefficiency. The code block is intended to efficiently perform a broadcast join of DataFrame storesDF and the much larger DataFrame employeesDF using key column storeId. Identify the logical error. Code block:storesDF.join(broadcast(employeesDF), "storeId")
Các lựa chọn
Đáp án được giữ gọn theo nhãn A, B, C, D trong phần bình chọn tương tác.
- A. The larger DataFrame employeesDF is being broadcasted rather than the smaller DataFrame storesDF. — đáp án hiện tại
- B. There is never a need to call the broadcast() operation in Apache Spark 3.
- C. The entire line of code should be wrapped in broadcast() rather than just DataFrame employeesDF.
- D. The broadcast() operation will only perform a broadcast join if the Spark property spark.sql.autoBroadcastJoinThreshold is manually set.
- E. Only one of the DataFrames is being broadcasted rather than both of the DataFrames.
Cộng đồng
0 bình luận công khai. Tên thành viên được ẩn một phần.