Question 1

A data engineer observes that an upstream streaming source sends duplicate records, where duplicates share the same key and have at most a 30-minute difference inevent_timestamp. The engineer adds: dropDuplicatesWithinWatermark("event_timestamp", "30 minutes") What is the result?

Options :

A : It is not able to handle deduplication in this scenario

B : It removes duplicates that arrive within the 30-minute window specified by the watermark

C : It removes all duplicates regardless of when they arrive

D : It accepts watermarks in seconds and the code results in an error

Answer: B

Question 2

A Spark engineer must select an appropriate deployment mode for the Spark jobs. What is the benefit of using cluster mode in Apache Spark™?

Options :

A :

In cluster mode, resources are allocated from a resource manager on the cluster, enabling better performance and scalability for large jobs

B :

In cluster mode, the driver is responsible for executing all tasks locally without distributing them across the worker nodes.

C :

In cluster mode, the driver runs on the client machine, which can limit the application's ability to handle large datasets efficiently.

D :

In cluster mode, the driver program runs on one of the worker nodes, allowing the application to fully utilize the distributed resources of the cluster.

Answer: D

Question 3

A developer initializes a SparkSession:

spark = SparkSession.builder \ .appName("Analytics Application") \ .getOrCreate() Which statement describes thesparkSparkSession?ThegetOrCreate()method explicitly destroys any existing SparkSession and creates a new one.

Options :

A : ThegetOrCreate()method explicitly destroys any existing SparkSession and creates a new one.

B :

A SparkSession is unique for eachappName, and callinggetOrCreate()with the same name will return an existing SparkSession once it has been created.

C : If a SparkSession already exists, this code will return the existing session instead of creating a new one.

D : A new SparkSession is created every time thegetOrCreate()method is invoked.

Answer: C

Question 4

Which feature of Spark Connect should be considered when designing an application that plans to enable remote interaction with a Spark cluster?

Options :

A : It is primarily used for data ingestion into Spark from external sources.

B : It provides a way to run Spark applications remotely in any programming language.

C : It can be used to interact with any remote cluster using the REST API.

D : It allows for remote execution of Spark jobs.

Answer: D

Question 5

Which Spark configuration controls the number of tasks that can run in parallel on the executor? Options:

Options :

A : spark.executor.cores

B : spark.task.maxFailures

C : spark.driver.cores

D : spark.executor.memory

Answer: A

Free Databricks-Certified-Associate-Developer-for-Apache-Spark-3.5 Mock Exam – Practice Online Confidently

Buying Options: