Question 1

Which statement regarding Spark configuration on the Databricks platform is true?

Options :

A : The Databricks REST API can be used to modify the Spark configuration properties for an interactive cluster without interrupting jobs currently running on the cluster.

B : Spark configurations set within a notebook will affect all SparkSessions attached to the same interactive cluster.

C : When the same Spark configuration property is set for an interactive cluster and a notebook attached to that cluster, the notebook setting will always be ignored.

D : Spark configuration properties set for an interactive cluster with the Clusters UI will impact all notebooks attached to that cluster.

Answer: D

Question 2

The data engineering team has a secret scope named ‘DataOps-Prod’ that contains all secrets needed by DataOps engineers in a production workspace.

Which of the following is the minimum permission required for the DataOps engineers to use the secrets in this scope ?

Options :

A : MANAGE permission on the “DataOps-Prod” scope

B : READ permission on the “DataOps-Prod” scope

C : MANAGE permission on each secret in the “DataOps-Prod” scope

D : READ permission on each secret in the “DataOps-Prod” scope

E : Workspace Administrator role

Answer: B

Question 3

A data engineer has configured their Databricks Asset Bundle with multiple targets in databricks.yml and deployed it to the production workspace. Now, to validate the deployment, they need to invoke a job named my_project_job specifically within the prod target context. Assuming the job is already deployed, they need to trigger its execution while ensuring the target-specific configuration is respected. Which command will trigger the job execution?

Options :

A : databricks execute my_project_job -e prod

B : databricks job run my_project_job --env prod

C : databricks run my_project_job -t prod

D : databricks bundle run my_project_job -t prod

Answer: D

Question 4

An upstream source writes Parquet data as hourly batches to directories named with the current date. A nightly batch job runs the following code to ingest all data from the previous day as indicated by the date variable:

Databricks-Certified-Professional-Data-Engineer-page61-image7

Assume that the fields customer_id and order_id serve as a composite key to uniquely identify each order. If the upstream system is known to occasionally produce duplicate entries for a single order hours apart, which statement is correct

Options :

A :

Each write to the orders table will only contain unique records, and only those records without duplicates in the target table will be written.

B :

Each write to the orders table will only contain unique records, but newly written records may have duplicates already present in the target table.

C :

Each write to the orders table will only contain unique records; if existing records with the same key are present in the target table, these records will be overwritten.

D :

Each write to the orders table will only contain unique records; if existing records with the same key are present in the target table, the operation will fail.

E :

Each write to the orders table will run deduplication over the union of new and existing records, ensuring no duplicate records are present.

Answer: B

Question 5

All records from an Apache Kafka producer are being ingested into a single Delta Lake table with the following schema:

key BINARY, value BINARY, topic STRING, partition LONG, offset LONG, timestamp LONG

There are 5 unique topics being ingested. Only the "registration" topic contains Personal Identifiable Information (PII). The company wishes to restrict access to PII. The company also wishes to only retain records containing PII in this table for 14 days after initial ingestion. However, for non-PII information, it would like to retain these records indefinitely.

Which of the following solutions meets the requirements?

Options :

A :

All data should be deleted biweekly; Delta Lake-s time travel functionality should be leveraged to maintain a history of non-PII information.

B :

Data should be partitioned by the registration field, allowing ACLs and delete statements to be set for the PII directory

C :

Because the value field is stored as binary data, this information is not considered PII and no special precautions should be taken

D :

Separate object storage containers should be specified based on the partition field, allowing isolation at the storage level

E :

Data should be partitioned by the topic field, allowing ACLs and delete statements to leverage partition boundaries.

Answer: E

Free Databricks-Certified-Professional-Data-Engineer Mock Exam – Practice Online Confidently

Buying Options: