Question 1

At the end of the inventory process a file gets uploaded to the cloud object storage, you are asked to build a process to ingest data which of the following method can be used to ingest the data incrementally, schema of the file is expected to change overtime ingestion process should be able to handle these changes automatically. Below is the auto loader to command to load the data, fill in the blanks for successful execution of below code.

spark.readStream

.format("cloudfiles")

.option("_______",”csv)

.option("_______", ‘dbfs:/location/checkpoint/’)

.load(data_source)

.writeStream

.option("_______",’ dbfs:/location/checkpoint/’)

.option("_______", "true")

.table(table_name))

Options :

A : format, checkpointlocation, schemalocation, overwrite

B : cloudfiles.format, checkpointlocation, cloudfiles.schemalocation, overwrite

C : cloudfiles.format, cloudfiles.schemalocation, checkpointlocation, mergeSchema

D : cloudfiles.format, cloudfiles.schemalocation, checkpointlocation, append

E : cloudfiles.format, cloudfiles.schemalocation, checkpointlocation, overwrite

Answer: C

Question 2

A data analyst has created a Delta table sales that is used by the entire data analysis team. They want help from the data engineering team to implement a series of tests to ensure the data is clean. However, the data engineering team uses Python for its tests rather than SQL.

Which command could the data engineering team use to access sales in PySpark?

Options :

A : SELECT * FROM sales

B : spark.table("sales")

C : spark.sql("sales")

D : spark.delta.table("sales")

Answer: B

Question 3

Which of the following is not a privilege in the Unity catalog?

Options :

A : SELECT

B : MODIFY

C : EXECUTE

D : CREATE

E : USAGE

Answer: C

Question 4

A data engineer wants to create a data entity from a couple of tables. The data entity must be used by other data engineers in other sessions. It also must be saved to a physical location.

Which of the following data entities should the data engineer create?

Options :

A : Table

B : Function

C : View

D : Temporary view

Answer: A

Question 5

A data engineer needs to apply custom logic to string column city in table stores for a specific use case. In

order to apply this custom logic at scale, the data engineer wants to create a SQL user-defined function (UDF).

Which of the following code blocks creates this SQL UDF?

Options :