dp-203 Practice Question 1941
Exam: dp-203
Domain: Design and implement data storage
Topic: Implement physical data storage structures
Difficulty: medium
In an Azure Data Lake Storage Gen2 environment, you need to design a storage structure that allows efficient querying and processing of large datasets using Apache Spark. Which of the following should you implement to achieve this goal while maintaining a hierarchical namespace and partitioning the data by date and hour?
Answer Options
A
Use Azure Data Lake Storage Gen2 without any additional configurations.
B
Implement Delta Lake on top of Azure Data Lake Storage Gen2 with partitions by date and hour.
C
Use Azure Blob Storage with custom scripts for partitioning and querying.
D
Deploy SQL Server on-premises and use it to query the data stored in Azure Data Lake Storage Gen2.
Correct Answer
B: Implement Delta Lake on top of Azure Data Lake Storage Gen2 with partitions by date and hour.
Explanation
Delta Lake is designed to handle large-scale data processing efficiently and supports ACID transactions, which is beneficial for querying and processing big datasets. Implementing partitions by date and hour will allow for more granular control over data access and processing. Azure Data Lake Storage Gen2 provides a hierarchical namespace, but it does not inherently support partitioning or the Delta Lake format.