Exam Certified Data Engineer Associate topic 1 question 5 discussion

Delta tables use a distributed storage format, where data, history, metadata, and other attributes are stored across multiple files. This includes data files (e.g., Parquet files) for the actual data and log files for transaction history and metadata, allowing Delta Lake to support version control, schema enforcement, and ACID properties.

C. Delta tables are stored in a collection of files that contain data, history, metadata, and other attributes. Delta tables store data in a structured manner using Parquet files, and they also maintain metadata and transaction logs in separate directories. This organization allows for versioning, transactional capabilities, and metadata tracking in Delta Lake. Thank you for pointing out the error, and I appreciate your understanding.

C. Delta tables are stored in a collection of files that contain data, history, metadata, and other attributes.

The answer is C!

GPT4: Delta tables in Databricks use: Parquet format files for data storage. A _delta_log folder for JSON log files that track transactions. Scheme enforcement in metadata to ensure consistency. Checkpoint files to speed up the rebuilding of the table state.

C is correct

C is correct

Answer is C

Reading Material: 5 reasons to choose Delta format (on Databricks) https://medium.com/datalex/5-reasons-to-use-delta-lake-format-on-databricks-d9e76cf3e77d

Correct ans C

C is the right answer

C Delta tables in Databricks Delta Lake are stored in a collection of files organized in a directory structure. This directory structure includes data files, transaction log files, and metadata files. These files are stored in a specified location, typically in a distributed file system such as Hadoop Distributed File System (HDFS) or Amazon S3.

First selected D as I assumed the data to be stored in the Delta lake and the transaction log to be stored separately. However, documentation states when a user creates a Delta Lake table, that table’s transaction log is automatically created in the _delta_log subdirectory. The deltalog contains multiple files hence a collection of files. Answer C.

C is the right option

C , respuesta correcta

C is correct answer https://docs.delta.io/latest/delta-faq.html#:~:text=Delta%20Lake%20uses%20versioned%20Parquet,directory%20to%20provide%20ACID%20transactions.