Exam AWS Certified Data Analytics - Specialty topic 1 question 40 discussion

It is B

Ans B This is a textbook question. https://docs.aws.amazon.com/glue/latest/dg/monitor-continuations.html

B: I passed the test

The correct approach to solve the issue with minimal coding effort would be to enable job bookmarks on the AWS Glue jobs. Enabling job bookmarks on the AWS Glue jobs would allow the ETL job to keep track of the last processed record in the data source. This way, on the next run, the job will only process the new or updated data that was added to the source since the last successful run, thus processing only the incremental data. Using DataFrame instead of DynamicFrame or custom logic to track processed S3 objects could require significant coding effort and may not be the most efficient approach. Deleting processed objects or data from Amazon S3 after each run may not be ideal since it may result in loss of valuable historical data. Therefore, enabling job bookmarks is the most appropriate approach to solve the issue with minimal coding effort.

Correct answer is B as AWS Glue can be used to export the data incrementally using job bookmarks with coding required. AWS Glue tracks data that has already been processed during a previous run of an ETL job by persisting state information from the job run. This persisted state information is called a job bookmark. Job bookmarks help AWS Glue maintain state information and prevent the reprocessing of old data. With job bookmarks, you can process new data when rerunning on a scheduled interval. A job bookmark is composed of the states for various elements of jobs, such as sources, transformations, and targets. For example, your ETL job might read new partitions in an Amazon S3 file. AWS Glue tracks which partitions the job has processed successfully to prevent duplicate processing and duplicate data in the job's target data store. Job bookmarks are implemented for JDBC data sources, the Relationalize transform, and some Amazon Simple Storage Service (Amazon S3) sources.

For incremental data, Job bookmark is the built-in feature for Glue.

For incremental data, Job bookmark is the built-in option to choose for Glue.

B is correct

Answer is B

its strongly B as book mark only take new data it stops processing preprocessed data

The answer is B, the hint is in the wording 'only in incremental data'.

Ans B

although B is the obvious answer the part of the question that says minimal coding effort suggests it might be D.

B is the right answer

My answer is B

Job bookmarks help AWS Glue maintain state information and prevent the reprocessing of old data so answer is B 100%

Job Bookmarks should do the trick. So option B.