Welcome to ExamTopics
ExamTopics Logo
- Expert Verified, Online, Free.
Mail Us[email protected]
Menu
Amazon Discussions
exam questions

Exam AWS Certified Data Engineer - Associate DEA-C01 All Questions

View all questions & answers for the AWS Certified Data Engineer - Associate DEA-C01 exam
Go to Exam

Exam AWS Certified Data Engineer - Associate DEA-C01 topic 1 question 166 discussion

Exam question from Amazon's AWS Certified Data Engineer - Associate DEA-C01
Question #: 166
Topic #: 1
[All AWS Certified Data Engineer - Associate DEA-C01 Questions]

A data engineer configured an AWS Glue Data Catalog for data that is stored in Amazon S3 buckets. The data engineer needs to configure the Data Catalog to receive incremental updates.

The data engineer sets up event notifications for the S3 bucket and creates an Amazon Simple Queue Service (Amazon SQS) queue to receive the S3 events.

Which combination of steps should the data engineer take to meet these requirements with LEAST operational overhead? (Choose two.)

  • A. Create an S3 event-based AWS Glue crawler to consume events from the SQS queue.
  • B. Define a time-based schedule to run the AWS Glue crawler, and perform incremental updates to the Data Catalog.
  • C. Use an AWS Lambda function to directly update the Data Catalog based on S3 events that the SQS queue receives.
  • D. Manually initiate the AWS Glue crawler to perform updates to the Data Catalog when there is a change in the S3 bucket.
  • E. Use AWS Step Functions to orchestrate the process of updating the Data Catalog based on S3 events that the SQS queue receives.
Show Suggested Answer Hide Answer
Suggested Answer: AC 🗳️
by ae35a02 at Oct. 28, 2024, 2:54 p.m.
Disclaimers:
  • - ExamTopics website is not related to, affiliated with, endorsed or authorized by Amazon.
  • - Trademarks, certification & product names are used for reference only and belong to Amazon.

Comments

Chosen Answer:
This is a voting comment (?) , you can switch to a simple comment.
Switch to a voting comment New
Submit Cancel
tucobbad
1 week, 1 day ago
Selected Answer: AC
- Option A suggests creating an S3 event-based AWS Glue crawler to consume events from the SQS queue. This option is appropriate as it allows the crawler to automatically respond to events, thereby reducing manual intervention and ensuring timely updates to the Data Catalog - Option C involves using an AWS Lambda function to directly update the Data Catalog based on S3 events received from the SQS queue. This is a strong candidate as it automates the update process without the need for manual scheduling or intervention, thus minimizing operational overhead. AWS Glue Crawlers can consume events from an SQS queue: https://docs.aws.amazon.com/glue/latest/dg/crawler-s3-event-notifications.html
upvoted 1 times
...
pikuantne
2 weeks ago
Selected Answer: AB
Based on this article (Option 1 for the architecture) it should be AB: 1. Run the crawler on a schedule. 2. Crawler polls for object create events in the SQS queue 3a. If there are events, crawler updates the Data Catalog 3b. If not, crawler stops
upvoted 1 times
...
ae35a02
2 weeks, 3 days ago
Selected Answer: BC
AWS Glue Crawlers can not consupe events from an SQS queue D introduce a manual operation E introduce more complexity so BC
upvoted 1 times
tucobbad
1 week, 1 day ago
Answer is A and C In fact, AWS Glue Crawlers can consume events indeed: https://docs.aws.amazon.com/glue/latest/dg/crawler-s3-event-notifications.html
upvoted 1 times
...
...

Get IT Certification

Unlock free, top-quality video courses on ExamTopics with a simple registration. Elevate your learning journey with our expertly curated content. Register now to access a diverse range of educational resources designed for your success. Start learning today with ExamTopics!

Start Learning for free
Community vote distribution
A (35%)
C (25%)
B (20%)
Other
Most Voted
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

SaveCancel