Exam AWS Certified Data Engineer - Associate DEA-C01 topic 1 question 100 discussion

Actually, I think A makes more sense.

For workloads with low access frequency where you only need to query data occasionally (for example, during audits), option (A)—S3 Glacier Flexible Retrieval combined with S3 Glacier Select—provides the most cost-effective solution.

Transaction Data Refers To Data Which Are Updating Frequently and To Query That Data occasionally Means It Can Be Query At Any Time (In Question Time Is Not Define). So We Can't Take Risk For Customer To Wait For Hours To Get The Result And The Best Way To Query The Data On Top of The S3 Bucket We Can Use Athena.

Glacier Select incurs higher costs compared to S3 Select.

You cannot use S3 Select on S3 Glacier Flexible Retrieval storage class. So answer is B, based on given options.

B is the more cost-effective solution for occasional audits. It allows for easier access to the data without incurring high retrieval costs

gzip compressed data querying -> s3 select -Answer B

https://aws.amazon.com/blogs/aws/s3-glacier-select/ option B is not cost effective as it is stored in standard S3

Occasional audits, so go for S3 glacier select

this is B

IT is A

Glacier is an expensive option in cases when you need to access data occasionally

I am not sure whether to go for B or C. Can anyone comment on this? B: No problem, but not available if Parquet is Gzip compressed. But the problem statement doesn't say Parquet is Gzip compressed. C: Correct if Parquet is Gzip compressed, but B is more cost-effective if csv or json is Gzip compressed

I think the solution is either B or D but I would go with B because they mentioned storing the data in gzip and not parquet which is optimised for Athena queries

there is no such thing as Glacier Flexible Retrieval, so its no A . its either B or D and most likely its D for the cost

B. Store the data in Amazon S3. Use Amazon S3 Select to query the data. Amazon S3 is a cost-effective object storage service, and S3 Select allows you to retrieve only a subset of data from an object by using simple SQL expressions. S3 Select works on objects stored in CSV, JSON, or Apache Parquet format. It also supports GZIP and BZIP2 compression formats, which makes it suitable for the given scenario where the data is compressed with gzip. While Amazon Athena is a powerful query service, it can be more expensive than S3 Select for occasional queries. Amazon Glacier and Glacier Select are designed for long-term archival storage and not for frequent access or queries, which might not be suitable for occasional audits. Therefore, option B is the most cost-effective choice for this scenario.

ill go with B, because. of cost to query