Exam AWS Certified Data Engineer - Associate DEA-C01 topic 1 question 100 discussion

Actually, I think A makes more sense.

You cannot use S3 Select on S3 Glacier Flexible Retrieval storage class. So answer is B, based on given options.

B is the more cost-effective solution for occasional audits. It allows for easier access to the data without incurring high retrieval costs

gzip compressed data querying -> s3 select -Answer B

https://aws.amazon.com/blogs/aws/s3-glacier-select/ option B is not cost effective as it is stored in standard S3

Occasional audits, so go for S3 glacier select

this is B

IT is A

Glacier is an expensive option in cases when you need to access data occasionally

I am not sure whether to go for B or C. Can anyone comment on this? B: No problem, but not available if Parquet is Gzip compressed. But the problem statement doesn't say Parquet is Gzip compressed. C: Correct if Parquet is Gzip compressed, but B is more cost-effective if csv or json is Gzip compressed

I think the solution is either B or D but I would go with B because they mentioned storing the data in gzip and not parquet which is optimised for Athena queries

there is no such thing as Glacier Flexible Retrieval, so its no A . its either B or D and most likely its D for the cost

B. Store the data in Amazon S3. Use Amazon S3 Select to query the data. Amazon S3 is a cost-effective object storage service, and S3 Select allows you to retrieve only a subset of data from an object by using simple SQL expressions. S3 Select works on objects stored in CSV, JSON, or Apache Parquet format. It also supports GZIP and BZIP2 compression formats, which makes it suitable for the given scenario where the data is compressed with gzip. While Amazon Athena is a powerful query service, it can be more expensive than S3 Select for occasional queries. Amazon Glacier and Glacier Select are designed for long-term archival storage and not for frequent access or queries, which might not be suitable for occasional audits. Therefore, option B is the most cost-effective choice for this scenario.

ill go with B, because. of cost to query

B. Store the data in Amazon S3. Use Amazon S3 Select to query the data. Amazon S3 is a cost-effective storage service, and S3 Select allows you to retrieve only a subset of data from an object by using simple SQL expressions. S3 Select works on objects stored in CSV, JSON, or Apache Parquet format. It also supports GZIP compression, which is the format used by the company. This makes it a cost-effective solution for occasional queries needed for audits.

Option B (Amazon S3 with S3 Select) is generally more cost-effective and operationally efficient for occasional audits of gzip-compressed data. It provides faster access to data and lower querying costs, which are critical factors for ad-hoc and timely data retrievals. While Option A (Amazon Glacier Flexible Retrieval with S3 Glacier Select) offers cheaper storage, its longer retrieval times and potential higher querying costs make it less suitable for use cases requiring timely access to data.

Looks like that A - fit better in question requirements