Exam AWS Certified Data Analytics - Specialty topic 1 question 101 discussion

C. Should be the right answer, because of the main requirement "A single data record can be 100 KB-10 MB." - Kinesis firehose - The maximum size of a record sent to Kinesis Data Firehose, before base64-encoding, is 1,000 KiB.
 - Kinesis stream - The maximum size of the data payload of a record before base64-encoding is up to 1 MB. - SQS - https://aws.amazon.com/pt/about-aws/whats-new/2015/10/now-send-payloads-up-to-2gb-with-amazon-sqs/

It should be C. 1 MB is the soft limit for the Kafka which can be increased up to 10 MB. That's the main difference b/w KDA and Kafka

MSK is the only one that can handle single put of 10MB. Firehose can handle up to 128 MB Buffered data, but it just catches single records of up to 3MB in that window and sends them in batch, you can't put a record that is higher than 3MB

C: I passed the test

Correct answer is C as only Amazon Managed Streaming for Apache Kafka seems to provide a maximum size of a record that can be configured up to 10MB. Amazon Managed Streaming for Apache Kafka (Amazon MSK) is a fully managed service that enables you to build and run applications that use Apache Kafka to process streaming data. Amazon MSK provides the control-plane operations, such as those for creating, updating, and deleting clusters. It lets you use Apache Kafka data-plane operations, such as those for producing and consuming data. It runs open-source versions of Apache Kafka. This means existing applications, tooling, and plugins from partners and the Apache Kafka community are supported without requiring changes to application code. Options A & B are wrong as the maximum size of a record sent to both Kinesis Data Stream and Kinesis Data Firehose base64-encoding, is 1,000 KiB. Option D is wrong SQS data size limit is 256KB.

Correct answer is C as only Amazon Managed Streaming for Apache Kafka seems to provide a maximum size of a record that can be configured up to 10MB. Correct answer is C as only Amazon Managed Streaming for Apache Kafka seems to provide a maximum size of a record that can be configured up to 10MB. Correct answer is C as only Amazon Managed Streaming for Apache Kafka seems to provide a maximum size of a record that can be configured up to 10MB. Option D is wrong SQS data size limit is 256KB.

Kalka can handle the limit, Firehose is 8mb max

Selected Answer: C

KDS, KDF and MSK all have record/message limit lower than 10MB. https://aws.amazon.com/kinesis/data-streams/faqs/, https://aws.amazon.com/kinesis/data-streams/faqs/, https://docs.aws.amazon.com/msk/latest/developerguide/limits.html. SQS is recommended for "Using the ability of Amazon SQS to scale transparently. For example, you buffer requests and the load changes as a result of occasional load spikes or the natural growth of your business. Because each buffered request can be processed independently, Amazon SQS can scale transparently to handle the load without any provisioning instructions from you.": https://aws.amazon.com/kinesis/data-streams/faqs/

Although looks unnecessary to use EC2 to clean up data, C is still the right answer. Both Kinesis data streams and firehose have upper limit of 1 mb record size. Ideally, instead of using ec2, I would prefer to use something like Kafka Streams to perform required transformation.

C The maximum size of a record sent to Kinesis Data Firehose, before base64-encoding, is 1,000 KiB.

Answer - C

C. For AWS Lambda processing, you can set a buffering hint between 1 MiB and 3 MiB using the BufferSizeInMBs processor parameter.

C - cleanses the data, and writes to Amazon S3. D does not mention cleaning the data

why not B ? Buffer size can be set up to 128 MB

Between B and C, I chose C because The maximum size of a record sent to Kinesis Data Firehose, before base64-encoding, is 1,000 KiB.

Why not B? Question is saying about near real time. and Firehose quota can be increased using Amazon Kinesis data firehose limit form.