A data engineer needs to provide a team of data scientists with the appropriate dataset to run machine learning training jobs. The data will be stored in Amazon S3. The data engineer is obtaining the data from an Amazon Redshift database and is using join queries to extract a single tabular dataset. A portion of the schema is as follows:
TransactionTimestamp (Timestamp)
CardName (Varchar)
CardNo (Varchar)
The data engineer must provide the data so that any row with a CardNo value of NULL is removed. Also, the TransactionTimestamp column must be separated into a TransactionDate column and a TransactionTime column. Finally, the CardName column must be renamed to NameOnCard.
The data will be extracted on a monthly basis and will be loaded into an S3 bucket. The solution must minimize the effort that is needed to set up infrastructure for the ingestion and transformation. The solution also must be automated and must minimize the load on the Amazon Redshift cluster.
Which solution meets these requirements?
ystotest
Highly Voted 1 year, 3 months ago2eb8df0
Most Recent 1 week, 1 day agoakgarg00
3 months, 3 weeks agoteka112233
6 months, 1 week agoloict
6 months, 1 week agoMickey321
6 months, 3 weeks agoMickey321
6 months, 3 weeks agokaike_reis
7 months, 1 week agoJerry84
1 year, 2 months ago