You have data files in Azure Blob Storage. You plan to transform the files and move them to Azure Data Lake Storage. You need to transform the data by using mapping data flow. Which service should you use?
Correct
https://docs.microsoft.com/en-us/azure/data-factory/concepts-data-flow-overview
What are mapping data flows?
Mapping data flows are visually designed data transformations in Azure Data Factory. Data flows allow data engineers to develop data transformation logic without writing code. The resulting data flows are executed as activities within Azure Data Factory pipelines that use scaled-out Apache Spark clusters. Data flow activities can be operationalized using existing Azure Data Factory scheduling, control, flow, and monitoring capabilities.
Correct. Both Databricks and Data Factory can move the data.
The key point here is the "mapping data flow" which is the GUI that only Data Factory provides.
Azure Data Factory is a cloud-based data integration service that allows you to create, schedule, and manage data pipelines that can move and transform data across different sources and destinations, including Azure Blob Storage and Azure Data Lake Storage.
Azure Databricks is a cloud-based analytics platform that allows you to process large amounts of data using Apache Spark. It can also be used for data transformation and ETL, but it requires more technical expertise and development effort than using Azure Data Factory mapping data flows.
Azure Storage Sync is a service that allows you to sync on-premises file servers with Azure file shares, but it does not support data transformation.
Azure Data Box Gateway is a hardware device that allows you to transfer large amounts of data to Azure, but it does not support data transformation using mapping data flow.
C. Azure Data Factory
Azure Data Factory is the appropriate service to use for transforming data using mapping data flow. Mapping data flow is a feature in Azure Data Factory that allows you to visually design, build, and manage data transformation processes without writing any code. You can use mapping data flow in Azure Data Factory to transform the data files in Azure Blob Storage and move them to Azure Data Lake Storage as per your requirements.
A voting comment increases the vote count for the chosen answer by one.
Upvoting a comment with a selected answer will also increase the vote count towards that answer by one.
So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
Davin0406
Highly Voted 2 years, 1 month agoGarryK
Highly Voted 2 years, 2 months agojellybiscuit
2 years, 2 months agomtc9
2 years agoSeMo0o0o0o
Most Recent 3 weeks, 2 days agoLazylinux
7 months, 3 weeks agolombri
1 year, 7 months agoNotMeAnyWay
1 year, 8 months agoVBK8579
1 year, 10 months agoOPT_001122
1 year, 10 months ago