https://docs.snowflake.com/en/user-guide/data-load-considerations-manage
Note
"S3 transmits a directory list with each COPY statement used by Snowflake, so reducing the number of files in each directory improves the performance of your COPY statements. You may even consider creating subfolders of 10-15 minute increments within the folders for each hour."
--reducing the number of files in each directory improves the performance of your COPY statements. meaning more partition, better the performance.
It's A & D : https://docs.snowflake.com/en/user-guide/data-load-considerations-stage#organizing-data-by-path
A-> When loading your staged data, narrow the path to the most granular level that includes your data for improved data load performance
D-> Organizing your data files by path lets you copy any fraction of the partitioned data into Snowflake with a single command
When staging regular data sets, we recommend partitioning the data into logical paths that include identifying details such as geographical location or other source identifiers, along with the date when the data was written.
Organizing your data files by path lets you copy any fraction of the partitioned data into Snowflake with a single command. This allows you to execute concurrent COPY statements that match a subset of files, taking advantage of parallel operations.
https://docs.snowflake.com/en/user-guide/data-load-considerations-stage#organizing-data-by-path
A voting comment increases the vote count for the chosen answer by one.
Upvoting a comment with a selected answer will also increase the vote count towards that answer by one.
So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
JRayan
1 week agoMatthieuDN
4 weeks agod22770a
4 months, 1 week agoLematthew31
9 months, 3 weeks agoyaho5
10 months, 2 weeks agoMitchdu
1 month, 3 weeks ago