So far in this series we’ve uploaded files using the Snowsight UI, which has a limitation of 50mb currently. In my experience, not many data files are 50mb or less (even when compressed). For testing and demo purposes, this shouldn’t be an issue; however, in practice, data engineers need to stage files much larger thanContinue reading “Snowflake: Upload to Stage With Snowpark”
Tag Archives: data warehouse
Snowflake: Loading Data from Stage
In the previous articles in this series, we’ve created a named internal stage and connected to an Amazon S3 Bucket as an external stage. So now what? We need to load the data from the staged file to a table so that we can execute SQL Commands against the data as needed. In this postContinue reading “Snowflake: Loading Data from Stage”
Snowflake: Connect to S3 Bucket
Create An Amazon S3 External Stage External stages with cloud providers such as Amazon AWS, Google Cloud Platform or Microsoft Azure can be thought of as “windows” from Snowflake to a set of files in an outside location. Like an internal stage, an external stage can be created with just a few lines of code.Continue reading “Snowflake: Connect to S3 Bucket”
Eric Heilman 