So far in this series we’ve uploaded files using the Snowsight UI, which has a limitation of 50mb currently. In my experience, not many data files are 50mb or less (even when compressed). For testing and demo purposes, this shouldn’t be an issue; however, in practice, data engineers need to stage files much larger thanContinue reading “Snowflake: Upload to Stage With Snowpark”
Tag Archives: cloud
Snowflake: Loading Data from Stage
In the previous articles in this series, we’ve created a named internal stage and connected to an Amazon S3 Bucket as an external stage. So now what? We need to load the data from the staged file to a table so that we can execute SQL Commands against the data as needed. In this postContinue reading “Snowflake: Loading Data from Stage”
Snowflake: Getting Started with Stages
One of the most fundamental tools in the toolbox for data developers is loading a data file from a staging, or landing, location into a database. From there the possibilities are endless to transform the data through code to fit your needs. For a lot of developers with on-premises solutions, this takes the form ofContinue reading “Snowflake: Getting Started with Stages”
Eric Heilman 