Performance Tuning, Reliability Engineering, Cost Optimization / Internals, Research
Presto is an extremely powerful distributed SQL query engine, so at some point you may consider using it to replace SQL-based ETL processes that you currently run on Apache Hive.
Although it is completely possible, you should be aware of some limitations that may affect your SLAs.
Sometimes you need to reload the entire data set from the source storage into Snowflake. For example, you may want to fully refresh a quite large lookup table (2 GB compressed) without keeping the history. Let’s see how to do this in Snowflake and what issues you need to take into account.