
Community Corner — Michael Costner (Customer) asked a question.
How to ingest Progress OpenEdge database files into Snowflake
Hi All, I have a requirement to ingest various database files into Snowflake. In particular, I'm interested in database log files (.lg) and transaction history files (.tn).
Is anyone aware of a direct integration between Openedge/Snowflake which would allow me to ingest these files? If not, is there a recommended approach to unload these files to a cloud storage bucket like S3?
Thanks in advance!
Based on my experience, there’s no native or direct integration between OpenEdge and Snowflake for ingesting files. The practical approach is to export data from OpenEdge to structured flat files (CSV/JSON) and then load them into Snowflake via S3 using Snowpipe or the COPY INTO command. You can also check the official OpenEdge and Snowflake documentation.
Thanks Muhammad. I am new to OpenEdge. Do you have an code example or example docs you could share about unloading files to S3?
Thanks again!
The snowflake database has so called "Stage Areas". That is a location from where Snowflake will load the data.
And in case of S3, it will be "External" Stage.
On a OpenEdge side you just need to export the data in appropreate format that Snowflake will accept: CSV, JSON, Parquet, XML, Avro, ORC. You can even compress the files then with gzip or something like it.
With Nichol’s permission, I’ll share this :)
if snowflake has a PostgreSQL connector then you may want to look at our Spirit Medium product which exposes OpenEdge tables as PostgreSQL. So any tool that has a pg driver can read/write/delete OpenEdge table data directly.
https://www.linkedin.com/feed/update/urn:li:activity:7427869188129738752
https://whogloo.io/products/spirit-medium