How to ingest Progress OpenEdge database files into Snowflake

Hi All, I have a requirement to ingest various database files into Snowflake. In particular, I'm interested in database log files (.lg) and transaction history files (.tn).

 

Is anyone aware of a direct integration between Openedge/Snowflake which would allow me to ingest these files? If not, is there a recommended approach to unload these files to a cloud storage bucket like S3?

 

Thanks in advance!


  • Muhammad Ahsan Saleem (CNS Engineering)

    Based on my experience, there’s no native or direct integration between OpenEdge and Snowflake for ingesting files. The practical approach is to export data from OpenEdge to structured flat files (CSV/JSON) and then load them into Snowflake via S3 using Snowpipe or the COPY INTO command. You can also check the official OpenEdge and Snowflake documentation.

  • Michael Costner (Customer)

    Thanks Muhammad. I am new to OpenEdge. Do you have an code example or example docs you could share about unloading files to S3?

     

    Thanks again!

  • Dmitri Levin (Customer)

    The snowflake database has so called "Stage Areas". That is a location from where Snowflake will load the data.

    And in case of S3, it will be "External" Stage.

    On a OpenEdge side you just need to export the data in appropreate format that Snowflake will accept: CSV, JSON, Parquet, XML, Avro, ORC. You can even compress the files then with gzip or something like it.