jankowalski

Tag: etl

  • openESB ETL plugin remarks

    ETL plugin for openESB for small data migration project is awesome. I don’t know how would it work for small data warehouse issue where you get 4 gb of data daily. Maybe fine. But for other small migration project it does the job just fine and first of all it’s amazingly easy to setup. I think that blind dog of one friend of mine could make a project with this tool. There is just one mistake in the last GlassfishESB version 2.2. This plugin forget to set two variables. You must put them by hand in:
    files/nbproject/project.properties (add at the end, mine two entries with path would look like)

    o.n.soa.libs.wsdl4j.dir=C:/GlassFishESBv22/netbeans/soa2
xml.validation.dir=C:/GlassFishESBv22/netbeans/xml2

    After that the project is ready to be build and generates wsdl file required for another operations: like including in business process or putting just inside composite application.

  • bpel + ETL + scheduler + db log

    bpel + ETL + scheduler + db log

    Simple idea of how to use openESB and scheduled invocation of ETL process and store log data in database. Best ETL method is “Stagging” that uses “stagging table”. It simply transfers a bunch of rows from one db to another firstly to the middle buffer table and then to the target one. No delays, no empty tables, and data always fresh and ready for processing :)