Open Lab
Integrant Open Lab is where we share with the community. Our first open lab project is still in the requirements and design phase, but once we have a working model that is useful, we will open up the repo and invite collaborators.
DataStream
DataStream is our flagship open source ETL tool project. We found that there is a lack of basic affordable ETL tools that can just shift data around. We have a long history with Microsoft SQL Server Integration Services which is probably the most comparable feature set to what we want to achieve. Other ETL tools we have used or considered tend to focus on Big Data and come with big cost and infrastructure requirements.
DataStream will have a modular design with a CLI and JSON and YAML ETL definition schema. We hope to supplement this with a UI that enables code generation and execution visualisation. We will build this using web frameworks so that it can be hosted anywhere, but can also be embed in Electron as a stand alone application.
DataStream has the following design goals:
Free to use
Simple to use
Source control friendly
Extensible
Secret Lab
What goes on here? That's a secret.
But we will share our roadmap as projects start to get some legs. We will also spin off a tech blog as a result of our "secret work".
