What we do

An Introduction into Modular Data Logistics.

Pollinate is a modular extract and load service; a type of tool that help organizations manage their data more effectively. We do this by providing a flexible and scalable approach to data logistics, the first and last steps in every analytical data process.

Our users define and schedule workflows by pick and choosing connectors from a repository of highly performant and thoroughly tested data connectors.

What are modular extract and load Services?

Extract and load connectors are composable and modular when their interfaces and data exchange protocols are standardized. When a target connector doesn't need to know which source connector is supplying the data, and vice versa, you can connect every source connector to every target connector. As a result connectors become interchangeable and they can easily be combined and reconfigured into different workflows. This makes the extract and load process more efficient and flexible, enabling organizations to quickly and more easily adapt to changing business needs.

How do Pollinate connectors exchange data?

Pollinate connectors use Annotated Apache Arrow (triple-A) tables to exchange data. Apache Arrow is a high-performing and widely-adopted data layout standard. Pollinate source connectors output data laid out as Apache Arrow tables, with added annotations and metadata like the table name and it's source path. Target connectors handle data of this structure, using and often mapping annotations to what its target system needs to organize the data properly.

Where do Pollinate connectors run?

Unless otherwise specified, Pollinate connectors run on Modal, which in theory can be executed anywhere and in practice usually runs on AWS compute in the US. If you need connectors to run in a specific geography, please contact us about the possibilities on our Discord channel, or by email via [email protected].