Easier Integrations with Cloud Services

I’ve spent a lot of time in the past building out mundane code to integrate data between different platforms. While it’s never difficult, it’s always a time-consuming task to learn the new packages, read through the documentation, and ultimately go through trial and error. I figured there had to be an easier way to help teams get integrations up and running quickly.

To try and combat this issue, our team at Shipyard built out over 50 CLIs into what we call “Blueprints” that we've open-sourced. Every Blueprint is designed to do exactly one action (ex. download data, upload data, execute query, send message), work directly with CSVs, and have minimal dependencies. To run the Blueprints locally, all you need to do is:

1. clone the repo

2. create a virtual environment

3. install packages in requirements.txt

4. In the main folder of the repo, run python3 script_name.py with any command line arguments.

These commands can be executed manually or scheduled to run in succession. In our platform, we have a native integration with these blueprints that allows you to quickly use them with just a few inputs.

Here’s a list of the Blueprints for easy access:

• Salesforce
• Email
• PostgreSQL
• Amazon Athena
• SQL Server
• MySQL
• Snowflake
• Amazon Redshift
• Bigquery
• Box
• Dropbox
• Google Sheets
• Amazon S3
• Azure Blob Storage
• Google Cloud Storage
• Google Drive
• Slack
• SFTP
• FTP

Hope these are helpful to the community!