pipely

KO | EN

gitlite — search

#javascript #python #hacktoberfest #ai #golang #deep-learning #nodejs #macos #java #windows #kubernetes #awesome-list #pytorch #open-source

(★ 23)

Visualize pipeline definitions for AWS Data Pipeline

pipely Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

pipely
======
[![Gem Version](https://badge.fury.io/rb/pipely.png)](http://badge.fury.io/rb/pipely) [![Build Status](https://travis-ci.org/swipely/pipely.png?branch=master)](https://travis-ci.org/swipely/pipely) [![Code Climate](https://codeclimate.com/repos/524b941156b1025b6c08a96a/badges/c0ad2bbec610f1d0f0f7/gpa.png)](https://codeclimate.com/repos/524b941156b1025b6c08a96a/feed)

Build, deploy, and visualize pipeline definitions for AWS Data Pipeline

"AWS Data Pipeline is a web service that you can use to automate the movement and transformation of data. With AWS Data Pipeline, you can define data-driven workflows, so that tasks can be dependent on the successful completion of previous tasks."

http://docs.aws.amazon.com/datapipeline/latest/DeveloperGuide/what-is-datapipeline.html

## Install

(First install [GraphViz](http://www.graphviz.org) if it is not already installed.)

Into Gemfile from rubygems.org:

gem 'pipely'

Into environment gems from rubygems.org:

gem install pipely

## Usage

### Rake Tasks

Coming soon.

rake definition        # Graphs the full pipeline definition using Graphviz
    rake deploy            # Deploy pipeline
    rake graph             # Graphs the full pipeline definition using Graphviz
    rake upload_steps      # Upload Data Pipeline steps to S3

In order to run these tasks, you must have an aws-sdk credentials file.
This can be created by running `aws cli configure`, as described [in the aws-sdk docs](http://docs.aws.amazon.com/AWSSdkDocsRuby/latest/DeveloperGuide/ruby-dg-setup.html#set-up-creds).

### Command-line Interface

(If you used the Gemfile install, prefix the below commands with `bundle exec`.)

To render a JSON pipeline definition as a PNG graph visualization:

pipely definition.json

To specify the output path for PNG files:

pipely -o path/to/graph/pngs definition.json

pipely

pipely Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

pipely

pipely Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README