DataDuck - GitLite

KO | EN

gitlite — search

#javascript #python #hacktoberfest #ai #typescript #rust #linux #docker #macos #windows #kubernetes #security #ios #open-source

DataDuck

(★ 60)

DataDuck ETL - the extract-transform-load framework for data warehousing

파일 탐색기

최종 버전 다운로드 (.zip)

- console
- dataduck
- setup
- - console.md
  - dbconsole.md
  - etl.md
  - quickstart.md
  - README.md
  - recreate.md
  - show.md
- - airbrake.md
  - optimizely.md
  - semrush.md
  - sentry.md
- - getting_started.md
  - README.md
- - incremental_vs_full_loading.md
  - README.md
- contents.yml
- README.md
- - .gitignore
  - .ruby-version
  - Gemfile
  - README.md
- - commands.rb
  - database.rb
  - destination.rb
  - etl.rb
  - logs.rb
  - mysql_source.rb
  - postgresql_source.rb
  - redshift_destination.rb
  - s3_object.rb
  - source.rb
  - sql_db_source.rb
  - table.rb
  - util.rb
  - version.rb
- - module_vars.rb
- - integration_table.rb
- dataduck.rb
- dataduck_spec.rb
- logs_spec.rb
- spec_helper.rb
- table_spec.rb
- util_spec.rb
- logo.png
.gitignore
.rspec
dataduck.gemspec
DEV_README.md
Gemfile
Rakefile
README.md

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# DataDuck ETL

##### Set up in under 5 minutes

DataDuck ETL is probably the quickest extract-transform-load framework system to set up. If you want to set up a data warehouse, give DataDuck ETL a try.

##### Extract-transform-load to Amazon Redshift

DataDuck ETL is currently focused on loading to Amazon Redshift (through Amazon S3).

![DataDuck ETL](https://raw.githubusercontent.com/DataDuckETL/DataDuck/master/static/logo.png "DataDuck ETL")

## Installation

##### Instructions for using DataDuck ETL

Create a new, empty directory. Inside this directory, create a file named Gemfile, and add the following to it:

```ruby
source 'https://rubygems.org'

gem 'dataduck'
```

Then execute:

$ bundle install

Finally, run the quickstart command:

$ dataduck quickstart

The quickstart wizard will ask you for credentials to your database, then create the basic setup for your project. After the quickstart, you'll still need to edit the .env and config/base.yml files, as well as customize your tables. Finally, your project's ETL can be run by running the `dataduck etl all` command.

If you'd like to run this regularly, such as every night, it's recommended to use the [whenever](https://github.com/javan/whenever) gem to manage a cron job to regularly run the ETL.

## Documentation

Visit the [docs page](http://dataducketl.com/docs/overview/welcome) to read the documentation. The docs page is autogenerated from the files in this project's docs directory.

## Third Party Integrations

There are many third party integrations, including Optimizely, SEMrush, Sentry, and Airbrake. Visit the [docs page](http://dataducketl.com/docs/overview/welcome) to learn more about integrating.

## Contributing

To contribute, get in touch at http://DataDuckETL.com/ so that we can share the [Contributor License Agreement (CLA)](https://en.wikipedia.org/wiki/Contributor_License_Agreement) with you, then create a pull request.

## License

You can buy a license directly from Supported Source at [https://supportedsource.org/projects/dataduck-etl](https://supportedsource.org/projects/dataduck-etl)

You're also welcome to get in touch at [http://dataducketl.com/](http://dataducketl.com/) for invoicing or anything else.