poolio

KO | EN

gitlite — search

#javascript #python #hacktoberfest #ai #llm #golang #android #linux #nodejs #windows #cli #vue #security #openai

(★ 8)

Node.js / NPM module for creating custom worker pools using child processes.

poolio Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Poolio

[![Build Status](https://travis-ci.org/ORESoftware/poolio.svg?branch=master)](https://travis-ci.org/ORESoftware/poolio)

##  => a versatile process pool for Node.js

* create a pool of N workers
* define the start script for each worker in the pool
* kill workers after each task and automatically generate a new worker on exit, or more likely, reuse the same
workers for the lifecycle of the worker pool.
* dynamically add or remove workers at will

This module behaves much like these two pre-existing modules:

* core: https://nodejs.org/api/cluster.html#cluster_cluster_setupmaster_settings
* userland: https://github.com/thisandagain/fork-pool

This module strives for a better implementation and simpler API. Like the above,
this lib utilizes a child_process pool, using child_process.fork() like so:

```javascript

const cp = require('child_process');
const n = cp.spawn('node',['<your-worker-script>']);

```

## Installation

```bash
npm install -S poolio
```

## Basic Use

```js

const {Pool} = require('poolio');

// in the current process, we initialize a pool
const pool = new Pool({
    filePath: 'child.js',    //path is relative to root of your project, but it's best to pass in an absolute path
    size: 3
});

function rankPostsUsingWorkerPool(postIds){

return pool.anyp({action: 'run', posts: postIds})
    .then(function(){
        log.info('successfully processes post ranking.');
    })
    .catch(function (err) {
        log.error(err);
    });
    
}

// in a child process - simple example

process.on('message', function (data) {   //use the closure, it is better that way

```

## Advanced use

```js

// in the parent process, we require the module and initialize a pool

const Pool = require('poolio');

const pool = new Pool({
    filePath: 'child.js',    //path is relative to root of your project
    size: 5
});

function doHeavyDataIntensiveAsyncWork(data){
    return pool.anyp({action: 'all', data: data}); // return the promise
}

// in a child process - advanced example

const _ = require('lodash');
const domain = require('domain');

process.on('message', function (data) {   //use the closure, it is better that way

```

poolio

poolio Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

poolio

poolio Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README