A minimalistic nodejs fork queue with typescript support.
npm install ts-fork-queue
yarn add ts-fork-queue
This library offers a queue of configurable size that contains tasks. Each task keeps all the information for forking the nodejs process and running a specified module. A scheduler regularly polls the queue to check if tasks can be forked and does so if they can.
The scheduler however does not take care of shutting down tasks. Tasks need to take care of exiting themselves calling
process.exit(), otherwise processes will only be killed when the root process dies.
Create a new
ForkQueue object with the desired configuration (see below). Start the scheduler with
queue.start() and add tasks to be forked calling
Task objects must provide methods to execute a nodejs module.
getCommand(): A path to a nodejs module, relative to current working directory provided with
getArgs(): Any arguments provided to the command.
getCwd(): The current working directory.
toString(): A string representation (used for debugging and error output).
queue.enqueue will throw a
QueueFullError if the queue is full.
If an invalid configuration is provided, an
InvalidConfigError is thrown.
maxQueueSize: number: The maximum size of the queue, i.e. the maximum number of entries that wait to be forked.
maxParallelism: number: The maximum number of tasks that will be executed in parallel. This corresponds to the maximum number of nodejs processes generated.
pollingPeriodSeconds: number: The polling period in seconds (can be a floating point value). The lower this value, the quicker tasks will be checked if they can be scheduled.
Q: Why do I need this library?
A: You probably don't.
Q: Why does it not emit events when tasks are scheduled, error, etc?
A: Because when building this library I did not have any use case for that. I might add events if needed in the future.