Wondering what’s next for npm?Check out our public roadmap! »

    @restorecommerce/gql-bot

    0.1.8 • Public • Published

    gql-bot

    VersionBuild StatusDependenciesCoverage Status

    This is an automated GraphQL API client.

    Example use cases:

    • Mass data imports.
    • Seeding of GraphQL based services.
    • Reset (deletion and re-import of data) of GraphQL based services.

    Supported data format: YAML.

    The jobs are defined as JSON files whose syntax can be seen in a test job.

    Usage

    The module mainly consists of two usable components.

    GraphQL Client

    A wrapper around graphql-request. It is used to connect to a GraphQL endpoint with custom headers, further prepare the mutation parameters based on job specifications and parsed resources, and for making the mutations/queries requests. Such resources are described in a YAML file, and they are initially parsed by the Job Processor before handing them to the Client.

    Job Processor

    The job processor implements a pipeline mechanism to process JSON-based job files, which can contain one or more tasks, which can be run concurrently or sequentially. The job can have different options such as the maximum number of concurrent tasks and each task contains useful information for the GraphQL Client, such as the file path filter (e.g: 'create*.yaml'), the desired operation, batching, or useful metadata. Currently, the only implemented operation is 'sync'. There is a GraphQL-based processor, which performs calls to the GraphQL client and a generic processor, to which the GraphQL-specific processor is provided.

    Batching

    After reading the resources from the .yaml file, splitting of documents is done in streaming fashion, using yaml-document-stream, (which internally uses js-yaml for single document parsing), and then gathered into a single payload or optionally batched if the property batchSize is provided inside the job's task properties. This way, a larger amount of data can be imported as-well, by making subsequent GraphQL requests.

    Example:

    import { GraphQLProcessor, JobProcessor, Job } from 'gql-bot';
    
    const jobInfo = JSON.parse(fs.readFileSync('./test/job1.json', 'utf8'));
    
    // instantiating a job processor
    jobInfo.options.processor = new GraphQLProcessor({
        entry: 'http://example.com/graphql',
        apiKey: 'apiKey'
      });
    const jobProcessor = new JobProcessor(jobInfo);
    
    // starting a job
    const job = new Job(); // an extension of EventEmitter which can receive job-related options
    job.on('progress', (task) => {
      console.log('Progress:', task.name, task.progress);
    });
    job.on('done', () => {
      done();
    });
    await jobProcessor.start(jobInfo, job);

    Refer to tests for more details.

    Events

    The following events are issued by the Job object:

    • progress (contains info specific with the task progress percentage and the task's description)
    • warn
    • error
    • done

    Install

    npm i @restorecommerce/gql-bot

    DownloadsWeekly Downloads

    16

    Version

    0.1.8

    License

    MIT

    Unpacked Size

    39.2 kB

    Total Files

    18

    Last publish

    Collaborators

    • avatar
    • avatar
    • avatar
    • avatar
    • avatar