Need private packages and team management tools?Check out npm Teams »

@cabbiepete/sitemapper

3.0.2 • Public • Published

Sitemap-parser

Insipired by https://github.com/hawaiianchimp/sitemapper

Allows loading of sitemap.xml.gz files.

// TODO badges Build Status Monthly Downloads npm version dependencies Status Inline docs

Parse through a sitemaps xml to get all the urls for your crawler.

Version 3

Installation

npm install @cabbiepete/sitemapper

Simple Example

const Sitemapper = require('sitemapper');
 
const sitemap = new Sitemapper();
 
sitemap.fetch('http://wp.seantburke.com/sitemap.xml').then(function(sites) {
  console.log(sites);
});
 

Examples in ES5

const Sitemapper = require('sitemapper');
 
const Google = new Sitemapper({
  url: 'https://www.google.com/work/sitemap.xml',
  timeout: 15000 //15 seconds
});
 
Google.fetch()
  .then(function (data) {
    console.log(data);
  })
  .catch(function (error) {
    console.log(error);
  });
 
 
// or
 
 
const sitemap = new Sitemapper();
 
sitemapper.timeout = 5000;
sitemapper.fetch('http://wp.seantburke.com/sitemap.xml')
  .then(function (data) {
    console.log(data);
  })
  .catch(function (error) {
    console.log(error);
  });
 

Examples in ES6

import Sitemapper from 'sitemapper';
 
const Google = new Sitemapper({
  url: 'https://www.google.com/work/sitemap.xml',
  timeout: 15000, // 15 seconds
});
 
Google.fetch()
  .then(data => console.log(data.sites))
  .catch(error => console.log(error));
 
 
// or
 
 
const sitemapper = new Sitemapper();
sitemapper.timeout = 5000;
 
sitemapper.fetch('http://wp.seantburke.com/sitemap.xml')
  .then(({ url, sites }) => console.log(`url:${url}`, 'sites:', sites))
  .catch(error => console.log(error));

Install

npm i @cabbiepete/sitemapper

DownloadsWeekly Downloads

2

Version

3.0.2

License

MIT

Unpacked Size

14.8 kB

Total Files

8

Last publish

Collaborators

  • avatar