Package category
Scraping and browser automation
Headless browsers, crawlers and HTML extraction.
373 packages7 comparisons
Packages compared
373 packages
| Package | Weekly downloads | 12-month change | 52 weeks | Gzip | Last release | Module | Types | Categories |
|---|---|---|---|---|---|---|---|---|
| jest-playwright-preset Running tests using Jest & Playwright. | 508.4k | -58% | - | 2 years ago 4.0.0 | CommonJS | Bundled | Testing, Scraping and browser automation | |
| firefox-profile firefox profile for selenium WebDriverJs, admc/wd or any other node selenium driver that supports capabilities | 495.6k | +216% | - | 1 month ago 4.7.1 | CommonJS | Bundled | Scraping and browser automation | |
| mailosaur The Mailosaur Node library lets you integrate email and SMS testing into your continuous integration process. | 468.9k | +79% | - | 3 months ago 11.1.1 | ESM + CommonJS | Bundled | Email, Scraping and browser automation | |
| axe-playwright Custom Playwright commands to inject axe-core and test for a11y | 424.1k | +23% | - | 1 year ago 2.2.2 | CommonJS | Bundled | Accessibility, Scraping and browser automation | |
| proxy-chain Node.js implementation of a proxy server (think Squid) with support for SSL, authentication, upstream proxy chaining, and protocol tunneling. | 422.5k | +145% | - | 17 days ago 3.0.1 | ESM only | Bundled | Scraping and browser automation | |
| codeceptjs Supercharged End 2 End Testing Framework for NodeJS | 415.4k | +171% | - | 2 days ago 4.2.0 | ESM + CommonJS | Bundled | Testing, Scraping and browser automation | |
| playwright-bdd BDD Testing with Playwright runner | 409.9k | +268% | - | 18 days ago 9.2.1 | CommonJS | Bundled | Testing, Scraping and browser automation | |
| @crawlee/types Shared types for the crawlee projects | 408.7k | - | - | - | 1 month ago 3.18.1 | ESM + CommonJS | Bundled | Scraping and browser automation |
| puppeteer-extra Teach puppeteer new tricks through plugins. | 380k | +45% | - | 3 years ago 3.3.6 | ESM + CommonJS | Bundled | Scraping and browser automation | |
| header-generator NodeJS package for generating realistic browser-like HTTP headers. | 365.9k | +183% | - | 1 month ago 2.1.88 | ESM + CommonJS | Bundled | Scraping and browser automation, TypeScript tooling | |
| playwright-ctrf-json-reporter A Playwright JSON test reporter to create test results reports | 306.5k | +176% | - | 6 months ago 0.0.29 | CommonJS | Bundled | Scraping and browser automation, Testing | |
| apify-client Apify API client for JavaScript | 282.4k | +231% | - | 1 month ago 2.25.0 | ESM + CommonJS | Bundled | Scraping and browser automation | |
| @takumi-rs/core Render OG images from Takumi node trees with native Node.js bindings. No headless browser. | 261k | - | - | - | 10 days ago 2.14.0 | ESM + CommonJS | Bundled | Cloud SDKs, Scraping and browser automation |
| fingerprint-generator NodeJS package for generating realistic browser fingerprints. | 253.5k | +227% | - | - 2.1.88 | ESM + CommonJS | Bundled | Scraping and browser automation, TypeScript tooling | |
| @mintlify/scraping Scrape documentation frameworks to Mintlify docs | 250.3k | - | - | - | today 4.0.1041 | ESM only | Bundled | Scraping and browser automation |
| monocart-reporter A playwright test reporter. Shows suites/cases/steps with tree style, markdown annotations, custom columns/formatters/data collection visitors, console logs, style tags, send email. | 245k | +125% | - | - 2.13.1 | ESM + CommonJS | Bundled | Email, Testing | |
| @takumi-rs/wasm Render OG images from Takumi node trees with WebAssembly. No headless browser. | 227.1k | - | - | - | 10 days ago 2.14.0 | ESM + CommonJS | Bundled | Cloud SDKs, Scraping and browser automation |
| open-graph-scraper Node.js scraper module for Open Graph and Twitter Card info | 225.1k | +251% | - | 2 months ago 6.12.0 | ESM + CommonJS | Bundled | Scraping and browser automation | |
| @takumi-rs/core-linux-x64-gnu Render OG images from Takumi node trees with native Node.js bindings. No headless browser. | 221.9k | - | - | - | 10 days ago 2.14.0 | CommonJS | None | Cloud SDKs, Scraping and browser automation |
| @memlab/e2e memlab browser E2E interaction libraries | 217.8k | - | - | - | 26 days ago 2.0.5 | CommonJS | Bundled | Scraping and browser automation, Testing |
| json-crawl Async and sync crawler for json object | 216.5k | +171% | - | 2 years ago 0.5.3 | ESM + CommonJS | Bundled | Scraping and browser automation | |
| jest-dev-server Starts a server before your Jest tests and tears it down after. | 212.5k | -18% | - | - 11.0.0 | CommonJS | Bundled | Testing, Scraping and browser automation | |
| @sparticuz/chromium-min Chromium Binary for Serverless Platforms | 207.4k | - | - | - | 13 days ago 153.0.0 | ESM only | Bundled | Cloud SDKs, Scraping and browser automation |
| expect-puppeteer Assertion toolkit for Puppeteer. | 197.6k | -17% | - | 1 year ago 11.0.0 | CommonJS | Bundled | Testing, Scraping and browser automation | |
| @fingerprintjs/botd botd is a browser library for JavaScript bot detection | 193k | - | - | - | 10 months ago 2.0.0 | ESM + CommonJS | Bundled | Scraping and browser automation |
| pa11y Pa11y is your automated accessibility testing pal | 187.1k | +5% | - | 28 days ago 10.0.0 | CommonJS | None | Accessibility, Testing | |
| @crawlee/utils A set of shared utilities that can be used by crawlers | 175k | - | - | - | 1 month ago 3.18.1 | ESM + CommonJS | Bundled | Scraping and browser automation |
| @crawlee/core The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer. | 174.5k | - | - | - | 1 month ago 3.18.1 | ESM + CommonJS | Bundled | Scraping and browser automation |
| @msw/playwright Mock Service Worker binding for Playwright | 144.1k | - | - | - | 5 months ago 0.6.7 | ESM only | Bundled | Testing, Scraping and browser automation |
| @crawlee/http The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer. | 139.2k | - | - | - | 1 month ago 3.18.1 | ESM + CommonJS | Bundled | Scraping and browser automation |
| @lambdatest/node-tunnel Nodejs bindings for LambdaTest Tunnel | 136.2k | - | - | - | 18 days ago 4.0.13 | CommonJS | None | Scraping and browser automation, Testing |
| global-jsdom Enable DOM in Node.js | 133.3k | +41% | - | 20 days ago 30.0.0 | ESM + CommonJS | Bundled | Scraping and browser automation | |
| @crawlee/cheerio The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer. | 133.1k | - | - | - | 1 month ago 3.18.1 | ESM + CommonJS | Bundled | Scraping and browser automation |
| @metascraper/helpers Shared helper utilities used across metascraper rules for parsing and normalizing metadata. | 132.1k | - | - | - | 1 month ago 5.56.2 | CommonJS | None | Parsers and serialisers, Scraping and browser automation |
| jest-puppeteer Run your tests using Jest & Puppeteer. | 129.5k | -15% | - | - 11.0.0 | CommonJS | Bundled | Scraping and browser automation | |
| momentic The official CLI for Momentic. Build, run, and manage end-to-end tests through natural language prompts. | 125.3k | +305% | - | today 3.60.0 | ESM only | None | Testing, CLI tools and terminal utilities | |
| @happy-dom/jest-environment Use Happy DOM as environment in Jest. | 125.1k | - | - | - | 13 days ago 20.14.5 | ESM only | Bundled | Scraping and browser automation, Testing |
| md-to-pdf CLI tool for converting Markdown files to PDF. | 123k | +361% | - | 10 months ago 5.2.5 | CommonJS | Bundled | CLI tools and terminal utilities, Parsers and serialisers | |
| @crawlee/browser The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer. | 122.6k | - | - | - | 1 month ago 3.18.1 | ESM + CommonJS | Bundled | Scraping and browser automation |
| @crawlee/playwright The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer. | 121.5k | - | - | - | 1 month ago 3.18.1 | ESM + CommonJS | Bundled | Scraping and browser automation |
| linkinator Find broken links, missing images, etc in your HTML. Scurry around your site and find all those broken links. | 121.2k | +20% | - | 27 days ago 8.1.0 | ESM only | Bundled | Scraping and browser automation, TypeScript tooling | |
| recrawl-sync [](https://www.npmjs.com/package/recrawl-sync) [](https://github.com/aleclarson/recrawl/actions/workflows/release.yml) | 119.8k | -27% | - | 3 years ago 2.2.3 | CommonJS | Bundled | Files and file systems, Scraping and browser automation | |
| wd WebDriver/Selenium 2 node.js client | 119k | -22% | - | 5 years ago 1.14.0 | CommonJS | None | Scraping and browser automation, Testing | |
| metascraper Scrape metadata from any URL using Open Graph, JSON-LD, HTML meta tags, and smart fallbacks. | 117.3k | +231% | - | 7 days ago 5.58.1 | CommonJS | Bundled | Scraping and browser automation | |
| nightwatch Easy to use Node.js based end-to-end testing solution for web applications using the W3C WebDriver API. | 114.3k | -30% | - | 4 months ago 3.16.0 | CommonJS | Bundled | Testing, Scraping and browser automation | |
| @crawlee/puppeteer The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer. | 113.3k | - | - | - | 1 month ago 3.18.1 | ESM + CommonJS | Bundled | Scraping and browser automation |
| serpapi Scrape and parse search engine results using SerpApi. | 112.9k | +145% | - | 1 year ago 2.2.1 | ESM + CommonJS | Bundled | Parsers and serialisers, Scraping and browser automation | |
| @crawlee/templates Templates for the crawlee projects | 111.9k | - | - | - | 1 month ago 3.18.1 | ESM + CommonJS | Bundled | Scraping and browser automation |
| @crawlee/cli The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer. | 111.8k | - | - | - | 1 month ago 3.18.1 | ESM + CommonJS | Bundled | Scraping and browser automation, CLI tools and terminal utilities |
| @crawlee/jsdom The scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer. | 111.1k | - | - | - | 1 month ago 3.18.1 | ESM + CommonJS | Bundled | Scraping and browser automation |
12-month change compares the average of the last 4 weeks of downloads with the first 4 weeks of the 52-week series. Gzip size is for the whole package, as measured by Bundlephobia. "-" means the value has not been fetched.
- jest-playwright-presetRunning tests using Jest & Playwright.
- firefox-profilefirefox profile for selenium WebDriverJs, admc/wd or any other node selenium driver that supports capabilities
- mailosaurThe Mailosaur Node library lets you integrate email and SMS testing into your continuous integration process.
- axe-playwrightCustom Playwright commands to inject axe-core and test for a11y
- proxy-chainNode.js implementation of a proxy server (think Squid) with support for SSL, authentication, upstream proxy chaining, and protocol tunneling.
- codeceptjsSupercharged End 2 End Testing Framework for NodeJS
- playwright-bddBDD Testing with Playwright runner
- @crawlee/typesShared types for the crawlee projects
- puppeteer-extraTeach puppeteer new tricks through plugins.
- header-generatorNodeJS package for generating realistic browser-like HTTP headers.
- playwright-ctrf-json-reporterA Playwright JSON test reporter to create test results reports
- apify-clientApify API client for JavaScript
- @takumi-rs/coreRender OG images from Takumi node trees with native Node.js bindings. No headless browser.
- fingerprint-generatorNodeJS package for generating realistic browser fingerprints.
- @mintlify/scrapingScrape documentation frameworks to Mintlify docs
- monocart-reporterA playwright test reporter. Shows suites/cases/steps with tree style, markdown annotations, custom columns/formatters/data collection visitors, console logs, style tags, send email.
- @takumi-rs/wasmRender OG images from Takumi node trees with WebAssembly. No headless browser.
- open-graph-scraperNode.js scraper module for Open Graph and Twitter Card info
- @takumi-rs/core-linux-x64-gnuRender OG images from Takumi node trees with native Node.js bindings. No headless browser.
- @memlab/e2ememlab browser E2E interaction libraries
- json-crawlAsync and sync crawler for json object
- jest-dev-serverStarts a server before your Jest tests and tears it down after.
- @sparticuz/chromium-minChromium Binary for Serverless Platforms
- expect-puppeteerAssertion toolkit for Puppeteer.
- @fingerprintjs/botdbotd is a browser library for JavaScript bot detection
- pa11yPa11y is your automated accessibility testing pal
- @crawlee/utilsA set of shared utilities that can be used by crawlers
- @crawlee/coreThe scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
- @msw/playwrightMock Service Worker binding for Playwright
- @crawlee/httpThe scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
- @lambdatest/node-tunnelNodejs bindings for LambdaTest Tunnel
- global-jsdomEnable DOM in Node.js
- @crawlee/cheerioThe scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
- @metascraper/helpersShared helper utilities used across metascraper rules for parsing and normalizing metadata.
- jest-puppeteerRun your tests using Jest & Puppeteer.
- momenticThe official CLI for Momentic. Build, run, and manage end-to-end tests through natural language prompts.
- @happy-dom/jest-environmentUse Happy DOM as environment in Jest.
- md-to-pdfCLI tool for converting Markdown files to PDF.
- @crawlee/browserThe scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
- @crawlee/playwrightThe scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
- linkinatorFind broken links, missing images, etc in your HTML. Scurry around your site and find all those broken links.
- recrawl-sync[](https://www.npmjs.com/package/recrawl-sync) [](https://github.com/aleclarson/recrawl/actions/workflows/release.yml)
- wdWebDriver/Selenium 2 node.js client
- metascraperScrape metadata from any URL using Open Graph, JSON-LD, HTML meta tags, and smart fallbacks.
- nightwatchEasy to use Node.js based end-to-end testing solution for web applications using the W3C WebDriver API.
- @crawlee/puppeteerThe scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
- serpapiScrape and parse search engine results using SerpApi.
- @crawlee/templatesTemplates for the crawlee projects
- @crawlee/cliThe scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.
- @crawlee/jsdomThe scalable web crawling and scraping library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.