Package category
Scraping and browser automation
Headless browsers, crawlers and HTML extraction.
373 packages7 comparisons
Packages compared
373 packages
| Package | Weekly downloads | 12-month change | 52 weeks | Gzip | Last release | Module | Types | Categories |
|---|---|---|---|---|---|---|---|---|
| fdir The fastest directory crawler & globbing alternative to glob, fast-glob, & tiny-glob. Crawls 1m files in < 1s | 136.1m | +290% | - | 1 year ago 6.5.0 | ESM + CommonJS | Bundled | Files and file systems, Scraping and browser automation | |
| playwright-core A high-level API to automate web browsers | 75.4m | +277% | - | 20 days ago 1.63.0 | ESM + CommonJS | Bundled | Testing, Scraping and browser automation | |
| jsdom A JavaScript implementation of many web standards | 75.1m | +141% | - | 3 days ago 30.1.1 | CommonJS | None | Scraping and browser automation, Node.js utilities | |
| playwright A high-level API to automate web browsers | 69.1m | +260% | - | 20 days ago 1.63.0 | ESM + CommonJS | Bundled | Testing, Scraping and browser automation | |
| environment Check which JavaScript environment your code is running in at runtime: browser, Node.js, Bun, etc | 26.5m | +150% | - | 2 years ago 1.1.0 | ESM only | Bundled | Scraping and browser automation | |
| cheerio The fast, flexible & elegant library for parsing and manipulating HTML and XML. | 19.8m | +87% | - | 8 months ago 1.2.0 | ESM + CommonJS | Bundled | Parsers and serialisers, DOM and browser utilities | |
| puppeteer-core A high-level API to control headless Chrome over the DevTools Protocol | 15.1m | +80% | - | 1 day ago 25.12.0 | ESM + CommonJS | Bundled | Scraping and browser automation | |
| happy-dom Happy DOM is a JavaScript implementation of a web browser without its graphical user interface. It includes many web standards from WHATWG DOM and HTML. | 12.4m | +420% | - | 13 days ago 20.14.5 | ESM only | Bundled | Scraping and browser automation, React | |
| query-selector-shadow-dom use querySelector syntax to search for nodes inside of (nested) shadow roots | 9.6m | +948% | - | 3 years ago 1.0.1 | CommonJS | None | Scraping and browser automation, Testing | |
| webdriver-bidi-protocol This repository contains TypeScript types conforming to the [WebDriver BiDi](https://w3c.github.io/webdriver-bidi/) specification. It also supports WebDriver BiDi extension modules defined in other specifications: | 9.2m | +649% | - | 10 days ago 1.0.1 | CommonJS | Bundled | Scraping and browser automation | |
| puppeteer A high-level API to control headless Chrome over the DevTools Protocol | 8.2m | +67% | - | 1 day ago 25.12.0 | ESM + CommonJS | Bundled | Scraping and browser automation | |
| linkedom A triple-linked lists based DOM implementation | 3.6m | +1428% | - | 2 months ago 0.18.13 | ESM only | Bundled | Scraping and browser automation | |
| robots-parser A specification compliant robots.txt parser with wildcard (*) matching support. | 3.3m | +125% | - | 3 years ago 3.0.1 | CommonJS | Bundled | Scraping and browser automation, Node.js utilities | |
| @appium/types Various type declarations used across Appium | 2.6m | +230% | - | today 1.7.1 | CommonJS | Bundled | Scraping and browser automation, Testing | |
| @appium/support Support libs used across Appium packages | 2.4m | +242% | - | today 7.2.8 | CommonJS | Bundled | Scraping and browser automation, Testing | |
| @appium/schema Appium Configuration Schema | 2.4m | +249% | - | 2 months ago 1.3.0 | CommonJS | Bundled | Scraping and browser automation, Testing | |
| @wdio/utils A WDIO helper utility to provide several utility functions used across the project. | 2.2m | +2% | - | 4 days ago 9.32.0 | ESM only | Bundled | Utility libraries, Scraping and browser automation | |
| selenium-webdriver The official WebDriver JavaScript bindings from the Selenium project | 2m | +19% | - | 15 days ago 4.49.0 | CommonJS | None | Scraping and browser automation, Testing | |
| webdriver A Node.js bindings implementation for the W3C WebDriver and Mobile JSONWire Protocol | 2m | +10% | - | 4 days ago 9.32.0 | ESM + CommonJS | Bundled | Scraping and browser automation, Testing | |
| webdriverio Next-gen browser and mobile automation test framework for Node.js | 2m | +17% | - | 4 days ago 9.32.0 | ESM + CommonJS | Bundled | Testing, Scraping and browser automation | |
| spawnd Spawn a dependent child process. | 1.7m | +15% | - | 1 year ago 11.0.0 | CommonJS | Bundled | Node.js utilities, Scraping and browser automation | |
| @appium/logger A Universal Logger For The Appium Ecosystem | 1.7m | +252% | - | today 2.0.12 | - | - | Logging, Scraping and browser automation | |
| @sparticuz/chromium Chromium Binary for Serverless Platforms | 1.5m | - | - | - | 13 days ago 153.0.0 | - | - | Cloud SDKs, Scraping and browser automation |
| @happy-dom/global-registrator Use Happy DOM globally in a Node.js environment for testing. | 1.5m | - | - | - | 13 days ago 20.14.5 | - | - | Scraping and browser automation |
| agent-browser Browser automation CLI for AI agents | 1.2m | - | - | 8 days ago 0.38.1 | - | - | CLI tools and terminal utilities, Scraping and browser automation | |
| @appium/tsconfig Shared TypeScript Config for Appium | 1.2m | - | - | - | 1 month ago 1.2.1 | - | - | Scraping and browser automation, Testing |
| @browserbasehq/stagehand Browserbase's SDK for building browser agents | 1.1m | - | - | - | 16 days ago 4.1.0 | ESM only | Bundled | Scraping and browser automation, Testing |
| @appium/base-driver Base driver class for Appium drivers | 1.1m | - | - | - | today 10.8.1 | CommonJS | Bundled | Scraping and browser automation, Testing |
| chrome-devtools-mcp MCP server for Chrome DevTools | 1m | +1621% | - | 2 days ago 1.10.1 | ESM only | None | DOM and browser utilities, Scraping and browser automation | |
| @appium/docutils Documentation generation utilities for Appium and related projects | 933k | - | - | - | today 3.0.1 | ESM only | Bundled | Scraping and browser automation, Testing |
| appium Automation for Apps. | 923.5k | +140% | - | today 3.8.0 | CommonJS | Bundled | Scraping and browser automation, Testing | |
| allure-playwright Allure Playwright integration | 923.1k | +74% | - | 9 days ago 3.12.2 | CommonJS | Bundled | Testing, Scraping and browser automation | |
| @mendable/firecrawl-js JavaScript SDK for the Firecrawl API: web scraping, crawling, web search, and scientific literature search over a research paper index of PubMed, bioRxiv, medRxiv and arXiv abstracts | 891.5k | - | - | - | 5 days ago 4.41.0 | ESM only | Bundled | Scraping and browser automation |
| playwright-extra Teach playwright new tricks through plugins. | 874.6k | +491% | - | 3 years ago 4.3.6 | ESM + CommonJS | Bundled | Scraping and browser automation | |
| @appium/base-plugin The base plugin used to create Appium plugins | 862.4k | - | - | - | today 3.3.5 | CommonJS | Bundled | Scraping and browser automation, Testing |
| puppeteer-extra-plugin Base class for puppeteer-extra plugins. | 848.4k | +109% | - | 3 years ago 3.2.3 | ESM + CommonJS | Bundled | Scraping and browser automation | |
| puppeteer-extra-plugin-stealth Stealth mode: Applies various techniques to make detection of headless puppeteer harder. | 834.8k | +123% | - | 3 years ago 2.11.2 | CommonJS | Bundled | Scraping and browser automation | |
| puppeteer-extra-plugin-user-data-dir Custom user data directory for puppeteer. | 833.4k | +113% | - | 3 years ago 2.4.1 | CommonJS | None | Scraping and browser automation | |
| puppeteer-extra-plugin-user-preferences Launch puppeteer with arbitrary user preferences. | 833.1k | +118% | - | 3 years ago 2.4.1 | CommonJS | None | Scraping and browser automation | |
| chromedriver ChromeDriver for Selenium | 737.2k | +14% | - | 2 days ago 154.0.0 | CommonJS | None | Scraping and browser automation, Node.js utilities | |
| webdriver-manager A selenium server and browser driver manager for your end to end tests. | 701.8k | -23% | - | 3 years ago 12.1.9 | CommonJS | None | Testing, Scraping and browser automation | |
| protractor Webdriver E2E test wrapper for Angular. | 700.6k | -19% | - | 6 years ago 7.0.0 | CommonJS | Bundled | Testing, Angular | |
| appium-webdriveragent Package bundling WebDriverAgent | 652.6k | +142% | - | 3 days ago 16.12.10 | ESM only | Bundled | Scraping and browser automation | |
| webdriver-js-extender A plugin which adds additional commands to selenium's javascript implementation of the webdriver client side API | 641.8k | -21% | - | 6 years ago 2.2.0 | CommonJS | Bundled | Scraping and browser automation, Testing | |
| blocking-proxy WebDriver Proxy for testing rich clients. It block certain calls until Angular is done updating the page under test. | 635.5k | -18% | - | 8 years ago 1.0.1 | CommonJS | Bundled | Testing, Scraping and browser automation | |
| @appium/strongbox Persistent storage for Appium extensions | 632.2k | - | - | - | today 2.0.1 | ESM only | Bundled | Scraping and browser automation, Testing |
| jasminewd2 WebDriverJS adapter for Jasmine2. | 619.2k | -24% | - | 8 years ago 2.2.0 | CommonJS | None | Testing, Scraping and browser automation | |
| firecrawl JavaScript SDK for the Firecrawl API: web scraping, crawling, web search, and scientific literature search over a research paper index of PubMed, bioRxiv, medRxiv and arXiv abstracts | 603.1k | +10144% | - | 5 days ago 4.41.0 | ESM only | Bundled | Scraping and browser automation | |
| browserstack-local Nodejs bindings for BrowserStack Local | 586.4k | +20% | - | today 1.5.15 | CommonJS | Bundled | Scraping and browser automation, Testing | |
| jsdom-global Enable DOM in Node.js | 573.4k | -1% | - | 9 years ago 3.0.2 | CommonJS | None | Scraping and browser automation |
12-month change compares the average of the last 4 weeks of downloads with the first 4 weeks of the 52-week series. Gzip size is for the whole package, as measured by Bundlephobia. "-" means the value has not been fetched.
- fdirThe fastest directory crawler & globbing alternative to glob, fast-glob, & tiny-glob. Crawls 1m files in < 1s
- playwright-coreA high-level API to automate web browsers
- jsdomA JavaScript implementation of many web standards
- playwrightA high-level API to automate web browsers
- environmentCheck which JavaScript environment your code is running in at runtime: browser, Node.js, Bun, etc
- cheerioThe fast, flexible & elegant library for parsing and manipulating HTML and XML.
- puppeteer-coreA high-level API to control headless Chrome over the DevTools Protocol
- happy-domHappy DOM is a JavaScript implementation of a web browser without its graphical user interface. It includes many web standards from WHATWG DOM and HTML.
- query-selector-shadow-domuse querySelector syntax to search for nodes inside of (nested) shadow roots
- webdriver-bidi-protocolThis repository contains TypeScript types conforming to the [WebDriver BiDi](https://w3c.github.io/webdriver-bidi/) specification. It also supports WebDriver BiDi extension modules defined in other specifications:
- puppeteerA high-level API to control headless Chrome over the DevTools Protocol
- linkedomA triple-linked lists based DOM implementation
- robots-parserA specification compliant robots.txt parser with wildcard (*) matching support.
- @appium/typesVarious type declarations used across Appium
- @appium/supportSupport libs used across Appium packages
- @appium/schemaAppium Configuration Schema
- @wdio/utilsA WDIO helper utility to provide several utility functions used across the project.
- selenium-webdriverThe official WebDriver JavaScript bindings from the Selenium project
- webdriverA Node.js bindings implementation for the W3C WebDriver and Mobile JSONWire Protocol
- webdriverioNext-gen browser and mobile automation test framework for Node.js
- spawndSpawn a dependent child process.
- @appium/loggerA Universal Logger For The Appium Ecosystem
- @sparticuz/chromiumChromium Binary for Serverless Platforms
- @happy-dom/global-registratorUse Happy DOM globally in a Node.js environment for testing.
- agent-browserBrowser automation CLI for AI agents
- @appium/tsconfigShared TypeScript Config for Appium
- @browserbasehq/stagehandBrowserbase's SDK for building browser agents
- @appium/base-driverBase driver class for Appium drivers
- chrome-devtools-mcpMCP server for Chrome DevTools
- @appium/docutilsDocumentation generation utilities for Appium and related projects
- appiumAutomation for Apps.
- allure-playwrightAllure Playwright integration
- @mendable/firecrawl-jsJavaScript SDK for the Firecrawl API: web scraping, crawling, web search, and scientific literature search over a research paper index of PubMed, bioRxiv, medRxiv and arXiv abstracts
- playwright-extraTeach playwright new tricks through plugins.
- @appium/base-pluginThe base plugin used to create Appium plugins
- puppeteer-extra-pluginBase class for puppeteer-extra plugins.
- puppeteer-extra-plugin-stealthStealth mode: Applies various techniques to make detection of headless puppeteer harder.
- puppeteer-extra-plugin-user-data-dirCustom user data directory for puppeteer.
- puppeteer-extra-plugin-user-preferencesLaunch puppeteer with arbitrary user preferences.
- chromedriverChromeDriver for Selenium
- webdriver-managerA selenium server and browser driver manager for your end to end tests.
- protractorWebdriver E2E test wrapper for Angular.
- appium-webdriveragentPackage bundling WebDriverAgent
- webdriver-js-extenderA plugin which adds additional commands to selenium's javascript implementation of the webdriver client side API
- blocking-proxyWebDriver Proxy for testing rich clients. It block certain calls until Angular is done updating the page under test.
- @appium/strongboxPersistent storage for Appium extensions
- jasminewd2WebDriverJS adapter for Jasmine2.
- firecrawlJavaScript SDK for the Firecrawl API: web scraping, crawling, web search, and scientific literature search over a research paper index of PubMed, bioRxiv, medRxiv and arXiv abstracts
- browserstack-localNodejs bindings for BrowserStack Local
- jsdom-globalEnable DOM in Node.js