Firecrawl Release Notes

We're excited to announce the release of Firecrawl v1.12.0, packed with new features.

v1.12.0 Launch

• New Concurrency System - Specify max concurrency by request in crawl and batch scrape for better control. See docs.
• Crawl Entire Domain Param - Follow internal links to sibling or parent URLs, not just child paths (prev. allowBackwardLinks). See docs.
• Google Docs Scraping - We now officially support scraping Google Docs files
• Improved Activity Logs - Better support for FIRE-1 requests. See your logs here.
• /search Playground Enhanced - Location Params added. Check out the playground.
• Plus tons of performance improvements and bug fixes.

We're excited to announce the release of Firecrawl v1.11.0, packed with major performance improvements and new features.

Index Launch

Major Updates:

• Firecrawl Index: 500% faster scraping speeds when opted in. See docs for more details.
• Enhanced Activity Logs:
  • View webhook events
  • See and manage active crawls
• Fire Enrich Example: New open-source Clay integration. Open Source repository here.
• Community Java SDK: Expanding our SDK support. View repository.
• And many more improvements!

Enhanced Mode

• What is Enhanced Mode: Enhanced Mode is a specialized proxy feature for scraping websites with advanced anti-bot protection, providing better success rates when extracting data from challenging sites.

• Pricing Change: Starting May 8th, 2025, Enhanced Mode proxy requests will cost 5 credits per request (previously included in standard credit pricing).

• Quality Improvements: The price adjustment reflects significant quality improvements to Enhanced Mode, ensuring higher success rates and more reliable data extraction from complex and difficult-to-scrape sites.

• Usage Optimization: For optimal credit usage, consider using Enhanced Mode as a retry mechanism only when encountering specific error status codes (401, 403, or 500).

• Update (August 17, 2026): The 5-credit price above no longer applies. Enhanced Mode requests are billed at the same 1 credit per request as basic requests, and an automatic escalated retry is not charged separately. See the Enhanced Mode docs.

v1.7.0 Release

New Features

• Deep Research Open Alpha: Structured outputs + customizability.
• Concurrent Browsers: Improved rate limits for all users.
• Compare Beta: Figure what has changed in the website directly in /scrape and /crawl endpoints. Currently in closed beta.
• /extract: URLs are now optional.
• /scrape: Warns if concurrency-limited.
• New Firecrawl Examples: Featuring models like Claude 3.7, Gemini 2.5, Deepseek V3, Mistral 3.1, and more.
• Crawl: maxDiscoveryDepth option added.

Fixes & Improvements

• Fixed circular JSON error in search.
• Reworked new tally system.
• Fixed sitemaps poisoning crawler with unrelated links.
• Crawler status retries added on failure (up to 3 times).
• Credit check now snaps to remaining credits if exceeded.
• Fixed path filtering bug in Map.
• Removed unsupported schema in llmExtract.

v1.6.0 Release

Introducing LLMs.txt API

The /llmstxt endpoint allows you to transform any website into clean, LLM-ready text files. Simply provide a URL, and Firecrawl will crawl the site and generate both llms.txt and llms-full.txt files that can be used for training or analysis with any LLM.

Docs here: https://docs.firecrawl.dev/features/alpha/llmstxt

Introducing Deep Research API (Alpha)

The /deep-research endpoint enables AI-powered deep research and analysis on any topic. Simply provide a research query, and Firecrawl will autonomously explore the web, gather relevant information, and synthesize findings into comprehensive insights.

Join the waitlist here: https://www.firecrawl.dev/deep-research

Official Firecrawl MCP Server

Introducing the Firecrawl MCP Server. Give Cursor, Windsurf, Claude enhanced web extraction capabilities. Big thanks to @vrknetha, @cawstudios for the initial implementation!

See here: https://github.com/firecrawl/firecrawl-mcp-server

Fixes & Enhancements

• Improved charset detection and re-decoding.
• Fixed extract token limit issues.
• Addressed issues with includes/excludes handling.
• Fixed AI SDK handling of JSON responses. …

v1.5.0 Release

Self-Host Fixes

• Reworked Guide: The SELF_HOST.md and docker-compose.yaml have been updated for clarity and compatibility
• Kubernetes Imporvements: Updated self-hosted Kubernetes deployment examples for compatibility and consistency (#1177)
• Self-Host Fixes: Numerous fixes aimed at improving self-host performance and stability (#1207)
• Proxy Support: Added proxy support tailored for self-hosted environments (#1212)
• Playwright Integration: Added fixes and continuous integration for the Playwright microservice (#1210)
• Search Endpoint Upgrade: Added SearXNG support for the /search endpoint (#1193)

Core Fixes & Enhancements

• Crawl Status Fixes: Fixed various race conditions in the crawl status endpoint (#1184)
• Timeout Enforcement: Added timeout for scrapeURL engines to prevent hanging requests (#1183)
• Query Parameter Retention: Map function now preserves query parameters in results (#1191)
• Screenshot Action Order: Ensured screenshots execute after specified actions (#1192)
• PDF Scraping: Improved handling for PDFs on complex websites (#1198)
• Map/scrapeURL Abort Control: Integrated AbortController to stop scraping when the request times out (#1205)
• SDK Timeout Enforcement: Enforced request timeouts in the SDK (#1204)

New Features & Additions

• Proxy Options: Introduced proxy configuration options for infrastructure management (#1196) …

v1.4.4 Release

Features & Enhancements

• Scrape API: Added action & wait time validation (#1146)
• Extraction Improvements:
  • Added detection of PDF/image sub-links & extracted text via Gemini (#1173)
  • Multi-entity prompt enhancements for extraction (#1181)
  • Show sources out of __experimental in extraction (#1180)
• Environment Setup: Added Serper & Search API env vars to docker-compose (#1147)
• Credit System Update: Now displays "tokens" instead of "credits" when out of tokens (#1178)

Examples

• Gemini 2.0 Crawler: Implemented new crawling example (#1161)
• Gemini TrendFinder: https://github.com/firecrawl/gemini-trendfinder
• Normal Search to Open Deep Research: https://github.com/nickscamara/open-deep-research

Fixes

• HTML Transformer: Updated free_string function parameter type (#1163) …

v1.4.3 Release

Summary of changes

• Open Deep Research: An open source version of OpenAI Deep Research. See here: https://github.com/nickscamara/open-deep-research
• R1 Web Extractor Feature: New extraction capability added.
• O3-Mini Web Crawler: Introduces a lightweight crawler for specific use cases.
• Updated Model Parameters: Enhancements to o3-mini_company_researcher.
• URL Deduplication: Fixes handling of URLs ending with /, index.html, index.php, etc.
• Improved URL Blocking: Uses tldts parsing for better blocklist management.
• Valid JSON via rawHtml in Scrape: Ensures valid JSON extraction.
• Product Reviews Summarizer: Implements summarization using o3-mini.
• Scrape Options for Extract: Adds more configuration options for extracting data.
• O3-Mini Job Resource Extractor: Extracts job-related resources using o3-mini.
• Cached Scrapes for Extract evals: Improves performance by using cached data for extractions evals.

v1.4.2 Release

We're excited to announce several new features and improvements:

New Features

• Added web search capabilities to the extract endpoint via the enableWebSearch parameter
• Introduced source tracking with __experimental_showSources parameter
• Added configurable webhook events for crawl and batch operations
• New timeout parameter for map endpoint
• Optional ad blocking with blockAds parameter (enabled by default)

Infrastructure & UI

• Enhanced proxy selection and infrastructure reliability
• Added domain checker tool to cloud platform
• Redesigned LLMs.txt generator interface for better usability

Introducing /search

Introducing /v1/search

The search endpoint combines web search with Firecrawl’s scraping capabilities to return full page content for any query.

Include scrapeOptions with formats: ["markdown"] to get complete markdown content for each search result otherwise it defaults to getting SERP results (url, title, description).

More info here: v1/search docs

Fixes and improvements

• Fixed LLM not following the schema in the python SDK for /extract
• Fixed schema json not being able to be sent to the /extract endpoint through the Node SDK
• Prompt is now optional for the /extract endpoint
• Our fork of MinerU is now default for PDF Parsing

v1.1.0 Release

Changelog Highlights

Feature Enhancements

• New Features:
  • Geolocation, mobile scraping, 4x faster parsing, better webhooks,
  • Credit packs, auto-recharges and batch scraping support.
  • Iframe support and query parameter differentiation for URLs.
  • Similar URL deduplication.
  • Enhanced map ranking and sitemap fetching.

Performance Improvements

• Faster crawl status filtering and improved map ranking algorithm.
• Optimized Kubernetes setup and simplified build processes.
• Sitemap discoverability and performance improved

Bug Fixes

• Resolved issues:
  • Badly formatted JSON, scrolling actions, and encoding errors.
  • Crawl limits, relative URLs, and missing error handlers.
• Fixed self-hosted crawling inconsistencies and schema errors.

SDK Updates

• Added dynamic WebSocket imports with fallback support.
• Optional API keys for self-hosted instances.
• Improved error handling across SDKs.

Documentation Updates

• Improved API docs and examples.
• Updated self-hosting URLs and added Kubernetes optimizations.
• Added articles: mastering /scrape and /crawl.

Miscellaneous

• Added new Firecrawl examples
• Enhanced metadata handling for webhooks and improved sitemap fetching.
• Updated blocklist and streamlined error messages.

Interact with pages before extracting data, unlocking more data from every site!

Firecrawl now allows you to perform various actions on a web page before scraping its content. This is particularly useful for interacting with dynamic content, navigating through pages, or accessing content that requires user interaction.

• Version 1.5.x of the Node SDK now supports type-safe Actions.
• Actions are now available in the REST API and Python SDK (no version bumps required!).

Here is a python example of how to use actions to navigate to google.com, search for Firecrawl, click on the first result, and take a screenshot.

from firecrawl import Firecrawl

app = Firecrawl(api_key="fc-YOUR_API_KEY")

# Scrape a website:
scrape_result = app.scrape_url('firecrawl.dev',
    params={
        'formats': ['markdown', 'html'],
        'actions': [
            {"type": "wait", "milliseconds": 2000},
            {"type": "click", "selector": "textarea[title=\"Search\"]"},
            {"type": "wait", "milliseconds": 2000},
            {"type": "write", "text": "firecrawl"},
            {"type": "wait", "milliseconds": 2000},
            {"type": "press", "key": "ENTER"},
            {"type": "wait", "milliseconds": 3000},
            {"type": "click", "selector": "h3"},
            {"type": "wait", "milliseconds": 3000},
            {"type": "screenshot"}
        ]
    }
)
print(scrape_result)
``` …

Typesafe LLM Extract

• E2E Type Safety for LLM Extract in Node SDK version 1.5.x.
• 10x cheaper in the cloud version. From 50 to 5 credits per extract.
• Improved speed and reliability.

Rust SDK v1.0.0

• Rust SDK v1 is finally here! Check it out here.

Map Improved Limits

• Map smart results limits increased from 100 to 1000.

Faster scrape

• Scrape speed improved by 200ms-600ms depending on the website.

Launching changelog

• For now on, for every new release, we will be creating a changelog entry here.

Improvements

• Lots of improvements pushed to the infra and API. For all Mid-September changes, refer to the commits here.

Here is what's new:

• Output Formats for /scrape: Choose what formats you want your output in.
• New /map endpoint: Get most of the URLs of a webpage.
• Developer friendly API for /crawl/id status.
• 2x Rate Limits for all plans.
• Go SDK and Rust SDK.
• Teams support.
• API Key Management in the dashboard.
• onlyMainContent is now default to true.
• /crawl webhooks and websocket support.

Learn more about it here.

Start using v1 right away at https://firecrawl.dev

Canonical HTML: https://www.firecrawl.dev/changelog