Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
Merge pull request #3380 from firecrawl/devin/1776329178-rename-nuget-package-id
e1cb548 Gaurav Chadha committed 7 months ago
Merge pull request #3383 from firecrawl/devin/1776352187-fix-ruby-publisher-unknown-version
53a5152 Gaurav Chadha committed 7 months ago
fix(ci): handle 'unknown' version from RubyGems for first-time publishes
f0bda82 Devin AI committed 7 months ago
Merge pull request #3367 from firecrawl/chadha93/SPT-44
01afc73 Gaurav Chadha committed 7 months ago
fix(ruby-sdk): rename gem from firecrawl to firecrawl-sdk
4f2ffbc firecrawl-spring[bot] committed 7 months ago
fix: resolve merge conflicts in version check script (keep ruby + dotnet + rust)
6c130cd Devin AI committed 7 months ago
feat(api): add customRobotsAgent flag separate from ignoreRobots (#3377)
b5f8ac3 firecrawl-spring[bot] committed 7 months ago
Merge pull request #3362 from firecrawl/chadha93/SPT-46
6790aa4 Gaurav Chadha committed 7 months ago
fix: resolve merge conflicts with main in check_version_has_incremented.py
7ebe279 Devin AI committed 7 months ago
fix(dotnet-sdk): rename NuGet package ID from firecrawl-dotnet to firecrawl-sdk
149281b Devin AI committed 7 months ago
Merge pull request #3368 from firecrawl/chadha93/NetSDK
c55c090 Gaurav Chadha committed 7 months ago
fix: resolve merge conflict in check_version_has_incremented.py (keep both dotnet and php)
010d30c Devin AI committed 7 months ago
fix: resolve merge conflict in check_version_has_incremented.py (keep both ruby and php)
b552f86 Devin AI committed 7 months ago
Merge pull request #3348 from firecrawl/chadha93/SPT-42
ffc9207 Gaurav Chadha committed 7 months ago
fix(test): skip robotsUserAgent test in self-hosted CI (#3376)
12bcbbf firecrawl-spring[bot] committed 7 months ago
feat(sdk): add ignoreRobotsTxt and robotsUserAgent to JS, Python, and Java SDKs (#3375)
fcf6b89 firecrawl-spring[bot] committed 7 months ago
feat(crawl): add robotsUserAgent parameter for custom robots.txt checks (#3325)
ef10cd3 firecrawl-spring[bot] committed 7 months ago
chore(api): remove ignoreRobots backward compat for boolean format (#3374)
3315afc firecrawl-spring[bot] committed 7 months ago
feat(api): migrate ignoreRobots org flag to disabled/allowed/forced pattern (#3328)
518e86e firecrawl-spring[bot] committed 7 months ago
fix(api): treat empty actions array as no actions in feature flags (#3370)
b12f475 firecrawl-spring[bot] committed 7 months ago
fix(.net-sdk): address cubic review comments and fix CI build
0e5c21c Devin AI committed 7 months ago
feat(.net-sdk): add .NET SDK for Firecrawl v2 API
f705a1e firecrawl-spring[bot] committed 7 months ago
fix: correct Autumn billing period timestamps, subscription lookup, and planCredits (#3364)
267e86c devin-ai-integration[bot] committed 7 months ago
fix(rust-sdk): address cubic review feedback and fix cargo fmt
782169f Devin AI committed 7 months ago