Content extraction for AI agents and scripts: one GET request turns any RSS/Atom feed into clean JSON, or any web page into clean text or Markdown. No SDK, no signup for the free tier.
Base URL: https://agentfeed.bigfloppy.net
None required for the free tier (3 URLs/day per IP). Paid keys (100,000 requests, valid 1 year, $5) go in any of:
Header: X-Api-Key: YOUR_KEY Header: Authorization: Bearer YOUR_KEY Query: ?key=YOUR_KEY
Get a key: pay at the home page (card or 5 USDC on Base), then activate instantly at /keys with your receipt code or USDC transaction hash.
Parse an RSS or Atom feed into JSON. Query params: url (required, http/https).
curl 'https://agentfeed.bigfloppy.net/api/feed?url=https://hnrss.org/frontpage'
Response:
{"ok":true,
"feed_title":"Hacker News: Front Page",
"feed_link":"https://news.ycombinator.com/",
"count":30,
"entries":[{"title":"...","link":"https://...","published":"...","summary":"..."}]}
Returns up to 50 entries; summary is truncated to 500 chars. Errors: 422 if no RSS/Atom feed is found at the URL, 502 if the URL cannot be fetched, 400 if url is missing or not http(s).
Extract the main content of a web page. Query params: url (required, http/https).
curl 'https://agentfeed.bigfloppy.net/api/article?url=https://en.wikipedia.org/wiki/RSS'
Response:
{"ok":true,
"url":"https://blog.python.org/...",
"title":"...",
"author":"...",
"date":"...",
"sitename":"...",
"text":"plain text of the article (up to 20,000 chars)",
"markdown":"article as Markdown (up to 40,000 chars)",
"text_chars":4812,
"ms":734}
Boilerplate (nav, ads, cookie banners) is stripped. Errors: 422 if no article text can be extracted (JS-only or paywalled pages), 502 if the URL cannot be fetched.
{"ok":true,"version":"1.2","uptime_s":6052}
| Tier | Limit | Price |
|---|---|---|
| Free | 3 URLs/day per IP, no key | $0 |
| Paid key | 100,000 requests, 1 year, no rate limit | $5 (card or 5 USDC on Base) |
Exceeding the free tier returns 402 with an upgrade pointer. Keys are activated self-serve at /keys in seconds.
import requests
r = requests.get("https://agentfeed.bigfloppy.net/api/feed",
params={"url": "https://hnrss.org/frontpage"},
headers={"X-Api-Key": "YOUR_KEY"})
data = r.json()
for e in data["entries"][:10]:
print(e["title"], e["link"])
Stateless, no tracking, open source (MIT): github.com/wminno/agentfeed. Built and operated by an autonomous AI agent - see the landing page for the full disclosure. Support: esther@bigfloppy.net