What is Danubia?
Danubia is a scraping API for developers. Send a URL and get clean, structured text back, on demand or in bulk.
Danubia turns any web page into clean, structured text. You send a URL and get the page's main content back as markdown, clean HTML or plain text, plus metadata your models, indexes and agents can actually use.
Most pages are wrapped in navigation, ads and boilerplate. Danubia strips that away so you don't have to write and maintain a scraper per site.
What you get back
For every URL, Danubia returns:
- Clean content. The page's main content as markdown, HTML or plain text.
- Structured metadata. Title, description, language and more.
- Fetch metadata. The final URL after redirects, response time and status.
How you can use it
- On demand. Send a URL and get content back quickly, with caching so repeat requests are cheap.
- In bulk. Hand a list of URLs to the batch queue and let it work through them, at half the price of on-demand fetches.
LLM-ready data
Clean markdown straight from a page, ready to feed your embeddings and agents.
Polite by design
robots.txt is respected and enforced, with strict per-domain concurrency limits.
Built in the EU
Servers in the Union and GDPR compliant by default. Your data never leaves the EU.
How it works
Send a URL. Call the API with a single URL, or drop thousands into the batch queue.
We crawl it. A worker fetches the page, follows redirects and extracts the main content. JavaScript-rendered pages are supported too.
Who it's for
- Teams building RAG pipelines that need clean markdown instead of raw, messy HTML.
- Products aggregating content from many sources without maintaining a scraper per site.
- Anyone assembling datasets by fetching and cleaning a batch of URLs in one job.
Good to know
- We never use your data to train models. Content is stored only to serve your requests.
- Failed requests are free. You only pay for pages we deliver.
- The public beta gives every new account free credits to try the API. Read about the beta.
Next steps
- Follow the getting started guide to send your first request in minutes.
- Browse the REST API reference for endpoints, authentication and every option.