JavaScript
import ContextDev from 'context.dev';
const client = new ContextDev({
apiKey: process.env['CONTEXT_DEV_API_KEY'], // This is the default and can be omitted
});
const response = await client.web.webScrapeMd({ url: 'https://example.com' });
console.log(response.markdown);{
"success": true,
"markdown": "<string>",
"url": "<string>"
}Web Scraping
Scrape Markdown
Scrapes the given URL into LLM usable Markdown.
GET
/
web
/
scrape
/
markdown
JavaScript
import ContextDev from 'context.dev';
const client = new ContextDev({
apiKey: process.env['CONTEXT_DEV_API_KEY'], // This is the default and can be omitted
});
const response = await client.web.webScrapeMd({ url: 'https://example.com' });
console.log(response.markdown);{
"success": true,
"markdown": "<string>",
"url": "<string>"
}1 CreditDocumentation Index
Fetch the complete documentation index at: https://docs.context.dev/llms.txt
Use this file to discover all available pages before exploring further.
Authorizations
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Query Parameters
Full URL to scrape into LLM usable Markdown (must include http:// or https:// protocol)
Preserve hyperlinks in Markdown output
Include image references in Markdown output
Shorten base64-encoded image data in the Markdown output
Extract only the main content of the page, excluding headers, footers, sidebars, and navigation
When true (default), PDF URLs are fetched and their text layer is extracted and converted to Markdown. When false, PDF URLs are skipped and a 400 WEBSITE_ACCESS_ERROR is returned.
When true, the contents of iframes are rendered to Markdown.
Return a cached result if a prior scrape for the same parameters exists and is younger than this many milliseconds. Defaults to 1 day (86400000 ms) when omitted. Max is 30 days (2592000000 ms). Set to 0 to always scrape fresh.
Required range:
0 <= x <= 2592000000Was this page helpful?
āI