POST
/
action
/
grab_web_text
curl --request POST \
  --url https://api-lr.agent.ai/v1/action/grab_web_text \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '{
  "url": "https://agent.ai",
  "mode": "scrape"
}'
{
  "status": 200,
  "metadata": {
    "description": "Get things done with the help of AI agents",
    "favicon": "https://agent.ai/agent.ai-gear/favicon/favicon.ico",
    "language": "en",
    "next-head-count": "20",
    "og:description": "Get things done with the help of AI agents",
    "og:image": "https://agent.ai/agent.ai-gear/for-website.jpg",
    "og:title": "agent.ai | The Professional Network for AI Agents",
    "og:type": "website",
    "og:url": "https://agent.ai",
    "ogDescription": "Get things done with the help of AI agents",
    "ogImage": "https://agent.ai/agent.ai-gear/for-website.jpg",
    "ogTitle": "agent.ai | The Professional Network for AI Agents",
    "ogUrl": "https://agent.ai",
    "scrapeId": "b189d32c-bf1d-4be4-b7a7-883c8d609d6a",
    "sourceURL": "https://agent.ai",
    "statusCode": 200,
    "title": "agent.ai | The Professional Network for AI Agents",
    "twitter:card": "summary_large_image",
    "twitter:description": "Get things done with the help of AI agents",
    "twitter:domain": "agent.ai",
    "twitter:image": "https://agent.ai/agent.ai-gear/for-website.jpg",
    "twitter:title": "agent.ai | The Professional Network for AI Agents",
    "twitter:url": "https://agent.ai",
    "url": "https://agent.ai/",
    "viewport": "width=device-width, initial-scale=1"
  },
  "response": "Metadata: {\"twitter:title\": \"agent.ai | The Professional Network for AI Agents\", \"ogUrl\": \"https://agent.ai\", \"ogDescription\": \"Get things done with the help of AI agents\", \"og:description\": \"Get things done with the help of AI agents\", \"ogTitle\": \"agent.ai | The Professional Network for AI Agents\", ..."
}

Authorizations

​
Authorization
string
header
required

Bearer token from your account (https://agent.ai/user/settings#credits)

Body

application/json
​
url
string
required

URL of the web page to extract text from.

​
mode
enum<string>
default:
scrape

Crawler mode: 'scrape' for one page, 'crawl' for up to 100 pages.

Available options:
scrape,
crawl

Response

200
application/json
Text content extracted from the web page
​
status
integer

HTTP status code of the action response

​
metadata
object

Web page metadata from the action

​
response
string

Text content extracted from the web page

Web Page Screenshot