Overview Use Cases Connectors Authentication Getting Started with the Python SDK API API Reference ai_agents constructAgentConversationMessagesForLLM createAgent describeAgent describeAgentVersion downloadAgentAttachment evaluatePrompt extractAgentWorkflowInformation extractDataUsingLLM fetchWebPage generateAgentCode generateCodeForDataQueryUsingLLM listAgentVersions listAgents renderFeatureGroupsForLLM searchFeatureGroups searchWebForLLM updateAgent validateWorkflowGraph ai_chat algorithm annotations application_connectors batch_prediction code_completion custom_loss_function custom_metric database_connectors dataset deployment deployment_conversations docstore document_retrievers documentation eda external_app feature_drift feature_group feature_group_row_process feature_group_template file_connectors graph_dashboard holdout_analysis llm_apps model model_monitoring module natural_language_explanation organization pipelines predict prediction_operator project python_function refresh secrets streaming streaming_connectors upload user webhooks API Classes API Inputs Documentation Chat Bot API Search How to

Method

fetchWebPage POST

Copy POST

Scrapes the content of a web page and returns it as a string.

Arguments:

REQUIRED	KEY	TYPE	DESCRIPTION
Yes	url	str	The url of the web page to scrape.
No	convertToMarkdown	bool	Whether content should be converted to markdown.

Note: The arguments for the API methods follow camelCase but for Python SDK underscore_case is followed.

Response:

KEY

TYPE

DESCRIPTION

success

Boolean

true if the call succeeded, false if there was an error

result

WebPageResponse

KEY	TYPE	Description
content	str	The content of the web page.

Language: