Synapse PaaS Template
  1. Web Query
Synapse PaaS Template
  • Synapse PaaS API
    • Chat
      • Cortext: Chat
      • Vision: Chat
    • Image
      • Vision: Text-To-Image
      • Cortext: Text To Image
      • Vision: Image-To-Image
      • Vision: Inpaint
      • Vision: Avatar
      • Vision: Clip Embeddings
      • Niche: Text-To-Image
      • Niche: Image-To-Image
      • Niche: InstantID
    • Web Query
      • Smart Scrape
        GET
    • AI Detection
      • It's AI: AI Text Detector
      • It's AI: AI Text Detector Batch
    • Speech
      • Text To Speech Create
      • Text To Speech Retrieve
    • Compute
      • Get Jobs
      • Create Docker Job
      • Create Raw Script Job
  • Schemas
    • Schemas
      • ChatMessageRequest
      • AvatarRequest
      • ChatMessageRequest
      • AvatarRequest
      • HTTPValidationError
      • ChatMessageVariantRequest
      • AvatarResponse
      • ChatMessageVariantRequest
      • AvatarResponse
      • ValidationError
      • HTTPValidationError
      • ChatModels
      • HTTPValidationError
      • ChatModels
      • ValidationError
      • ChatRequest
      • ValidationError
      • ChatRequest
      • ClipEmbeddingsRequest
      • ClipEmbeddingsRequest
      • ClipEmbeddingsResponse
      • ClipEmbeddingsResponse
      • EngineEnum
      • EngineEnum
      • HTTPValidationError
      • HTTPValidationError
      • ImageToImageRequest
      • ImageToImageRequest
      • ImageToImageResponse
      • ImageToImageResponse
      • InpaintRequest
      • InpaintRequest
      • InpaintResponse
      • InpaintResponse
      • Message
      • Message
      • Role
      • Role
      • TextPrompt
      • TextPrompt
      • TextToImageRequest
      • TextToImageRequest
      • TextToImageResponse
      • TextToImageResponse
      • UpscaleRequest
      • UpscaleRequest
      • UpscaleResponse
      • UpscaleResponse
      • ValidationError
      • ValidationError
  1. Web Query

Smart Scrape

Localhost Development Server
http://localhost:3000
Localhost Development Server
http://localhost:3000
GET
/api/smart-scrape
Performs a search across multiple platforms. Available tools are:
Twitter Search: Uses Twitter API to search for tweets in past week date range.
Google Search: Searches the web using Google.
Google News Search: Searches news articles using Google News.
Google Image Search: Searches images using Google.
Bing Search: Searches the web using Bing.
ArXiv Search: Searches academic papers on ArXiv.
Wikipedia Search: Searches articles on Wikipedia.
Youtube Search: Searches videos on Youtube.
Hacker News Search: Searches posts on Hacker News, under the hood it uses Google search.
Reddit Search: Searches posts on Reddit, under the hood it uses Google search.

Request

Query Params

Header Params

Body Params application/json

Example
{}

Request Code Samples

Shell
JavaScript
Java
Swift
Go
PHP
Python
HTTP
C
C#
Objective-C
Ruby
OCaml
Dart
R
Request Request Example
Shell
JavaScript
Java
Swift
curl --location -g --request GET 'http://localhost:3000/api/smart-scrape?tools=["Twitter Search", "Google Search", "Google News Search", "Google Image Search", "Bing Search", "ArXiv Search", "Wikipedia Search", "Youtube Search", "Hacker News Search", "Reddit Search"]&query=What are the recent sport events?' \
--header 'X-API-KEY;' \
--header 'Content-Type: application/json' \
--data-raw '{}'

Responses

🟢200A dictionary of search results from the specified tools.
application/json
Body

Example
{
    "Twitter Search": [
        {
            "data": [
                {
                    "entities": {
                        "annotations": [
                            {
                                "start": 21,
                                "normalized_text": "Arunachal",
                                "end": 29,
                                "type": "Organization",
                                "probability": 0.5305
                            }
                        ],
                        "urls": [
                            {
                                "display_url": "northeasttoday.in/2024/05/14/aru…",
                                "start": 83,
                                "expanded_url": "https://www.northeasttoday.in/2024/05/14/arunachal-to-host-blue-cubs-football-tournament-starting-june-8/",
                                "unwound_url": "https://www.northeasttoday.in/2024/05/14/arunachal-to-host-blue-cubs-football-tournament-starting-june-8/",
                                "description": "In a groundbreaking collaboration between the Arunachal Pradesh Football Association (APFA) and Northeast United FC, the Blue Cubs Tournament is all set to kick off on June 8, 2024, at the Rajiv Gandhi Stadium in Naharlagun, Arunachal. The tournament, aimed at nurturing the footballing aspirations of young talents, will feature participants in the U7, U9,...",
                                "end": 106,
                                "title": "Arunachal To Host ‘Blue Cubs Football Tournament’ Starting June 8",
                                "url": "https://t.co/ZyyJKNuRtd",
                                "status": 200
                            }
                        ]
                    },
                    "possibly_sensitive": false,
                    "public_metrics": {
                        "bookmark_count": 0,
                        "like_count": 0,
                        "reply_count": 0,
                        "quote_count": 0,
                        "retweet_count": 0,
                        "impression_count": 2
                    },
                    "edit_history_tweet_ids": [
                        "1790286520873881730"
                    ],
                    "created_at": "2024-05-14T07:42:23.000Z",
                    "text": "Podium positions for Arunachal athletes is propping up bustling sports tournaments.https://t.co/ZyyJKNuRtd",
                    "id": "1790286520873881730",
                    "author_id": "1562452268485554178"
                },
                {
                    "attachments": {
                        "media_keys": [
                            "7_1790282284026810368"
                        ]
                    },
                    "entities": {
                        "annotations": [
                            {
                                "start": 27,
                                "normalized_text": "Addis Abeba",
                                "end": 37,
                                "type": "Person",
                                "probability": 0.8981
                            }
                        ],
                        "urls": [
                            {
                                "start": 104,
                                "expanded_url": "https://twitter.com/firew_asrat/status/1790282361206194438/video/1",
                                "display_url": "pic.twitter.com/g3FADan720",
                                "end": 127,
                                "media_key": "7_1790282284026810368",
                                "url": "https://t.co/g3FADan720"
                            }
                        ],
                        "mentions": [
                            {
                                "start": 3,
                                "end": 15,
                                "id": "2360995844",
                                "username": "firew_asrat"
                            }
                        ]
                    },
                    "possibly_sensitive": false,
                    "public_metrics": {
                        "bookmark_count": 0,
                        "like_count": 0,
                        "reply_count": 0,
                        "quote_count": 0,
                        "retweet_count": 1,
                        "impression_count": 0
                    },
                    "edit_history_tweet_ids": [
                        "1790284492822724736"
                    ],
                    "created_at": "2024-05-14T07:34:19.000Z",
                    "text": "RT @firew_asrat: Here's to Addis Abeba's future as a premier destination for major sports events luck 🙌 https://t.co/g3FADan720",
                    "id": "1790284492822724736",
                    "author_id": "2859936765"
                },
                {
                    "entities": {
                        "annotations": [
       
🟠422Validation Error
Modified at 2024-06-12 14:05:44
Previous
Niche: InstantID
Next
It's AI: AI Text Detector
Built with