External APIs

Diffbot: Content Analysis

Analyze and extract content and webdata from websites and pages
Back to BLOCKS

About Diffbot: Content Analysis

Diffbot extracts web data and content from articles, products, discussions, images, and more. Using AI, computer vision, and natural language processing, the API understands objects from any webpage and retrieves clean, structured data.

The Diffbot block for analyzing and extracting web data allows you to process incoming realtime messages with attached URLs, and amend website contextual information to that stream.

Try it Now
Categories:
External APIs External APIs
Bots & AI
Bots & AI
Chat & Social
Chat & Social
Last Updated:
20160914 at 23:00:24
Author:
PubNub
pubnub content analysis block

Walkthrough

This block analyzes incoming messages with attached URLs using Diffbot to give amend website contextual information to the stream.

To learn more about Diffbot API and getting your production keys, visit DiffBot Registration

Input

Input Channel: diffbot-channel (configurable) If the message contains an "url" field, the block will use the URL in the "url" field to send to Diffbot for analysis.
{
    "url" : "https://sports.yahoo.com/news/power-rankings-denny-hamlin-heads-into-the-chase-at-no-1-183112294.html"
}

Output

The Diffbot block sends the url to Diffbot for analysis and appends the returned analysis into the message payload
{
    "url": "https://sports.yahoo.com/news/power-rankings-denny-hamlin-heads-into-the-chase-at-no-1-183112294.html",
    "diffbotResponse": < Response provided by Diffbot >
}