Skip to content
×

How can you find websites that scrape your content?

To find external websites that scrape your content, start with four types of clues: article titles, inbound links, WordPress trackback notifications, and searches for copies of your content. Then open suspicious pages to check their content. Being mentioned or receiving many links does not mean your content has been scraped. The methods below come from an article published on Neil Patel’s website in 2012. Its descriptions of tool interfaces, notification mechanisms, and plans reflect that time and may no longer apply today.

Track article titles, then compare the content

If you publish infrequently or only want to track important articles, the original article suggests setting up Google Alerts with the full title in quotation marks. This can find mentions of the title on other websites, but it does not establish that someone has copied the entire article.

  • Select the articles you want to track and use their full titles in quotation marks as search terms.
  • When you find an identical title, open the other website’s page and check whether your article’s content also appears there.
  • Distinguish between a simple mention, a link, and a full copy rather than drawing conclusions solely from matching titles.

Find websites that link to several of your articles

The original article also suggests using what was then called Webmaster Tools to review domains linking to your website. Pay particular attention to websites linking to several of your articles, then open the pages containing those links. In the original article’s example, the author first noticed a matching article title and confirmed that the full text had been copied only after visiting the page.

However, a large number of links is only a clue to investigate. Social networking sites, social bookmarking services, and loyal readers who regularly recommend articles may all link to multiple articles. Link counts cannot be treated as evidence of scraping; what matters is what the other page actually publishes. The original article’s old menu paths should not be used as a guide to the current interface either.

WordPress trackback notifications work only under certain conditions

The original article notes that linking to your other articles within a post may help you discover scrapers through WordPress trackback notifications. If you use Akismet, these notifications may also appear in the spam folder.

For this method to help you find a scraper, the other website must retain the links within the article, and WordPress must generate a corresponding trackback notification. Not every instance of copying triggers a notification. The original article also cautions that websites retaining links within the text are often easier to trace, so receiving no notification does not prove that your content has not been scraped.

Search for copies using a URL and cross-check against other clues

The article introduces Copyscape, which lets you enter your article’s URL to search for copies elsewhere on the web. Copyscape looks for duplicate content; title tracking and link checks start by finding pages that mention the title or link to your content.

The original article lists differences between the free searches and paid plans available at the time, but these should not be used to infer current limits or prices. When compiling a list of suspicious websites, treat search results as pages to investigate and check the content of each one. Do not assume that every page a tool finds has scraped your article.

Finding websites that scrape your content: perspectives from across the web

Are matching titles and a large number of links enough to confirm that a website has scraped your content?

Not yet. Both can help narrow the search, but you still need to open the other website’s pages and check what they actually publish. In the example from the 2012 article, the author first noticed that another website was using the same title and only confirmed that the full text had been copied after visiting it. The article also cautions that social networking sites, bookmarking services, and loyal readers may all link to multiple articles.

Can you still find a scraping website if it removes the links within the article?

You may still be able to find it by searching for the article’s title or copies of its content, but you can no longer rely on links within the text to trace it. The original article notes that, unless you regularly search for article titles, the websites that are easier to trace are generally those that retain links within the text. It also describes how to search for copies online by entering an article’s URL. You still need to check each page you find, and these methods do not guarantee that you will find every scraping website.

Does receiving no WordPress trackback notification mean that your article has not been scraped?

No. The method described in the original article depends on the scraping website retaining links to other articles within the text, and notifications may also appear in Akismet’s spam folder. Not seeing a notification therefore does not rule out other instances of scraping. This is a 2012 article’s description of the mechanism at that time and should not be treated as a statement of current notification rules.

References

  1. Content Scrapers – How to Find Out Who is Stealing Your Content & What to Do About Itneilpatel.com · 2012-01-09T20:38:36+00:00 — Discusses: Are matching titles and a large number of links enough to confirm that a website has scraped your content?; Can you still find a scraping website if it removes the links within the article?
Keep the conversation going

Join the discussion 0 comments

What are you working through? Share a question or experience and let’s find the next step.

No comments yet. Start the conversation.

Share your thoughts

← Keep exploring
LET’S TALK

Start with your brand.

Tell me about your website and what you want to achieve.

WhatsApp tony@procrustes.info
Scan to chat on WhatsApp