dataforseo.com Open in urlscan Pro
2606:4700:3034::6815:4a6c  Public Scan

Form analysis
2 forms found in the DOM

<form id="frr_form">
  <input type="hidden" id="g-recaptcha-response" name="g-recaptcha-response">
  <input type="hidden" name="action" value="validate_captcha">
  <input type="text" name="force_reload_sitename" id="force_reload_sitename" placeholder="Enter domain name..." autocomplete="off">
  <button type="submit" id="frr_form_submit">Send</button>
  <button id="load_robots_button" type="button">Check Your Robots.txt Settings</button>
  <div id="frr_result"></div>
  <div id="get_robots_result"></div>
</form>

POST /dataforseo-bot#wpcf7-f16384-p16355-o1

<form action="/dataforseo-bot#wpcf7-f16384-p16355-o1" method="post" class="wpcf7-form init" novalidate="novalidate" data-status="init">
  <div style="display: none;">
    <input type="hidden" name="_wpcf7" value="16384">
    <input type="hidden" name="_wpcf7_version" value="5.5.6">
    <input type="hidden" name="_wpcf7_locale" value="en_US">
    <input type="hidden" name="_wpcf7_unit_tag" value="wpcf7-f16384-p16355-o1">
    <input type="hidden" name="_wpcf7_container_post" value="16355">
    <input type="hidden" name="_wpcf7_posted_data_hash" value="">
    <input type="hidden" name="_wpcf7_recaptcha_response"
      value="03ANYolquD_WnEWb6ujhwxUiq1FnmA1JFFm-mcQiq5Y5-BduA_hJmA1-5uav3XZlPAV7_dq9RYItc6NLKFaOS3O0scCxHtitTg-BolWJpbNOdv6iizUs_CgPWGOAFP6fx1vRG5oD8_HDstF_euwP3hftm2r_pa_1gd4mMIs4iNokKDCpq1iG6tyf9kgcFwXvCkwUMk8hkooD8PG5JE15Ti04NmknkB6dV7Sl3jbrOJHF_ftUAowCN6PPB-1jVkSX-NTblAC_5NJ4MfbZyhqEz-7Vt-78K9xWplj5CYzOfQWeIDZuRWQR7Zki4h6-lQhyUjvG9cy0k4PqOyrojkMMON2FJeRA9Oa3r8R7rkvveWKa1HS8GmW0EFyQk3TCahYCME9o3540dvQRQ9cA0frk-qOEBbPSaFMmGqpeqJCpFh0R28Ve6dBSew-U5YuU88iExDjKIIeGi406K4TIfR-mb_eS9gzyj1rdeJcFha2TTlDgDuqTWCrJFrO9DVjD1wfXNcSprB40zdl7VEBxYawSHksoSM8WYgVBHb5A">
  </div>
  <div class="qodef-two-columns-50-50">
    <div class="qodef-two-columns-50-50-inner">
      <div class="qodef-column">
        <div class="qodef-column-inner">
          <span class="qodef-input-title contact-valid-mark">Your Name</span><br>
          <label> <span class="wpcf7-form-control-wrap your-name"><input type="text" name="your-name" value="" size="40" class="wpcf7-form-control wpcf7-text wpcf7-validates-as-required" aria-required="true" aria-invalid="false"></span> </label>
        </div>
      </div>
      <div class="qodef-column">
        <div class="qodef-column-inner">
          <span class="qodef-input-title contact-valid-mark">Your Email</span><br>
          <label> <span class="wpcf7-form-control-wrap your-email"><input type="email" name="your-email" value="" size="40" class="wpcf7-form-control wpcf7-text wpcf7-email wpcf7-validates-as-required wpcf7-validates-as-email" aria-required="true"
                aria-invalid="false"></span> </label>
        </div>
      </div>
    </div>
  </div>
  <div>
    <span class="qodef-input-title contact-valid-mark">Your Subject</span><br>
    <label> <span class="wpcf7-form-control-wrap your-subject"><input type="text" name="your-subject" value="" size="40" class="wpcf7-form-control wpcf7-text wpcf7-validates-as-required" aria-required="true" aria-invalid="false"></span> </label>
  </div>
  <div>
    <span class="qodef-input-title contact-valid-mark">Your Message</span><br>
    <label> <span class="wpcf7-form-control-wrap your-message"><textarea name="your-message" cols="40" rows="10" class="wpcf7-form-control wpcf7-textarea wpcf7-validates-as-required" aria-required="true" aria-invalid="false"></textarea></span>
    </label>
  </div>
  <p><input type="submit" value="Send" class="wpcf7-form-control has-spinner wpcf7-submit"><span class="wpcf7-spinner"></span></p>
  <div class="wpcf7-response-output" aria-hidden="true"></div>
</form>

Text Content

 * Products
    * APIs
      * SERP API
      * Keyword Data API
        * Google Ads
        * Google Trends
        * Bing Ads
      * Backlinks API
      * Traffic Analytics API
      * On-Page API
      * DataForSEO Labs API
      * App Data API
      * Business Data API
        * Reviews
      * Merchant API
        * Amazon
        * Google Shopping
    * Databases
      * Google Databases
      * Bing Databases
      * Amazon Database
      * App Store Database
      * Google Play Database
      * Domains Database

 * Solutions
    * By industry
      * Media
      * Ecommerce
      * Market Research
      * Digital Marketing
      * Marketing Tech
    * By company type
      * SEO Agency
      * SEO Software
    * By application
      * API-driven BacklinksApp

 * Pricing
 * Docs
    * Docs API v2
    * Docs API v3

 * Knowledge base
 * Resources
    * FAQ
    * SERP features
    * Top 1000 sites
    * Google Sheets Connector
    * Our data
    * Status Page

 * Contact
 * Try for free
 * Login
    * Version 2 Dashboard
    * Version 3 Dashboard

 * Products
    * APIs
      * SERP API
      * Keyword Data API
        * Google Ads
        * Google Trends
        * Bing Ads
      * Backlinks API
      * Traffic Analytics API
      * On-Page API
      * DataForSEO Labs API
      * App Data API
      * Business Data API
        * Reviews
      * Merchant API
        * Amazon
        * Google Shopping
    * Databases
      * Google Databases
      * Bing Databases
      * Amazon Database
      * App Store Database
      * Google Play Database
      * Domains Database

 * Solutions
    * By industry
      * Media
      * Ecommerce
      * Market Research
      * Digital Marketing
      * Marketing Tech
    * By company type
      * SEO Agency
      * SEO Software
    * By application
      * API-driven BacklinksApp

 * Pricing
 * Docs
    * Docs API v2
    * Docs API v3

 * Knowledge base
 * Resources
    * FAQ
    * SERP features
    * Top 1000 sites
    * Google Sheets Connector
    * Our data
    * Status Page

 * Contact
 * Try for free
 * Login
    * Version 2 Dashboard
    * Version 3 Dashboard

 * PRODUCTS
   
   * APIs
     * SERP API
     * Keyword Data API
       * Google Ads
       * Google Trends
       * Bing Ads
     * Backlinks API
     * Traffic Analytics API
     * On-Page API
     * DataForSEO Labs API
     * App Data API
     * Business Data API
       * Reviews
     * Merchant API
       * Amazon
       * Google Shopping
   * Databases
     * Google Databases
     * Bing Databases
     * Amazon Database
     * App Store Database
     * Google Play Database
     * Domains Database
 * Solutions
   
   * BY INDUSTRY
     
     * Media
     * Ecommerce
     * Market Research
     * Digital Marketing
     * Marketing Tech
   
   * BY COMPANY TYPE
     
     * SEO Agency
     * SEO Software
   
   * BY APPLICATION
     
     * API-driven BacklinksApp
 * Pricing

 * DOCS
   
   * Docs API v2
   * Docs API v3
 * Knowledge base

 * RESOURCES
   
   * FAQ
   * SERP features
   * Top 1000 sites
   * Google Sheets Connector
   * Our data
   * Status Page
 * Contact
 * Try for free

 * LOGIN
   
   * Version 2 Dashboard
   * Version 3 Dashboard


DATAFORSEO LINK BOT



Good bot for a fair play




WHAT IS DATAFORSEO LINK BOT?



Many people would classify DataForSEO Link Bot as yet another web crawler.

Well, they are wrong, and here’s why.

Ever since we launched DataForSEO, our mission was to level the playing field by
providing
quality data to SEO enthusiasts and professionals around the world.

DataForSEO Link Bot is key to ensuring that every member of the SEO community –
no matter
the size of the pocket – can access the core element of Google’s ranking
algorithm.

Yes, we’re working on the biggest available backlink database on the web that
every single
member of the community, including you, can use and benefit from.


DATAFORSEO LINK BOT

Version: 1.0
Bot type: backlink checker bot
Obeys robots.txt: YES
Obeys crawl delay: YES
User agent string:
Mozilla/5.0 (compatible; DataForSeoBot; +https://dataforseo.com/dataforseo-bot)


ENTER THE BACKLINKS API



Backlinks API is the name of our new product that has been developed with a
single purpose: providing website owners, webmasters, and SEO professionals with
opportunities to analyze the key component of website optimization – backlinks.

To attain this ambitious goal, we had to build a system similar to Google’s
PageRank algorithm and make sure it works. Our team had spent the past year
researching, planning, building, and iterating this system.

But to go any further, we’ll need your help. No, this time we don’t want to sell
you anything. In fact, the best thing you can do is… well, do nothing.

If you’re reading this, don’t rush straight to your robots.txt to block our user
agent. This way, you will help thousands of website owners – like yourself – to
improve their websites’ visibility.




MODIFY DATAFORSEO BOT
FOR A SMOOTHER RIDE



There are literally thousands of good bots crawling your website to help parse
and index your content and make it available to users searching for it.

DataForSEO Bot belongs to the category of Good Bots, meaning it won’t harm your
website in any way. Our bot supports your robots.txt settings, explicitely
identifies itself and has an official moniker.

You have a full control over what DataForSEO Bot can and cannot do on your
website. For example, you can change the default 5-second frequency of it
visiting your site or block it from accessing certain pages or folders by using
wildcards (*).



CHANGE CRAWL DELAY OF DATAFORSEO BOT

User-agent: DataForSeoBot
Crawl-delay: 5


DISALLOW DATAFORSEO BOT ON A PAGE

User-agent: DataForSeoBot
Disallow: /example-page


REQUEST THE FORCE-RELOAD OF ROBOTS.TXT

Send Check Your Robots.txt Settings





WANT TO LEARN MORE ABOUT DATAFORSEO BOT?

Contact our support team to request more information.

Contact us


QUICK FAQ



What is DataForSeoBot?

DataForSEO Bot is constantly crawling the web to add new links to our backlink
database and check links that are already included.
This is crucial to support our mission – providing website owners, webmasters
and SEOs with equal access to vital data.



What is DataForSeoBot doing on my website?

DataForSEO Bot crawls your website pages and adds all found links to our
backlink database. It does not collect any other data about your website and
won’t trigger ads or add numbers to your traffic in Google Analytics.



How to change crawl delay?

DataForSEO Bot is a good bot that plays by your rules. It allows modifying lots
of crawling parameters, including crawl delay. Add the following snippet with a
crawl delay you need to your website’s robots.txt file:

User-agent: DataForSeoBot

Crawl-delay: [value]



What subnets does DataForSEO Link Bot use to make requests?

DataForSEO Bot relies on a number of subnets to collect backlink data.  You can
use these subnets to identify DataForSEO Bot. The following are IPv4 and IPv6
identifiers of our subnets.

IPv4:
136.243.220.208/29
136.243.228.176/29
136.243.228.192/29

IPv6:
2a01:4f8:271:6283::/64
2a01:4f8:271:6284::/64
2a01:4f8:271:6285::/64



What is the Reverse DNS mask of DataForSEO Bot?

You can verify if a web crawler accessing your website is a legitimate
DataForSEO Bot by running a reverse DNS lookup.

Reverse DNS mask: crawling-gateway-*.dataforseo.com

Example:
# host 136.243.228.176
176.228.243.136.in-addr.arpa domain name pointer
crawling-gateway-136-243-228-176.dataforseo.com.



How do I disallow DataForSEO bot on certain pages?

To disallow our bot on certain pages of your website, add the following snippet
to your website’s robots.txt file:

User-agent: DataForSeoBot

Disallow: /[url path]



How do I disallow DataForSEO bot on the entire website?

To disallow our bot on all pages of your website, add the following snippet to
your website’s robots.txt file:

User-agent: DataForSeoBot

Disallow: /


CONTACT US



Your Name

Your Email

Your Subject

Your Message







Built with love in Ukraine


Vesivärava tn 50-201, Kesklinna linnaosa, Tallinn, Harju maakond, Republic of
Estonia, 10152



616 Corporate Way, Suite 2-4116 Valley Cottage, 10989, NY, USA



63 Kolomenskaya Str, Kharkov, 61166, Ukraine

Email: info@dataforseo.com



APIS

 * SERP API
 * Google Ads API
 * Backlinks API
 * Traffic Analytics API
 * OnPage API
 * DataForSEO Labs API
 * Business Data API
 * Amazon API
 * Google Shopping API

DATABASES

 * Google Databases
 * Bing Databases
 * Amazon Database
 * App Store Database
 * Google Play Database
 * Domains Database

SOLUTIONS

 * Backlink App
 * SEO Agency
 * SEO Software
 * Media
 * Ecommerce
 * Market Research
 * Digital Marketing
 * Marketing Tech
 * Scraping Services

KNOWLEDGE BASE

 * Blog
 * White Papers
 * Help Center
 * Updates

RESOURCES

 * FAQ
 * SERP Features
 * Top 1000 Sites
 * Google Sheets Connector
 * Our data
 * Status Page

LEGAL INFORMATION

 * Privacy Policy
 * Terms of Services

PAYMENT METHODS:












×
We Value Your Privacy
Settings
NextRoll, Inc. ("NextRoll") and our advertising partners use cookies and similar
technologies on this site and use personal data (e.g., your IP address). If you
consent, the cookies, device identifiers, or other information can be stored or
accessed on your device for the purposes described below. You can click "Allow
All" or "Decline All" or click Settings above to customize your consent.
NextRoll and our advertising partners process personal data to: ● Store and/or
access information on a device; ● Create a personalized content profile; ●
Select personalised content; ● Personalized ads, ad measurement and audience
insights; ● Product development. For some of the purposes above, our advertising
partners: ● Use precise geolocation data. Some of our partners rely on their
legitimate business interests to process personal data. View our advertising
partners if you wish to provide or deny consent for specific partners, review
the purposes each partner believes they have a legitimate interest for, and
object to such processing.
If you select Decline All, you will still be able to view content on this site
and you will still receive advertising, but the advertising will not be tailored
for you. You may change your setting whenever you see the Manage consent
preferences on this site.
Decline All
Allow All
Manage consent preferences