URL: http://ahrefs.com/robot/)
Submission: On April 23 via api from US

Summary

This website contacted 5 IPs in 2 countries across 4 domains to perform 10 HTTP transactions. The main IP is 151.80.39.61, located in Roubaix, France and belongs to OVH, FR. The main domain is ahrefs.com.
This is the only time ahrefs.com was scanned on urlscan.io!

urlscan.io Verdict: No classification

Domain & IP information

IP Address AS Autonomous System
3 151.80.39.61 16276 (OVH)
1 2001:4de0:ac1... 20446 (HIGHWINDS3)
4 104.74.124.113 16625 (AKAMAI-AS)
1 178.62.192.243 14061 (DIGITALOC...)
10 5
Domain Requested by
3 cdn.iubenda.com ahrefs.com
cdn.iubenda.com
3 ahrefs.com ahrefs.com
1 hits-i.iubenda.com cdn.iubenda.com
1 www.iubenda.com cdn.iubenda.com
1 maxcdn.bootstrapcdn.com ahrefs.com
0 widget.intercom.io Failed ahrefs.com
10 6

This site contains links to these domains. Also see Links.

Domain
www.iubenda.com
Subject Issuer Validity Valid
*.bootstrapcdn.com
Sectigo RSA Domain Validation Secure Server CA
2019-09-14 -
2020-10-13
a year crt.sh

This page contains 2 frames:

Primary Page: http://ahrefs.com/robot/)
Frame ID: 2D42B219D8988B1472B0C0EF6D20FDBC
Requests: 10 HTTP requests in this frame

Frame: http://cdn.iubenda.com/cookie_solution/iframe_bridge.html?origin=http%3A%2F%2Fahrefs.com%2Frobot%2F)&meth=%22compact%22
Frame ID: 3EFF256B94561EDA3FEE7D756B838789
Requests: 1 HTTP requests in this frame

Screenshot


Detected technologies

Overall confidence: 100%
Detected patterns
  • html /<link[^>]+?href="[^"]*bootstrap(?:\.min)?\.css/i

Overall confidence: 100%
Detected patterns
  • headers server /nginx(?:\/([\d.]+))?/i

Page Statistics

10
Requests

10 %
HTTPS

25 %
IPv6

4
Domains

6
Subdomains

5
IPs

2
Countries

89 kB
Transfer

231 kB
Size

0
Cookies

Redirected requests

There were HTTP redirect chains for the following requests:

10 HTTP transactions

Resource
Path
Size
x-fer
Type
MIME-Type
Primary Request )
ahrefs.com/robot/
3 KB
1 KB
Document
General
Full URL
http://ahrefs.com/robot/)
Protocol
HTTP/1.1
Server
151.80.39.61 Roubaix, France, ASN16276 (OVH, FR),
Reverse DNS
front1.a.ahrefs.com
Software
nginx /
Resource Hash
81c059ae0522877090371a3eebe5abceb3b479ae357868cd32c22191bda984a9

Request headers

Host
ahrefs.com
Connection
keep-alive
Pragma
no-cache
Cache-Control
no-cache
Upgrade-Insecure-Requests
1
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36
Accept
text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9
Accept-Encoding
gzip, deflate
Accept-Language
en-US
Upgrade-Insecure-Requests
1
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36

Response headers

Server
nginx
Date
Thu, 23 Apr 2020 18:44:39 GMT
Content-Type
text/html; charset=utf8
Transfer-Encoding
chunked
Connection
keep-alive
Vary
Accept-Encoding
ETag
W/"5cc29951-a3d"
Content-Encoding
gzip
bootstrap.min.css
maxcdn.bootstrapcdn.com/bootstrap/4.0.0-alpha.2/css/
93 KB
17 KB
Stylesheet
General
Full URL
https://maxcdn.bootstrapcdn.com/bootstrap/4.0.0-alpha.2/css/bootstrap.min.css
Requested by
Host: ahrefs.com
URL: http://ahrefs.com/robot/)
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
2001:4de0:ac19::1:b:2a , Netherlands, ASN20446 (HIGHWINDS3, US),
Reverse DNS
Software
/
Resource Hash
c567912a3cf283a6dea7d0f502c1f350f1161db58cce545cf38674686fadca6b
Security Headers
Name Value
X-Content-Type-Options nosniff

Request headers

Referer
http://ahrefs.com/robot/)
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36

Response headers

date
Thu, 23 Apr 2020 18:44:39 GMT
content-encoding
gzip
x-content-type-options
nosniff
last-modified
Wed, 12 Dec 2018 18:34:08 GMT
status
200
etag
"1544639648"
vary
Accept-Encoding
x-cache
HIT
content-type
text/css; charset=utf-8
access-control-allow-origin
*
cache-control
public, max-age=31536000
cross-origin-resource-policy
cross-origin
accept-ranges
bytes
timing-allow-origin
*
content-length
17650
notfound.css
ahrefs.com/assets/css/
2 KB
1 KB
Stylesheet
General
Full URL
http://ahrefs.com/assets/css/notfound.css
Requested by
Host: ahrefs.com
URL: http://ahrefs.com/robot/)
Protocol
HTTP/1.1
Server
151.80.39.61 Roubaix, France, ASN16276 (OVH, FR),
Reverse DNS
front1.a.ahrefs.com
Software
nginx /
Resource Hash
2e299a956f3520fef19678ddbfdf9a227aa58130dccec19851317b9e4d3d1daf

Request headers

Referer
http://ahrefs.com/robot/)
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36

Response headers

Pragma
public
Date
Thu, 23 Apr 2020 18:44:39 GMT
Content-Encoding
gzip
Last-Modified
Fri, 01 Mar 2019 05:02:31 GMT
Server
nginx
ETag
W/"5c78bce7-921"
Vary
Accept-Encoding
Content-Type
text/css
Cache-Control
max-age=2592000, public
Transfer-Encoding
chunked
Connection
keep-alive
Expires
Sat, 23 May 2020 18:44:39 GMT
iubenda_cs.js
cdn.iubenda.com/cookie_solution/safemode/
237 B
659 B
Script
General
Full URL
http://cdn.iubenda.com/cookie_solution/safemode/iubenda_cs.js
Requested by
Host: ahrefs.com
URL: http://ahrefs.com/robot/)
Protocol
HTTP/1.1
Server
104.74.124.113 , Netherlands, ASN16625 (AKAMAI-AS, US),
Reverse DNS
a104-74-124-113.deploy.static.akamaitechnologies.com
Software
nginx/1.15.8 /
Resource Hash
3a585399acea802506b248a0f83926def3bc57198d35a8e48dadd149c556f2b1

Request headers

Referer
http://ahrefs.com/robot/)
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36

Response headers

Date
Thu, 23 Apr 2020 18:44:39 GMT
Content-Encoding
gzip
Last-Modified
Thu, 23 Apr 2020 08:52:16 GMT
Server
nginx/1.15.8
ETag
"5ea15740-c8"
Vary
Accept-Encoding
P3P
CP="DSP NOI COR", policyref="http://www.iubenda.com/w3c/p3p.xml"
Cache-Control
public, must-revalidate, proxy-revalidate, max-age=10800
Connection
keep-alive
Content-Type
application/javascript
Content-Length
200
Expires
Thu, 23 Apr 2020 21:44:39 GMT
robot-error.png
ahrefs.com/images/service/
35 KB
35 KB
Image
General
Full URL
http://ahrefs.com/images/service/robot-error.png
Requested by
Host: ahrefs.com
URL: http://ahrefs.com/robot/)
Protocol
HTTP/1.1
Server
151.80.39.61 Roubaix, France, ASN16276 (OVH, FR),
Reverse DNS
front1.a.ahrefs.com
Software
nginx /
Resource Hash
2d6333654303d90c9cd9c4a694c1e226149804b48f6dbb36c182c304d5a0390a

Request headers

Referer
http://ahrefs.com/robot/)
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36

Response headers

Pragma
public
Date
Thu, 23 Apr 2020 18:44:39 GMT
Last-Modified
Thu, 03 Jan 2019 08:22:24 GMT
Server
nginx
ETag
"5c2dc640-8be6"
Content-Type
image/png
Cache-Control
max-age=2592000, public
Connection
keep-alive
Accept-Ranges
bytes
Content-Length
35814
Expires
Sat, 23 May 2020 18:44:39 GMT
truncated
/
691 B
0
Image
General
Full URL
data:truncated
Protocol
DATA
Server
-, , ASN (),
Reverse DNS
Software
/
Resource Hash
bdc4d74d1594b58a45c618064cfec3fb1f66db5108d52ee86840ec20de469dc0

Request headers

Referer
http://ahrefs.com/assets/css/notfound.css
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36

Response headers

Content-Type
image/svg+xml
core-fcf8c9eac36aece9d290934b54a63296.js
cdn.iubenda.com/cookie_solution/iubenda_cs/
97 KB
32 KB
Script
General
Full URL
http://cdn.iubenda.com/cookie_solution/iubenda_cs/core-fcf8c9eac36aece9d290934b54a63296.js
Requested by
Host: cdn.iubenda.com
URL: http://cdn.iubenda.com/cookie_solution/safemode/iubenda_cs.js
Protocol
HTTP/1.1
Server
104.74.124.113 , Netherlands, ASN16625 (AKAMAI-AS, US),
Reverse DNS
a104-74-124-113.deploy.static.akamaitechnologies.com
Software
nginx/1.15.8 /
Resource Hash
3883953ece04ad3f10b29882c2d75b7dfed7c4fc3a2505063b78cb6549038645

Request headers

Referer
http://ahrefs.com/robot/)
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36

Response headers

Date
Thu, 23 Apr 2020 18:44:39 GMT
Content-Encoding
gzip
Last-Modified
Thu, 23 Apr 2020 08:52:16 GMT
Server
nginx/1.15.8
ETag
"5ea15740-7dbd"
Vary
Accept-Encoding
P3P
CP="DSP NOI COR", policyref="http://www.iubenda.com/w3c/p3p.xml"
Cache-Control
public, must-revalidate, proxy-revalidate, max-age=31536000
Connection
keep-alive
Content-Type
application/javascript
Content-Length
32189
Expires
Fri, 23 Apr 2021 18:44:39 GMT
794932.js
www.iubenda.com/cookie-solution/confs/js/
86 B
705 B
Script
General
Full URL
http://www.iubenda.com/cookie-solution/confs/js/794932.js
Requested by
Host: cdn.iubenda.com
URL: http://cdn.iubenda.com/cookie_solution/iubenda_cs/core-fcf8c9eac36aece9d290934b54a63296.js
Protocol
HTTP/1.1
Server
104.74.124.113 , Netherlands, ASN16625 (AKAMAI-AS, US),
Reverse DNS
a104-74-124-113.deploy.static.akamaitechnologies.com
Software
nginx /
Resource Hash
10859c934f9a7a5b9cd0cfa05fc4eea24f753a556ed0c5bb962b5f33ddd773d6

Request headers

Referer
http://ahrefs.com/robot/)
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36

Response headers

Date
Thu, 23 Apr 2020 18:44:39 GMT
Access-Control-Request-Method
*
Connection
keep-alive
Content-Encoding
gzip
Content-Length
84
Last-Modified
Thu, 09 Apr 2020 15:04:27 GMT
Server
nginx
ETag
"5e8f397b-56"
Vary
Accept-Encoding
Access-Control-Allow-Methods
POST, PUT, DELETE, GET, OPTIONS
Content-Type
application/javascript
Access-Control-Allow-Origin
*
Cache-Control
max-age=86400
Access-Control-Allow-Credentials
true
Accept-Ranges
bytes
Access-Control-Allow-Headers
Origin, X-Requested-With, Content-Type, Accept, Authorization
Expires
Fri, 24 Apr 2020 18:44:39 GMT
dic5omcp
widget.intercom.io/widget/
0
0

iframe_bridge.html
cdn.iubenda.com/cookie_solution/ Frame 3EFF
0
0
Document
General
Full URL
http://cdn.iubenda.com/cookie_solution/iframe_bridge.html?origin=http%3A%2F%2Fahrefs.com%2Frobot%2F)&meth=%22compact%22
Requested by
Host: cdn.iubenda.com
URL: http://cdn.iubenda.com/cookie_solution/iubenda_cs/core-fcf8c9eac36aece9d290934b54a63296.js
Protocol
HTTP/1.1
Server
104.74.124.113 , Netherlands, ASN16625 (AKAMAI-AS, US),
Reverse DNS
a104-74-124-113.deploy.static.akamaitechnologies.com
Software
nginx/1.15.8 /
Resource Hash

Request headers

Host
cdn.iubenda.com
Connection
keep-alive
Pragma
no-cache
Cache-Control
no-cache
Upgrade-Insecure-Requests
1
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36
Accept
text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9
Referer
http://ahrefs.com/robot/)
Accept-Encoding
gzip, deflate
Accept-Language
en-US
Upgrade-Insecure-Requests
1
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36
Referer
http://ahrefs.com/robot/)

Response headers

Server
nginx/1.15.8
Content-Type
text/html
Content-Length
1236
Last-Modified
Thu, 23 Apr 2020 08:52:17 GMT
ETag
"5ea15741-4d4"
Content-Encoding
gzip
P3P
CP="DSP NOI COR", policyref="http://www.iubenda.com/w3c/p3p.xml"
Cache-Control
public, must-revalidate, proxy-revalidate, max-age=86400
Expires
Fri, 24 Apr 2020 18:44:39 GMT
Date
Thu, 23 Apr 2020 18:44:39 GMT
Connection
keep-alive
Vary
Accept-Encoding
write
hits-i.iubenda.com/
0
611 B
XHR
General
Full URL
http://hits-i.iubenda.com/write?db=hits1
Requested by
Host: cdn.iubenda.com
URL: http://cdn.iubenda.com/cookie_solution/iubenda_cs/core-fcf8c9eac36aece9d290934b54a63296.js
Protocol
HTTP/1.1
Server
178.62.192.243 Amsterdam, Netherlands, ASN14061 (DIGITALOCEAN-ASN, US),
Reverse DNS
Software
nginx /
Resource Hash
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

Authorization
Basic aGl0czFfdTpoaXRzMV91cHdk
Referer
http://ahrefs.com/robot/)
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36
Content-Type
text/plain;charset=UTF-8

Response headers

Date
Thu, 23 Apr 2020 18:44:39 GMT
Server
nginx
X-Influxdb-Build
OSS
Access-Control-Allow-Methods
DELETE, GET, OPTIONS, POST, PUT
Content-Type
application/json
Access-Control-Allow-Origin
http://ahrefs.com
Access-Control-Expose-Headers
Date, X-InfluxDB-Version, X-InfluxDB-Build
Connection
keep-alive
Request-Id
7d218d57-8592-11ea-af69-0242ac110003
Access-Control-Allow-Headers
Accept, Accept-Encoding, Authorization, Content-Length, Content-Type, X-CSRF-Token, X-HTTP-Method-Override
X-Influxdb-Version
1.7.5
X-Request-Id
7d218d57-8592-11ea-af69-0242ac110003

Failed requests

These URLs were requested, but there was no response received. You will also see them in the list above.

Domain
widget.intercom.io
URL
https://widget.intercom.io/widget/dic5omcp

Verdicts & Comments Add Verdict or Comment

6 JavaScript Global Variables

These are the non-standard "global" variables defined on the window object. These can be helpful in identifying possible client-side frameworks and code.

object| onformdata object| onpointerrawupdate object| _iub object| intercomSettings function| Intercom object| ontouchmove

0 Cookies