www.semrush.com Open in urlscan Pro
104.18.70.106 Public Scan

Go To Rescan
Add Verdict Report

URL:
https://www.semrush.com/bot/
Submission: On January 13 via manual (January 13th 2020, 4:57:18 am UTC) from JP

Summary HTTP 48 Redirects Links 8 Behaviour Indicators

Summary

This website contacted 24 IPs in 6 countries across 24 domains to perform 48 HTTP transactions. The main IP is 104.18.70.106, located in United States and belongs to CLOUDFLARENET - Cloudflare, Inc., US. The main domain is www.semrush.com.
TLS certificate: Issued by Sectigo RSA Domain Validation Secure ... on May 21st 2019. Valid for: a year.

This is the only time www.semrush.com was scanned on urlscan.io!

urlscan.io Verdict: No classification

Domain & IP information

	IP Address	AS Autonomous System
19	104.18.70.106 104.18.70.106	13335 (CLOUDFLAR...) (CLOUDFLARENET - Cloudflare)
1	2606:4700::68... 2606:4700::6810:5f41	13335 (CLOUDFLAR...) (CLOUDFLARENET - Cloudflare)
2	2a00:1450:400... 2a00:1450:4001:808::200e	15169 (GOOGLE) (GOOGLE - Google LLC)
1	2a00:1450:400... 2a00:1450:4001:816::2008	15169 (GOOGLE) (GOOGLE - Google LLC)
1	151.101.12.157 151.101.12.157	54113 (FASTLY) (FASTLY - Fastly)
1 2	172.217.23.134 172.217.23.134	15169 (GOOGLE) (GOOGLE - Google LLC)
1	2a02:26f0:6c0... 2a02:26f0:6c00:293::3adf	20940 (AKAMAI-ASN1) (AKAMAI-ASN1)
2	2620:1ec:c11:... 2620:1ec:c11::200	8068 (MICROSOFT...) (MICROSOFT-CORP-MSN-AS-BLOCK - Microsoft Corporation)
2	2a03:2880:f02... 2a03:2880:f02d:12:face:b00c:0:3	32934 (FACEBOOK) (FACEBOOK - Facebook)
2	52.232.113.156 52.232.113.156	8075 (MICROSOFT...) (MICROSOFT-CORP-MSN-AS-BLOCK - Microsoft Corporation)
1	151.101.113.140 151.101.113.140	54113 (FASTLY) (FASTLY - Fastly)
1	54.164.86.91 54.164.86.91	14618 (AMAZON-AES) (AMAZON-AES - Amazon.com)
2	2606:4700::68... 2606:4700::6811:1b5c	13335 (CLOUDFLAR...) (CLOUDFLARENET - Cloudflare)
1 2	2a05:f500:11:... 2a05:f500:11:101::b93f:9005	14413 (LINKEDIN) (LINKEDIN - LinkedIn Corporation)
1 1	2a05:f500:10:... 2a05:f500:10:101::b93f:9101	14413 (LINKEDIN) (LINKEDIN - LinkedIn Corporation)
1	35.186.228.179 35.186.228.179	15169 (GOOGLE) (GOOGLE - Google LLC)
1 1	2a00:1450:400... 2a00:1450:400c:c00::9d	15169 (GOOGLE) (GOOGLE - Google LLC)
1 1	2a00:1450:400... 2a00:1450:4001:825::2004	15169 (GOOGLE) (GOOGLE - Google LLC)
1	2a00:1450:400... 2a00:1450:4001:81a::2003	15169 (GOOGLE) (GOOGLE - Google LLC)
1 2	2a03:2880:f12... 2a03:2880:f12d:83:face:b00c:0:25de	32934 (FACEBOOK) (FACEBOOK - Facebook)
1	104.244.42.133 104.244.42.133	13414 (TWITTER) (TWITTER - Twitter Inc.)
1	3.225.77.184 3.225.77.184	14618 (AMAZON-AES) (AMAZON-AES - Amazon.com)
1	2a03:2880:f02... 2a03:2880:f02d:5:face:b00c:0:8c	32934 (FACEBOOK) (FACEBOOK - Facebook)
1	151.101.114.110 151.101.114.110	54113 (FASTLY) (FASTLY - Fastly)
1	104.244.42.3 104.244.42.3	13414 (TWITTER) (TWITTER - Twitter Inc.)
3	162.247.242.20 162.247.242.20	23467 (NEWRELIC-...) (NEWRELIC-AS-1 - New Relic)
48	24

19 104.18.70.106 (United States)

ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US)

www.semrush.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools
static.semrush.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2606:4700::6810:5f41 (United States)

ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US)

static.cloudflareinsights.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2a00:1450:4001:808::200e (Frankfurt am Main, Germany)

ASN15169 (GOOGLE - Google LLC, US)

www.google-analytics.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2a00:1450:4001:816::2008 (Frankfurt am Main, Germany)

ASN15169 (GOOGLE - Google LLC, US)

www.googletagmanager.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 151.101.12.157 (Frankfurt am Main, Germany)

ASN54113 (FASTLY - Fastly, US)

static.ads-twitter.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 172.217.23.134 (United States) 1 redirects

ASN15169 (GOOGLE - Google LLC, US)
PTR: fra16s18-in-f134.1e100.net

6266241.fls.doubleclick.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2a02:26f0:6c00:293::3adf (Ascension Island)

ASN20940 (AKAMAI-ASN1, US)

sjs.bizographics.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2620:1ec:c11::200 (United States)

ASN8068 (MICROSOFT-CORP-MSN-AS-BLOCK - Microsoft Corporation, US)

bat.bing.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2a03:2880:f02d:12:face:b00c:0:3 (Ireland)

ASN32934 (FACEBOOK - Facebook, Inc., US)

connect.facebook.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 52.232.113.156 (Amsterdam, Netherlands)

ASN8075 (MICROSOFT-CORP-MSN-AS-BLOCK - Microsoft Corporation, US)

api.mindbox.cloud	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 151.101.113.140 (Frankfurt am Main, Germany)

ASN54113 (FASTLY - Fastly, US)

www.redditstatic.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 54.164.86.91 (Ashburn, United States)

ASN14618 (AMAZON-AES - Amazon.com, Inc., US)
PTR: ec2-54-164-86-91.compute-1.amazonaws.com

q.quora.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2606:4700::6811:1b5c (United States)

ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US)

widget.uservoice.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools
by2.uservoice.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2a05:f500:11:101::b93f:9005 (Ireland) 1 redirects

ASN14413 (LINKEDIN - LinkedIn Corporation, US)

px.ads.linkedin.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2a05:f500:10:101::b93f:9101 (Ireland) 1 redirects

ASN14413 (LINKEDIN - LinkedIn Corporation, US)

www.linkedin.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 35.186.228.179 (Mountain View, United States)

ASN15169 (GOOGLE - Google LLC, US)
PTR: 179.228.186.35.bc.googleusercontent.com

google-analytics.bi.owox.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2a00:1450:400c:c00::9d (Brussels, Belgium) 1 redirects

ASN15169 (GOOGLE - Google LLC, US)

stats.g.doubleclick.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2a00:1450:4001:825::2004 (Frankfurt am Main, Germany) 1 redirects

ASN15169 (GOOGLE - Google LLC, US)

www.google.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2a00:1450:4001:81a::2003 (Frankfurt am Main, Germany)

ASN15169 (GOOGLE - Google LLC, US)

www.google.de	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2a03:2880:f12d:83:face:b00c:0:25de (Ireland) 1 redirects

ASN32934 (FACEBOOK - Facebook, Inc., US)

www.facebook.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 104.244.42.133 (United States)

ASN13414 (TWITTER - Twitter Inc., US)

t.co	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 3.225.77.184 (Ashburn, United States)

ASN14618 (AMAZON-AES - Amazon.com, Inc., US)
PTR: ec2-3-225-77-184.compute-1.amazonaws.com

alb.reddit.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2a03:2880:f02d:5:face:b00c:0:8c (Ireland)

ASN32934 (FACEBOOK - Facebook, Inc., US)

cx.atdmt.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 151.101.114.110 (Frankfurt am Main, Germany)

ASN54113 (FASTLY - Fastly, US)

js-agent.newrelic.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 104.244.42.3 (United States)

ASN13414 (TWITTER - Twitter Inc., US)

analytics.twitter.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

3 162.247.242.20 (San Francisco, United States)

ASN23467 (NEWRELIC-AS-1 - New Relic, US)
PTR: bam-8.nr-data.net

bam.nr-data.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

	Apex Domain Subdomains	Transfer
19	semrush.com www.semrush.com static.semrush.com	306 KB
3	nr-data.net bam.nr-data.net	625 B
3	linkedin.com 2 redirects px.ads.linkedin.com www.linkedin.com	2 KB
3	doubleclick.net 2 redirects 6266241.fls.doubleclick.net stats.g.doubleclick.net	971 B
2	facebook.com 1 redirects www.facebook.com	672 B
2	uservoice.com widget.uservoice.com by2.uservoice.com	20 KB
2	mindbox.cloud api.mindbox.cloud	14 KB
2	facebook.net connect.facebook.net	143 KB
2	bing.com bat.bing.com	8 KB
2	google-analytics.com www.google-analytics.com	18 KB
1	twitter.com analytics.twitter.com	633 B
1	newrelic.com js-agent.newrelic.com	14 KB
1	atdmt.com cx.atdmt.com	433 B
1	reddit.com alb.reddit.com	339 B
1	t.co t.co	448 B
1	google.de www.google.de	109 B
1	google.com 1 redirects www.google.com	189 B
1	owox.com google-analytics.bi.owox.com	442 B
1	quora.com q.quora.com	457 B
1	redditstatic.com www.redditstatic.com	5 KB
1	bizographics.com sjs.bizographics.com	2 KB
1	ads-twitter.com static.ads-twitter.com	2 KB
1	googletagmanager.com www.googletagmanager.com	57 KB
1	cloudflareinsights.com static.cloudflareinsights.com	2 KB
48	24

	Domain	Requested by
17	www.semrush.com	www.semrush.com
3	bam.nr-data.net	www.semrush.com
2	www.facebook.com	1 redirects www.semrush.com
2	px.ads.linkedin.com	1 redirects www.semrush.com
2	api.mindbox.cloud	www.semrush.com
2	connect.facebook.net	www.semrush.com
2	bat.bing.com	www.semrush.com
2	6266241.fls.doubleclick.net	1 redirects www.googletagmanager.com
2	www.google-analytics.com	www.semrush.com
2	static.semrush.com	www.semrush.com
1	analytics.twitter.com	www.semrush.com
1	by2.uservoice.com	www.semrush.com
1	js-agent.newrelic.com	www.semrush.com
1	cx.atdmt.com	www.semrush.com
1	alb.reddit.com	www.semrush.com
1	t.co	www.semrush.com
1	www.google.de	www.semrush.com
1	www.google.com	1 redirects
1	stats.g.doubleclick.net	1 redirects
1	google-analytics.bi.owox.com	www.semrush.com
1	www.linkedin.com	1 redirects
1	widget.uservoice.com	www.semrush.com
1	q.quora.com	www.semrush.com
1	www.redditstatic.com	www.semrush.com
1	sjs.bizographics.com	www.semrush.com
1	static.ads-twitter.com	www.semrush.com
1	www.googletagmanager.com	www.semrush.com
1	static.cloudflareinsights.com	www.semrush.com
48	28

This site contains links to these domains. Also see Links.

Domain
www.berush.com
www.robotstxt.org
twitter.com
www.facebook.com
linkedin.com
instagram.com
www.youtube.com
www.seoquake.com

Subject Issuer	Validity	Valid
*.semrush.com Sectigo RSA Domain Validation Secure Server CA	`2019-05-21` - `2020-05-20`	a year	crt.sh
ssl713275.cloudflaressl.com COMODO ECC Domain Validation Secure Server CA 2	`2019-09-10` - `2020-03-18`	6 months	crt.sh
*.google-analytics.com GTS CA 1O1	`2019-12-10` - `2020-03-03`	3 months	crt.sh
ads-twitter.com DigiCert SHA2 High Assurance Server CA	`2019-08-14` - `2020-08-18`	a year	crt.sh
*.doubleclick.net GTS CA 1O1	`2019-12-10` - `2020-03-03`	3 months	crt.sh
js.bizographics.com DigiCert SHA2 Secure Server CA	`2018-04-13` - `2020-04-17`	2 years	crt.sh
www.bing.com Microsoft IT TLS CA 2	`2019-04-30` - `2021-04-30`	2 years	crt.sh
*.facebook.com DigiCert SHA2 High Assurance Server CA	`2019-12-06` - `2020-03-05`	3 months	crt.sh
*.mindbox.cloud Thawte RSA CA 2018	`2019-10-11` - `2020-11-09`	a year	crt.sh
*.reddit.com DigiCert SHA2 Secure Server CA	`2018-08-17` - `2020-09-02`	2 years	crt.sh
*.quora.com Let's Encrypt Authority X3	`2019-12-01` - `2020-02-29`	3 months	crt.sh
uservoice.com CloudFlare Inc ECC CA-2	`2019-07-28` - `2020-07-27`	a year	crt.sh
px.ads.linkedin.com DigiCert SHA2 Secure Server CA	`2019-05-29` - `2021-06-29`	2 years	crt.sh
google-analytics.bi.owox.com Let's Encrypt Authority X3	`2019-12-11` - `2020-03-10`	3 months	crt.sh
www.google.de GTS CA 1O1	`2019-12-10` - `2020-03-03`	3 months	crt.sh
t.co DigiCert SHA2 High Assurance Server CA	`2019-03-07` - `2020-03-07`	a year	crt.sh
alb.reddit.com Amazon	`2019-05-20` - `2020-06-20`	a year	crt.sh
*.atlassolutions.com DigiCert SHA2 High Assurance Server CA	`2019-12-06` - `2020-03-04`	3 months	crt.sh
f4.shared.global.fastly.net GlobalSign CloudSSL CA - SHA256 - G3	`2019-04-10` - `2020-03-21`	a year	crt.sh
*.twitter.com DigiCert SHA2 High Assurance Server CA	`2020-01-02` - `2020-12-28`	a year	crt.sh
*.nr-data.net GeoTrust RSA CA 2018	`2018-01-11` - `2020-03-17`	2 years	crt.sh

This page contains 2 frames:

Primary Page: https://www.semrush.com/bot/
Frame ID: 9B4F01749C7E0D3D9321D054DD7CE81F
Requests: 48 HTTP requests in this frame

Frame: https://6266241.fls.doubleclick.net/activityi;dc_pre=CJWW8_Hk_-YCFYWL3godP6sG4Q;src=6266241;type=count0;cat=all_p0;ord=4827683670227;gtm=2wg121;auiddc=831494643.1578891420;u1=not%20set;u2=0;u5=495413072.1578891420;u3=undefined;u4=Unlogged-User;~oref=https%3A%2F%2Fwww.semrush.com%2Fbot%2F
Frame ID: 5821ECBFD3C45F31F2E35DB6F9F90492
Requests: 1 HTTP requests in this frame

Screenshot
Live screenshot

Full Image

Detected technologies

CloudFlare (CDN) Expand

Overall confidence: 100%
Detected patterns

headers server /^cloudflare$/i

Facebook (Widgets) Expand

Overall confidence: 100%
Detected patterns

script /\/\/connect\.facebook\.net\/[^\/]*\/[a-z]*\.js/i

Google Analytics (Analytics) Expand

Overall confidence: 100%
Detected patterns

script /google-analytics\.com\/(?:ga|urchin|analytics)\.js/i

Page Statistics

48
Requests

100 %
HTTPS

54 %
IPv6

24
Domains

28
Subdomains

24
IPs

6
Countries

595 kB
Transfer

1946 kB
Size

17
Cookies

8 Outgoing links

These are links going to different origins than the main page.

URL: https://www.berush.com/
Title: Affiliate Program

Search URL Search Domain Scan URL

URL: http://www.robotstxt.org/
Title: http://www.robotstxt.org/

Search URL Search Domain Scan URL

URL: https://twitter.com/semrush
Title:

Search URL Search Domain Scan URL

URL: https://www.facebook.com/SEMrush
Title:

Search URL Search Domain Scan URL

URL: https://linkedin.com/company/semrush
Title:

Search URL Search Domain Scan URL

URL: https://instagram.com/semrush/
Title:

Search URL Search Domain Scan URL

URL: https://www.youtube.com/user/SEMrushHQ
Title:

Search URL Search Domain Scan URL

URL: https://www.seoquake.com/
Title: SEOquake

Search URL Search Domain Scan URL

Redirected requests

There were HTTP redirect chains for the following requests:

Request Chain 13

https://6266241.fls.doubleclick.net/activityi;src=6266241;type=count0;cat=all_p0;ord=4827683670227;gtm=2wg121;auiddc=831494643.1578891420;u1=not%20set;u2=0;u5=495413072.1578891420;u3=undefined;u4=Unlogged-User;~oref=https%3A%2F%2Fwww.semrush.com%2Fbot%2F HTTP 302
https://6266241.fls.doubleclick.net/activityi;dc_pre=CJWW8_Hk_-YCFYWL3godP6sG4Q;src=6266241;type=count0;cat=all_p0;ord=4827683670227;gtm=2wg121;auiddc=831494643.1578891420;u1=not%20set;u2=0;u5=495413072.1578891420;u3=undefined;u4=Unlogged-User;~oref=https%3A%2F%2Fwww.semrush.com%2Fbot%2F

Request Chain 21

https://px.ads.linkedin.com/collect?v=2&fmt=js&pid=387538&url=https%3A%2F%2Fwww.semrush.com%2Fbot%2F&time=1578891420072 HTTP 302
https://www.linkedin.com/px/li_sync?redirect=https%3A%2F%2Fpx.ads.linkedin.com%2Fcollect%3Fv%3D2%26fmt%3Djs%26pid%3D387538%26url%3Dhttps%253A%252F%252Fwww.semrush.com%252Fbot%252F%26time%3D1578891420072%26liSync%3Dtrue HTTP 302
https://px.ads.linkedin.com/collect?v=2&fmt=js&pid=387538&url=https%3A%2F%2Fwww.semrush.com%2Fbot%2F&time=1578891420072&liSync=true

Request Chain 24

https://stats.g.doubleclick.net/r/collect?t=dc&aip=1&_r=3&v=1&_v=j79&tid=UA-6197637-22&cid=495413072.1578891420&jid=378387706&gjid=343629736&_gid=244521904.1578891420&_u=6GBAgEAD~&z=643280713 HTTP 302
https://www.google.com/ads/ga-audiences?v=1&aip=1&t=sr&_r=4&tid=UA-6197637-22&cid=495413072.1578891420&jid=378387706&_v=j79&z=643280713 HTTP 302
https://www.google.de/ads/ga-audiences?v=1&aip=1&t=sr&_r=4&tid=UA-6197637-22&cid=495413072.1578891420&jid=378387706&_v=j79&z=643280713&slf_rd=1&random=1177148791

Request Chain 40

https://www.facebook.com/tr/?id=239948206198576&ev=Microdata&dl=https%3A%2F%2Fwww.semrush.com%2Fbot%2F&rl=&if=false&ts=1578891420654&cd[DataLayer]=%5B%5D&cd[Meta]=%7B%22title%22%3A%22SEMrush%20Bot%20%7C%20SEMrush%22%2C%22meta%3Adescription%22%3A%22%22%7D&cd[OpenGraph]=%7B%22og%3Atitle%22%3A%22%22%2C%22og%3Aurl%22%3A%22https%3A%2F%2Fwww.semrush.com%2Fbot%2F%22%2C%22og%3Asite_name%22%3A%22SEMrush%22%2C%22og%3Adescription%22%3A%22%22%2C%22og%3Aimage%22%3A%22%22%2C%22og%3Atype%22%3A%22website%22%7D&cd[Schema.org]=%5B%5D&cd[JSON-LD]=%5B%7B%22%40context%22%3A%22http%3A%2F%2Fschema.org%22%2C%22%40type%22%3A%22Corporation%22%2C%22name%22%3A%22SEMrush%22%2C%22description%22%3A%22SEMrush%20-%20online%20visibility%20management%20and%20content%20marketing%20SaaS%20platform%22%2C%22logo%22%3A%22https%3A%2F%2Fcdn.semrush.com%2F__static__%2Fsemrush-logo-700.jpg%22%2C%22address%22%3A%7B%22%40type%22%3A%22PostalAddress%22%2C%22addressCountry%22%3A%22USA%22%2C%22addressLocality%22%3A%22Boston%22%2C%22addressRegion%22%3A%22MA%22%2C%22postalCode%22%3A%2202199%22%2C%22streetAddress%22%3A%22800%20Boylston%20Street%2C%20Suite%202475%22%7D%2C%22email%22%3A%22mailto%3Amail%40semrush.com%22%2C%22telephone%22%3A%22%2B1-800-815-9959%22%2C%22url%22%3A%22https%3A%2F%2Fwww.semrush.com%2F%22%2C%22sameAs%22%3A%5B%22https%3A%2F%2Ftwitter.com%2Fsemrush%22%2C%22https%3A%2F%2Fwww.facebook.com%2FSEMrush%22%2C%22https%3A%2F%2Flinkedin.com%2Fcompany%2Fsemrush%22%2C%22https%3A%2F%2Finstagram.com%2Fsemrush%2F%22%2C%22https%3A%2F%2Fwww.youtube.com%2Fuser%2FSEMrushHQ%22%5D%7D%5D&sw=1600&sh=1200&v=2.9.15&r=stable&ec=1&o=30&fbp=fb.1.1578891420150.561044770&it=1578891420109&coo=false&es=automatic&tm=3&rqm=GET HTTP 302
https://cx.atdmt.com/?c=11204078024649621221&f=AYxzVLqVfc40J-_dRgA2b6UqNVPJP1I-ZKxThzUjZqfEmQP34Fm-wEqHGG3oZWMaiSIOISp_QalK6iIWG4iEXO5h&id=239948206198576&l=3&v=0

48 HTTP transactions
1 data transactions

Method
Protocol Status Resource
Path Size
x-fer Time
Latency Type
MIME-Type IP
Location

GET
H2 200 Primary Request / Show response
www.semrush.com/bot/ 77 KB
21 KB 314ms
264ms Document
text/html 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

6b8ef6e32c55a3b9c7aa85a5578621eea92e4841cff1b70dc5804b5c2ebda576

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubdomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Request headers

:method: GET
:authority: www.semrush.com
:scheme: https
:path: /bot/
pragma: no-cache
cache-control: no-cache
upgrade-insecure-requests: 1
user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36
sec-fetch-user: ?1
accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3
sec-fetch-site: none
sec-fetch-mode: navigate
accept-encoding: gzip, deflate, br
Upgrade-Insecure-Requests: 1
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36
Sec-Fetch-User: ?1

Response headers

status: 200
date: Mon, 13 Jan 2020 04:56:59 GMT
content-type: text/html; charset=utf-8
set-cookie: __cfduid=d54ba6f10694ea830ad08f859cade617d1578891419; expires=Wed, 12-Feb-20 04:56:59 GMT; path=/; domain=.semrush.com; HttpOnly; SameSite=Lax; Secure ref_code=__default__; Domain=.semrush.com; expires=Sat, 12-Jan-2030 16:56:59 GMT; Max-Age=315576000; Path=/ refer_source=""; Domain=.semrush.com; expires=Sat, 12-Jan-2030 16:56:59 GMT; Max-Age=315576000; Path=/ ga_exp_7xHEszwjQFucPwMnhXHIzQ=2; Domain=.semrush.com; expires=Mon, 27-Jan-2020 04:56:59 GMT; Max-Age=1209600; Path=/ PHPSESSID=2ap-q2zg9l6yfwarjz95wby675l82u9w; Domain=.semrush.com; HttpOnly; Path=/; Secure n_userid=LuWkzV4b+JubQBTdBsSlAg==; domain=semrush.com; path=/ __cflb=02DiuHX4Ba44zLq78eDqAqPoPZytTuS8kFLvx7kiT8Xjr; SameSite=Lax; path=/; expires=Tue, 14-Jan-20 03:56:59 GMT; HttpOnly __cflb=02DiuHX4Ba44zLq78eDqAqPoPZytTuS8kFLvx7kiT8Xjr; SameSite=Lax; path=/; expires=Tue, 14-Jan-20 03:56:59 GMT; HttpOnly; domain=.semrush.com
cf-ray: 5544c96cd970e624-LHR
access-control-allow-origin: *
age: 56712
cache-control: no-cache
content-language: en
expires: Sun, 12 Jan 2020 14:11:47 GMT
last-modified: Thu, 14 Nov 2019 11:04:23 GMT
strict-transport-security: max-age=31536000; includeSubdomains; preload
vary: Accept-Encoding, Accept-Encoding, Cookie
cf-cache-status: HIT
access-control-expose-headers: Content-Type
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
p3p: policyref="/w3c/p3p.xml", CP="CUR ADM OUR NOR STA NID"
sm-log-id: 5544c96ce0b3e624-IAD
x-content-type-options: nosniff
x-frame-options: SAMEORIGIN
x-goog-generation: 1573729463027198
x-goog-hash: crc32c=NuzelA==, md5=WJbaRdhBcnBQoPjg0mRD9w==
x-goog-meta-goog-reserved-file-mtime: 1573729449
x-goog-metageneration: 1
x-goog-storage-class: MULTI_REGIONAL
x-goog-stored-content-encoding: identity
x-goog-stored-content-length: 11376
x-guploader-uploadid: AEnB2UobvV7BTUyyLysZGhxEHbTeUAwLSh9Nk-V51IGDNCHdlF2-5BGSDSnM9uFah2xeej6YuDjBzWJGRqMQI7dl2YTl7xau1w
x-service: bot
x-service-response-time: 0.06082
x-xss-protection: 1; mode=block
server: cloudflare
content-encoding: br

GET
H2 200 ubuntu-regular-latin.woff2
www.semrush.com/__static__/fonts/ 13 KB
14 KB 55ms
55ms Font
text/plain 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://www.semrush.com/__static__/fonts/ubuntu-regular-latin.woff2

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

943a150e9577247cc5e8e493065795ca77a35485b4169f33a4d6f570c209b010

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubdomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Request headers

User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36
Referer: https://www.semrush.com/bot/
Origin: https://www.semrush.com

Response headers

date: Mon, 13 Jan 2020 04:56:59 GMT
content-encoding: br
x-content-type-options: nosniff
cf-cache-status: HIT
age: 313390
status: 200
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-xss-protection: 1; mode=block
last-modified: Mon, 23 Dec 2019 12:50:12 GMT
server: cloudflare
x-frame-options: SAMEORIGIN
etag: W/"5e00b804-3598"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary: Accept-Encoding
content-type: text/plain
sm-log-id: 5526e64ad6e8bc24-LHR
cache-control: max-age=2678400
cf-ray: 5544c96e8b12e624-LHR
expires: Sun, 09 Feb 2020 13:53:49 GMT

GET
H2 200 ubuntu-bold-latin.woff2
www.semrush.com/__static__/fonts/ 14 KB
14 KB 53ms
53ms Font
text/plain 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://www.semrush.com/__static__/fonts/ubuntu-bold-latin.woff2

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

251e8e864140d9a7ceacce3371ff692595dd0a455ad000de4041d8a313618bd7

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubdomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Request headers

User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36
Referer: https://www.semrush.com/bot/
Origin: https://www.semrush.com

Response headers

date: Mon, 13 Jan 2020 04:56:59 GMT
content-encoding: br
x-content-type-options: nosniff
cf-cache-status: HIT
age: 313390
status: 200
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-xss-protection: 1; mode=block
last-modified: Mon, 23 Dec 2019 12:50:12 GMT
server: cloudflare
x-frame-options: SAMEORIGIN
etag: W/"5e00b804-3710"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary: Accept-Encoding
content-type: text/plain
sm-log-id: 5526e64ae6e9bc24-LHR
cache-control: max-age=2678400
cf-ray: 5544c96e8b13e624-LHR
expires: Sun, 09 Feb 2020 13:53:49 GMT

GET
H2 200 fonts.css
www.semrush.com/__static__/ 2 KB
552 B 45ms
44ms Stylesheet
text/css 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://www.semrush.com/__static__/fonts.css

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

7abcf162b90cd591072e956d6b05fb827bdfdec4f4daba8980b5dad789bc2b4d

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubdomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:56:59 GMT
content-encoding: br
x-content-type-options: nosniff
cf-cache-status: HIT
age: 313390
cf-polished: origSize=2473
status: 200
last-modified: Mon, 23 Dec 2019 12:50:12 GMT
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-xss-protection: 1; mode=block
cf-bgj: minify
server: cloudflare
x-frame-options: SAMEORIGIN
etag: W/"5e00b804-9a9"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary: Accept-Encoding
content-type: text/css
sm-log-id: 5526e64ae6ebbc24-LHR
cache-control: max-age=2678400
cf-ray: 5544c96e8b14e624-LHR
expires: Sun, 09 Feb 2020 13:53:49 GMT

GET
H2 200 base.ae348150.css
www.semrush.com/__static__/ 52 KB
13 KB 46ms
46ms Stylesheet
text/css 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://www.semrush.com/__static__/base.ae348150.css

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

a722f57c4f401f5dd6665f60bfb25247aa8c9b714f7e915b08f7431860b4e5c2

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubdomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:56:59 GMT
content-encoding: br
x-content-type-options: nosniff
cf-cache-status: HIT
age: 313390
cf-polished: origSize=53656
status: 200
last-modified: Mon, 23 Dec 2019 14:03:14 GMT
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-xss-protection: 1; mode=block
cf-bgj: minify
server: cloudflare
x-frame-options: SAMEORIGIN
etag: W/"5e00c922-d198"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary: Accept-Encoding
content-type: text/css
sm-log-id: 5526e64ae6ecbc24-LHR
cache-control: max-age=2678400
cf-ray: 5544c96e8b15e624-LHR
expires: Sun, 09 Feb 2020 13:53:49 GMT

GET
H2 200 / Show response
www.semrush.com/jsi18n/ 2 KB
1 KB 46ms
45ms Script
text/javascript 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://www.semrush.com/jsi18n/

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

98cf19b1b242b55673fa578612d05760183b181342ac72c323348d6e1fd24820

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubdomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:56:59 GMT
content-encoding: br
x-content-type-options: nosniff
cf-cache-status: HIT
age: 54162
cf-polished: origSize=3271
status: 200
last-modified: Thu, 09 Jan 2020 11:25:31 GMT
strict-transport-security: max-age=31536000; includeSubdomains; preload
content-type: text/javascript
x-xss-protection: 1; mode=block
cf-bgj: minify
server: cloudflare
x-frame-options: SAMEORIGIN
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary: Accept-Encoding
content-language: en
sm-log-id: 5526e663448ace6b-LHR
cache-control: max-age=86400, public
x-service: semrush2
cf-ray: 5544c96ecb45e624-LHR
expires: Mon, 13 Jan 2020 13:54:17 GMT

GET
H2 200 polyfills.c8b8681a.js Show response
www.semrush.com/__static__/ 19 KB
7 KB 39ms
38ms Script
application/javascript 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://www.semrush.com/__static__/polyfills.c8b8681a.js

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

593cc5ce6eb8733ea4603ff382caa167fbfd1561d56ccfb0156a0fdd6c92cb7c

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubdomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:56:59 GMT
content-encoding: br
x-content-type-options: nosniff
cf-cache-status: HIT
age: 313386
status: 200
last-modified: Mon, 23 Dec 2019 14:03:14 GMT
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-xss-protection: 1; mode=block
cf-bgj: minify
server: cloudflare
x-frame-options: SAMEORIGIN
etag: W/"5e00c922-4a50"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary: Accept-Encoding
content-type: application/javascript
sm-log-id: 5526e663448ece6b-LHR
cache-control: max-age=2678400
cf-ray: 5544c96ecb47e624-LHR
expires: Sun, 09 Feb 2020 13:53:53 GMT

GET
H2 200 base.c74ead53.js Show response
www.semrush.com/__static__/ 95 KB
29 KB 46ms
45ms Script
application/javascript 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://www.semrush.com/__static__/base.c74ead53.js

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

a3d03af4e7c4783617c75ca12fd456785986a6281b26d4b6bfadef561437d94b

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubdomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:56:59 GMT
content-encoding: br
x-content-type-options: nosniff
cf-cache-status: HIT
age: 313390
cf-polished: origSize=97063
status: 200
last-modified: Mon, 23 Dec 2019 14:03:14 GMT
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-xss-protection: 1; mode=block
cf-bgj: minify
server: cloudflare
x-frame-options: SAMEORIGIN
etag: W/"5e00c922-17b27"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary: Accept-Encoding
content-type: application/javascript
sm-log-id: 5526e64ae6edbc24-LHR
cache-control: max-age=2678400
cf-ray: 5544c96ecb48e624-LHR
expires: Sun, 09 Feb 2020 13:53:49 GMT

GET
H2 200 exp.min.js Show response
static.semrush.com/wte/js/ 9 KB
3 KB 55ms
54ms Script
application/javascript 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL: https://static.semrush.com/wte/js/exp.min.js
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),
Reverse DNS
Software: cloudflare /
Resource Hash: ecd60a941b824fe17b4757735dc54cefaac49ab7ad6ae82714453db1c48ed7ac

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:56:59 GMT
content-encoding: br
cf-cache-status: HIT
x-goog-meta-goog-reserved-file-mtime: 1577108770
age: 35
x-guploader-uploadid: AEnB2UpjwgtNfMDjYiJpX1zOQaIbgX-cG8vb3wiIzzN8mQgTvas_5_t0c2GeC84Iss2LZBXsxIKXNHTw3as7jzteLfqAFEEWXhL_4Pk8Zhp4s5prcOS_-gk
x-goog-storage-class: MULTI_REGIONAL
status: 200
x-goog-metageneration: 1
x-goog-stored-content-encoding: identity
access-control-allow-origin: *
last-modified: Mon, 23 Dec 2019 13:46:16 GMT
server: cloudflare
etag: W/"4bd8fc14694788d35ce783ac1ec3e8fb"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary: Accept-Encoding
x-goog-hash: crc32c=Jg+aew==, md5=S9j8FGlHiNNc54OsHsPo+w==
content-type: application/javascript
x-goog-generation: 1577108776692673
access-control-expose-headers: Content-Type
cache-control: public, max-age=60
x-goog-stored-content-length: 8707
cf-ray: 5544c96ecb4ce624-LHR
expires: Mon, 13 Jan 2020 04:57:24 GMT

GET
H2 200 bot.4444f834.css
static.semrush.com/semrush-bot/prod/ 2 KB
1 KB 75ms
74ms Stylesheet
text/css 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL: https://static.semrush.com/semrush-bot/prod/bot.4444f834.css
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),
Reverse DNS
Software: cloudflare /
Resource Hash: 5677b866170b8b995a3038b3c6702172f75539ec25e23805859df16b8bb08b1e

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
content-encoding: br
cf-cache-status: HIT
x-goog-meta-goog-reserved-file-mtime: 1573729449
age: 42502
cf-polished: origSize=2489
x-guploader-uploadid: AEnB2UpKq3INFdiGP5r2A6m5FHRMTuOizCJIzpR25zmnjRdUoDDMJ77_obV0DOKfZ0H0QM7-cdliY2GN9z7tvHUnvxxKQ_gOe8sOOSiBTJKHeaWGmYSie20
x-goog-storage-class: MULTI_REGIONAL
status: 200
x-goog-metageneration: 1
last-modified: Thu, 14 Nov 2019 11:04:22 GMT
x-goog-stored-content-encoding: identity
content-type: text/css
cf-bgj: minify
server: cloudflare
etag: W/"aac5f688906b5208291b3c66abdeba2c"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary: Accept-Encoding
x-goog-hash: crc32c=QOUsZg==, md5=qsX2iJBrUggpGzxmq966LA==
x-goog-generation: 1573729462998259
access-control-allow-origin: *
access-control-expose-headers: Content-Type
cache-control: public, max-age=3600
x-goog-stored-content-length: 2489
cf-ray: 5544c96ecb4be624-LHR
expires: Sun, 12 Jan 2020 18:08:37 GMT

GET
H2 200 beacon.min.js Show response
static.cloudflareinsights.com/ 5 KB
2 KB 26ms
10ms Script
text/javascript 2606:4700::6810:5f41
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL: https://static.cloudflareinsights.com/beacon.min.js
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2606:4700::6810:5f41 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),
Reverse DNS
Software: cloudflare /
Resource Hash: 895dd5cd067d31f6d73f74b2b76b4d1b62bd0a3db5a7391ddf067650fd6bd3f2

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:56:59 GMT
content-encoding: gzip
server: cloudflare
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary: Accept-Encoding
content-type: text/javascript;charset=UTF-8
status: 200
cf-ray: 5544c96ecf069abc-FRA

GET
H2 200 analytics.js Show response
www.google-analytics.com/ 43 KB
17 KB 6ms
5ms Script
text/javascript 2a00:1450:4001:808::200e
Google LLC

General

Check archive.org

Show headers Download Go to

Full URL

https://www.google-analytics.com/analytics.js

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:808::200e Frankfurt am Main, Germany, ASN15169 (GOOGLE - Google LLC, US),

Reverse DNS

Software

Golfe2 /

Resource Hash

dbb67c620eaabf6679a314db18d3ae43037aef71ab27422e6feec08ee987cc0a

Security Headers

Name	Value
Strict-Transport-Security	max-age=10886400; includeSubDomains; preload
X-Content-Type-Options	nosniff

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

strict-transport-security: max-age=10886400; includeSubDomains; preload
content-encoding: gzip
x-content-type-options: nosniff
last-modified: Mon, 19 Aug 2019 17:22:41 GMT
server: Golfe2
age: 1404
date: Mon, 13 Jan 2020 04:33:35 GMT
vary: Accept-Encoding
content-type: text/javascript
status: 200
cache-control: public, max-age=7200
alt-svc: quic=":443"; ma=2592000; v="46,43",h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000
content-length: 17803
expires: Mon, 13 Jan 2020 06:33:35 GMT

GET
H2 200 gtm.js Show response
www.googletagmanager.com/ 295 KB
57 KB 15ms
15ms Script
application/javascript 2a00:1450:4001:816::2008
Google LLC

General

Check archive.org

Show headers Download Go to

Full URL

https://www.googletagmanager.com/gtm.js?id=GTM-5K82J2

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:816::2008 Frankfurt am Main, Germany, ASN15169 (GOOGLE - Google LLC, US),

Reverse DNS

Software

Google Tag Manager /

Resource Hash

ef1f3e28deeab6d2c271cfc0dbfde355a85f17231740b554d78bc349fe7285f3

Security Headers

Name	Value
X-Xss-Protection	0

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:56:59 GMT
content-encoding: br
last-modified: Mon, 13 Jan 2020 03:00:00 GMT
server: Google Tag Manager
access-control-allow-origin: http://www.googletagmanager.com
vary: Accept-Encoding
content-type: application/javascript; charset=UTF-8
status: 200
alt-svc: quic=":443"; ma=2592000; v="46,43",h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000
cache-control: private, max-age=900
access-control-allow-credentials: true
access-control-allow-headers: Cache-Control
content-length: 57882
x-xss-protection: 0
expires: Mon, 13 Jan 2020 04:56:59 GMT

GET
H2 200 uwt.js Show response
static.ads-twitter.com/ 5 KB
2 KB 126ms
40ms Script
application/javascript 151.101.12.157
Fastly

General

Check archive.org

Show headers Download Go to

Full URL: https://static.ads-twitter.com/uwt.js
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 151.101.12.157 Frankfurt am Main, Germany, ASN54113 (FASTLY - Fastly, US),
Reverse DNS
Software: /
Resource Hash: 319949c8c08b86e9c35ea542c0dc0c30cedaa9b8d3d3c3327a36c91aefbd8af5

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
content-encoding: gzip
age: 74580
x-cache: HIT
p3p: CP="CAO DSP LAW CURa ADMa DEVa TAIa PSAa PSDa IVAa IVDa OUR BUS IND UNI COM NAV INT"
status: 200
content-length: 1954
x-served-by: cache-fra19183-FRA
last-modified: Tue, 23 Jan 2018 20:09:00 GMT
x-timer: S1578891420.139966,VS0,VE0
etag: "b7b33882a4f3ffd5cbf07434f3137166+gzip"
vary: Accept-Encoding,Host
content-type: application/javascript; charset=utf-8
via: 1.1 varnish
cache-control: no-cache
accept-ranges: bytes

GET
H2

200

activityi;dc_pre=CJWW8_Hk_-YCFYWL3godP6sG4Q;src=6266241;type=count0;cat=all_p0;ord=4827683670227;gtm=2wg121;auiddc=831494643.1578891420;u1=not%20set;u2=0;u5=495413072.1578891420;u3=undefined;u4=Unl...
6266241.fls.doubleclick.net/ Frame 5821
Redirect Chain

https://6266241.fls.doubleclick.net/activityi;src=6266241;type=count0;cat=all_p0;ord=4827683670227;gtm=2wg121;auiddc=831494643.1578891420;u1=not%20set;u2=0;u5=495413072.1578891420;u3=undefined;u4=U...
https://6266241.fls.doubleclick.net/activityi;dc_pre=CJWW8_Hk_-YCFYWL3godP6sG4Q;src=6266241;type=count0;cat=all_p0;ord=4827683670227;gtm=2wg121;auiddc=831494643.1578891420;u1=not%20set;u2=0;u5=4954...

0
0

50ms
50ms

Document
text/html

172.217.23.134
Google LLC

General

Check archive.org

Show headers Download Go to

Full URL

https://6266241.fls.doubleclick.net/activityi;dc_pre=CJWW8_Hk_-YCFYWL3godP6sG4Q;src=6266241;type=count0;cat=all_p0;ord=4827683670227;gtm=2wg121;auiddc=831494643.1578891420;u1=not%20set;u2=0;u5=495413072.1578891420;u3=undefined;u4=Unlogged-User;~oref=https%3A%2F%2Fwww.semrush.com%2Fbot%2F?

Requested by

Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtm.js?id=GTM-5K82J2

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

172.217.23.134 , United States, ASN15169 (GOOGLE - Google LLC, US),

Reverse DNS

fra16s18-in-f134.1e100.net

Software

cafe /

Resource Hash

Security Headers

Name	Value
Strict-Transport-Security	max-age=21600
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

:method: GET
:authority: 6266241.fls.doubleclick.net
:scheme: https
:path: /activityi;dc_pre=CJWW8_Hk_-YCFYWL3godP6sG4Q;src=6266241;type=count0;cat=all_p0;ord=4827683670227;gtm=2wg121;auiddc=831494643.1578891420;u1=not%20set;u2=0;u5=495413072.1578891420;u3=undefined;u4=Unlogged-User;~oref=https%3A%2F%2Fwww.semrush.com%2Fbot%2F?
pragma: no-cache
cache-control: no-cache
upgrade-insecure-requests: 1
user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36
accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3
sec-fetch-site: cross-site
sec-fetch-mode: nested-navigate
referer: https://www.semrush.com/bot/
accept-encoding: gzip, deflate, br
cookie: test_cookie=CheckForPermission
Upgrade-Insecure-Requests: 1
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36
Referer: https://www.semrush.com/bot/

Response headers

status: 200
p3p: policyref="https://googleads.g.doubleclick.net/pagead/gcn_p3p_.xml", CP="CURa ADMa DEVa TAIo PSAo PSDo OUR IND UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR"
timing-allow-origin: *
date: Mon, 13 Jan 2020 04:57:00 GMT
expires: Mon, 13 Jan 2020 04:57:00 GMT
cache-control: private, max-age=0
strict-transport-security: max-age=21600
content-type: text/html; charset=UTF-8
x-content-type-options: nosniff
content-encoding: gzip
server: cafe
content-length: 384
x-xss-protection: 0
set-cookie: IDE=AHWqTUlh3OLaJ1Q8lu7JZdCtl47Azpr3GPVksI-Hz_4FhUtqWibCc83NzTtsJJsy; expires=Sat, 06-Feb-2021 04:57:00 GMT; path=/; domain=.doubleclick.net; HttpOnly test_cookie=; domain=.doubleclick.net; path=/; expires=Mon, 21 Jul 2008 23:59:00 GMT
alt-svc: quic=":443"; ma=2592000; v="46,43",h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000

Redirect headers

status: 302
p3p: policyref="https://googleads.g.doubleclick.net/pagead/gcn_p3p_.xml", CP="CURa ADMa DEVa TAIo PSAo PSDo OUR IND UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR"
timing-allow-origin: *
date: Mon, 13 Jan 2020 04:57:00 GMT
pragma: no-cache
expires: Fri, 01 Jan 1990 00:00:00 GMT
cache-control: no-cache, must-revalidate
follow-only-when-prerender-shown: 1
strict-transport-security: max-age=21600
location: https://6266241.fls.doubleclick.net/activityi;dc_pre=CJWW8_Hk_-YCFYWL3godP6sG4Q;src=6266241;type=count0;cat=all_p0;ord=4827683670227;gtm=2wg121;auiddc=831494643.1578891420;u1=not%20set;u2=0;u5=495413072.1578891420;u3=undefined;u4=Unlogged-User;~oref=https%3A%2F%2Fwww.semrush.com%2Fbot%2F?
content-type: text/html; charset=UTF-8
x-content-type-options: nosniff
server: cafe
content-length: 0
x-xss-protection: 0
set-cookie: test_cookie=CheckForPermission; expires=Mon, 13-Jan-2020 05:12:00 GMT; path=/; domain=.doubleclick.net
alt-svc: quic=":443"; ma=2592000; v="46,43",h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000

GET
H/1.1 200
OK insight.min.js Show response
sjs.bizographics.com/ 3 KB
2 KB 18ms
6ms Script
application/x-javascript 2a02:26f0:6c00:293::3adf
AKAMAI-ASN1

General

Check archive.org

Show headers Download Go to

Full URL: https://sjs.bizographics.com/insight.min.js
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: HTTP/1.1
Security: TLS 1.3, , AES_256_GCM
Server: 2a02:26f0:6c00:293::3adf , Ascension Island, ASN20940 (AKAMAI-ASN1, US),
Reverse DNS
Software: /
Resource Hash: 41dd5e421fe221a7d2921d6fa2b36e8b01a9f2c054aaef5fad866fe896c1d1e0

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

Date: Mon, 13 Jan 2020 04:57:00 GMT
Content-Encoding: gzip
Last-Modified: Mon, 07 Oct 2019 16:41:31 GMT
X-CDN: AKAM
Vary: Accept-Encoding
Content-Type: application/x-javascript;charset=utf-8
Cache-Control: max-age=76035
Connection: keep-alive
Accept-Ranges: bytes
Content-Length: 1576

GET
H2 200 bat.js Show response
bat.bing.com/ 23 KB
7 KB 45ms
30ms Script
application/javascript 2620:1ec:c11::200
Microsoft Corpora...

General

Check archive.org

Show headers Download Go to

Full URL: https://bat.bing.com/bat.js
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_256_GCM
Server: 2620:1ec:c11::200 , United States, ASN8068 (MICROSOFT-CORP-MSN-AS-BLOCK - Microsoft Corporation, US),
Reverse DNS
Software: /
Resource Hash: b139982ce002c53ddfb65aec1e90704c0a3704fc5aa35247f9323b74a1d3f721

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:56:59 GMT
content-encoding: gzip
last-modified: Tue, 10 Sep 2019 18:57:28 GMT
x-msedge-ref: Ref A: B5C1F88ABD6448F6A535BBC0BF50916A Ref B: FRAEDGE0920 Ref C: 2020-01-13T04:57:00Z
access-control-allow-origin: *
etag: "09c5197968d51:0"
vary: Accept-Encoding
content-type: application/javascript
status: 200
cache-control: private,max-age=1800
accept-ranges: bytes
content-length: 7148

GET
H2 200 fbevents.js Show response
connect.facebook.net/en_US/ 126 KB
31 KB 17ms
6ms Script
application/x-javascript 2a03:2880:f02d:12:face:b00c:0:3
Facebook

General

Check archive.org

Show headers Download Go to

Full URL

https://connect.facebook.net/en_US/fbevents.js

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a03:2880:f02d:12:face:b00c:0:3 , Ireland, ASN32934 (FACEBOOK - Facebook, Inc., US),

Reverse DNS

Software

Resource Hash

1ada5b4d0b63b06d2bd668cd7d6597689796da41a434a675cfdbd2a1bddf251a

Security Headers

Name	Value
Content-Security-Policy	default-src * data: blob:;script-src .facebook.com .fbcdn.net .facebook.net .google-analytics.com .virtualearth.net .google.com 127.0.0.1:* .spotilocal.com: 'unsafe-inline' 'unsafe-eval' blob: data: 'self';style-src data: blob: 'unsafe-inline' ;connect-src .facebook.com facebook.com .fbcdn.net .facebook.net .spotilocal.com: wss://.facebook.com: https://fb.scanandcleanlocal.com:* attachment.fbsbx.com ws://localhost:* blob: *.cdninstagram.com 'self' chrome-extension://boadgeojelhgndaghljhdicfkmllpafd chrome-extension://dliochdbjfkdbacpmhlcpmleaejidimm;
Strict-Transport-Security	max-age=31536000; preload; includeSubDomains
X-Content-Type-Options	nosniff
X-Frame-Options	DENY
X-Xss-Protection	0

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

strict-transport-security: max-age=31536000; preload; includeSubDomains
content-encoding: gzip
x-content-type-options: nosniff
status: 200
alt-svc: h3-24=":443"; ma=3600
content-length: 30426
x-xss-protection: 0
pragma: public
x-fb-debug: KSJN4dAXEM3wMsZwaMaugcFIESu+m4SUDRys3INkowyJnruCYtN4MBNKPBf2X7NSLWb/93YN9o5y1sVp6Tg/FA==
x-fb-trip-id: 194532234
date: Mon, 13 Jan 2020 04:57:00 GMT
x-frame-options: DENY
content-type: application/x-javascript; charset=utf-8
vary: Accept-Encoding
cache-control: public, max-age=1200
content-security-policy: default-src * data: blob:;script-src *.facebook.com *.fbcdn.net *.facebook.net *.google-analytics.com *.virtualearth.net *.google.com 127.0.0.1:* *.spotilocal.com:* 'unsafe-inline' 'unsafe-eval' blob: data: 'self';style-src data: blob: 'unsafe-inline' *;connect-src *.facebook.com facebook.com *.fbcdn.net *.facebook.net *.spotilocal.com:* wss://*.facebook.com:* https://fb.scanandcleanlocal.com:* attachment.fbsbx.com ws://localhost:* blob: *.cdninstagram.com 'self' chrome-extension://boadgeojelhgndaghljhdicfkmllpafd chrome-extension://dliochdbjfkdbacpmhlcpmleaejidimm;
expires: Sat, 01 Jan 2000 00:00:00 GMT

GET
H2 200 tracker.js Show response
api.mindbox.cloud/scripts/v1/ 47 KB
14 KB 112ms
43ms Script
application/javascript 52.232.113.156
Microsoft Corpora...

General

Check archive.org

Show headers Download Go to

Full URL: https://api.mindbox.cloud/scripts/v1/tracker.js
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_256_GCM
Server: 52.232.113.156 Amsterdam, Netherlands, ASN8075 (MICROSOFT-CORP-MSN-AS-BLOCK - Microsoft Corporation, US),
Reverse DNS
Software: Microsoft-IIS/10.0 / ASP.NET
Resource Hash: 2d83b543be799794cef81bda33376a237169a22421be5ed2bb10c58019b32b96

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
content-encoding: gzip
last-modified: Thu, 09 Jan 2020 15:57:00 GMT
x-server-name: AZURE-WEB3
x-powered-by: ASP.NET
etag: "0ae4f6d5c7d51:0"
vary: Accept-Encoding
content-type: application/javascript; charset=utf-8
status: 200
cache-control: public,max-age=604800
accept-ranges: bytes
x-revision: 5ad4f89c3ff9e04d81d24d610e87ceaac0ffd05a
content-length: 14110
server: Microsoft-IIS/10.0

GET
H2 200 pixel.js Show response
www.redditstatic.com/ads/ 16 KB
5 KB 131ms
42ms Script
application/javascript 151.101.113.140
Fastly

General

Check archive.org

Show headers Download Go to

Full URL: https://www.redditstatic.com/ads/pixel.js
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 151.101.113.140 Frankfurt am Main, Germany, ASN54113 (FASTLY - Fastly, US),
Reverse DNS
Software: snooserv /
Resource Hash: 3d15b6c83aceefb58ef1dd147c1a7ed7a76254c039387416abaf9f7c66beb032

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
content-encoding: gzip
age: 2
x-cache: HIT, HIT
status: 200
content-length: 5325
x-served-by: cache-iad2148-IAD, cache-hhn4039-HHN
last-modified: Thu, 29 Aug 2019 19:06:18 GMT
server: snooserv
x-timer: S1578891420.155839,VS0,VE0
etag: "364dd685e7a12d491363ff4e900fd6fa"
vary: Accept-Encoding,Origin
content-type: application/javascript
via: 1.1 varnish, 1.1 varnish
cache-control: public, max-age=60
accept-ranges: bytes
x-cache-hits: 2, 1

GET
H/1.1 200
OK pixel
q.quora.com/_/ad/45e3c52c422547dcaae04883de1fa150/ 43 B
457 B 417ms
101ms Image
image/gif 54.164.86.91
Amazon.com

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://q.quora.com/_/ad/45e3c52c422547dcaae04883de1fa150/pixel?tag=ViewContent&i=gtm&u=https%3A%2F%2Fwww.semrush.com%2Fbot%2F
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: HTTP/1.1
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 54.164.86.91 Ashburn, United States, ASN14618 (AMAZON-AES - Amazon.com, Inc., US),
Reverse DNS: ec2-54-164-86-91.compute-1.amazonaws.com
Software: nginx /
Resource Hash: 548f2d6f4d0d820c6c5ffbeffcbd7f0e73193e2932eefe542accc84762deec87

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

Date: Mon, 13 Jan 2020 04:57:00 GMT
Server: nginx
Connection: keep-alive
Content-Length: 43
X-Q-Stat: 81,be1a12cfde94fe69d333c1097de861d4,10.0.4.159,50016,185.38.150.96,,18573345271,1,1578891420.412,0.002,,.,0,0,0.004,0.004,-,0,0,304,329,164,10,26847,,,,,,,
Content-Type: image/gif

GET
H2 200 6DFyJNaWUJ8l7zFVHVVOQ.js Show response
widget.uservoice.com/ 75 KB
20 KB 47ms
21ms Script
text/javascript 2606:4700::6811:1b5c
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://widget.uservoice.com/6DFyJNaWUJ8l7zFVHVVOQ.js

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2606:4700::6811:1b5c , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

4e16801c6ce10ec4a471fadae4d71c3ac50ed3b91d9906e9aa43ff64d9edc003

Security Headers

Name	Value
Strict-Transport-Security	max-age=15724800; includeSubDomains
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
content-encoding: br
x-content-type-options: nosniff
cf-cache-status: HIT
x-permitted-cross-domain-policies: none
age: 41
status: 200
strict-transport-security: max-age=15724800; includeSubDomains
x-xss-protection: 1; mode=block
x-request-id: f75de2cf2ae55c69c7efe28554f37ab4
referrer-policy: strict-origin-when-cross-origin
server: cloudflare
x-frame-options: SAMEORIGIN
etag: W/"c44cce04bb3f042653972d9ae39cff9d"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary: Accept-Encoding
x-download-options: noopen
content-type: text/javascript; charset=utf-8
access-control-allow-origin: *
cache-control: public, max-age=300
cf-ray: 5544c96f9b63bebf-FRA
expires: Mon, 13 Jan 2020 05:02:00 GMT

GET
H2

200

collect
px.ads.linkedin.com/
Redirect Chain

https://px.ads.linkedin.com/collect?v=2&fmt=js&pid=387538&url=https%3A%2F%2Fwww.semrush.com%2Fbot%2F&time=1578891420072
https://www.linkedin.com/px/li_sync?redirect=https%3A%2F%2Fpx.ads.linkedin.com%2Fcollect%3Fv%3D2%26fmt%3Djs%26pid%3D387538%26url%3Dhttps%253A%252F%252Fwww.semrush.com%252Fbot%252F%26time%3D15788914...
https://px.ads.linkedin.com/collect?v=2&fmt=js&pid=387538&url=https%3A%2F%2Fwww.semrush.com%2Fbot%2F&time=1578891420072&liSync=true

0
87 B

164ms
162ms

Image
application/javascript

2a05:f500:11:101::b93f:9005
LinkedIn Corporation

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://px.ads.linkedin.com/collect?v=2&fmt=js&pid=387538&url=https%3A%2F%2Fwww.semrush.com%2Fbot%2F&time=1578891420072&liSync=true
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 2a05:f500:11:101::b93f:9005 , Ireland, ASN14413 (LINKEDIN - LinkedIn Corporation, US),
Reverse DNS
Software: Play /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
content-encoding: gzip
server: Play
vary: Accept-Encoding
x-li-fabric: prod-lor1
status: 200
x-li-proto: http/2
x-li-pop: prod-tln1
content-type: application/javascript
content-length: 20
x-li-uuid: YH0As2FZ6RUQflOXmysAAA==

Redirect headers

date: Mon, 13 Jan 2020 04:57:00 GMT
content-encoding: gzip
x-content-type-options: nosniff
status: 302
x-li-pop: prod-efr5
content-length: 20
x-li-uuid: qhP2p2FZ6RUg7uA4iSsAAA==
pragma: no-cache
server: Play
x-frame-options: sameorigin
expect-ct: max-age=86400, report-uri="https://www.linkedin.com/platform-telemetry/ct"
vary: Accept-Encoding
strict-transport-security: max-age=2592000
x-li-fabric: prod-lor1
location: https://px.ads.linkedin.com/collect?v=2&fmt=js&pid=387538&url=https%3A%2F%2Fwww.semrush.com%2Fbot%2F&time=1578891420072&liSync=true
x-xss-protection: 1; mode=block
cache-control: no-cache, no-store
content-security-policy: default-src *; connect-src 'self' static.licdn.com media.licdn.com static-exp1.licdn.com static-exp2.licdn.com static-exp3.licdn.com media-exp1.licdn.com media-exp2.licdn.com https://media-src.linkedin.com/media/ www.linkedin.com s.c.lnkd.licdn.com m.c.lnkd.licdn.com s.c.exp1.licdn.com s.c.exp2.licdn.com m.c.exp1.licdn.com m.c.exp2.licdn.com wss://*.linkedin.com dms.licdn.com https://dpm.demdex.net/id https://lnkd.demdex.net/event blob:; img-src data: blob: *; font-src data: *; style-src 'unsafe-inline' 'self' static-src.linkedin.com *.licdn.com; script-src 'report-sample' 'unsafe-inline' 'unsafe-eval' 'self' spdy.linkedin.com static-src.linkedin.com *.ads.linkedin.com *.licdn.com static.chartbeat.com www.google-analytics.com ssl.google-analytics.com bcvipva02.rightnowtech.com www.bizographics.com sjs.bizographics.com js.bizographics.com d.la4-c1-was.salesforceliveagent.com slideshare.www.linkedin.com https://snap.licdn.com/li.lms-analytics/insight.min.js platform.linkedin.com platform-akam.linkedin.com platform-ecst.linkedin.com platform-azur.linkedin.com; object-src 'none'; media-src blob: *; child-src blob: lnkd-communities: voyager: *; frame-ancestors 'self'; report-uri https://www.linkedin.com/platform-telemetry/csp?f=l
x-li-proto: http/2
expires: Thu, 01 Jan 1970 00:00:00 GMT

GET
H2 200 collect
www.google-analytics.com/ 35 B
100 B 6ms
5ms Image
image/gif 2a00:1450:4001:808::200e
Google LLC

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://www.google-analytics.com/collect?v=1&_v=j79&a=1375602821&t=pageview&_s=2&dl=https%3A%2F%2Fwww.semrush.com%2Fbot%2F&ul=en-us&de=UTF-8&dt=SEMrush%20Bot%20%7C%20SEMrush&sd=24-bit&sr=1600x1200&vp=1600x1200&je=0&exp=7xHEszwjQFucPwMnhXHIzQ.2&_u=6GBAgEAD~&jid=378387706&gjid=343629736&cid=495413072.1578891420&tid=UA-6197637-22&_gid=244521904.1578891420&cd2=Unlogged-User&cd3=not%20set&cd7=__default__&cd12=not%20set&cd16=all%20tools&cd11=495413072.1578891420_1578891420074&z=780673715

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:808::200e Frankfurt am Main, Germany, ASN15169 (GOOGLE - Google LLC, US),

Reverse DNS

Software

Golfe2 /

Resource Hash

8337212354871836e6763a41e615916c89bac5b3f1f0adf60ba43c7c806e1015

Security Headers

Name	Value
X-Content-Type-Options	nosniff

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

pragma: no-cache
date: Thu, 21 Nov 2019 18:44:22 GMT
x-content-type-options: nosniff
last-modified: Sun, 17 May 1998 03:00:00 GMT
server: Golfe2
age: 4529558
content-type: image/gif
status: 200
alt-svc: quic=":443"; ma=2592000; v="46,43",h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000
cache-control: no-cache, no-store, must-revalidate
access-control-allow-origin: *
content-length: 35
expires: Mon, 01 Jan 1990 00:00:00 GMT

GET
H2 200 collect
google-analytics.bi.owox.com/ 4 B
442 B 95ms
34ms Image
image/gif 35.186.228.179
Google LLC

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://google-analytics.bi.owox.com/collect?v=1&_v=j79&a=1375602821&t=pageview&_s=2&dl=https%3A%2F%2Fwww.semrush.com%2Fbot%2F&ul=en-us&de=UTF-8&dt=SEMrush%20Bot%20%7C%20SEMrush&sd=24-bit&sr=1600x1200&vp=1600x1200&je=0&exp=7xHEszwjQFucPwMnhXHIzQ.2&_u=6GBAgEAD~&jid=378387706&gjid=343629736&cid=495413072.1578891420&tid=UA-6197637-22&_gid=244521904.1578891420&cd2=Unlogged-User&cd3=not%20set&cd7=__default__&cd12=not%20set&cd16=all%20tools&cd11=495413072.1578891420_1578891420074&z=780673715
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 35.186.228.179 Mountain View, United States, ASN15169 (GOOGLE - Google LLC, US),
Reverse DNS: 179.228.186.35.bc.googleusercontent.com
Software: openresty /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

pragma: no-cache
date: Mon, 13 Jan 2020 04:57:00 GMT
owoxtid: UA-6197637-22
server: openresty
access-control-allow-origin: *
content-type: image/gif
status: 200
owoxserver: eu-f-jw5d
cache-control: max-age=0, no-store, no-cache, must-revalidate
access-control-allow-credentials: true
owoxcode: 200
alt-svc: quic=":443"; ma=2592000; v="46,43",h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000
via: 1.1 google
expires: Mon, 13 Jan 2020 04:57:00 GMT

GET
H2

200

ga-audiences
www.google.de/ads/
Redirect Chain

https://stats.g.doubleclick.net/r/collect?t=dc&aip=1&_r=3&v=1&_v=j79&tid=UA-6197637-22&cid=495413072.1578891420&jid=378387706&gjid=343629736&_gid=244521904.1578891420&_u=6GBAgEAD~&z=643280713
https://www.google.com/ads/ga-audiences?v=1&aip=1&t=sr&_r=4&tid=UA-6197637-22&cid=495413072.1578891420&jid=378387706&_v=j79&z=643280713
https://www.google.de/ads/ga-audiences?v=1&aip=1&t=sr&_r=4&tid=UA-6197637-22&cid=495413072.1578891420&jid=378387706&_v=j79&z=643280713&slf_rd=1&random=1177148791

42 B
109 B

16ms
16ms

Image
image/gif

2a00:1450:4001:81a::2003
Google LLC

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://www.google.de/ads/ga-audiences?v=1&aip=1&t=sr&_r=4&tid=UA-6197637-22&cid=495413072.1578891420&jid=378387706&_v=j79&z=643280713&slf_rd=1&random=1177148791

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:81a::2003 Frankfurt am Main, Germany, ASN15169 (GOOGLE - Google LLC, US),

Reverse DNS

Software

cafe /

Resource Hash

ef1955ae757c8b966c83248350331bd3a30f658ced11f387f8ebf05ab3368629

Security Headers

Name	Value
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

pragma: no-cache
date: Mon, 13 Jan 2020 04:57:00 GMT
x-content-type-options: nosniff
content-type: image/gif
server: cafe
p3p: policyref="https://www.googleadservices.com/pagead/p3p.xml", CP="NOI DEV PSA PSD IVA IVD OTP OUR OTR IND OTC"
status: 200
cache-control: no-cache, no-store, must-revalidate
timing-allow-origin: *
alt-svc: quic=":443"; ma=2592000; v="46,43",h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000
content-length: 42
x-xss-protection: 0
expires: Fri, 01 Jan 1990 00:00:00 GMT

Redirect headers

pragma: no-cache
date: Mon, 13 Jan 2020 04:57:00 GMT
x-content-type-options: nosniff
server: cafe
timing-allow-origin: *
location: https://www.google.de/ads/ga-audiences?v=1&aip=1&t=sr&_r=4&tid=UA-6197637-22&cid=495413072.1578891420&jid=378387706&_v=j79&z=643280713&slf_rd=1&random=1177148791
p3p: policyref="https://www.googleadservices.com/pagead/p3p.xml", CP="NOI DEV PSA PSD IVA IVD OTP OUR OTR IND OTC"
status: 302
cache-control: no-cache, no-store, must-revalidate
content-type: text/html; charset=UTF-8
alt-svc: quic=":443"; ma=2592000; v="46,43",h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000
content-length: 0
x-xss-protection: 0
expires: Fri, 01 Jan 1990 00:00:00 GMT

GET
H2 200 semrush-community-menu.c956c43e.js Show response
www.semrush.com/__static__/ 25 KB
7 KB 61ms
61ms Script
application/javascript 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://www.semrush.com/__static__/semrush-community-menu.c956c43e.js

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

4f30135f1de34e52349aa6fb179058dd1e1c2d15aa1bc6c7ccd095cd80818c6c

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubdomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
content-encoding: br
x-content-type-options: nosniff
cf-cache-status: HIT
age: 313386
status: 200
last-modified: Mon, 23 Dec 2019 14:03:14 GMT
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-xss-protection: 1; mode=block
cf-bgj: minify
server: cloudflare
x-frame-options: SAMEORIGIN
etag: W/"5e00c922-64b3"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary: Accept-Encoding
content-type: application/javascript
sm-log-id: 5526e66a45d0ce6b-LHR
cache-control: max-age=2678400
cf-ray: 5544c96f9c4ce624-LHR
expires: Sun, 09 Feb 2020 13:53:54 GMT

GET
H2 200 semrush-resources-menu.8f4f5eb5.js Show response
www.semrush.com/__static__/ 29 KB
10 KB 32ms
32ms Script
application/javascript 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://www.semrush.com/__static__/semrush-resources-menu.8f4f5eb5.js

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

ce7b7b7775ad64d682a935e8a4118a3b43ab8d15ae8958aae94582214301874c

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubdomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
content-encoding: br
x-content-type-options: nosniff
cf-cache-status: HIT
age: 313386
status: 200
last-modified: Mon, 23 Dec 2019 14:03:14 GMT
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-xss-protection: 1; mode=block
cf-bgj: minify
server: cloudflare
x-frame-options: SAMEORIGIN
etag: W/"5e00c922-7420"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary: Accept-Encoding
content-type: application/javascript
sm-log-id: 5526e66a55d2ce6b-LHR
cache-control: max-age=2678400
cf-ray: 5544c96f9c4ee624-LHR
expires: Sun, 09 Feb 2020 13:53:54 GMT

GET
H2 200 semrush-sso-extended.137f8af1.js Show response
www.semrush.com/__static__/ 389 KB
95 KB 38ms
38ms Script
application/javascript 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://www.semrush.com/__static__/semrush-sso-extended.137f8af1.js

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

3d470deb36b058ffc20c811e3c56426213ba6f035af88273b497d719b22c1585

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubdomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
content-encoding: br
x-content-type-options: nosniff
cf-cache-status: HIT
age: 313386
cf-polished: origSize=397910
status: 200
last-modified: Mon, 23 Dec 2019 14:03:14 GMT
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-xss-protection: 1; mode=block
cf-bgj: minify
server: cloudflare
x-frame-options: SAMEORIGIN
etag: W/"5e00c922-61256"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary: Accept-Encoding
content-type: application/javascript
sm-log-id: 5526e66a55d1ce6b-LHR
cache-control: max-age=2678400
cf-ray: 5544c96f9c4fe624-LHR
expires: Sun, 09 Feb 2020 13:53:54 GMT

GET
H2 200 uservoice.06d98318.js Show response
www.semrush.com/__static__/ 3 KB
1 KB 60ms
60ms Script
application/javascript 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://www.semrush.com/__static__/uservoice.06d98318.js

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

beed9dbdeb30f7db25b7fab2d0e93df2bbdc1ce0c7bd53c2adeecc03dc286800

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubdomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
content-encoding: br
x-content-type-options: nosniff
cf-cache-status: HIT
age: 313379
status: 200
last-modified: Mon, 23 Dec 2019 14:03:14 GMT
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-xss-protection: 1; mode=block
cf-bgj: minify
server: cloudflare
x-frame-options: SAMEORIGIN
etag: W/"5e00c922-c64"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary: Accept-Encoding
content-type: application/javascript
sm-log-id: 5526e6951744ce2b-LHR
cache-control: max-age=2678400
cf-ray: 5544c96f9c5ae624-LHR
expires: Sun, 09 Feb 2020 13:54:01 GMT

GET
DATA 200
OK truncated
/ 2 KB
0 Image
image/svg+xml

General

Check archive.org

Show headers Download Go to Show image

Full URL: data:truncated
Protocol: DATA
Server: -, , ASN (),
Reverse DNS
Software: /
Resource Hash: 9a87205c152cc0d704be3f310b5ee1279f96436a785f88ca686b0467b10d57fd

Request headers

User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

Content-Type: image/svg+xml

GET
H2 200 ubuntu-v13-latin_cyrillic-500.woff2
www.semrush.com/__static__/fonts/ 41 KB
41 KB 63ms
63ms Font
text/plain 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://www.semrush.com/__static__/fonts/ubuntu-v13-latin_cyrillic-500.woff2

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

135a9b57320ff71f9094aaafd67205a292f49f7dc62ae1f40dc233af9a45462d

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubdomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Request headers

User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36
Referer: https://www.semrush.com/__static__/fonts.css
Origin: https://www.semrush.com

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
content-encoding: br
x-content-type-options: nosniff
cf-cache-status: HIT
age: 313377
status: 200
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-xss-protection: 1; mode=block
last-modified: Mon, 23 Dec 2019 12:50:12 GMT
server: cloudflare
x-frame-options: SAMEORIGIN
etag: W/"5e00b804-a2b0"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary: Accept-Encoding
content-type: text/plain
sm-log-id: 5526e6a1875f34da-LHR
cache-control: max-age=2678400
cf-ray: 5544c96f9c5ce624-LHR
expires: Sun, 09 Feb 2020 13:54:03 GMT

GET
H2 200 ubuntu-v13-latin_cyrillic-regular.woff2
www.semrush.com/__static__/fonts/ 46 KB
46 KB 67ms
67ms Font
text/plain 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://www.semrush.com/__static__/fonts/ubuntu-v13-latin_cyrillic-regular.woff2

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

7b8136aeec9845d2472b8dcace3cf9a375dc841679d55861f40cbdbdaf0a5adf

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubdomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Request headers

User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36
Referer: https://www.semrush.com/__static__/fonts.css
Origin: https://www.semrush.com

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
content-encoding: br
x-content-type-options: nosniff
cf-cache-status: HIT
age: 313390
status: 200
strict-transport-security: max-age=31536000; includeSubdomains; preload
x-xss-protection: 1; mode=block
last-modified: Mon, 23 Dec 2019 12:50:12 GMT
server: cloudflare
x-frame-options: SAMEORIGIN
etag: W/"5e00b804-b834"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary: Accept-Encoding
content-type: text/plain
sm-log-id: 5526e652c789bc24-LHR
cache-control: max-age=2678400
cf-ray: 5544c96fcc9ae624-LHR
expires: Sun, 09 Feb 2020 13:53:50 GMT

GET
H2 200 239948206198576 Show response
connect.facebook.net/signals/config/ 447 KB
113 KB 11ms
11ms Script
application/x-javascript 2a03:2880:f02d:12:face:b00c:0:3
Facebook

General

Check archive.org

Show headers Download Go to

Full URL

https://connect.facebook.net/signals/config/239948206198576?v=2.9.15&r=stable

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a03:2880:f02d:12:face:b00c:0:3 , Ireland, ASN32934 (FACEBOOK - Facebook, Inc., US),

Reverse DNS

Software

Resource Hash

dba82ed6386eddef80333d1dfca913ccbb287f0827d58c8d2c4bcd7edc010948

Security Headers

Name	Value
Content-Security-Policy	default-src * data: blob:;script-src .facebook.com .fbcdn.net .facebook.net .google-analytics.com .virtualearth.net .google.com 127.0.0.1:* .spotilocal.com: 'unsafe-inline' 'unsafe-eval' blob: data: 'self';style-src data: blob: 'unsafe-inline' ;connect-src .facebook.com facebook.com .fbcdn.net .facebook.net .spotilocal.com: wss://.facebook.com: https://fb.scanandcleanlocal.com:* attachment.fbsbx.com ws://localhost:* blob: *.cdninstagram.com 'self';
Strict-Transport-Security	max-age=31536000; preload; includeSubDomains
X-Content-Type-Options	nosniff
X-Frame-Options	DENY
X-Xss-Protection	0

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

strict-transport-security: max-age=31536000; preload; includeSubDomains
content-encoding: gzip
x-content-type-options: nosniff
status: 200
alt-svc: h3-24=":443"; ma=3600
content-length: 114962
x-xss-protection: 0
pragma: public
x-fb-debug: 3AzOhOWJyTKPvo+rtMEzy8IJQ9U3tgGvCl2HDxQK2K6cj88BzY3EJCV4KVaUhTXsHYBM1OxsvO+hifYPLk9iNw==
x-fb-trip-id: 194532234
date: Mon, 13 Jan 2020 04:57:00 GMT
x-frame-options: DENY
content-type: application/x-javascript; charset=utf-8
vary: Accept-Encoding
cache-control: public, max-age=1200
content-security-policy: default-src * data: blob:;script-src *.facebook.com *.fbcdn.net *.facebook.net *.google-analytics.com *.virtualearth.net *.google.com 127.0.0.1:* *.spotilocal.com:* 'unsafe-inline' 'unsafe-eval' blob: data: 'self';style-src data: blob: 'unsafe-inline' *;connect-src *.facebook.com facebook.com *.fbcdn.net *.facebook.net *.spotilocal.com:* wss://*.facebook.com:* https://fb.scanandcleanlocal.com:* attachment.fbsbx.com ws://localhost:* blob: *.cdninstagram.com 'self';
expires: Sat, 01 Jan 2000 00:00:00 GMT

GET
H2 204 0
bat.bing.com/action/ 0
148 B 29ms
28ms Image
text/plain 2620:1ec:c11::200
Microsoft Corpora...

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://bat.bing.com/action/0?ti=5128787&Ver=2&mid=1ffff1d7-5fdf-5596-dea1-1fa20bb3106f&pi=0&lg=en-US&sw=1600&sh=1200&sc=24&tl=SEMrush%20Bot%20%7C%20SEMrush&p=https%3A%2F%2Fwww.semrush.com%2Fbot%2F&r=&lt=490&evt=pageLoad&msclkid=N&rn=956423
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_256_GCM
Server: 2620:1ec:c11::200 , United States, ASN8068 (MICROSOFT-CORP-MSN-AS-BLOCK - Microsoft Corporation, US),
Reverse DNS
Software: /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

status: 204
pragma: no-cache
date: Mon, 13 Jan 2020 04:56:59 GMT
cache-control: no-cache, must-revalidate
x-msedge-ref: Ref A: B30D0CC8A3754E3EB83FABAEC273B398 Ref B: FRAEDGE0920 Ref C: 2020-01-13T04:57:00Z
access-control-allow-origin: *
expires: Fri, 01 Jan 1990 00:00:00 GMT

GET
H2 200 / Show response
www.semrush.com/news/api/entry/new/ 44 B
382 B 516ms
516ms Fetch
application/json 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://www.semrush.com/news/api/entry/new/

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

652af54480ffb1782b3f2a97d3f9d645e21f737ca446184f75a58423ef303245

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubdomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36
newrelic: eyJ2IjpbMCwxXSwiZCI6eyJ0eSI6IkJyb3dzZXIiLCJhYyI6IjE3OTg4NjUiLCJhcCI6Ijc1NTQ5MDMyIiwiaWQiOiJkYjczZDE3Yzg4NDZjYWJlIiwidHIiOiIxZjA1ZGVlMDMzN2QwYzg1IiwidGkiOjE1Nzg4OTE0MjAxMjB9fQ==

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
x-content-type-options: nosniff
cf-cache-status: DYNAMIC
x-service-response-time: 0.01365
status: 200
strict-transport-security: max-age=31536000; includeSubdomains; preload
content-length: 44
x-xss-protection: 1; mode=block
cf-ray: 5544c96fdcafe624-LHR
allow: GET, HEAD, OPTIONS
server: cloudflare
x-frame-options: SAMEORIGIN
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary: Accept, Cookie, Accept-Encoding
content-language: en
sm-log-id: 5544c97080e2e624-LHR
x-service: news
content-type: application/json

GET
H2 200 / Show response
www.semrush.com/menupopup/list/ 5 KB
2 KB 42ms
42ms Fetch
application/json 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://www.semrush.com/menupopup/list/?language=en

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

45016ffac0dfba5c7249f3c9a3a968e1d5d9dfcddd08c87e5f13075da0f40fc8

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubdomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36
newrelic: eyJ2IjpbMCwxXSwiZCI6eyJ0eSI6IkJyb3dzZXIiLCJhYyI6IjE3OTg4NjUiLCJhcCI6Ijc1NTQ5MDMyIiwiaWQiOiJkMWZmZDZlYTQyZDIzOTNiIiwidHIiOiJkMmI1MjA3NWVmYjc4YzNlIiwidGkiOjE1Nzg4OTE0MjAxMjB9fQ==

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
content-encoding: br
x-content-type-options: nosniff
cf-cache-status: HIT
age: 1787
status: 200
vary: Accept-Encoding
x-xss-protection: 1; mode=block
pragma: no-cache, no-cache
server: cloudflare
x-frame-options: SAMEORIGIN
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security: max-age=31536000; includeSubdomains; preload
content-type: application/json
sm-log-id: 55449dccf74de610-LHR
cache-control: no-store, no-cache, must-revalidate
cf-ray: 5544c96fdcb0e624-LHR
expires: Thu, 19 Nov 1981 08:52:00 GMT, -1

GET
H2 200 /
www.facebook.com/tr/ 44 B
357 B 17ms
6ms Image
image/gif 2a03:2880:f12d:83:face:b00c:0:25de
Facebook

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://www.facebook.com/tr/?id=239948206198576&ev=PageView&dl=https%3A%2F%2Fwww.semrush.com%2Fbot%2F&rl=&if=false&ts=1578891420151&sw=1600&sh=1200&v=2.9.15&r=stable&ec=0&o=30&fbp=fb.1.1578891420150.561044770&it=1578891420109&coo=false&rqm=GET

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a03:2880:f12d:83:face:b00c:0:25de , Ireland, ASN32934 (FACEBOOK - Facebook, Inc., US),

Reverse DNS

Software

proxygen-bolt /

Resource Hash

10d8d42d73a02ddb877101e72fbfa15a0ec820224d97cedee4cf92d571be5caa

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubDomains

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
last-modified: Fri, 21 Dec 2012 00:00:01 GMT
server: proxygen-bolt
strict-transport-security: max-age=31536000; includeSubDomains
content-type: image/gif
status: 200
cache-control: no-cache, must-revalidate, max-age=0
alt-svc: h3-24=":443"; ma=3600
content-length: 44
expires: Mon, 13 Jan 2020 04:57:00 GMT

POST
H2 200 track-visit Show response
api.mindbox.cloud/v1.1/customer/ 134 B
389 B 58ms
58ms XHR
application/json 52.232.113.156
Microsoft Corpora...

General

Check archive.org

Show headers Download Go to

Full URL: https://api.mindbox.cloud/v1.1/customer/track-visit?version=0.38.8&transport=XmlHttpRequest
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_256_GCM
Server: 52.232.113.156 Amsterdam, Netherlands, ASN8075 (MICROSOFT-CORP-MSN-AS-BLOCK - Microsoft Corporation, US),
Reverse DNS
Software: / ASP.NET
Resource Hash: 64ee1ec9f0db4ee752f01e6ff10584e2f1d8b2adb7dc2c4826f9646582ba329a

Request headers

Accept: application/json
Referer: https://www.semrush.com/bot/
Origin: https://www.semrush.com
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36
Content-Type: application/x-www-form-urlencoded

Response headers

pragma: no-cache
date: Mon, 13 Jan 2020 04:57:00 GMT
x-server-name: AZURE-WEB3
x-aspnet-version: 4.0.30319
x-powered-by: ASP.NET
status: 200
content-type: application/json; charset=utf-8
access-control-allow-origin: https://www.semrush.com
cache-control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
x-revision: 5ad4f89c3ff9e04d81d24d610e87ceaac0ffd05a
content-length: 134
expires: -1

GET
H2 200 adsct
t.co/i/ 43 B
448 B 187ms
139ms Image
image/gif 104.244.42.133
Twitter Inc.

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://t.co/i/adsct?p_id=Twitter&p_user_id=0&txn_id=nvnwp&events=%5B%5B%22pageview%22%2Cnull%5D%5D&tw_sale_amount=0&tw_order_quantity=0&tw_iframe_status=0

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.2, ECDHE_RSA, AES_128_GCM

Server

104.244.42.133 , United States, ASN13414 (TWITTER - Twitter Inc., US),

Reverse DNS

Software

tsa_f /

Resource Hash

ac8778041fdb7f2e08ceb574c9a766247ea26f1a7d90fa854c4efcf4b361a957

Security Headers

Name	Value
Strict-Transport-Security	max-age=0
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	0

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
content-encoding: gzip
x-content-type-options: nosniff
status: 200, 200 OK
x-twitter-response-tags: BouncerCompliant
strict-transport-security: max-age=0
content-length: 65
x-xss-protection: 0
x-response-time: 117
pragma: no-cache
last-modified: Mon, 13 Jan 2020 04:57:00 GMT
server: tsa_f
x-frame-options: SAMEORIGIN
content-type: image/gif;charset=utf-8
cache-control: no-cache, no-store, must-revalidate, pre-check=0, post-check=0
x-connection-hash: 81d5b260b8f3c748a3bdb736ae2df89b
x-transaction: 0017b1f7007ac188
expires: Tue, 31 Mar 1981 05:00:00 GMT

GET
H/1.1 200
OK rp.gif
alb.reddit.com/ 35 B
339 B 406ms
101ms Image
image/gif 3.225.77.184
Amazon.com

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://alb.reddit.com/rp.gif?ts=1578891420301&id=t2_mryo6&event=PageVisit&s=ftcCn5HZBZ%2FWbSGO3fwXBYRKh33w0bTXiM9fMlZSEPU%3D
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: HTTP/1.1
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 3.225.77.184 Ashburn, United States, ASN14618 (AMAZON-AES - Amazon.com, Inc., US),
Reverse DNS: ec2-3-225-77-184.compute-1.amazonaws.com
Software: /
Resource Hash: 6a842ea462daca2a0b5a0f5f25bcfc8e0059ac811ca6c6a1bc54e4d9119621c3

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

Date: Mon, 13 Jan 2020 04:57:00 GMT
Cache-Control: no-cache, no-store, must-revalidate
Connection: keep-alive
Content-Length: 35
Content-Type: image/gif

GET
H2

200

/
cx.atdmt.com/
Redirect Chain

https://www.facebook.com/tr/?id=239948206198576&ev=Microdata&dl=https%3A%2F%2Fwww.semrush.com%2Fbot%2F&rl=&if=false&ts=1578891420654&cd[DataLayer]=%5B%5D&cd[Meta]=%7B%22title%22%3A%22SEMrush%20Bot%...
https://cx.atdmt.com/?c=11204078024649621221&f=AYxzVLqVfc40J-_dRgA2b6UqNVPJP1I-ZKxThzUjZqfEmQP34Fm-wEqHGG3oZWMaiSIOISp_QalK6iIWG4iEXO5h&id=239948206198576&l=3&v=0

42 B
433 B

51ms
39ms

Image
image/gif

2a03:2880:f02d:5:face:b00c:0:8c
Facebook

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://cx.atdmt.com/?c=11204078024649621221&f=AYxzVLqVfc40J-_dRgA2b6UqNVPJP1I-ZKxThzUjZqfEmQP34Fm-wEqHGG3oZWMaiSIOISp_QalK6iIWG4iEXO5h&id=239948206198576&l=3&v=0
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2a03:2880:f02d:5:face:b00c:0:8c , Ireland, ASN32934 (FACEBOOK - Facebook, Inc., US),
Reverse DNS
Software: /
Resource Hash: 6d8ba81d1b60a18707722a1f2b62dad48a6acced95a1933f49a68b5016620b93

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

status: 200
date: Mon, 13 Jan 2020 04:57:00 GMT
p3p: CP="NOI DSP COR CUR ADM DEV TAIo PSAo PSDo OUR BUS UNI PUR COM NAV INT DEM STA PRE OTC"
alt-svc: h3-24=":443"; ma=3600
content-length: 42
content-type: image/gif

Redirect headers

pragma: no-cache
date: Mon, 13 Jan 2020 04:57:00 GMT
server: proxygen-bolt
location: https://cx.atdmt.com/?c=11204078024649621221&f=AYxzVLqVfc40J-_dRgA2b6UqNVPJP1I-ZKxThzUjZqfEmQP34Fm-wEqHGG3oZWMaiSIOISp_QalK6iIWG4iEXO5h&id=239948206198576&l=3&v=0
content-type: text/plain
status: 302
cache-control: no-cache, no-store, must-revalidate
alt-svc: h3-24=":443"; ma=3600
content-length: 0
expires: 0

GET
H2 200 nr-spa-1158.min.js Show response
js-agent.newrelic.com/ 36 KB
14 KB 122ms
39ms Script
application/javascript 151.101.114.110
Fastly

General

Check archive.org

Show headers Download Go to

Full URL: https://js-agent.newrelic.com/nr-spa-1158.min.js
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 151.101.114.110 Frankfurt am Main, Germany, ASN54113 (FASTLY - Fastly, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: f23cae2aad5f0e9b235bdc77e700f6fa80cb929c6de287cc9069ad946185e23b

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
content-encoding: gzip
x-amz-request-id: 21107943D9AD9003
x-cache: HIT
status: 200
content-length: 13779
x-amz-id-2: EJm7m4dov+c7/ikFC9XN/vFrE9P18yZuz0t2bPHak4mpXCWykLHDEeF36O0LTAkvJVo9ow57WzA=
x-served-by: cache-hhn4046-HHN
last-modified: Wed, 18 Dec 2019 00:24:15 GMT
server: AmazonS3
x-timer: S1578891421.813650,VS0,VE0
etag: "fd44bd873ae6cbbe691aec0e41f49977"
vary: Accept-Encoding
content-type: application/javascript
via: 1.1 varnish
cache-control: public, max-age=7200, stale-if-error=604800
accept-ranges: bytes
x-cache-hits: 324

GET
H2 200 track.js Show response
by2.uservoice.com/t2/181906/web/ 66 B
252 B 137ms
129ms Script
application/javascript 2606:4700::6811:1b5c
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://by2.uservoice.com/t2/181906/web/track.js?_=1578891420715&s=0&c=__uvSessionData0&d=eyJlIjp7InUiOiJodHRwczovL3d3dy5zZW1ydXNoLmNvbS9ib3QvIiwiciI6IiJ9fQ%3D%3D

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2606:4700::6811:1b5c , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

25e389f69244bf91f4c05380e7ab26cc928111df708885fab9d16c803783ca1d

Security Headers

Name	Value
Strict-Transport-Security	max-age=15724800; includeSubDomains

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
content-encoding: br
cf-cache-status: DYNAMIC
server: cloudflare
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security: max-age=15724800; includeSubDomains
content-type: application/javascript; charset=utf-8
status: 200
cache-control: no-cache, private
cf-ray: 5544c9738edebebf-FRA
expires: Mon, 13 Jan 2020 04:56:59 GMT

GET
H2 200 adsct Show response
analytics.twitter.com/i/ 31 B
633 B 185ms
140ms Script
application/javascript 104.244.42.3
Twitter Inc.

General

Check archive.org

Show headers Download Go to

Full URL

https://analytics.twitter.com/i/adsct?p_id=Twitter&p_user_id=0&txn_id=nvnwp&events=%5B%5B%22pageview%22%2Cnull%5D%5D&tw_sale_amount=0&tw_order_quantity=0&tw_iframe_status=0&tpx_cb=twttr.conversion.loadPixels&tw_document_href=https%3A%2F%2Fwww.semrush.com%2Fbot%2F

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.2, ECDHE_RSA, AES_128_GCM

Server

104.244.42.3 , United States, ASN13414 (TWITTER - Twitter Inc., US),

Reverse DNS

Software

tsa_f /

Resource Hash

df3e003cc30e9bdd0313100e8ee5d468070b4b34d11ad355f276a356d4b9c7bf

Security Headers

Name	Value
Strict-Transport-Security	max-age=631138519
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	0

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

date: Mon, 13 Jan 2020 04:57:00 GMT
content-encoding: gzip
x-content-type-options: nosniff
p3p: CP="CAO DSP LAW CURa ADMa DEVa TAIa PSAa PSDa IVAa IVDa OUR BUS IND UNI COM NAV INT"
status: 200, 200 OK
x-twitter-response-tags: BouncerCompliant
content-length: 57
x-xss-protection: 0
x-response-time: 118
pragma: no-cache
last-modified: Mon, 13 Jan 2020 04:57:00 GMT
server: tsa_f
x-frame-options: SAMEORIGIN
strict-transport-security: max-age=631138519
content-type: application/javascript;charset=utf-8
cache-control: no-cache, no-store, must-revalidate, pre-check=0, post-check=0
x-connection-hash: d293a0e9b61c41571aac102ee9b7cb99
x-transaction: 001febb800cd846e
expires: Tue, 31 Mar 1981 05:00:00 GMT

POST
H2 204 performance Show response
www.semrush.com/cdn-cgi/beacon/ 0
54 B 42ms
42ms XHR
text/plain 104.18.70.106
Cloudflare

General

Check archive.org

Show headers Download Go to

Full URL

https://www.semrush.com/cdn-cgi/beacon/performance?req_id=5544c96cd970e624

Requested by

Host: www.semrush.com
URL: https://www.semrush.com/bot/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.18.70.106 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),

Reverse DNS

Software

cloudflare /

Resource Hash

e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Security Headers

Name	Value
X-Frame-Options	SAMEORIGIN

Request headers

X-NewRelic-ID: VQEOWV5VDRAHUVRTBwkAUg==
Origin: https://www.semrush.com
Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36
newrelic: eyJ2IjpbMCwxXSwiZCI6eyJ0eSI6IkJyb3dzZXIiLCJhYyI6IjE3OTg4NjUiLCJhcCI6Ijc1NTQ5MDMyIiwiaWQiOiI4OWU5ZDY4ZjI2YTBjYWEwIiwidHIiOiJkMjc1N2M3MWEyYzk4MWY1IiwidGkiOjE1Nzg4OTE0MjA3MjF9fQ==
content-type: application/json

Response headers

status: 204
date: Mon, 13 Jan 2020 04:57:00 GMT
server: cloudflare
cf-ray: 5544c9739929e624-LHR
x-frame-options: SAMEORIGIN

GET
H/1.1 200
OK a87e051934 Show response
bam.nr-data.net/1/ 57 B
261 B 471ms
134ms Script
text/javascript 162.247.242.20
New Relic

General

Check archive.org

Show headers Download Go to

Full URL: https://bam.nr-data.net/1/a87e051934?a=75510874&v=1158.afc605b&to=NFYGY0FVXkBZBUdbDA0cIkJdV0RaVwgcQQYOQRFEWwYeUFcIR0AKAR0WUl5bRFYWEFpXFBAJNlJeW0RWbg9WRQ%3D%3D&rst=1282&ref=https://www.semrush.com/bot/&ap=111&be=373&fe=1120&dc=483&af=err,xhr,stn,ins,spa&perf=%7B%22timing%22:%7B%22of%22:1578891419593,%22n%22:0,%22f%22:0,%22dn%22:1,%22dne%22:3,%22c%22:3,%22s%22:22,%22ce%22:50,%22rq%22:51,%22rp%22:314,%22rpe%22:357,%22dl%22:317,%22di%22:483,%22ds%22:484,%22de%22:490,%22dc%22:1120,%22l%22:1120,%22le%22:1124%7D,%22navigation%22:%7B%7D%7D&fp=470&fcp=470&jsonp=NREUM.setToken
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: HTTP/1.1
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 162.247.242.20 San Francisco, United States, ASN23467 (NEWRELIC-AS-1 - New Relic, US),
Reverse DNS: bam-8.nr-data.net
Software: /
Resource Hash: 5e864c2e3f674c60970513411eaeeeafd2d615d842e65ec01d09ccfcb4a7b38d

Request headers

Referer: https://www.semrush.com/bot/
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36

Response headers

Content-Type: text/javascript;charset=ISO-8859-1
Content-Length: 57
Expires: Thu, 01 Jan 1970 00:00:00 GMT

POST
H/1.1 200
OK a87e051934 Show response
bam.nr-data.net/events/1/ 24 B
182 B 110ms
110ms XHR
image/gif 162.247.242.20
New Relic

General

Check archive.org

Show headers Download Go to

Full URL: https://bam.nr-data.net/events/1/a87e051934?a=75510874&v=1158.afc605b&to=NFYGY0FVXkBZBUdbDA0cIkJdV0RaVwgcQQYOQRFEWwYeUFcIR0AKAR0WUl5bRFYWEFpXFBAJNlJeW0RWbg9WRQ%3D%3D&rst=1764&ref=https://www.semrush.com/bot/
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: HTTP/1.1
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 162.247.242.20 San Francisco, United States, ASN23467 (NEWRELIC-AS-1 - New Relic, US),
Reverse DNS: bam-8.nr-data.net
Software: /
Resource Hash: 0c9cf152a0ad00d4f102c93c613c104914be5517ac8f8e0831727f8bfbe8b300

Request headers

Referer: https://www.semrush.com/bot/
Origin: https://www.semrush.com
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36
content-type: text/plain

Response headers

Access-Control-Allow-Origin: https://www.semrush.com
Access-Control-Allow-Credentials: true
Content-Length: 24
Content-Type: image/gif

POST
H/1.1 200
OK a87e051934 Show response
bam.nr-data.net/events/1/ 24 B
182 B 111ms
111ms XHR
image/gif 162.247.242.20
New Relic

General

Check archive.org

Show headers Download Go to

Full URL: https://bam.nr-data.net/events/1/a87e051934?a=75510874&v=1158.afc605b&to=NFYGY0FVXkBZBUdbDA0cIkJdV0RaVwgcQQYOQRFEWwYeUFcIR0AKAR0WUl5bRFYWEFpXFBAJNlJeW0RWbg9WRQ%3D%3D&rst=11280&ref=https://www.semrush.com/bot/
Requested by: Host: www.semrush.com
URL: https://www.semrush.com/bot/
Protocol: HTTP/1.1
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 162.247.242.20 San Francisco, United States, ASN23467 (NEWRELIC-AS-1 - New Relic, US),
Reverse DNS: bam-8.nr-data.net
Software: /
Resource Hash: 0c9cf152a0ad00d4f102c93c613c104914be5517ac8f8e0831727f8bfbe8b300

Request headers

Referer: https://www.semrush.com/bot/
Origin: https://www.semrush.com
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.88 Safari/537.36
content-type: text/plain

Response headers

Access-Control-Allow-Origin: https://www.semrush.com
Access-Control-Allow-Credentials: true
Content-Length: 24
Content-Type: image/gif

Verdicts & Comments Add Verdict or Comment

57 JavaScript Global Variables

These are the non-standard "global" variables defined on the window object. These can be helpful in identifying possible client-side frameworks and code.

17 Cookies

Cookies are little pieces of information stored in the browser of a user. Whenever a user visits the site again, he will also send his cookie values, thus allowing the website to re-identify him even if he changed locations. This is how permanent logins work.

Domain/Path	Expires	Name / Value
.semrush.com/	1970-01-25 21:15:46	Name: mindboxDeviceUUID Value: a3fb1329-9d82-4de5-8495-593903f6a257
.semrush.com/	1970-01-19 08:44:27	Name: _fbp Value: fb.1.1578891420150.561044770
.doubleclick.net/	1970-01-19 15:56:27	Name: IDE Value: AHWqTUlh3OLaJ1Q8lu7JZdCtl47Azpr3GPVksI-Hz_4FhUtqWibCc83NzTtsJJsy
.semrush.com/	1970-01-19 06:34:51	Name: _gat Value: 1
.semrush.com/	1970-01-20 00:07:08	Name: directCrm-session Value: %7B%22deviceGuid%22%3A%22a3fb1329-9d82-4de5-8495-593903f6a257%22%7D
.semrush.com/	1970-01-19 08:44:27	Name: _gcl_au Value: 1.1.831494643.1578891420
.semrush.com/	1970-01-20 00:06:03	Name: _ga Value: GA1.2.495413072.1578891420
.semrush.com/	1970-01-22 22:10:51	Name: visit_first Value: 1578891420079
.semrush.com/	1970-01-22 22:14:27	Name: refer_source Value: ""
.semrush.com/	1970-01-19 06:36:14	Name: __cflb Value: 02DiuHX4Ba44zLq78eDqAqPoPZytTuS8kFLvx7kiT8Xjr
.semrush.com/	1969-12-31 23:59:59	Name: PHPSESSID Value: 2ap-q2zg9l6yfwarjz95wby675l82u9w
.semrush.com/	1969-12-31 23:59:59	Name: n_userid Value: LuWkzV4b+JubQBTdBsSlAg==
.semrush.com/	1970-01-19 07:18:03	Name: __cfduid Value: d54ba6f10694ea830ad08f859cade617d1578891419
.semrush.com/	1970-01-19 06:55:01	Name: ga_exp_7xHEszwjQFucPwMnhXHIzQ Value: 2
.semrush.com/	1970-01-22 22:14:27	Name: ref_code Value: __default__
.semrush.com/	1970-01-19 06:36:17	Name: _gid Value: GA1.2.244521904.1578891420
www.semrush.com/	1970-01-19 06:36:14	Name: __cflb Value: 02DiuHX4Ba44zLq78eDqAqPoPZytTuS8kFLvx7kiT8Xjr

1 Console Messages

A page may trigger messages to the console to be logged. These are often error messages about being unable to load a resource or execute a piece of JavaScript. Sometimes they also provide insight into the technology behind a website.

Source	Level	URL Text
console-api	error	URL: https://www.semrush.com/__static__/semrush-resources-menu.8f4f5eb5.js(Line 1) Message: Error JSON parse

Security Headers

This page lists any security headers set by the main page. If you want to understand what these mean and how to use them, head on over to this page

Header	Value
Strict-Transport-Security	max-age=31536000; includeSubdomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Indicators

This is a term in the security industry to describe indicators such as IPs, Domains, Hashes, etc. This does not imply that any of these indicate malicious activity.

6266241.fls.doubleclick.net
alb.reddit.com
analytics.twitter.com
api.mindbox.cloud
bam.nr-data.net
bat.bing.com
by2.uservoice.com
connect.facebook.net
cx.atdmt.com
google-analytics.bi.owox.com
js-agent.newrelic.com
px.ads.linkedin.com
q.quora.com
sjs.bizographics.com
static.ads-twitter.com
static.cloudflareinsights.com
static.semrush.com
stats.g.doubleclick.net
t.co
widget.uservoice.com
www.facebook.com
www.google-analytics.com
www.google.com
www.google.de
www.googletagmanager.com
www.linkedin.com
www.redditstatic.com
www.semrush.com
104.18.70.106
104.244.42.133
104.244.42.3
151.101.113.140
151.101.114.110
151.101.12.157
162.247.242.20
172.217.23.134
2606:4700::6810:5f41
2606:4700::6811:1b5c
2620:1ec:c11::200
2a00:1450:4001:808::200e
2a00:1450:4001:816::2008
2a00:1450:4001:81a::2003
2a00:1450:4001:825::2004
2a00:1450:400c:c00::9d
2a02:26f0:6c00:293::3adf
2a03:2880:f02d:12:face:b00c:0:3
2a03:2880:f02d:5:face:b00c:0:8c
2a03:2880:f12d:83:face:b00c:0:25de
2a05:f500:10:101::b93f:9101
2a05:f500:11:101::b93f:9005
3.225.77.184
35.186.228.179
52.232.113.156
54.164.86.91
0c9cf152a0ad00d4f102c93c613c104914be5517ac8f8e0831727f8bfbe8b300
10d8d42d73a02ddb877101e72fbfa15a0ec820224d97cedee4cf92d571be5caa
135a9b57320ff71f9094aaafd67205a292f49f7dc62ae1f40dc233af9a45462d
1ada5b4d0b63b06d2bd668cd7d6597689796da41a434a675cfdbd2a1bddf251a
251e8e864140d9a7ceacce3371ff692595dd0a455ad000de4041d8a313618bd7
25e389f69244bf91f4c05380e7ab26cc928111df708885fab9d16c803783ca1d
2d83b543be799794cef81bda33376a237169a22421be5ed2bb10c58019b32b96
319949c8c08b86e9c35ea542c0dc0c30cedaa9b8d3d3c3327a36c91aefbd8af5
3d15b6c83aceefb58ef1dd147c1a7ed7a76254c039387416abaf9f7c66beb032
3d470deb36b058ffc20c811e3c56426213ba6f035af88273b497d719b22c1585
41dd5e421fe221a7d2921d6fa2b36e8b01a9f2c054aaef5fad866fe896c1d1e0
45016ffac0dfba5c7249f3c9a3a968e1d5d9dfcddd08c87e5f13075da0f40fc8
4e16801c6ce10ec4a471fadae4d71c3ac50ed3b91d9906e9aa43ff64d9edc003
4f30135f1de34e52349aa6fb179058dd1e1c2d15aa1bc6c7ccd095cd80818c6c
548f2d6f4d0d820c6c5ffbeffcbd7f0e73193e2932eefe542accc84762deec87
5677b866170b8b995a3038b3c6702172f75539ec25e23805859df16b8bb08b1e
593cc5ce6eb8733ea4603ff382caa167fbfd1561d56ccfb0156a0fdd6c92cb7c
5e864c2e3f674c60970513411eaeeeafd2d615d842e65ec01d09ccfcb4a7b38d
64ee1ec9f0db4ee752f01e6ff10584e2f1d8b2adb7dc2c4826f9646582ba329a
652af54480ffb1782b3f2a97d3f9d645e21f737ca446184f75a58423ef303245
6a842ea462daca2a0b5a0f5f25bcfc8e0059ac811ca6c6a1bc54e4d9119621c3
6b8ef6e32c55a3b9c7aa85a5578621eea92e4841cff1b70dc5804b5c2ebda576
6d8ba81d1b60a18707722a1f2b62dad48a6acced95a1933f49a68b5016620b93
7abcf162b90cd591072e956d6b05fb827bdfdec4f4daba8980b5dad789bc2b4d
7b8136aeec9845d2472b8dcace3cf9a375dc841679d55861f40cbdbdaf0a5adf
8337212354871836e6763a41e615916c89bac5b3f1f0adf60ba43c7c806e1015
895dd5cd067d31f6d73f74b2b76b4d1b62bd0a3db5a7391ddf067650fd6bd3f2
943a150e9577247cc5e8e493065795ca77a35485b4169f33a4d6f570c209b010
98cf19b1b242b55673fa578612d05760183b181342ac72c323348d6e1fd24820
9a87205c152cc0d704be3f310b5ee1279f96436a785f88ca686b0467b10d57fd
a3d03af4e7c4783617c75ca12fd456785986a6281b26d4b6bfadef561437d94b
a722f57c4f401f5dd6665f60bfb25247aa8c9b714f7e915b08f7431860b4e5c2
ac8778041fdb7f2e08ceb574c9a766247ea26f1a7d90fa854c4efcf4b361a957
b139982ce002c53ddfb65aec1e90704c0a3704fc5aa35247f9323b74a1d3f721
beed9dbdeb30f7db25b7fab2d0e93df2bbdc1ce0c7bd53c2adeecc03dc286800
ce7b7b7775ad64d682a935e8a4118a3b43ab8d15ae8958aae94582214301874c
dba82ed6386eddef80333d1dfca913ccbb287f0827d58c8d2c4bcd7edc010948
dbb67c620eaabf6679a314db18d3ae43037aef71ab27422e6feec08ee987cc0a
df3e003cc30e9bdd0313100e8ee5d468070b4b34d11ad355f276a356d4b9c7bf
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
ecd60a941b824fe17b4757735dc54cefaac49ab7ad6ae82714453db1c48ed7ac
ef1955ae757c8b966c83248350331bd3a30f658ced11f387f8ebf05ab3368629
ef1f3e28deeab6d2c271cfc0dbfde355a85f17231740b554d78bc349fe7285f3
f23cae2aad5f0e9b235bdc77e700f6fa80cb929c6de287cc9069ad946185e23b

www.semrush.com Open in urlscan Pro 104.18.70.106 Public Scan

Summary

urlscan.io Verdict: No classification

Domain & IP information

Screenshot Live screenshot Full Image

Detected technologies

Page Statistics

48 Requests

100 %HTTPS

54 %IPv6

24 Domains

28 Subdomains

24 IPs

6 Countries

595 kBTransfer

1946 kBSize

17 Cookies

8 Outgoing links

Redirected requests

48 HTTP transactions Everything HTML Script AJAX CSS Image Expand all 1 data transactions

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Redirect headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Redirect headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Redirect headers

Request headers

Response headers

Request headers

Response headers

Request headers

www.semrush.com Open in urlscan Pro
104.18.70.106 Public Scan

Screenshot
Live screenshot

Full Image

48
Requests

100 %
HTTPS

54 %
IPv6

24
Domains

28
Subdomains

24
IPs

6
Countries

595 kB
Transfer

1946 kB
Size

17
Cookies

48 HTTP transactions
1 data transactions