www.theverge.com Open in urlscan Pro
151.101.129.91 Public Scan

Go To Rescan
Add Verdict Report

URL:
https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Submission: On April 05 via manual (April 5th 2024, 4:07:59 pm UTC) from US — Scanned from DE

Summary HTTP 229 Redirects Behaviour Indicators

Summary

This website contacted 73 IPs in 9 countries across 54 domains to perform 229 HTTP transactions. The main IP is 151.101.129.91, located in United States and belongs to FASTLY, US. The main domain is www.theverge.com. The Cisco Umbrella rank of the primary domain is 10638.
TLS certificate: Issued by GlobalSign Atlas R3 DV TLS CA 2023 Q3 on August 22nd 2023. Valid for: a year.

This is the only time www.theverge.com was scanned on urlscan.io!

urlscan.io Verdict: No classification

Domain & IP information

	IP Address	AS Autonomous System
51	151.101.129.91 151.101.129.91	54113 (FASTLY) (FASTLY)
2	104.64.126.246 104.64.126.246	16625 (AKAMAI-AS) (AKAMAI-AS)
3	108.138.6.136 108.138.6.136	16509 (AMAZON-02) (AMAZON-02)
1	2a00:1450:400... 2a00:1450:4001:81d::2002	15169 (GOOGLE) (GOOGLE)
5	151.101.1.91 151.101.1.91	54113 (FASTLY) (FASTLY)
5	2606:4700::68... 2606:4700::6812:a6e0	13335 (CLOUDFLAR...) (CLOUDFLARENET)
1	2606:4700:311... 2606:4700:3110::6812:341b	13335 (CLOUDFLAR...) (CLOUDFLARENET)
1	2a00:1450:400... 2a00:1450:4001:80f::2002	15169 (GOOGLE) (GOOGLE)
1	2a00:1450:400... 2a00:1450:4001:811::200e	15169 (GOOGLE) (GOOGLE)
1	18.66.112.84 18.66.112.84	16509 (AMAZON-02) (AMAZON-02)
2	2a00:1450:400... 2a00:1450:4001:82f::2008	15169 (GOOGLE) (GOOGLE)
1	18.66.122.25 18.66.122.25	16509 (AMAZON-02) (AMAZON-02)
3	2600:1901:0:4... 2600:1901:0:4277::1	15169 (GOOGLE) (GOOGLE)
1 1	2600:9000:236... 2600:9000:236e:fc00:9:674:7440:21	16509 (AMAZON-02) (AMAZON-02)
1	2606:4700::68... 2606:4700::6810:457d	13335 (CLOUDFLAR...) (CLOUDFLARENET)
4	199.232.196.124 199.232.196.124	54113 (FASTLY) (FASTLY)
1	18.208.123.81 18.208.123.81	14618 (AMAZON-AES) (AMAZON-AES)
4	34.111.9.237 34.111.9.237	396982 (GOOGLE-CL...) (GOOGLE-CLOUD-PLATFORM)
2	35.214.187.215 35.214.187.215	15169 (GOOGLE) (GOOGLE)
3	2a00:1450:400... 2a00:1450:4001:806::200e	15169 (GOOGLE) (GOOGLE)
1	2606:4700:10:... 2606:4700:10::6816:4ad8	13335 (CLOUDFLAR...) (CLOUDFLARENET)
1 18	172.64.146.152 172.64.146.152	13335 (CLOUDFLAR...) (CLOUDFLARENET)
6	23.35.237.86 23.35.237.86	16625 (AKAMAI-AS) (AKAMAI-AS)
1	18.245.31.123 18.245.31.123	16509 (AMAZON-02) (AMAZON-02)
1	172.64.149.180 172.64.149.180	13335 (CLOUDFLAR...) (CLOUDFLARENET)
1	184.30.211.26 184.30.211.26	16625 (AKAMAI-AS) (AKAMAI-AS)
2	75.2.104.6 75.2.104.6	16509 (AMAZON-02) (AMAZON-02)
2	99.83.154.140 99.83.154.140	16509 (AMAZON-02) (AMAZON-02)
1	2600:9000:223... 2600:9000:223f:f800:8:48e:53c0:93a1	16509 (AMAZON-02) (AMAZON-02)
1	146.75.120.157 146.75.120.157	54113 (FASTLY) (FASTLY)
3	2001:4860:480... 2001:4860:4802:34::178	15169 (GOOGLE) (GOOGLE)
1	3.161.77.50 3.161.77.50	16509 (AMAZON-02) (AMAZON-02)
1 3	18.244.18.32 18.244.18.32	16509 (AMAZON-02) (AMAZON-02)
2	2a03:2880:f08... 2a03:2880:f083:100:face:b00c:0:3	32934 (FACEBOOK) (FACEBOOK)
1	3.160.150.11 3.160.150.11	16509 (AMAZON-02) (AMAZON-02)
3	130.211.23.194 130.211.23.194	396982 (GOOGLE-CL...) (GOOGLE-CLOUD-PLATFORM)
2	2606:4700:20:... 2606:4700:20::ac43:4513	13335 (CLOUDFLAR...) (CLOUDFLARENET)
1	142.250.185.70 142.250.185.70	15169 (GOOGLE) (GOOGLE)
2	52.204.131.34 52.204.131.34	14618 (AMAZON-AES) (AMAZON-AES)
2	15.197.193.217 15.197.193.217	16509 (AMAZON-02) (AMAZON-02)
2	34.120.133.55 34.120.133.55	396982 (GOOGLE-CL...) (GOOGLE-CLOUD-PLATFORM)
1	13.33.173.196 13.33.173.196	16509 (AMAZON-02) (AMAZON-02)
2	2606:4700::68... 2606:4700::6811:7711	13335 (CLOUDFLAR...) (CLOUDFLARENET)
1	54.155.18.159 54.155.18.159	16509 (AMAZON-02) (AMAZON-02)
1	13.32.27.115 13.32.27.115	16509 (AMAZON-02) (AMAZON-02)
1	104.244.42.133 104.244.42.133	13414 (TWITTER) (TWITTER)
1	104.244.42.3 104.244.42.3	13414 (TWITTER) (TWITTER)
20	35.157.246.167 35.157.246.167	16509 (AMAZON-02) (AMAZON-02)
2	69.173.144.137 69.173.144.137	26667 (RUBICONPR...) (RUBICONPROJECT)
2	2602:803:c003... 2602:803:c003:200::21	26667 (RUBICONPR...) (RUBICONPROJECT)
1	172.64.151.101 172.64.151.101	13335 (CLOUDFLAR...) (CLOUDFLARENET)
2	37.252.171.149 37.252.171.149	29990 (ASN-APPNEX) (ASN-APPNEX)
1	3.124.64.248 3.124.64.248	16509 (AMAZON-02) (AMAZON-02)
1	178.250.1.8 178.250.1.8	44788 (ASN-CRITE...) (ASN-CRITEO-EUROPE)
1	185.64.189.112 185.64.189.112	62713 (AS-PUBMATIC) (AS-PUBMATIC)
1	34.117.126.186 34.117.126.186	396982 (GOOGLE-CL...) (GOOGLE-CLOUD-PLATFORM)
1	2a00:1450:400... 2a00:1450:4001:82b::200a	15169 (GOOGLE) (GOOGLE)
2	2a00:1450:400... 2a00:1450:4001:80b::2003	15169 (GOOGLE) (GOOGLE)
1	2001:4860:480... 2001:4860:4802:34::36	15169 (GOOGLE) (GOOGLE)
2	2a00:1450:400... 2a00:1450:400c:c00::9a	15169 (GOOGLE) (GOOGLE)
1	2a00:1450:400... 2a00:1450:4001:831::2003	15169 (GOOGLE) (GOOGLE)
1	2a03:2880:f17... 2a03:2880:f176:181:face:b00c:0:25de	32934 (FACEBOOK) (FACEBOOK)
2	13.32.99.89 13.32.99.89	16509 (AMAZON-02) (AMAZON-02)
1	35.241.9.51 35.241.9.51	15169 (GOOGLE) (GOOGLE)
1	146.75.122.132 146.75.122.132	54113 (FASTLY) (FASTLY)
7	34.107.254.252 34.107.254.252	396982 (GOOGLE-CL...) (GOOGLE-CLOUD-PLATFORM)
5	34.107.222.173 34.107.222.173	396982 (GOOGLE-CL...) (GOOGLE-CLOUD-PLATFORM)
12	104.18.41.104 104.18.41.104	13335 (CLOUDFLAR...) (CLOUDFLARENET)
2	23.32.101.241 23.32.101.241	16625 (AKAMAI-AS) (AKAMAI-AS)
1	64.202.112.127 64.202.112.127	22075 (AS-OUTBRAIN) (AS-OUTBRAIN)
1	143.204.98.66 143.204.98.66	16509 (AMAZON-02) (AMAZON-02)
1	35.244.193.51 35.244.193.51	15169 (GOOGLE) (GOOGLE)
2	18.159.242.25 18.159.242.25	16509 (AMAZON-02) (AMAZON-02)
229	73

51 151.101.129.91 (United States)

ASN54113 (FASTLY, US)

www.theverge.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools
duet-cdn.vox-cdn.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 104.64.126.246 (Prague, Czech Republic)

ASN16625 (AKAMAI-AS, US)
PTR: a104-64-126-246.deploy.static.akamaitechnologies.com

micro.rubiconproject.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools
ads.rubiconproject.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

3 108.138.6.136 (United States)

ASN16509 (AMAZON-02, US)
PTR: server-108-138-6-136.fra56.r.cloudfront.net

c.amazon-adsystem.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2a00:1450:4001:81d::2002 (Frankfurt am Main, Germany)

ASN15169 (GOOGLE, US)

www.googletagservices.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

5 151.101.1.91 (United States)

ASN54113 (FASTLY, US)

cdn.concert.io	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

5 2606:4700::6812:a6e0 (United States)

ASN13335 (CLOUDFLARENET, US)

pub.doubleverify.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2606:4700:3110::6812:341b (United States)

ASN13335 (CLOUDFLARENET, US)

polyfill.io	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2a00:1450:4001:80f::2002 (Frankfurt am Main, Germany)

ASN15169 (GOOGLE, US)

securepubads.g.doubleclick.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2a00:1450:4001:811::200e (Frankfurt am Main, Germany)

ASN15169 (GOOGLE, US)

www.googleoptimize.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 18.66.112.84 (United States)

ASN16509 (AMAZON-02, US)
PTR: server-18-66-112-84.fra56.r.cloudfront.net

ak.sail-horizon.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2a00:1450:4001:82f::2008 (Frankfurt am Main, Germany)

ASN15169 (GOOGLE, US)

www.googletagmanager.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 18.66.122.25 (United States)

ASN16509 (AMAZON-02, US)
PTR: server-18-66-122-25.fra60.r.cloudfront.net

static.narrativ.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

3 2600:1901:0:4277::1 (Kansas City, United States)

ASN15169 (GOOGLE, US)

monacobeatles.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2600:9000:236e:fc00:9:674:7440:21 (United States) 1 redirects

ASN16509 (AMAZON-02, US)

d35xxde4fgg0cx.cloudfront.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2606:4700::6810:457d (United States)

ASN13335 (CLOUDFLARENET, US)

js.memberful.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

4 199.232.196.124 (United States)

ASN54113 (FASTLY, US)

apps.voxmedia.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools
concertads-configs.vox-cdn.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools
cdn.vox-cdn.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 18.208.123.81 (Ashburn, United States)

ASN14618 (AMAZON-AES, US)
PTR: ec2-18-208-123-81.compute-1.amazonaws.com

api.parsely.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

4 34.111.9.237 (Kansas City, United States)

ASN396982 (GOOGLE-CLOUD-PLATFORM, US)
PTR: 237.9.111.34.bc.googleusercontent.com

theverge.coral.coralproject.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 35.214.187.215 (Groningen, Netherlands)

ASN15169 (GOOGLE, US)
PTR: 215.187.214.35.bc.googleusercontent.com

media.grid.bidswitch.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

3 2a00:1450:4001:806::200e (Frankfurt am Main, Germany)

ASN15169 (GOOGLE, US)

fundingchoicesmessages.google.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2606:4700:10::6816:4ad8 (United States)

ASN13335 (CLOUDFLARENET, US)

btloader.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

18 172.64.146.152 (San Francisco, United States) 1 redirects

ASN13335 (CLOUDFLARENET, US)

cd.connatix.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools
cds.connatix.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools
capi.connatix.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools
vid.connatix.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

6 23.35.237.86 (Frankfurt am Main, Germany)

ASN16625 (AKAMAI-AS, US)
PTR: a23-35-237-86.deploy.static.akamaitechnologies.com

widgets.outbrain.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools
widget-pixels.outbrain.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 18.245.31.123 (United States)

ASN16509 (AMAZON-02, US)
PTR: server-18-245-31-123.fra56.r.cloudfront.net

config.aps.amazon-adsystem.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 172.64.149.180 (San Francisco, United States)

ASN13335 (CLOUDFLARENET, US)

js-sec.indexww.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 184.30.211.26 (Frankfurt am Main, Germany)

ASN16625 (AKAMAI-AS, US)
PTR: a184-30-211-26.deploy.static.akamaitechnologies.com

secure.cdn.fastclick.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 75.2.104.6 (United States)

ASN16509 (AMAZON-02, US)
PTR: a710cf531d4cd2506.awsglobalaccelerator.com

api.sail-track.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 99.83.154.140 (United States)

ASN16509 (AMAZON-02, US)
PTR: aa7557bb34ea5624b.awsglobalaccelerator.com

api.sail-personalize.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2600:9000:223f:f800:8:48e:53c0:93a1 (United States)

ASN16509 (AMAZON-02, US)

static.adsafeprotected.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 146.75.120.157 (Frankfurt am Main, Germany)

ASN54113 (FASTLY, US)

static.ads-twitter.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

3 2001:4860:4802:34::178 (United States)

ASN15169 (GOOGLE, US)

www.google-analytics.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 3.161.77.50 (United States)

ASN16509 (AMAZON-02, US)
PTR: server-3-161-77-50.fra56.r.cloudfront.net

cdn.parsely.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

3 18.244.18.32 (United States) 1 redirects

ASN16509 (AMAZON-02, US)
PTR: server-18-244-18-32.fra56.r.cloudfront.net

sb.scorecardresearch.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2a03:2880:f083:100:face:b00c:0:3 (Frankfurt am Main, Germany)

ASN32934 (FACEBOOK, US)

connect.facebook.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 3.160.150.11 (United States)

ASN16509 (AMAZON-02, US)
PTR: server-3-160-150-11.fra60.r.cloudfront.net

launchpad-wrapper.privacymanager.io	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

3 130.211.23.194 (Kansas City, United States)

ASN396982 (GOOGLE-CLOUD-PLATFORM, US)
PTR: 194.23.211.130.bc.googleusercontent.com

api.btloader.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2606:4700:20::ac43:4513 (United States)

ASN13335 (CLOUDFLARENET, US)

ad-delivery.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 142.250.185.70 (United States)

ASN15169 (GOOGLE, US)
PTR: fra16s48-in-f6.1e100.net

ad.doubleclick.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 52.204.131.34 (Ashburn, United States)

ASN14618 (AMAZON-AES, US)
PTR: ec2-52-204-131-34.compute-1.amazonaws.com

id.sv.rkdms.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools
prebid.sv.rkdms.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 15.197.193.217 (Seattle, United States)

ASN16509 (AMAZON-02, US)
PTR: a12b7a488abeaa9e4.awsglobalaccelerator.com

match.adsrvr.org	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 34.120.133.55 (Kansas City, United States)

ASN396982 (GOOGLE-CLOUD-PLATFORM, US)
PTR: 55.133.120.34.bc.googleusercontent.com

api.rlcdn.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 13.33.173.196 (United States)

ASN16509 (AMAZON-02, US)
PTR: server-13-33-173-196.fra60.r.cloudfront.net

aax.amazon-adsystem.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2606:4700::6811:7711 (United States)

ASN13335 (CLOUDFLARENET, US)

cdn.permutive.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 54.155.18.159 (Dublin, Ireland)

ASN16509 (AMAZON-02, US)
PTR: ec2-54-155-18-159.eu-west-1.compute.amazonaws.com

p1.parsely.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 13.32.27.115 (United States)

ASN16509 (AMAZON-02, US)
PTR: server-13-32-27-115.fra56.r.cloudfront.net

launchpad.privacymanager.io	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 104.244.42.133 (United States)

ASN13414 (TWITTER, US)

t.co	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 104.244.42.3 (United States)

ASN13414 (TWITTER, US)

analytics.twitter.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

20 35.157.246.167 (Frankfurt am Main, Germany)

ASN16509 (AMAZON-02, US)
PTR: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com

c2shb.pubgw.yahoo.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 69.173.144.137 (Frankfurt am Main, Germany)

ASN26667 (RUBICONPROJECT, US)

prebid-server.rubiconproject.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2602:803:c003:200::21 (Amsterdam, Netherlands)

ASN26667 (RUBICONPROJECT, US)

fastlane.rubiconproject.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 172.64.151.101 (San Francisco, United States)

ASN13335 (CLOUDFLARENET, US)

htlb.casalemedia.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 37.252.171.149 (Frankfurt am Main, Germany)

ASN29990 (ASN-APPNEX, US)
PTR: 984.bm-nginx-loadbalancer.mgmt.fra1.adnexus.net

ib.adnxs.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 3.124.64.248 (Frankfurt am Main, Germany)

ASN16509 (AMAZON-02, US)
PTR: ec2-3-124-64-248.eu-central-1.compute.amazonaws.com

tlx.3lift.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 178.250.1.8 (France)

ASN44788 (ASN-CRITEO-EUROPE, FR)

grid.bidswitch.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 185.64.189.112 (United Kingdom)

ASN62713 (AS-PUBMATIC, US)

hbopenbid.pubmatic.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 34.117.126.186 (Kansas City, United States)

ASN396982 (GOOGLE-CLOUD-PLATFORM, US)
PTR: 186.126.117.34.bc.googleusercontent.com

bids.concert.io	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2a00:1450:4001:82b::200a (Frankfurt am Main, Germany)

ASN15169 (GOOGLE, US)

fonts.googleapis.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2a00:1450:4001:80b::2003 (Frankfurt am Main, Germany)

ASN15169 (GOOGLE, US)

fonts.gstatic.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2001:4860:4802:34::36 (United States)

ASN15169 (GOOGLE, US)

region1.analytics.google.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2a00:1450:400c:c00::9a (Brussels, Belgium)

ASN15169 (GOOGLE, US)

stats.g.doubleclick.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2a00:1450:4001:831::2003 (Frankfurt am Main, Germany)

ASN15169 (GOOGLE, US)

www.google.de	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2a03:2880:f176:181:face:b00c:0:25de (Frankfurt am Main, Germany)

ASN32934 (FACEBOOK, US)

www.facebook.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 13.32.99.89 (United States)

ASN16509 (AMAZON-02, US)
PTR: server-13-32-99-89.fra60.r.cloudfront.net

geo.privacymanager.io	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 35.241.9.51 (Kansas City, United States)

ASN15169 (GOOGLE, US)
PTR: 51.9.241.35.bc.googleusercontent.com

d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.prmutv.co	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 146.75.122.132 (Frankfurt am Main, Germany)

ASN54113 (FASTLY, US)

mv.outbrain.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

7 34.107.254.252 (Kansas City, United States)

ASN396982 (GOOGLE-CLOUD-PLATFORM, US)
PTR: 252.254.107.34.bc.googleusercontent.com

api.permutive.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

5 34.107.222.173 (Kansas City, United States)

ASN396982 (GOOGLE-CLOUD-PLATFORM, US)
PTR: 173.222.107.34.bc.googleusercontent.com

d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.partner.permutive.app	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

12 104.18.41.104 (None, )

ASN13335 (CLOUDFLARENET, US)

ins.connatix.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools
lit.connatix.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 23.32.101.241 (Frankfurt am Main, Germany)

ASN16625 (AKAMAI-AS, US)
PTR: a23-32-101-241.deploy.static.akamaitechnologies.com

images.outbrainimg.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 64.202.112.127 (United States)

ASN22075 (AS-OUTBRAIN, US)
PTR: ny.outbrain.com

mcdp-nydc1.outbrain.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 143.204.98.66 (United States)

ASN16509 (AMAZON-02, US)
PTR: server-143-204-98-66.fra50.r.cloudfront.net

check.analytics.rlcdn.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 35.244.193.51 (Kansas City, United States)

ASN15169 (GOOGLE, US)
PTR: 51.193.244.35.bc.googleusercontent.com

lexicon.33across.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 18.159.242.25 (Frankfurt am Main, Germany)

ASN16509 (AMAZON-02, US)
PTR: ec2-18-159-242-25.eu-central-1.compute.amazonaws.com

prebid-a.rubiconproject.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

	Apex Domain Subdomains	Transfer
49	theverge.com www.theverge.com — Cisco Umbrella Rank: 10638	1 MB
30	connatix.com 1 redirects cd.connatix.com — Cisco Umbrella Rank: 3452 cds.connatix.com — Cisco Umbrella Rank: 3596 capi.connatix.com — Cisco Umbrella Rank: 814 ins.connatix.com — Cisco Umbrella Rank: 4752 vid.connatix.com — Cisco Umbrella Rank: 4344 lit.connatix.com — Cisco Umbrella Rank: 5749	505 KB
20	yahoo.com c2shb.pubgw.yahoo.com — Cisco Umbrella Rank: 2033	1 KB
9	permutive.com cdn.permutive.com — Cisco Umbrella Rank: 3333 api.permutive.com — Cisco Umbrella Rank: 2473	142 KB
8	outbrain.com widgets.outbrain.com — Cisco Umbrella Rank: 2023 widget-pixels.outbrain.com — Cisco Umbrella Rank: 4684 mv.outbrain.com — Cisco Umbrella Rank: 2751 mcdp-nydc1.outbrain.com — Cisco Umbrella Rank: 8389	108 KB
8	rubiconproject.com micro.rubiconproject.com — Cisco Umbrella Rank: 3056 ads.rubiconproject.com — Cisco Umbrella Rank: 2129 prebid-server.rubiconproject.com — Cisco Umbrella Rank: 792 fastlane.rubiconproject.com — Cisco Umbrella Rank: 511 prebid-a.rubiconproject.com — Cisco Umbrella Rank: 3202	191 KB
6	concert.io cdn.concert.io — Cisco Umbrella Rank: 15212 bids.concert.io — Cisco Umbrella Rank: 6387	139 KB
5	permutive.app d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.partner.permutive.app — Cisco Umbrella Rank: 20685	864 B
5	doubleverify.com pub.doubleverify.com — Cisco Umbrella Rank: 3750	21 KB
5	amazon-adsystem.com c.amazon-adsystem.com — Cisco Umbrella Rank: 303 config.aps.amazon-adsystem.com — Cisco Umbrella Rank: 629 aax.amazon-adsystem.com — Cisco Umbrella Rank: 409	79 KB
5	vox-cdn.com duet-cdn.vox-cdn.com — Cisco Umbrella Rank: 59479 concertads-configs.vox-cdn.com — Cisco Umbrella Rank: 19144 cdn.vox-cdn.com — Cisco Umbrella Rank: 16067	108 KB
4	privacymanager.io launchpad-wrapper.privacymanager.io — Cisco Umbrella Rank: 2864 launchpad.privacymanager.io — Cisco Umbrella Rank: 2374 geo.privacymanager.io — Cisco Umbrella Rank: 1937	32 KB
4	btloader.com btloader.com — Cisco Umbrella Rank: 928 api.btloader.com — Cisco Umbrella Rank: 1093	25 KB
4	google.com fundingchoicesmessages.google.com — Cisco Umbrella Rank: 664 region1.analytics.google.com — Cisco Umbrella Rank: 3274	120 KB
4	coralproject.net theverge.coral.coralproject.net — Cisco Umbrella Rank: 59944	40 KB
4	doubleclick.net securepubads.g.doubleclick.net — Cisco Umbrella Rank: 212 ad.doubleclick.net — Cisco Umbrella Rank: 169 stats.g.doubleclick.net — Cisco Umbrella Rank: 96	139 KB
3	rlcdn.com api.rlcdn.com — Cisco Umbrella Rank: 1105 check.analytics.rlcdn.com — Cisco Umbrella Rank: 4172	785 B
3	scorecardresearch.com 1 redirects sb.scorecardresearch.com — Cisco Umbrella Rank: 170	3 KB
3	google-analytics.com www.google-analytics.com — Cisco Umbrella Rank: 35	22 KB
3	bidswitch.net media.grid.bidswitch.net — Cisco Umbrella Rank: 2978 grid.bidswitch.net — Cisco Umbrella Rank: 1310	933 B
3	parsely.com api.parsely.com — Cisco Umbrella Rank: 9703 cdn.parsely.com — Cisco Umbrella Rank: 3244 p1.parsely.com — Cisco Umbrella Rank: 2375	20 KB
3	monacobeatles.com monacobeatles.com — Cisco Umbrella Rank: 36970	26 KB
2	outbrainimg.com images.outbrainimg.com — Cisco Umbrella Rank: 3083	226 KB
2	gstatic.com fonts.gstatic.com	173 KB
2	adnxs.com ib.adnxs.com — Cisco Umbrella Rank: 253	2 KB
2	adsrvr.org match.adsrvr.org — Cisco Umbrella Rank: 354	842 B
2	rkdms.com id.sv.rkdms.com — Cisco Umbrella Rank: 6584 prebid.sv.rkdms.com — Cisco Umbrella Rank: 6763	480 B
2	ad-delivery.net ad-delivery.net — Cisco Umbrella Rank: 960	1 KB
2	facebook.net connect.facebook.net — Cisco Umbrella Rank: 176	71 KB
2	sail-personalize.com api.sail-personalize.com — Cisco Umbrella Rank: 3496	332 B
2	sail-track.com api.sail-track.com — Cisco Umbrella Rank: 8869	348 B
2	googletagmanager.com www.googletagmanager.com — Cisco Umbrella Rank: 43	204 KB
1	33across.com lexicon.33across.com — Cisco Umbrella Rank: 1470	251 B
1	prmutv.co d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.prmutv.co — Cisco Umbrella Rank: 31026	386 B
1	facebook.com www.facebook.com — Cisco Umbrella Rank: 99	273 B
1	google.de www.google.de — Cisco Umbrella Rank: 7528	63 B
1	googleapis.com fonts.googleapis.com — Cisco Umbrella Rank: 38	6 KB
1	pubmatic.com hbopenbid.pubmatic.com — Cisco Umbrella Rank: 479	114 B
1	3lift.com tlx.3lift.com — Cisco Umbrella Rank: 595	730 B
1	casalemedia.com htlb.casalemedia.com — Cisco Umbrella Rank: 484	551 B
1	twitter.com analytics.twitter.com — Cisco Umbrella Rank: 816	724 B
1	t.co t.co — Cisco Umbrella Rank: 663	378 B
1	ads-twitter.com static.ads-twitter.com — Cisco Umbrella Rank: 787	15 KB
1	adsafeprotected.com static.adsafeprotected.com — Cisco Umbrella Rank: 708	483 B
1	fastclick.net secure.cdn.fastclick.net — Cisco Umbrella Rank: 1201	17 KB
1	indexww.com js-sec.indexww.com — Cisco Umbrella Rank: 713	12 KB
1	voxmedia.com apps.voxmedia.com — Cisco Umbrella Rank: 24201	379 B
1	memberful.com js.memberful.com — Cisco Umbrella Rank: 32842	23 KB
1	cloudfront.net 1 redirects d35xxde4fgg0cx.cloudfront.net	562 B
1	narrativ.com static.narrativ.com — Cisco Umbrella Rank: 11313	42 KB
1	sail-horizon.com ak.sail-horizon.com — Cisco Umbrella Rank: 3630	34 KB
1	googleoptimize.com www.googleoptimize.com — Cisco Umbrella Rank: 2933	48 KB
1	polyfill.io polyfill.io — Cisco Umbrella Rank: 1402	383 B
1	googletagservices.com www.googletagservices.com — Cisco Umbrella Rank: 293	29 KB
229	54

	Domain	Requested by
49	www.theverge.com	www.theverge.com
20	c2shb.pubgw.yahoo.com	www.theverge.com
12	cds.connatix.com	cd.connatix.com cds.connatix.com
11	ins.connatix.com	cds.connatix.com
7	api.permutive.com	www.theverge.com
5	d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.partner.permutive.app	www.theverge.com
5	widgets.outbrain.com	cdn.concert.io widgets.outbrain.com www.theverge.com
5	pub.doubleverify.com	www.theverge.com pub.doubleverify.com
5	cdn.concert.io	www.theverge.com
4	capi.connatix.com	1 redirects www.theverge.com cds.connatix.com
4	theverge.coral.coralproject.net	www.theverge.com theverge.coral.coralproject.net
3	api.btloader.com	www.theverge.com
3	sb.scorecardresearch.com	1 redirects www.theverge.com
3	www.google-analytics.com	www.googletagmanager.com www.google-analytics.com www.theverge.com
3	fundingchoicesmessages.google.com	securepubads.g.doubleclick.net www.theverge.com
3	monacobeatles.com	www.theverge.com
3	c.amazon-adsystem.com	www.theverge.com c.amazon-adsystem.com
2	prebid-a.rubiconproject.com	www.theverge.com
2	cdn.vox-cdn.com	www.theverge.com
2	images.outbrainimg.com	widgets.outbrain.com www.theverge.com
2	geo.privacymanager.io	www.theverge.com
2	stats.g.doubleclick.net	www.googletagmanager.com www.theverge.com
2	fonts.gstatic.com	www.theverge.com
2	ib.adnxs.com	www.theverge.com
2	fastlane.rubiconproject.com	www.theverge.com
2	prebid-server.rubiconproject.com	www.theverge.com
2	cdn.permutive.com	cdn.concert.io www.theverge.com
2	api.rlcdn.com	www.theverge.com
2	match.adsrvr.org	www.theverge.com
2	ad-delivery.net	www.theverge.com
2	connect.facebook.net	www.theverge.com connect.facebook.net
2	api.sail-personalize.com	www.theverge.com
2	api.sail-track.com	www.theverge.com
2	media.grid.bidswitch.net	www.theverge.com
2	www.googletagmanager.com	www.theverge.com www.googletagmanager.com
2	duet-cdn.vox-cdn.com	www.theverge.com
1	prebid.sv.rkdms.com	www.theverge.com
1	lexicon.33across.com	www.theverge.com
1	check.analytics.rlcdn.com	www.theverge.com
1	mcdp-nydc1.outbrain.com	www.theverge.com
1	lit.connatix.com	cds.connatix.com
1	vid.connatix.com	cds.connatix.com
1	mv.outbrain.com	widgets.outbrain.com
1	d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.prmutv.co	www.theverge.com
1	www.facebook.com	www.theverge.com
1	www.google.de	www.theverge.com
1	region1.analytics.google.com	www.googletagmanager.com
1	fonts.googleapis.com
1	bids.concert.io	www.theverge.com
1	hbopenbid.pubmatic.com	www.theverge.com
1	grid.bidswitch.net	www.theverge.com
1	tlx.3lift.com	www.theverge.com
1	htlb.casalemedia.com	www.theverge.com
1	analytics.twitter.com	www.theverge.com
1	t.co	www.theverge.com
1	launchpad.privacymanager.io	launchpad-wrapper.privacymanager.io
1	p1.parsely.com	www.theverge.com
1	aax.amazon-adsystem.com	www.theverge.com
1	id.sv.rkdms.com	www.theverge.com
1	widget-pixels.outbrain.com	www.theverge.com
1	ad.doubleclick.net	www.theverge.com
1	launchpad-wrapper.privacymanager.io	www.googletagmanager.com
1	cdn.parsely.com	www.googletagmanager.com
1	static.ads-twitter.com	www.googletagmanager.com
1	static.adsafeprotected.com	www.theverge.com
1	secure.cdn.fastclick.net	www.theverge.com
1	js-sec.indexww.com	cdn.concert.io
1	config.aps.amazon-adsystem.com	c.amazon-adsystem.com
1	cd.connatix.com	cdn.concert.io
1	btloader.com	cdn.concert.io
1	ads.rubiconproject.com	www.theverge.com
1	api.parsely.com	www.theverge.com
1	concertads-configs.vox-cdn.com	www.theverge.com
1	apps.voxmedia.com	cdn.concert.io
1	js.memberful.com	www.theverge.com
1	d35xxde4fgg0cx.cloudfront.net	1 redirects
1	static.narrativ.com	www.theverge.com
1	ak.sail-horizon.com	www.theverge.com
1	www.googleoptimize.com	www.theverge.com
1	securepubads.g.doubleclick.net	www.googletagservices.com
1	polyfill.io	www.theverge.com
1	www.googletagservices.com	www.theverge.com
1	micro.rubiconproject.com	www.theverge.com
229	83

This site contains no links.

Subject Issuer	Validity	Valid
*.americanninjawarriornation.com GlobalSign Atlas R3 DV TLS CA 2023 Q3	`2023-08-22` - `2024-09-22`	a year	crt.sh
*.rubiconproject.com DigiCert TLS RSA SHA256 2020 CA1	`2024-03-07` - `2025-04-03`	a year	crt.sh
c.amazon-adsystem.com Amazon RSA 2048 M01	`2023-12-30` - `2024-12-04`	a year	crt.sh
*.g.doubleclick.net GTS CA 1C3	`2024-03-04` - `2024-05-27`	3 months	crt.sh
concert.io GlobalSign Atlas R3 DV TLS CA 2023 Q3	`2023-09-28` - `2024-10-29`	a year	crt.sh
pub.doubleverify.com E1	`2024-02-07` - `2024-05-07`	3 months	crt.sh
*.polyfill.io Sectigo RSA Domain Validation Secure Server CA	`2024-02-20` - `2025-02-19`	a year	crt.sh
*.google-analytics.com GTS CA 1C3	`2024-03-04` - `2024-05-27`	3 months	crt.sh
ak.sail-horizon.com Amazon RSA 2048 M02	`2023-12-04` - `2024-12-30`	a year	crt.sh
static.planethowl.com Amazon RSA 2048 M01	`2023-08-07` - `2024-09-04`	a year	crt.sh
monacobeatles.com R3	`2024-02-18` - `2024-05-18`	3 months	crt.sh
*.vox-cdn.com GlobalSign Atlas R3 DV TLS CA 2023 Q4	`2023-10-19` - `2024-11-19`	a year	crt.sh
*.parsely.com Amazon RSA 2048 M03	`2024-04-05` - `2025-05-04`	a year	crt.sh
theverge.coral.coralproject.net GTS CA 1D4	`2024-03-11` - `2024-06-09`	3 months	crt.sh
media.grid.bidswitch.net Sectigo RSA Domain Validation Secure Server CA	`2023-08-11` - `2024-08-11`	a year	crt.sh
*.google.com GTS CA 1C3	`2024-03-04` - `2024-05-27`	3 months	crt.sh
btloader.com GTS CA 1P5	`2024-02-15` - `2024-05-15`	3 months	crt.sh
connatix.com GTS CA 1P5	`2024-03-01` - `2024-05-30`	3 months	crt.sh
*.outbrain.com DigiCert TLS RSA SHA256 2020 CA1	`2023-12-14` - `2024-12-14`	a year	crt.sh
config.aps.amazon-adsystem.com Amazon RSA 2048 M02	`2024-01-21` - `2025-02-19`	a year	crt.sh
indexww.com Cloudflare Inc ECC CA-3	`2023-09-05` - `2024-09-03`	a year	crt.sh
secure.cdn.fastclick.net DigiCert TLS RSA SHA256 2020 CA1	`2023-10-03` - `2024-10-03`	a year	crt.sh
api.sail-track.com Amazon RSA 2048 M02	`2024-03-24` - `2025-04-21`	a year	crt.sh
api.sail-personalize.com Amazon RSA 2048 M02	`2024-03-25` - `2025-04-22`	a year	crt.sh
static.adsafeprotected.com Amazon RSA 2048 M02	`2023-07-07` - `2024-08-04`	a year	crt.sh
ads-twitter.com DigiCert Global G2 TLS RSA SHA256 2020 CA1	`2023-07-21` - `2024-07-19`	a year	crt.sh
*.facebook.com DigiCert SHA2 High Assurance Server CA	`2024-01-13` - `2024-04-12`	3 months	crt.sh
*.privacymanager.io Amazon RSA 2048 M01	`2023-07-27` - `2024-08-24`	a year	crt.sh
api.btloader.com GTS CA 1D4	`2024-02-06` - `2024-05-06`	3 months	crt.sh
ad-delivery.net GTS CA 1P5	`2024-03-19` - `2024-06-17`	3 months	crt.sh
*.doubleclick.net GTS CA 1C3	`2024-03-04` - `2024-05-27`	3 months	crt.sh
rkdms.com Amazon RSA 2048 M03	`2023-10-04` - `2024-11-01`	a year	crt.sh
*.adsrvr.org GlobalSign GCC R3 DV TLS CA 2020	`2023-04-12` - `2024-05-13`	a year	crt.sh
*.rlcdn.com Sectigo RSA Domain Validation Secure Server CA	`2024-02-06` - `2025-03-05`	a year	crt.sh
alt1-3ps.amazon-adsystem.com Amazon RSA 2048 M03	`2024-03-29` - `2025-04-28`	a year	crt.sh
permutive.com Cloudflare Inc ECC CA-3	`2023-12-26` - `2024-12-25`	a year	crt.sh
t.co DigiCert Global G2 TLS RSA SHA256 2020 CA1	`2023-10-16` - `2024-10-14`	a year	crt.sh
*.twitter.com DigiCert Global G2 TLS RSA SHA256 2020 CA1	`2023-09-19` - `2024-09-17`	a year	crt.sh
web.ssp.yahoo.com DigiCert SHA2 High Assurance Server CA	`2024-03-12` - `2024-09-04`	6 months	crt.sh
casalemedia.com Cloudflare Inc ECC CA-3	`2023-05-21` - `2024-05-20`	a year	crt.sh
*.adnxs.com GeoTrust ECC CA 2018	`2024-02-14` - `2025-03-16`	a year	crt.sh
*.3lift.com Amazon RSA 2048 M02	`2024-03-13` - `2025-04-11`	a year	crt.sh
*.bidswitch.net DigiCert Global G2 TLS RSA SHA256 2020 CA1	`2024-03-14` - `2024-06-06`	3 months	crt.sh
*.pubmatic.com DigiCert Baltimore TLS RSA SHA256 2020 CA1	`2023-04-20` - `2024-05-20`	a year	crt.sh
bids.concert.io GTS CA 1D4	`2024-02-20` - `2024-05-20`	3 months	crt.sh
*.scorecardresearch.com Sectigo RSA Organization Validation Secure Server CA	`2023-12-11` - `2024-12-10`	a year	crt.sh
upload.video.google.com GTS CA 1C3	`2024-03-04` - `2024-05-27`	3 months	crt.sh
*.gstatic.com GTS CA 1C3	`2024-03-04` - `2024-05-27`	3 months	crt.sh
*.google.de GTS CA 1C3	`2024-03-04` - `2024-05-27`	3 months	crt.sh
*.prmutv.co R3	`2024-02-27` - `2024-05-27`	3 months	crt.sh
api.permutive.com R3	`2024-02-13` - `2024-05-13`	3 months	crt.sh
*.partner.permutive.app R3	`2024-02-27` - `2024-05-27`	3 months	crt.sh
ins.connatix.com GTS CA 1P5	`2024-02-19` - `2024-05-19`	3 months	crt.sh
vid.connatix.com GTS CA 1P5	`2024-03-19` - `2024-06-17`	3 months	crt.sh
lit.connatix.com GTS CA 1P5	`2024-02-12` - `2024-05-12`	3 months	crt.sh
*.outbrainimg.com DigiCert TLS RSA SHA256 2020 CA1	`2024-01-03` - `2025-01-03`	a year	crt.sh
analytics.rlcdn.com Amazon RSA 2048 M02	`2023-06-27` - `2024-07-24`	a year	crt.sh
lexicon.33across.com GTS CA 1D4	`2024-03-19` - `2024-06-17`	3 months	crt.sh

This page contains 3 frames:

Primary Page: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Frame ID: 3166401B2C272E81B5BB94450DCE71F1
Requests: 190 HTTP requests in this frame

Frame: https://cd.connatix.com/connatix.player.js
Frame ID: E480F067F75CFFE310503822F6D93A67
Requests: 24 HTTP requests in this frame

Frame: https://widgets.outbrain.com/nanoWidget/externals/topics/topics.html?r=https%3A%2F%2Fwww.theverge.com
Frame ID: 8080F029F23F5FFA75AD48E4F400797B
Requests: 1 HTTP requests in this frame

Screenshot
Live screenshot

Full Image

Detected technologies

Bootstrap (Web Frameworks) Expand

Overall confidence: 100%
Detected patterns

bootstrap(?:[^>]*?([0-9a-fA-F]{7,40}|[\d]+(?:.[\d]+(?:.[\d]+)?)?)|)[^>]*?(?:\.min)?\.js

Prototype (JavaScript Frameworks) Expand

Overall confidence: 100%
Detected patterns

(?:prototype|protoaculous)(?:-([\d.]*[\d]))?.*\.js

AppNexus (Advertising Networks) Expand

Overall confidence: 100%
Detected patterns

adnxs\.(?:net|com)

DoubleClick for Publishers (DFP) (Advertising Networks) Expand

Overall confidence: 100%
Detected patterns

googletagservices\.com/tag/js/gpt(?:_mobile)?\.js

Facebook (Widgets) Expand

Overall confidence: 100%
Detected patterns

//connect\.facebook\.([a-z]+)/[^/]*/[a-z]*\.js

Google Analytics (Analytics) Expand

Overall confidence: 100%
Detected patterns

google-analytics\.com/(?:ga|urchin|analytics)\.js

Google Optimize (A/B Testing) Expand

Overall confidence: 100%
Detected patterns

googleoptimize\.com/optimize\.js

Google Tag Manager (Tag Managers) Expand

Overall confidence: 100%
Detected patterns

googletagmanager\.com/gtm\.js
googletagmanager\.com/gtag/js

Outbrain (Widgets) Expand

Overall confidence: 100%
Detected patterns

widgets\.outbrain\.com/outbrain\.js

Polyfill (JavaScript Libraries) Expand

Overall confidence: 100%
Detected patterns

/polyfill\.min\.js

Prebid (Advertising Networks) Expand

Overall confidence: 100%
Detected patterns

adnxs\.com/[^"]*(?:prebid|/pb\.js)

PubMatic (Advertising Networks) Expand

Overall confidence: 100%
Detected patterns

https?://[^/]*\.pubmatic\.com

Rubicon Project (Advertising Networks) Expand

Overall confidence: 100%
Detected patterns

https?://[^/]*\.rubiconproject\.com

Page Statistics

229
Requests

98 %
HTTPS

32 %
IPv6

54
Domains

83
Subdomains

73
IPs

9
Countries

3914 kB
Transfer

10911 kB
Size

40
Cookies

0 Outgoing links

These are links going to different origins than the main page.

Redirected requests

There were HTTP redirect chains for the following requests:

Request Chain 66

https://d35xxde4fgg0cx.cloudfront.net/assets/embedded.js HTTP 301
https://js.memberful.com/embed.js

Request Chain 94

https://sb.scorecardresearch.com/cs/7976662/beacon.js HTTP 302
https://sb.scorecardresearch.com/internal-cs/default/beacon.js

Request Chain 186

https://capi.connatix.com/core/sync HTTP 302
https://capi.connatix.com/core/sync?tier=1&final=true&UserScoringType=Enabled&ImplementationType=0

229 HTTP transactions
0 data transactions

Method
Protocol Status Resource
Path Size
x-fer Time
Latency Type
MIME-Type IP
Location

GET
H2 200 Primary Request robots-txt-ai-text-file-web-crawlers-spiders Show response
www.theverge.com/24067997/ 271 KB
34 KB 128ms
97ms Document
text/html 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL

https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

151.101.129.91 , United States, ASN54113 (FASTLY, US),

Reverse DNS

Software

Resource Hash

2da2864bac6604dd9bf39ff9355424bbfeaf76d1941c68899cce34f20419719f

Security Headers

Name	Value
Content-Security-Policy	frame-ancestors https://voxmedia.stories.usechorus.com 'self'

Request headers

Upgrade-Insecure-Requests: 1
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
accept-language: de-DE,de;q=0.9
sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-mobile: ?0
sec-ch-ua-platform: "Win32"

Response headers

accept-ranges: bytes
age: 1147
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
cache-control: no-store,private
content-encoding: br
content-length: 34538
content-security-policy: frame-ancestors https://voxmedia.stories.usechorus.com 'self'
content-type: text/html; charset=utf-8
date: Fri, 05 Apr 2024 16:07:29 GMT
etag: "zqumskphj05x25"
vary: Accept-Encoding, X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
via: 1.1 varnish, 1.1 varnish
x-cache: HIT, MISS
x-cache-hits: 3, 0
x-served-by: cache-iad-kiad7000041-IAD, cache-fra-eddf8230086-FRA
x-timer: S1712333249.131976,VS0,VE89

GET
H2 200 246992_AI_at_Work_TXT_FILE_ECarter.png
duet-cdn.vox-cdn.com/thumbor/0x0:2040x1360/1920x1920/filters:focal(1020x680:1021x681):format(webp)/cdn.vox-cdn.com/uploads/chorus_asset/file/25282612/ 25 KB
26 KB 65ms
46ms Image
image/webp 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://duet-cdn.vox-cdn.com/thumbor/0x0:2040x1360/1920x1920/filters:focal(1020x680:1021x681):format(webp)/cdn.vox-cdn.com/uploads/chorus_asset/file/25282612/246992_AI_at_Work_TXT_FILE_ECarter.png

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

151.101.129.91 , United States, ASN54113 (FASTLY, US),

Reverse DNS

Software

Thumbor/6.7.0 /

Resource Hash

c58a61e32be78b4f3a47d9e4eec3af2c6d03c35ae74217f3006a4f7d2ee7c272

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

x-cache-hits: 8, 0
date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish, 1.1 varnish
strict-transport-security: max-age=31536000
age: 2078538
x-cache: HIT, HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 25980
x-served-by: cache-iad-kjyo7100118-IAD, cache-fra-eddf8230086-FRA
server: Thumbor/6.7.0
x-timer: S1712333249.277929,VS0,VE2
etag: "65a33e75f4e486be0dc509a75c92782e5dd1146d"
content-type: image/webp
access-control-allow-origin: *
cache-control: max-age=315576000,public
accept-ranges: bytes
expires: Tue, 14 Feb 2034 02:00:40 GMT

GET
H2 200 246992_AI_at_Work_TXT_FILE_ECarter.png
duet-cdn.vox-cdn.com/thumbor/0x0:2040x1360/1200x800/filters:focal(1020x680:1021x681):format(webp)/cdn.vox-cdn.com/uploads/chorus_asset/file/25282612/ 13 KB
14 KB 64ms
46ms Image
image/webp 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://duet-cdn.vox-cdn.com/thumbor/0x0:2040x1360/1200x800/filters:focal(1020x680:1021x681):format(webp)/cdn.vox-cdn.com/uploads/chorus_asset/file/25282612/246992_AI_at_Work_TXT_FILE_ECarter.png

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

151.101.129.91 , United States, ASN54113 (FASTLY, US),

Reverse DNS

Software

Thumbor/6.7.0 /

Resource Hash

640a7ef5bbeb843975b3d11016ce2bc57c9d43deee3022feb047e3d4802e90c9

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

x-cache-hits: 1, 0
date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish, 1.1 varnish
strict-transport-security: max-age=31536000
age: 206078
x-cache: HIT, HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 13720
x-served-by: cache-iad-kiad7000107-IAD, cache-fra-eddf8230086-FRA
server: Thumbor/6.7.0
x-timer: S1712333249.278837,VS0,VE1
etag: "209ea532f0fd3fb7a6077e16ddd8ce7d83dcffdd"
content-type: image/webp
access-control-allow-origin: *
cache-control: max-age=315576000,public
accept-ranges: bytes
expires: Mon, 13 Feb 2034 09:30:32 GMT

GET
H2 200 b61d461e2e1d8573-s.p.woff2
www.theverge.com/_next/static/media/ 60 KB
60 KB 21ms
5ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/b61d461e2e1d8573-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: e4b608f3ab4953e6da65353db61acc5d27b1a5bb8d4d1f202edd33e3db7d013a

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: 9K62YQHCPM1GH7TN
age: 652160
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 61164
x-amz-id-2: t3kEDrxgwJu/5pZ3bHIVSzKIbhF7X6NTwYsUPNTQ2t7XjzfeAOjiI4JTARyARbgoFzTx4pbCHlc=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Mon, 24 Jun 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Mon, 25 Mar 2024 20:47:28 GMT
server: AmazonS3
x-timer: S1712333249.268190,VS0,VE0
etag: "a91f1a6cfad9e0b3fd7f10db57a4871d"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 111

GET
H2 200 af51b8e80b7e5b97-s.p.woff2
www.theverge.com/_next/static/media/ 61 KB
61 KB 21ms
6ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/af51b8e80b7e5b97-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: f3beba70bdc28cec09d67181837a74dbaba0696a02e96a126e45919965a4ec27

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: 68ZK4SMAWK22NS6J
age: 213076
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 62088
x-amz-id-2: piC86IeXrq73RGTvUxuJ8gK/RKox74IhM1Qn9+ZArHcqg8v0Cvw7RvRYYOKM0gwg9nst8g09NEQ=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Thu, 31 Aug 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Thu, 01 Jun 2023 22:11:07 GMT
server: AmazonS3
x-timer: S1712333249.268822,VS0,VE0
etag: "c82fd06fa7d1bdee48b9740a7dfb7fe3"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 107

GET
H2 200 4c161430243654b9-s.p.woff2
www.theverge.com/_next/static/media/ 62 KB
62 KB 28ms
14ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/4c161430243654b9-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 890d645e6cd19d98974029eb8e82ee4da4524143ddd076b328c9361197ad11ca

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: QJ5MMQPM59X6V82X
age: 1940999
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 63416
x-amz-id-2: UzE7zxZEEW7W6mbZgkcIm+uknBAbC8SdYw8tArkVhFiUmuyYUjppjEBYo/GbYUCEQx9Vhc1sG24=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Tue, 14 Nov 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Tue, 15 Aug 2023 19:57:12 GMT
server: AmazonS3
x-timer: S1712333249.269305,VS0,VE0
etag: "9f3113c23553b46657b711677f75b3c6"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 107

GET
H2 200 faa4a7ab7fe4ff34-s.p.woff2
www.theverge.com/_next/static/media/ 62 KB
62 KB 20ms
6ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/faa4a7ab7fe4ff34-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 2b53e8eda1adcbcc9643b097216113950216db082803e2d603ea9f2598f274c8

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: VD70W6WKQ08HW498
age: 1403546
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 63100
x-amz-id-2: h+EfXrRXJAz2Ik0Ff920hn0fQ8UZakTWhlCk3NFaLYenzZZQpXVG2zMpfnO5cuLY9TATJomgi7Y=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Fri, 15 Dec 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Fri, 15 Sep 2023 15:27:24 GMT
server: AmazonS3
x-timer: S1712333249.268827,VS0,VE0
etag: "a5ad656303cebd309e3bd114313fff91"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 106

GET
H2 200 e0d450417c4fcdb2-s.p.woff2
www.theverge.com/_next/static/media/ 42 KB
43 KB 28ms
15ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/e0d450417c4fcdb2-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: da564905b9c2a54a99fd4ab7255ecfa6a5f401b9088915d54b4c90a478f3eb2d

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: 07KSWAY1S0NX3PVN
age: 1314250
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 43280
x-amz-id-2: tv1jvE3jdfAynou/6m1uBch26kJlGGg8tgE8fUJ58vgeLKSTqezFEsVyIFgwYLtgDj8vZvS8O3E=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Tue, 24 Oct 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Tue, 25 Jul 2023 00:25:06 GMT
server: AmazonS3
x-timer: S1712333249.269290,VS0,VE0
etag: "10415f22ab060ebaeb806a1beb2d6d18"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 109

GET
H2 200 c6806ee6b9a6284f-s.p.woff2
www.theverge.com/_next/static/media/ 38 KB
39 KB 20ms
7ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/c6806ee6b9a6284f-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: dc211aeaa9d2304a65fd072a8ac1d57c8ff5098ea0dbfcf848aa1b352a4352ac

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: 7XKC8WKF1X9G5N1M
age: 2124479
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 39058
x-amz-id-2: 5xZx8JJLKWVOOK+ag9HxgCOExiZoRlt9ydc7poWaHW3IWYQTDD79K/qGcORWsq/TjOHCokVIPtw=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Mon, 13 Nov 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Mon, 14 Aug 2023 22:01:17 GMT
server: AmazonS3
x-timer: S1712333249.268780,VS0,VE0
etag: "4790c8057b6abcc48f592a2dc4e26a7a"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 109

GET
H2 200 167de315d6f8820c-s.p.woff2
www.theverge.com/_next/static/media/ 30 KB
30 KB 36ms
23ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/167de315d6f8820c-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: efd79635ac9b4234b5236d40f7aa147e1b28e565d4845d1ffbed7b7e72b96067

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: FWC5NGXZSCJJDGN5
age: 835456
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 30288
x-amz-id-2: iiDzy05i2nwNM1TSXu+pbbdOUN6XpFrHztDDqBwNXl/tmJ7C4/SQikxzkiU30lbyoI7PIoF2StI=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Mon, 27 Nov 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Mon, 28 Aug 2023 18:19:28 GMT
server: AmazonS3
x-timer: S1712333249.269614,VS0,VE0
etag: "d446d00e9ddd131d9107319123bfed0e"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 114

GET
H2 200 c32d4f9e62509b70-s.p.woff2
www.theverge.com/_next/static/media/ 31 KB
31 KB 28ms
15ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/c32d4f9e62509b70-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: ba4530f1d5cdb22f1fe206dc780e62000253665d9b2bb0974695aebd82f7a5d9

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: 6RHF970WXP66C1QZ
age: 194190
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 31272
x-amz-id-2: wTwMCIlJaQIbuHzu28Uq1fcCTMJinMpx2/nioS6f64tHj75q54NHjw6ir0PZVV6gWtzoaCvAdlk=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Mon, 24 Jun 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Mon, 25 Mar 2024 20:47:28 GMT
server: AmazonS3
x-timer: S1712333249.269594,VS0,VE0
etag: "0fd9ef82343eeaf048cf7973ec737aa8"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 104

GET
H2 200 8314bd48671746e7-s.p.woff2
www.theverge.com/_next/static/media/ 30 KB
31 KB 25ms
13ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/8314bd48671746e7-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: f2087eba07b2ed3cdaed421506744188ea861e7f773cfa941be00e043715c3e4

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: S8RWE8Y303MV2GVP
age: 2026921
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 30864
x-amz-id-2: 6Ly2iPpnRsVOzakS1h7axnn6hPp172O1l3zQpvlzwWb1A4VUiK4wzoNyerOHWh9OSz50NqFhL/8=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Fri, 08 Dec 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Fri, 08 Sep 2023 20:22:42 GMT
server: AmazonS3
x-timer: S1712333249.269504,VS0,VE0
etag: "f4ddc24ff215e947b707db50409a8177"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 111

GET
H2 200 1acdcb23bd60cdf8-s.p.woff2
www.theverge.com/_next/static/media/ 31 KB
32 KB 36ms
24ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/1acdcb23bd60cdf8-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: f0b9d890208cf1b7529a510707c53fa5f7ee153ef95718756a970f05cc428287

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: R7YTDMZH4KHB4SBZ
age: 39969
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 32136
x-amz-id-2: Q55jaTWS12E5ANnOsjIeN8oWtZuAFmx4XCijfwEdEPEvNi+3/c5DBzFjNcY0xr6p+rqigVFRnj4=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Tue, 24 Oct 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Tue, 25 Jul 2023 20:15:40 GMT
server: AmazonS3
x-timer: S1712333249.270271,VS0,VE0
etag: "52a883d8bbb3cb1e0302cc2878b3e8eb"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 114

GET
H2 200 e334064d2786be51-s.p.woff2
www.theverge.com/_next/static/media/ 30 KB
31 KB 58ms
46ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/e334064d2786be51-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: dc757f26a467bd808d0c219455878a95317b28474ee415798fb4c166b31a8c12

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: N7H7RA1RK4GTZ2QN
age: 1937918
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 31216
x-amz-id-2: kvi4bVdnLj3RW5KKLKLmeRVUbtBfvmCsvej9BsZqi7IsOf/1aWkTfqMCKMM0ZiB9EIyhds4axE8=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Wed, 01 Nov 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Wed, 02 Aug 2023 14:58:39 GMT
server: AmazonS3
x-timer: S1712333249.277921,VS0,VE0
etag: "e93b99db8951dbdd35a6d3e41a0acb7e"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 109

GET
H2 200 dbe24bfb7e9bcd79-s.p.woff2
www.theverge.com/_next/static/media/ 32 KB
32 KB 37ms
25ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/dbe24bfb7e9bcd79-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 9803cd4df168f908d4bc5d9749180b33af2cc649325bdaba7a51fbbdfcd036a6

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: 77NNPCT4JARE7KY4
age: 297685
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 32492
x-amz-id-2: GeC53d+A6KeJg2uBtOZELCAyH3OCrj/U/yxZDAWgk3yCf+b8oCmY8OMY8n53MxvWTlXTtcCAs7g=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Thu, 28 Sep 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Thu, 29 Jun 2023 16:00:15 GMT
server: AmazonS3
x-timer: S1712333249.276903,VS0,VE0
etag: "9e08c69329122f7bc9173e3b744cca1c"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 115

GET
H2 200 caa65695070c604f-s.p.woff2
www.theverge.com/_next/static/media/ 35 KB
35 KB 44ms
32ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/caa65695070c604f-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 888797a9c9a7b048514405e6012888d8cc4f3aba71c1f48f19415d680733379b

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: MKVH79FMXPCJBC70
age: 798091
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 35560
x-amz-id-2: Hj6R1FnsAx5so1iSr411rMAd8Hg4d66MPL+uHlRR4JrWRWhDP412hP4FGZHPX4GFIU1O6amaFkM=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Mon, 30 Oct 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Mon, 31 Jul 2023 17:38:07 GMT
server: AmazonS3
x-timer: S1712333249.277228,VS0,VE0
etag: "d22ee36835cec4a7c0e908123b1d7dc1"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 114

GET
H2 200 7f8638c9585902a6-s.p.woff2
www.theverge.com/_next/static/media/ 37 KB
37 KB 38ms
27ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/7f8638c9585902a6-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 4bea6800604a37c7b6d8fe66dd5e7d947cbafb6e3707fd7dd2a717682b14aef3

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: 77NMYB5NYPWHRA8W
age: 1512880
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 37384
x-amz-id-2: csyRokwpvhhJSz+kJd+s5Mz8UAifutM2fsoIiWc9Z2pCgXk6qLhCYmsswKa6jIrDYpqj8GUDeCY=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Thu, 28 Sep 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Thu, 29 Jun 2023 16:00:15 GMT
server: AmazonS3
x-timer: S1712333249.276769,VS0,VE0
etag: "e8dbf1956d96a2eeaf7577008522a48e"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 112

GET
H2 200 d2cd5f6e542bad4c-s.p.woff2
www.theverge.com/_next/static/media/ 29 KB
29 KB 39ms
28ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/d2cd5f6e542bad4c-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: a83431825ec58cce1345a5d293df9474beda786a3525323eed1b1e19a15fdd9a

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: AMXMQNR7RSKG43MZ
age: 209618
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 29504
x-amz-id-2: j2Ywm8bEItQn+L8R0lo/xUZ8Dk6/IahBsvUx9enPjw3cCrcXau45y0GMq4GO/dJlUXHt3UMEUDg=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Mon, 27 Nov 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Mon, 28 Aug 2023 18:19:28 GMT
server: AmazonS3
x-timer: S1712333249.276360,VS0,VE0
etag: "35f48e820b8f2223f685cb5b825291e7"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 109

GET
H2 200 857aa1a339c7fe20-s.p.woff2
www.theverge.com/_next/static/media/ 30 KB
30 KB 37ms
26ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/857aa1a339c7fe20-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 1b20b46a4104acb0c120279fc766b735d3a889db7f459062f1453bd71fa06bd1

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: 91JF0TMZTNSW18D8
age: 730764
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 30384
x-amz-id-2: CS8QrzLUk1bKAi277AoUWcAyakYqRh5Y8WEUB0oLlgLclLnpcNjD1XNz78Hk0V7I/9zdC2a7xKU=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Mon, 27 Nov 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Mon, 28 Aug 2023 18:19:28 GMT
server: AmazonS3
x-timer: S1712333249.276755,VS0,VE0
etag: "b9dc80b5cb38668c0da9003d81fbe41a"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 112

GET
H2 200 516340c748fee9da-s.p.woff2
www.theverge.com/_next/static/media/ 29 KB
30 KB 42ms
32ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/516340c748fee9da-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 8bbbca8d193c13abacd58d5711b339fe70db245d50fe532707a999d02a1745ca

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: XTEQ32YFQ0S1546K
age: 47368
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 30144
x-amz-id-2: ymmU5JRyPpZBhlug+tMJMXI+Ecv6UToVcMunLiRG+jCUwLo/Mm78EU8j2sVQ7LetG196iyf20rA=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Tue, 02 Jan 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Tue, 03 Oct 2023 16:42:08 GMT
server: AmazonS3
x-timer: S1712333249.277358,VS0,VE0
etag: "f3dbc6774144347966d85e8973464f3b"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 108

GET
H2 200 afa7a955b67174eb-s.p.woff2
www.theverge.com/_next/static/media/ 30 KB
30 KB 42ms
32ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/afa7a955b67174eb-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 44da173d8bbcbdc1271e7a16861ab0ca8cf2889e994b1ef348594bb94c1665c9

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: 4CQT796F3BN8SXKJ
age: 885408
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 30628
x-amz-id-2: xeOAWMXck0YTsg5dAQ7pAEXRGta4j/YH8svUiAOhc3/F8l6x38uJR6Kq23wbsdQvLXiEuzK0rNw=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Mon, 27 Nov 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Mon, 28 Aug 2023 18:19:28 GMT
server: AmazonS3
x-timer: S1712333249.277342,VS0,VE0
etag: "851bca6e831f068a0e36464467432b63"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 113

GET
H2 200 d2ddd5a6c0493c79-s.p.woff2
www.theverge.com/_next/static/media/ 31 KB
32 KB 38ms
29ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/d2ddd5a6c0493c79-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 589000ad6b7c3b2c9f2b9ba72201c6cf2769bd4b45135e934666ed1ced443098

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: 7AA9HJFR0D42FQFM
age: 2127357
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 31708
x-amz-id-2: 080e9GyAAxYo6RAYi53U1bQrdsPTA0Ea91+ylXqMpFZ3fYWJYu7ZzIi1jh7krQXk1MalzQDV5pQ=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Thu, 31 Aug 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Thu, 01 Jun 2023 22:11:07 GMT
server: AmazonS3
x-timer: S1712333249.276329,VS0,VE0
etag: "73a25034693850b3e29f78bfd2df9b68"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 108

GET
H2 200 70754f98ca969379-s.p.woff2
www.theverge.com/_next/static/media/ 31 KB
31 KB 39ms
30ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/70754f98ca969379-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 3c55607e14730bc2245dd9e38ed728a1078892e52f00026bb33e0dbfe537c048

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: JYQD1VDFKZFV46A9
age: 135144
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 31296
x-amz-id-2: krzMKfEL3jtqPBL34gmPIGCspcqf27+4oiXnBkYH/64T3vQYh3b9+Cj6tkkOBODCKQpL19cnSF4=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Thu, 28 Sep 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Thu, 29 Jun 2023 16:00:15 GMT
server: AmazonS3
x-timer: S1712333249.276258,VS0,VE0
etag: "349ee56928cb8c8c4ed8ea58e4d749bf"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 111

GET
H2 200 60369a8d37d9d5b8-s.p.woff2
www.theverge.com/_next/static/media/ 35 KB
35 KB 39ms
31ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/60369a8d37d9d5b8-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 1cd096a8e75476195113ec5bc0cd3457c3d8f87f976f14c551127a55b6e019e4

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: MQB1VRYR69MTDAAQ
age: 2648504
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 35416
x-amz-id-2: sC71wmHORSJ6buHPkEn0XdZG/ifi02J9ZPCaxCo5x4wk78NjPocEXBBvyoknWiRBY/p2YPjpyF8=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Mon, 27 Nov 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Mon, 28 Aug 2023 18:19:28 GMT
server: AmazonS3
x-timer: S1712333249.276256,VS0,VE0
etag: "5016a3fa0c151f5cd4b5e2ad77c354af"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 108

GET
H2 200 96fec850ad729c00-s.p.woff2
www.theverge.com/_next/static/media/ 36 KB
36 KB 39ms
31ms Font
binary/octet-stream 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/media/96fec850ad729c00-s.p.woff2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 7e84004cb9a09bdf399c0aadb573f151b739141dd8a2a082d042c567c85c2501

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-amz-request-id: 2V6QA3FEWYNYBB78
age: 2731187
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 36656
x-amz-id-2: TOGXhnfpnDaqbG7Wfx5gXmco4sRejjOLEimhkS/DDo/qFiuioCsmZ4QDccpg5R1+cfobvzqqc9s=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Thu, 28 Sep 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Thu, 29 Jun 2023 16:00:15 GMT
server: AmazonS3
x-timer: S1712333249.276213,VS0,VE0
etag: "c23a13d6eec8f9b98706e0cd372af2b7"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
content-type: binary/octet-stream
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 111

GET
H2 200 78c96ab956e7dd1d.css
www.theverge.com/_next/static/css/ 109 KB
20 KB 32ms
26ms Stylesheet
text/css 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/css/78c96ab956e7dd1d.css
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: e2d7f0397e7f14b8d24b1957c023b4bda2c3529107bc23cf42ac9c44f3c42880

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: WJM2401X3QNHSQ9S
age: 736554
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 20303
x-amz-id-2: 7KZxRIGla7hgUxYDbvuSZjorBZCtMnW38vui4QbldoWni2f7FRUx7vi3mMyQVvqrf5qkhkZksKc=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Mon, 17 Jun 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Mon, 18 Mar 2024 17:34:20 GMT
server: AmazonS3
x-timer: S1712333249.276770,VS0,VE0
etag: "ecfd45d3dd6ff5e219140cf6c8d3f5ad"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: text/css
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 117

GET
H2 200 df212bc532bc2860.css
www.theverge.com/_next/static/css/ 4 KB
2 KB 52ms
46ms Stylesheet
text/css 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/css/df212bc532bc2860.css
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 1f9b6c01922110e0aa655584c7ddbcfd1e9c09b78bf30687af6901be82a1efe6

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: Y9D7VMSC5MT9J5M9
age: 1780365
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 1176
x-amz-id-2: zUF/2qdup3uiLyaf3W2v8c3x6Pofix8DXf6jKN2mBrJw/L/01FaNlteyDhg1Xz1To98U9ssGn0o=
x-served-by: cache-fra-eddf8230086-FRA
x-amz-expiration: expiry-date="Fri, 17 May 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Fri, 16 Feb 2024 15:30:19 GMT
server: AmazonS3
x-timer: S1712333249.277671,VS0,VE0
etag: "ef4958ebaffb9a42c3692bbc51a5bd4e"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: text/css
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 99

GET
H2 200 7470.js Show response
micro.rubiconproject.com/prebid/dynamic/ 675 KB
177 KB 144ms
46ms Script
text/javascript 104.64.126.246
AKAMAI-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://micro.rubiconproject.com/prebid/dynamic/7470.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 104.64.126.246 Prague, Czech Republic, ASN16625 (AKAMAI-AS, US),
Reverse DNS: a104-64-126-246.deploy.static.akamaitechnologies.com
Software: Apache/2.4.37 (rocky) OpenSSL/1.1.1k /
Resource Hash: 422710db345d658f032dc1c71f6aade54bb77bbb0c5e73fccbf55faf3bb99957

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: gzip
server: Apache/2.4.37 (rocky) OpenSSL/1.1.1k
vary: accept-encoding, referer
edge-cache-tag: prod-prebid-7470_Vox_Verge_Prebid_DM_optimalBidderOrder_exp.19.js
content-type: text/javascript;charset=UTF-8
cache-control: public, must-revalidate, max-age=14400
content-length: 181287
expires: Sat, 06 Apr 2024 15:19:32 GMT

GET
H2 200 apstag.js Show response
c.amazon-adsystem.com/aax2/ 298 KB
74 KB 49ms
4ms Script
application/javascript 108.138.6.136
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c.amazon-adsystem.com/aax2/apstag.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 108.138.6.136 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-108-138-6-136.fra56.r.cloudfront.net
Software: AmazonS3 /
Resource Hash: 0afdd055573d02ec33ed9ccfd582c5aa34d4d997ff549742e67f6a4c566d466a

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 15:18:53 GMT
content-encoding: gzip
via: 1.1 bf791e1829ff18782cd9837fbba03616.cloudfront.net (CloudFront), 1.1 e016ea20838aeed1d878a5244c9e2552.cloudfront.net (CloudFront)
last-modified: Mon, 25 Mar 2024 17:06:16 GMT
server: AmazonS3
x-amz-cf-pop: FRA60-P1, FRA56-P6
age: 2917
etag: W/"4f9091ca1740c69dd8d2e945b57ade3e"
x-amz-server-side-encryption: AES256
vary: Accept-Encoding
x-cache: Hit from cloudfront
content-type: application/javascript
cache-control: max-age=3600
x-amz-cf-id: 6SyoeZeL2pDZyB9drnRxaORhFZ1rolPW6V2lMsKXNR-F2wmQspKAbQ==

GET
H2 200 gpt.js Show response
www.googletagservices.com/tag/js/ 91 KB
29 KB 96ms
44ms Script
text/javascript 2a00:1450:4001:81d::2002
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://www.googletagservices.com/tag/js/gpt.js

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:81d::2002 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

cafe /

Resource Hash

bd52adb9be2bf9382f3710227409b2e13bcfd5751e170f8dc653c8ab5b102db8

Security Headers

Name	Value
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
x-content-type-options: nosniff
p3p: policyref="https://www.googleadservices.com/pagead/p3p.xml", CP="NOI DEV PSA PSD IVA IVD OTP OUR OTR IND OTC"
cross-origin-resource-policy: cross-origin
content-disposition: attachment; filename="f.txt"
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 29312
x-xss-protection: 0
server: cafe
etag: 386 / 19818 / 31082465 / config-hash: 9138469707559382745
vary: Accept-Encoding
content-type: text/javascript; charset=UTF-8
access-control-allow-origin: *
cache-control: private, max-age=900, stale-while-revalidate=3600
timing-allow-origin: *
expires: Fri, 05 Apr 2024 16:07:29 GMT

GET
H2 200 concert_ads.js Show response
cdn.concert.io/lib/concert-ads/v2-latest/ 436 KB
120 KB 51ms
6ms Script
text/javascript 151.101.1.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://cdn.concert.io/lib/concert-ads/v2-latest/concert_ads.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.1.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 48781768efb0eedf8395965b1b24e5276867988701cefcaa0dea8b34b7494efc

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: gzip
via: 1.1 varnish
x-amz-request-id: 73Z20E2TB3WHCPQG
age: 248578
x-amz-server-side-encryption: AES256
x-cache: HIT
x-amz-meta-surrogate-control: public, max-age=2592000, stale-if-error=86400, stale-while-revalidate=30
x-amz-meta-surrogate-key: concert-delivery-system
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 122578
x-amz-id-2: 5denU6pe8JuIIcOY+vzBUNDvl615PSnOAdSB1B9IzYCrMt4dflPKeWYNxx4uSj3HVwrA7vG3FGl5q4YbNeRTkiml+li71Q0NL/jTJNInziU=
x-served-by: cache-fra-eddf8230107-FRA
last-modified: Tue, 02 Apr 2024 19:04:30 GMT
server: AmazonS3
x-timer: S1712333249.349325,VS0,VE0
etag: "e1aa131812b039ddde18d45bc58d76ad"
vary: Accept-Encoding
content-type: text/javascript; charset=utf-8
access-control-allow-origin: *
cache-control: public, max-age=60
accept-ranges: bytes
x-cache-hits: 3179

GET
H2 200 concert-concierge.2.10.1.min.js Show response
cdn.concert.io/lib/ 50 KB
17 KB 49ms
4ms Script
text/javascript 151.101.1.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://cdn.concert.io/lib/concert-concierge.2.10.1.min.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 151.101.1.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 5125918873d03e6a8253cc71ed0b23fe4f42d2e3b7a78e9c20ba457f7f810d22

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: gzip
via: 1.1 varnish
x-amz-request-id: FV4T0XSTTKBWZ2YS
age: 2042585
x-cache: HIT
x-amz-meta-surrogate-control: public, max-age=2592000, stale-if-error=86400, stale-while-revalidate=30
x-amz-meta-surrogate-key: concert-delivery-system
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 16797
x-amz-id-2: 5DNFkrVPwucrc8sL+zyv6REjkXH8v0dz+5SMFQXaatbLTpenuj01DX0ErIi4SPjRdZ1RwZ/Mlr4=
x-served-by: cache-fra-eddf8230107-FRA
last-modified: Tue, 22 Nov 2022 14:35:19 GMT
server: AmazonS3
x-timer: S1712333249.349198,VS0,VE0
etag: "bc158ab2817555376b7f49e451f5a6d0"
content-type: text/javascript; charset=utf-8
access-control-allow-origin: *
cache-control: public, max-age=86400
accept-ranges: bytes
x-cache-hits: 8172

GET
H3 200 pub.js Show response
pub.doubleverify.com/dvtag/21236410/DV464041/ 62 KB
20 KB 77ms
33ms Script
text/javascript 2606:4700::6812:a6e0
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL

https://pub.doubleverify.com/dvtag/21236410/DV464041/pub.js

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Security

QUIC, , AES_128_GCM

Server

2606:4700::6812:a6e0 , United States, ASN13335 (CLOUDFLARENET, US),

Reverse DNS

Software

cloudflare /

Resource Hash

994ca135d53ac6723507c3feed7a2b4b342826c22043ed050a4cc098427e18c1

Security Headers

Name	Value
Content-Security-Policy	frame-ancestors 'self'
Strict-Transport-Security	max-age=31536000; includeSubDomains
X-Frame-Options	SAMEORIGIN

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
strict-transport-security: max-age=31536000; includeSubDomains
content-encoding: br
content-security-policy: frame-ancestors 'self'
server: cloudflare
vary: Accept-Encoding
x-frame-options: SAMEORIGIN
content-type: text/javascript;charset=UTF-8
access-control-allow-origin: *
access-control-expose-headers: Server-Timing, Cf-Ray
cache-control: public, max-age=900, stale-while-revalidate=3600
access-control-allow-credentials: true
timing-allow-origin: *
cf-ray: 86faca987f39363b-FRA
alt-svc: h3=":443"; ma=86400

GET
H2 200 polyfill.min.js Show response
polyfill.io/v3/ 104 B
383 B 182ms
34ms Script
text/javascript 2606:4700:3110::6812:341b
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://polyfill.io/v3/polyfill.min.js?features=AbortController,Array.prototype.entries,Array.prototype.keys,Array.prototype.sort,Array.prototype.values,ArrayBuffer,ArrayBuffer.isView,AudioContext,Blob,console,console.error,console.log,console.warn,CustomEvent,DataView,document,Document,DocumentFragment,DocumentFragment.prototype.append,DOMRect,DOMTokenList,DOMTokenList.prototype.forEach,DOMTokenList.prototype.replace,Element,Element.prototype.after,Element.prototype.append,Element.prototype.before,Element.prototype.classList,Element.prototype.closest,Element.prototype.matches,Element.prototype.previousElementSibling,Element.prototype.remove,Element.prototype.scroll,Element.prototype.scrollIntoView,Event,EventSource,getComputedStyle,globalThis,HTMLDocument,HTMLPictureElement,HTMLTemplateElement,IntersectionObserver,IntersectionObserverEntry,Intl,Intl.DateTimeFormat,Intl.NumberFormat,Intl.RelativeTimeFormat,JSON,location.origin,Math.clz32,Math.imul,Math.sign,modernizr:es6string,MutationObserver,Node.prototype.contains,NodeList.prototype.forEach,Object.getOwnPropertySymbols,Object.isExtensible,Object.isFrozen,Object.preventExtensions,Object.setPrototypeOf,queueMicrotask,Reflect.construct,Reflect.defineProperty,Reflect.set,RegExp.prototype.flags,requestAnimationFrame,ResizeObserver,String.prototype.link,String.prototype.normalize,String.prototype.sub,Symbol.for,Symbol.iterator,Symbol.prototype.description,Symbol.toPrimitive,Symbol.toStringTag,TextDecoder,TextEncoder,Uint8Array,Window,XMLHttpRequest,Intl.RelativeTimeFormat,Intl.RelativeTimeFormat.~locale.en
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2606:4700:3110::6812:341b , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 6c68769e8470ce89a0f2270529a5d47db00917e3ef9df946dca202098f09d0a2

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: gzip
cf-cache-status: HIT
last-modified: Thu, 14 Mar 2024 15:00:20 GMT
server: cloudflare
age: 1904829
vary: Accept-Encoding, User-Agent
access-control-allow-methods: GET,HEAD,OPTIONS
content-type: text/javascript; charset=utf-8
access-control-allow-origin: *
cache-control: public, max-age=14400
cf-ray: 86faca9929585ad7-VIE
expires: Fri, 05 Apr 2024 20:07:29 GMT

GET
H3 200 webpack-c376b9c42b10a4ef.js Show response
www.theverge.com/_next/static/chunks/ 5 KB
3 KB 16ms
11ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/webpack-c376b9c42b10a4ef.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 1f3f985cba0434b27db683698eb8b95ffbeb9de057865268b55dd51b567ce6e4

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: 7V87KBR2QSN4RR4D
age: 1417515
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 2295
x-amz-id-2: Ktt18nogqdTSUC0mkbFqGME3cYDPapAz7r1Jb2aMsJ2tNjreDwpuMcjLoChvVmy/p7bh5aDwuk8=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Mon, 17 Jun 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Mon, 18 Mar 2024 17:34:20 GMT
server: AmazonS3
x-timer: S1712333249.313926,VS0,VE0
etag: "289427ef9c03baeb943466b741b6c48b"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 154

GET
H3 200 framework-1d2b8554342c6a75.js Show response
www.theverge.com/_next/static/chunks/ 138 KB
46 KB 17ms
11ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/framework-1d2b8554342c6a75.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 337070c9ec6e978d98b76e4ae93576aabcaee891df19e9e393dbbc7bb43baea7

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: NS6FE2254PB0G94H
age: 903155
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 46646
x-amz-id-2: cPOLx2nlE9dfOd+viQ7mHSkqYIFwHndat/vQ1ez5BjwYU4lfHwb/INaneqoVzcx1XaducmF4UL8=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Tue, 31 Oct 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Tue, 01 Aug 2023 21:32:53 GMT
server: AmazonS3
x-timer: S1712333249.314376,VS0,VE0
etag: "2df6a67bb2f82d09889d56d71f039fa4"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 426

GET
H3 200 main-a19b11f4c6f53406.js Show response
www.theverge.com/_next/static/chunks/ 117 KB
35 KB 28ms
22ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/main-a19b11f4c6f53406.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 37ee9c33d5b941f4d78f7aa9bbb2abc9b734519f80d0acdf696145c99b41a16a

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: GZ2VEX1B5ZAXB87V
age: 2035873
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 35478
x-amz-id-2: +q/hcQKOKxpn6+IjopfhgeD0aknM+/CPUKukYtWiVN1d5vfwVXydN5RGvt9CHcSWXviNbaCJcCQ=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Fri, 08 Dec 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Fri, 08 Sep 2023 20:22:42 GMT
server: AmazonS3
x-timer: S1712333249.315052,VS0,VE0
etag: "58dbdf529be17a0522a5146ea1b40d70"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 280

GET
H3 200 _app-837ad8814bd2fa6a.js Show response
www.theverge.com/_next/static/chunks/pages/ 312 KB
104 KB 32ms
27ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: d61e4a8f703530a9c2c22216a8531f5ca6850dee608b6117493abe7c0407419b

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: B4262T9Y7MABY59N
age: 259091
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 106084
x-amz-id-2: uH6GX9GijT7560dGDqnFrt5ZyxnL5rsBkIQYM1Iv5iNH2gVos0DFk+YGeZ2A6EqSYKmmgKp3958=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Tue, 02 Jul 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Tue, 02 Apr 2024 16:08:16 GMT
server: AmazonS3
x-timer: S1712333249.314657,VS0,VE0
etag: "08dc8976ac0c590731fc4aece14d0e7d"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 463

GET
H3 200 7404-a1bc449f4440a25c.js Show response
www.theverge.com/_next/static/chunks/ 270 KB
77 KB 41ms
35ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/7404-a1bc449f4440a25c.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: b5d2f12da5c8464fdfe44f547d73ede31f3d31cf9ea77296fcece8114a593320

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: RC4DSHMHC5NFZV8E
age: 3743572
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 78444
x-amz-id-2: 9tntqoz/AmM6//ySjm1ACPEIZzhRxPZPw/WtvBo+ucdaDucSgawycPd0rps+vj74D/Ysmb3H/uo=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Tue, 02 Jan 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Tue, 03 Oct 2023 16:42:07 GMT
server: AmazonS3
x-timer: S1712333249.314651,VS0,VE0
etag: "104a8a0f71eae5ef2bf33204e34f9d23"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 439

GET
H3 200 5833-5ad65b6eeff676da.js Show response
www.theverge.com/_next/static/chunks/ 9 KB
4 KB 45ms
40ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/5833-5ad65b6eeff676da.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 3adca7885fd8a12cf46029ce311749c79f4c61d4ad37cd09e8a19ff78cb3c78e

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: 6QBGMH5AZDPZ172F
age: 652206
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 3645
x-amz-id-2: ebxOv9+4HRDiq+xjkF4sx6mZtF/s1jKf2VCUU6iWCG38mULpdeU+KQMIw3dksrPtV4E/abSXdZM=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Mon, 24 Jun 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Mon, 25 Mar 2024 20:47:28 GMT
server: AmazonS3
x-timer: S1712333249.315921,VS0,VE0
etag: "b7498eec94bdf8ac9e4590dd790332e6"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 147

GET
H3 200 4723-ec0bd4ab4f72e2c9.js Show response
www.theverge.com/_next/static/chunks/ 40 KB
14 KB 46ms
40ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/4723-ec0bd4ab4f72e2c9.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 1e90773659154acb549e8940a59b9550ed2dec593f8330ee9215a888e09947ba

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: R71DS3XTNSMD06Y5
age: 278885
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 14054
x-amz-id-2: +QYymA+4WvEohcchquoe+b4WH250dEDYV2c0nF/0rhmfNE1DgkxRSS0v2GjkTyQ2cOQCoVunBnQ=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Mon, 05 Feb 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Mon, 06 Nov 2023 21:50:36 GMT
server: AmazonS3
x-timer: S1712333249.316010,VS0,VE0
etag: "80f8581a56ddd07ebe593c22a83be09b"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 1853

GET
H3 200 5271-346d91caff9b1218.js Show response
www.theverge.com/_next/static/chunks/ 5 KB
3 KB 50ms
45ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/5271-346d91caff9b1218.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: b5c7801b11b8891b93d883ef8969cc1cee772b8d88f393eeeb6ffaeedb95961e

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: 0DCYH6C0PNM5TZRT
age: 1418417
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 1820
x-amz-id-2: m/9Rz9k3/xQDTp4ePEGvGPMZWEDnXtV2W4wZao2L55WnCHFomrtBmDSKHbS7x+Eq7jeotUIGb/8=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Fri, 15 Dec 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Fri, 15 Sep 2023 15:27:23 GMT
server: AmazonS3
x-timer: S1712333249.315561,VS0,VE0
etag: "2e56846b3744ad506235eba88ff4497f"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 154

GET
H3 200 3882-4e711a09aa4476ce.js Show response
www.theverge.com/_next/static/chunks/ 9 KB
5 KB 51ms
45ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/3882-4e711a09aa4476ce.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 95a6a7a3afc926ff989f37d14a67be9403cebc023a6ea8adee0441d3cb9aba25

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: RC48BGKGQSK1HZ40
age: 1940999
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 4050
x-amz-id-2: X7z10LSS2DoenA+C0k+OVzBPgXkzFdVZSynuagcpFnZ8A9SHNZOcZ4WpOy3xUOAmWi4saOkYDns=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Tue, 02 Jan 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Tue, 03 Oct 2023 16:42:07 GMT
server: AmazonS3
x-timer: S1712333249.315558,VS0,VE0
etag: "d5c230828c18a2baceda6ec4eceeb395"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 417

GET
H3 200 2156-c12acce1cfcae970.js Show response
www.theverge.com/_next/static/chunks/ 13 KB
6 KB 52ms
47ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/2156-c12acce1cfcae970.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: b96d2b33d9597778624fc74cd2b6772ef53f115f13ab35d42b6ca42ef9fdd2ca

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: RGPVYV06NEK4YYYS
age: 1341134
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 5256
x-amz-id-2: WH0i4P43DYIaz9Ob1f2G6vDy+S6PKbO8K8NypuAYlTFMtlkP9m4ZPDUwgev4qv4McUr/poOEHsg=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Thu, 13 Jun 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Thu, 14 Mar 2024 16:20:08 GMT
server: AmazonS3
x-timer: S1712333249.315540,VS0,VE0
etag: "c12be08c270e13b00b0394a0ba6866ca"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 277

GET
H3 200 996-f415a23a59cde4f1.js Show response
www.theverge.com/_next/static/chunks/ 12 KB
5 KB 52ms
47ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/996-f415a23a59cde4f1.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: e54b8ee1982fab63149c7dd288792a0919bfe858ac5c36cee53206859c892813

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: QYDBXJT5G65AX429
age: 752946
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 3945
x-amz-id-2: WWZO+bzGTHhoXkrFVYAfQLbZcmRmgDEorAMOWqJ0HKUaGV4hUO0vJMMrnhYP514Xy1BjOFU+PpI=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Fri, 22 Dec 2023 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Fri, 22 Sep 2023 17:36:13 GMT
server: AmazonS3
x-timer: S1712333249.315507,VS0,VE0
etag: "edad0324ea414f78f1610220f1bf0bcd"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 273

GET
H3 200 3494-79231dcbde5aec1f.js Show response
www.theverge.com/_next/static/chunks/ 13 KB
5 KB 52ms
47ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/3494-79231dcbde5aec1f.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: b251ec1f89a3144d5e00f5b813bbb531284a50bb3f48880118e69fb784062ad3

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: 2YK7QVSTJCD9F3CR
age: 216091
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 4468
x-amz-id-2: 1nsdyJotfnr2/l+VDZCriQUllcfFtELK9jyY/P+lxNFahdaLZIXMcL7pfGJksREjsiRYd7QcROk=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Fri, 17 May 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Fri, 16 Feb 2024 21:20:20 GMT
server: AmazonS3
x-timer: S1712333249.317405,VS0,VE0
etag: "fd81d024c5a1836ebf4e607f0eea5c14"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 255

GET
H3 200 5207-f1962b33fbbeca79.js Show response
www.theverge.com/_next/static/chunks/ 81 KB
18 KB 53ms
48ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/5207-f1962b33fbbeca79.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 4e14c1c026dc10618fad33f60c4e3483b3fea7cf03c69d69cc6a4f9454b54c72

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: P8P7D05XPK5ES0J6
age: 217743
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 17800
x-amz-id-2: y4K8Yqa7cdxhNosXIIBU23Pu+1kIfG+m+IUGf6QFStcsovSp0RkSQL9FGJfmFukRM/LgbMaoRRE=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Wed, 08 May 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Wed, 07 Feb 2024 21:56:10 GMT
server: AmazonS3
x-timer: S1712333249.317341,VS0,VE0
etag: "eebc2e3dc04ec8befacfb4c838dd1e3f"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 159

GET
H3 200 6276-ea6f3169216875c5.js Show response
www.theverge.com/_next/static/chunks/ 25 KB
7 KB 56ms
52ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/6276-ea6f3169216875c5.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 2d938572c4e9f49e56b0511a9d63c85616a275d2de872fb913978300e766facc

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: 9SWWWTMQBGG6DF5T
age: 651656
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 6607
x-amz-id-2: OC7zRUBDAEaov9Acfd7SHNzybPyRr16icCBF9s9K7xdu+pS2RaKLx+SHNea8ojWTjhMeycE8vnw=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Mon, 24 Jun 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Mon, 25 Mar 2024 20:47:28 GMT
server: AmazonS3
x-timer: S1712333249.317411,VS0,VE0
etag: "b6e8c23fdf3eba3f980cf50401480079"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 260

GET
H3 200 9549-99a115a465a16121.js Show response
www.theverge.com/_next/static/chunks/ 15 KB
5 KB 57ms
52ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/9549-99a115a465a16121.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: fc2929254ff94aaa1062683619792846e3be704b8d958a9ba9bb8b06949680a7

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: P8PEWJZN5RAZQ0YS
age: 301467
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 4613
x-amz-id-2: xZVPf1+4JG6rDmYUrqkygEXViwoucG0nWPX/Yx+0VQg4RIOZjY+aJRUkcKUPB+MT1R78yZLNhOQ=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Wed, 08 May 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Wed, 07 Feb 2024 21:56:11 GMT
server: AmazonS3
x-timer: S1712333249.317019,VS0,VE0
etag: "39acde12f591ee9aedddf5739a47a150"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 155

GET
H3 200 9546-25ba14b07b9f1957.js Show response
www.theverge.com/_next/static/chunks/ 10 KB
5 KB 58ms
53ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/9546-25ba14b07b9f1957.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: ae1643c852b5c2ebf992b43b71b286e452ef49b20b965260d677957e83e84805

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: D6MF58AHF8B9868Z
age: 1403546
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 4094
x-amz-id-2: /+dYusIWuuvBBhnVnnOmEhaLrhTTtHZ53RPFynvbUpPB2sqPLDWm2N52SxbNnPOqOQhFALdlcic=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Fri, 14 Jun 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Fri, 15 Mar 2024 13:20:28 GMT
server: AmazonS3
x-timer: S1712333249.316980,VS0,VE0
etag: "d8f6024a6240b7a1b5f2fe543c7fb65a"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 259

GET
H3 200 5055-f42044eaed03c6a4.js Show response
www.theverge.com/_next/static/chunks/ 22 KB
8 KB 58ms
53ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/5055-f42044eaed03c6a4.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: e161fcc4448cdfdb56de65d63e9216fae76f96f9684d6509a5d13b1e8f84571a

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: P8P3BREZ4CNJR66K
age: 2558923
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 7518
x-amz-id-2: mL3ohWlzwP8cIxMMmKuS4FbeTo+ESBwR5jAUz6YwR5DutRdD6ejkSc7DsM6z0GkNwpUdPrXAyyA=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Wed, 08 May 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Wed, 07 Feb 2024 21:56:11 GMT
server: AmazonS3
x-timer: S1712333249.316964,VS0,VE0
etag: "f41311918014026179ea8b2537b61d22"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 156

GET
H3 200 4640-33e62f43d3f652bf.js Show response
www.theverge.com/_next/static/chunks/ 9 KB
4 KB 58ms
54ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/4640-33e62f43d3f652bf.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 118c31a6f73280143f6a1091c1731383f7ca164999e3c09199070b0265c0130c

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: P8P820Q3JDKWCXC7
age: 286987
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 3089
x-amz-id-2: Idi7UK9DGIH8o/A6FrjSiYzsR0cEp68gHgZLiV+717PkpcT5p5Xur4+5EKf6fxDIyVNFv99b+nw=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Wed, 08 May 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Wed, 07 Feb 2024 21:56:11 GMT
server: AmazonS3
x-timer: S1712333249.316951,VS0,VE0
etag: "ff4e969e9e847528a4d9c3e250c27de6"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 154

GET
H3 200 5218-ff5f614f1dfc08d1.js Show response
www.theverge.com/_next/static/chunks/ 23 KB
6 KB 59ms
54ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/5218-ff5f614f1dfc08d1.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 4fe452a194227dee8b7d70e7080248c6cb8181a0c99764c897f5facbb1441cea

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: 7B19GXD0ZTD8CW23
age: 209688
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 5225
x-amz-id-2: XaaSXU4RnG07D1u0suOAzwvF5egt03vwHbaYROEabLIbTa0SRQLY7qXkLHISqpyXAPP9Z8z/unQ=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Wed, 08 May 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Wed, 07 Feb 2024 21:56:10 GMT
server: AmazonS3
x-timer: S1712333249.316910,VS0,VE1
etag: "b6e48fe40ca4021d7f88e85acd78bd8f"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 1

GET
H3 200 %5Buid%5D-e459bf40d237c510.js Show response
www.theverge.com/_next/static/chunks/pages/entry/feature/ 38 KB
8 KB 59ms
54ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/chunks/pages/entry/feature/%5Buid%5D-e459bf40d237c510.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: ffb541c0a258571df3ec42dac8f308e0dd156c73fdc4a753abf0243278e9820e

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: M152FKW3CXJADDP1
age: 2033604
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 7859
x-amz-id-2: lF5QFh7AU2Cn48Xlyx8xopXwtEeAc24dVIbx349yDmy0Ztn9D79gu2fh+ARDaoZ9AZQ7UQfQJvc=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Fri, 17 May 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Fri, 16 Feb 2024 21:20:20 GMT
server: AmazonS3
x-timer: S1712333249.318558,VS0,VE1
etag: "d90dee0d14def3719b8b89070028d80d"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 1

GET
H3 200 _buildManifest.js Show response
www.theverge.com/_next/static/2FEOwu8GfRWr8qiLQGWd8/ 5 KB
2 KB 63ms
59ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/2FEOwu8GfRWr8qiLQGWd8/_buildManifest.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 3d805275e8a3db2682328026393c4931c18996892256b1de74f8a5e89f773a0c

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: B42DPFCGAEPM1XMJ
age: 259091
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 1704
x-amz-id-2: Cqo3x1nWS0B4C4l9Su9Edxx7e4gwN9C/49eHK0doZptKRiB1nuGS1leleh0wxV9PkldPTxxQhPo=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Tue, 02 Jul 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Tue, 02 Apr 2024 16:08:16 GMT
server: AmazonS3
x-timer: S1712333249.318555,VS0,VE0
etag: "2cfb0a2131ae2acb6437cacbc02ff55f"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 294

GET
H3 200 _ssgManifest.js Show response
www.theverge.com/_next/static/2FEOwu8GfRWr8qiLQGWd8/ 77 B
791 B 63ms
59ms Script
application/javascript 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://www.theverge.com/_next/static/2FEOwu8GfRWr8qiLQGWd8/_ssgManifest.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.129.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 6f5b4aa00d2f8d6aed9935b471806bf7acef464d0c1d390260e5fe27f800c67e

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
via: 1.1 varnish
x-amz-request-id: B42F1HZJ6W94JETK
age: 259091
x-amz-server-side-encryption: AES256
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 52
x-amz-id-2: W8iDtkYHvF7/G2j1p4bZsOffQaTqCq+lbMQFHrqXkilMELM5At62JStfM3epulsVDuoqVniwi7E=
x-served-by: cache-fra-eddf8230061-FRA
x-amz-expiration: expiry-date="Tue, 02 Jul 2024 00:00:00 GMT", rule-id="duet-k8s-assets-lcr"
last-modified: Tue, 02 Apr 2024 16:08:16 GMT
server: AmazonS3
x-timer: S1712333249.318511,VS0,VE0
etag: "b6652df95db52feb4daf4eca35380933"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=31536000
accept-ranges: bytes
x-cache-hits: 454

GET
H2 200 native-ad-placeholder.png
www.theverge.com/icons/ 11 KB
12 KB 289ms
284ms Image
image/png 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://www.theverge.com/icons/native-ad-placeholder.png

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

151.101.129.91 , United States, ASN54113 (FASTLY, US),

Reverse DNS

Software

Resource Hash

5ca4082ec82e42e06128725e7d921d16f6aae3f470866ddd2563030667b8e732

Security Headers

Name	Value
Content-Security-Policy	frame-ancestors https://voxmedia.stories.usechorus.com 'self'

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

x-served-by: cache-fra-eddf8230086-FRA
content-security-policy: frame-ancestors https://voxmedia.stories.usechorus.com 'self'
via: 1.1 varnish
date: Fri, 05 Apr 2024 16:07:29 GMT
last-modified: Tue, 02 Apr 2024 16:02:36 GMT
x-timer: S1712333249.278036,VS0,VE270
etag: W/"2ddc-18e9f8c4d60"
vary: X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
x-cache: MISS
content-type: image/png
cache-control: private, no-store
accept-ranges: bytes
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 11740
x-cache-hits: 0

GET
H3 200 endmark.svg
www.theverge.com/icons/ 192 B
757 B 294ms
294ms Image
image/svg+xml 151.101.129.91
FASTLY

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://www.theverge.com/icons/endmark.svg

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/_next/static/css/78c96ab956e7dd1d.css

Protocol

Security

QUIC, , AES_256_GCM

Server

151.101.129.91 , United States, ASN54113 (FASTLY, US),

Reverse DNS

Software

Resource Hash

797032a498995d9236119df83db23add3071d56271ee07ae86a6ae9c6a1493f5

Security Headers

Name	Value
Content-Security-Policy	frame-ancestors https://voxmedia.stories.usechorus.com 'self'

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/_next/static/css/78c96ab956e7dd1d.css
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

x-served-by: cache-fra-eddf8230061-FRA
content-security-policy: frame-ancestors https://voxmedia.stories.usechorus.com 'self'
date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
last-modified: Tue, 02 Apr 2024 16:02:36 GMT
x-timer: S1712333249.400054,VS0,VE287
etag: W/"c0-18e9f8c4d60"
vary: Accept-Encoding, X-Vox-Duet-Beta-Cookie, X-Chorus-Unison-Testing, X-Chorus-Require-Privacy-Consent, X-Chorus-Restrict-In-Privacy-Consent-Region
x-cache: MISS
content-type: image/svg+xml
cache-control: private, no-store
accept-ranges: bytes
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 192
x-cache-hits: 0

GET
H2 200 aps_csm.js Show response
c.amazon-adsystem.com/bao-csm/aps-comm/ 6 KB
3 KB 19ms
6ms XHR
application/javascript 108.138.6.136
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c.amazon-adsystem.com/bao-csm/aps-comm/aps_csm.js
Requested by: Host: c.amazon-adsystem.com
URL: https://c.amazon-adsystem.com/aax2/apstag.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 108.138.6.136 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-108-138-6-136.fra56.r.cloudfront.net
Software: AmazonS3 /
Resource Hash: 06b99248a163333e36980a6cfb756f1a7de60fa49517162b87b1a44d5d48f844

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

x-amz-version-id: r5.lR.LJ66XEXzxUUVo7iMemjL_F_GoE
content-encoding: gzip
via: 1.1 ab68583a58d574d6a9e5fca1fb1e6316.cloudfront.net (CloudFront)
date: Fri, 05 Apr 2024 01:03:49 GMT
x-amz-cf-pop: FRA56-P6
age: 54221
x-amz-server-side-encryption: AES256
x-cache: Hit from cloudfront
last-modified: Thu, 29 Feb 2024 02:13:08 GMT
server: AmazonS3
etag: W/"a4d296427fc806b21335359e398c025c"
access-control-max-age: 3000
access-control-allow-methods: GET
content-type: application/javascript
access-control-allow-origin: *
cache-control: public, max-age=86400
vary: Accept-Encoding,Origin
x-amz-cf-id: W8bCMm-ogP85LXxF5x2q09XfOuztMyTKpIQzxRq8LSKFZhGfiaU0Yg==

GET
H3 200 pub.json Show response
pub.doubleverify.com/dvtag/signals/ids/ 13 B
272 B 69ms
47ms Fetch
application/json 2606:4700::6812:a6e0
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL

https://pub.doubleverify.com/dvtag/signals/ids/pub.json?ctx=21236410&cmp=DV464041&url=https%3A%2F%2Ftheverge.com&ids=1&token=%2B8dpMLevwOisE1rZMfTqJCL%2BlZFWvte0V5jL1NMzTitwbiJf6o95hXtvGhvQ2Lts2xDQftGDg77hsOYcHsISgramXtEoQ6P3V7fgMyn3oU4K5YTlhqq1%2FgV0uV%2Fp3YpFnC%2BkLBmu5ptAv2SUf5NF5g%3D%3D

Requested by

Host: pub.doubleverify.com
URL: https://pub.doubleverify.com/dvtag/21236410/DV464041/pub.js

Protocol

Security

QUIC, , AES_128_GCM

Server

2606:4700::6812:a6e0 , United States, ASN13335 (CLOUDFLARENET, US),

Reverse DNS

Software

cloudflare /

Resource Hash

c2a9c1dec1a24dd650f7b3b74a5c8ab1f6b68b653deef124accbde1c8a24abf0

Security Headers

Name	Value
Content-Security-Policy	frame-ancestors 'self'
Strict-Transport-Security	max-age=31536000; includeSubDomains
X-Frame-Options	SAMEORIGIN

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
strict-transport-security: max-age=31536000; includeSubDomains
content-security-policy: frame-ancestors 'self'
server: cloudflare
vary: origin, x-forwarded-for, user-agent, Accept-Encoding
x-frame-options: SAMEORIGIN
content-type: application/json
access-control-allow-origin: https://www.theverge.com
access-control-expose-headers: Server-Timing, Cf-Ray
cache-control: private, max-age=900
access-control-allow-credentials: true
timing-allow-origin: *
cf-ray: 86faca997f889f54-FRA
content-length: 13
alt-svc: h3=":443"; ma=86400

GET
H3 200 pub.json Show response
pub.doubleverify.com/dvtag/signals/bsc/ 358 B
412 B 65ms
45ms Fetch
application/json 2606:4700::6812:a6e0
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL

https://pub.doubleverify.com/dvtag/signals/bsc/pub.json?ctx=21236410&cmp=DV464041&url=https%3A%2F%2Ftheverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&bsc=1&abs=1&token=%2B8dpMLevwOisE1rZMfTqJCL%2BlZFWvte0V5jL1NMzTitwbiJf6o95hXtvGhvQ2Lts2xDQftGDg77hsOYcHsISgramXtEoQ6P3V7fgMyn3oU4K5YTlhqq1%2FgV0uV%2Fp3YpFnC%2BkLBmu5ptAv2SUf5NF5g%3D%3D

Requested by

Host: pub.doubleverify.com
URL: https://pub.doubleverify.com/dvtag/21236410/DV464041/pub.js

Protocol

Security

QUIC, , AES_128_GCM

Server

2606:4700::6812:a6e0 , United States, ASN13335 (CLOUDFLARENET, US),

Reverse DNS

Software

cloudflare /

Resource Hash

683cfbce49088ed0d0ec6b9ef26054ac37ea07a641bec02ea5ef31aab56ce21d

Security Headers

Name	Value
Content-Security-Policy	frame-ancestors 'self'
Strict-Transport-Security	max-age=31536000; includeSubDomains
X-Frame-Options	SAMEORIGIN

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
strict-transport-security: max-age=31536000; includeSubDomains
content-encoding: br
content-security-policy: frame-ancestors 'self'
server: cloudflare
vary: origin, Accept-Encoding
x-frame-options: SAMEORIGIN
content-type: application/json
access-control-allow-origin: https://www.theverge.com
access-control-expose-headers: Server-Timing, Cf-Ray
cache-control: public, max-age=1916
access-control-allow-credentials: true
timing-allow-origin: *
cf-ray: 86faca997f879f54-FRA
alt-svc: h3=":443"; ma=86400

GET
H2 200 pubads_impl.js Show response
securepubads.g.doubleclick.net/pagead/managed/js/gpt/m202404030101/ 441 KB
139 KB 35ms
7ms Script
text/javascript 2a00:1450:4001:80f::2002
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://securepubads.g.doubleclick.net/pagead/managed/js/gpt/m202404030101/pubads_impl.js?cb=31082465

Requested by

Host: www.googletagservices.com
URL: https://www.googletagservices.com/tag/js/gpt.js

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:80f::2002 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

cafe /

Resource Hash

d7a34e28e15bb1db09875565f4384397042d59bf38a4a2442e7264653f75a9fe

Security Headers

Name	Value
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 10:01:48 GMT
content-encoding: br
x-content-type-options: nosniff
age: 21941
p3p: policyref="https://googleads.g.doubleclick.net/pagead/gcn_p3p_.xml", CP="CURa ADMa DEVa TAIo PSAo PSDo OUR IND UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR"
cross-origin-resource-policy: cross-origin
content-disposition: attachment; filename="f.txt"
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 141390
x-xss-protection: 0
server: cafe
etag: 1947898002160924377
vary: Accept-Encoding
content-type: text/javascript; charset=UTF-8
access-control-allow-origin: *
cache-control: public, immutable, max-age=31536000
timing-allow-origin: *
expires: Sat, 05 Apr 2025 10:01:48 GMT

GET
H2 200 optimize.js Show response
www.googleoptimize.com/ 125 KB
48 KB 67ms
17ms Script
application/javascript 2a00:1450:4001:811::200e
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://www.googleoptimize.com/optimize.js?id=GTM-54FC4VZ

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/main-a19b11f4c6f53406.js

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:811::200e Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

Google Tag Manager /

Resource Hash

904dfce8a5b458f3652485aca3bb0fe3f6ff4b9334f15baf7a13eefcec71e0c5

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubDomains
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
strict-transport-security: max-age=31536000; includeSubDomains
server: Google Tag Manager
vary: Accept-Encoding
content-type: application/javascript; charset=UTF-8
access-control-allow-origin: *
cache-control: private, max-age=900
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
access-control-allow-headers: Cache-Control
content-length: 48772
x-xss-protection: 0
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
expires: Fri, 05 Apr 2024 16:07:29 GMT

GET
H2 200 spm.v1.min.js Show response
ak.sail-horizon.com/spm/ 103 KB
34 KB 52ms
7ms Script
application/javascript 18.66.112.84
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://ak.sail-horizon.com/spm/spm.v1.min.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/main-a19b11f4c6f53406.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 18.66.112.84 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-18-66-112-84.fra56.r.cloudfront.net
Software: AmazonS3 /
Resource Hash: 4ce1f595ea044b955619f6839a22ac34a22d80efde699f84f044976baa4831e3

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:01:56 GMT
content-encoding: gzip
via: 1.1 3517ce13630d84c5b14e88de469985cc.cloudfront.net (CloudFront)
last-modified: Tue, 20 Feb 2024 06:45:39 GMT
server: AmazonS3
x-amz-cf-pop: FRA56-P5
age: 334
x-amz-server-side-encryption: AES256
etag: W/"6a90e37d3f128291a2aab5a6b31ac0a6"
vary: Accept-Encoding
x-cache: Hit from cloudfront
content-type: application/javascript
cache-control: max-age=600; must-revalidate
x-amz-cf-id: 0wPmgiGDIfHcyStcwFs0A1IXK7yr0aHSHSZyEIF4WmNtkh7mLZvF1A==

GET
H2 200 gtm.js Show response
www.googletagmanager.com/ 373 KB
112 KB 56ms
35ms Script
application/javascript 2a00:1450:4001:82f::2008
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://www.googletagmanager.com/gtm.js?id=GTM-WQ5FM5W

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/main-a19b11f4c6f53406.js

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:82f::2008 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

Google Tag Manager /

Resource Hash

63e7d22ddb417c868fe594d2dd0a21bf2f929592584b02bbb555b733a0304225

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubDomains
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
strict-transport-security: max-age=31536000; includeSubDomains
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 114725
x-xss-protection: 0
last-modified: Fri, 05 Apr 2024 15:00:00 GMT
server: Google Tag Manager
vary: Accept-Encoding
content-type: application/javascript; charset=UTF-8
access-control-allow-origin: *
cache-control: private, max-age=900
access-control-allow-credentials: true
access-control-allow-headers: Cache-Control
expires: Fri, 05 Apr 2024 16:07:29 GMT

GET
H2 200 narrativ-pub.1.0.0.js Show response
static.narrativ.com/tags/ 42 KB
42 KB 35ms
8ms Script
application/javascript 18.66.122.25
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://static.narrativ.com/tags/narrativ-pub.1.0.0.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 18.66.122.25 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-18-66-122-25.fra60.r.cloudfront.net
Software: AmazonS3 /
Resource Hash: 535535d875141da2658a22a90f2d2e32380e7c40332af837a37df9288d097562

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Thu, 04 Apr 2024 18:50:23 GMT
via: 1.1 508d9aac3b0097e502b117c1e7390bb0.cloudfront.net (CloudFront)
last-modified: Wed, 03 Jan 2024 16:47:31 GMT
server: AmazonS3
x-amz-cf-pop: FRA60-P2
age: 76627
etag: "655bed72a69fc88c1a12979138d44079"
vary: Accept-Encoding
x-cache: Hit from cloudfront
content-type: application/javascript
alt-svc: h3=":443"; ma=86400
content-length: 42523
x-amz-cf-id: W_yaY2eR86UwVcSvmj43SUAdcbKjNNUdKZRpCvQQItQf6_BAYU5RjA==

GET
H2 200 cc0f6cd23e150e3500575362cb4f3.js Show response
monacobeatles.com/static/0ec3782/ 72 KB
26 KB 55ms
18ms Script
text/javascript 2600:1901:0:4277::1
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://monacobeatles.com/static/0ec3782/cc0f6cd23e150e3500575362cb4f3.js

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2600:1901:0:4277::1 Kansas City, United States, ASN15169 (GOOGLE, US),

Reverse DNS

Software

Resource Hash

b07662b2a6108d2872de909e1f5b02eb0c39c34b2c3e61b07ea45dbcaaba1f63

Security Headers

Name	Value
Strict-Transport-Security	max-age=15724800; preload

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

strict-transport-security: max-age=15724800; preload
content-encoding: zstd
via: 1.1 google
date: Fri, 05 Apr 2024 16:07:29 GMT
x-datacenter: gce-europe-west1
etag: "b30042bad69634b0a955cb534e762b666d5ff6061f8b670ef2e8829da7c61a08"
x-buildname: hoothoot
vary: Accept-Encoding, Accept-Language
x-hostname: fen-hoothoot-europe-west1-spot-ltqf
content-type: text/javascript; charset=utf-8
cache-control: private, must-revalidate, max-age=21600
x-buildnumber: 1205290244
timing-allow-origin: *
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000

GET
H2

200

embed.js Show response
js.memberful.com/
Redirect Chain

https://d35xxde4fgg0cx.cloudfront.net/assets/embedded.js
https://js.memberful.com/embed.js

43 KB
23 KB

50ms
21ms

Script
application/javascript

2606:4700::6810:457d
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL

https://js.memberful.com/embed.js

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Server

2606:4700::6810:457d , United States, ASN13335 (CLOUDFLARENET, US),

Reverse DNS

Software

cloudflare /

Resource Hash

88d82bd41ab6773bfd2f4a32472a0b8a8b854ddb6367ba8a96cde336673baabe

Security Headers

Name	Value
Strict-Transport-Security	max-age=15552000

Request headers

accept-language: de-DE,de;q=0.9
Referer: https://www.theverge.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: gzip
via: 1.1 vegur
strict-transport-security: max-age=15552000
nel: {"report_to":"heroku-nel","max_age":3600,"success_fraction":0.005,"failure_fraction":0.05,"response_headers":["Via"]}
cf-cache-status: HIT
age: 2380
content-length: 22840
reporting-endpoints: heroku-nel=https://nel.heroku.com/reports?ts=1712323666&sid=c46efe9b-d3d2-4a0c-8c76-bfafa16c5add&s=l1Dr0d88gRFwHviy%2B%2BMU75jLdrXoNPfSGJoXKr1SKIw%3D
last-modified: Fri, 05 Apr 2024 11:54:07 GMT
server: cloudflare
vary: accept-encoding
report-to: {"group":"heroku-nel","max_age":3600,"endpoints":[{"url":"https://nel.heroku.com/reports?ts=1712323666&sid=c46efe9b-d3d2-4a0c-8c76-bfafa16c5add&s=l1Dr0d88gRFwHviy%2B%2BMU75jLdrXoNPfSGJoXKr1SKIw%3D"}]}
content-type: application/javascript
cache-control: public, max-age=14400
accept-ranges: bytes
cf-ray: 86faca9be82e37eb-FRA

Redirect headers

Date: Fri, 05 Apr 2024 15:40:10 GMT
Strict-Transport-Security: max-age=15552000
Via: 1.1 c60125e7f3465aceafb0abd071a41a36.cloudfront.net (CloudFront)
Server: cloudflare
X-Amz-Cf-Pop: FRA60-P1
Age: 1639
Transfer-Encoding: chunked
Vary: Accept-Encoding
X-Cache: Hit from cloudfront
Location: https://js.memberful.com/embed.js
Cache-Control: max-age=3600
Connection: keep-alive
CF-RAY: 86faa2949d8f049f-FRA
X-Amz-Cf-Id: mWv314a9vBfdiIPyDOG6DY5ChqBjyu5tYgKveY0UdaQjP4WAykrgfw==
Expires: Fri, 05 Apr 2024 16:40:10 GMT

GET
H2 200 test_ads_prebid_blocker.js Show response
apps.voxmedia.com/ad-block-detect/ 44 B
379 B 40ms
7ms Script
application/javascript 199.232.196.124
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL

https://apps.voxmedia.com/ad-block-detect/test_ads_prebid_blocker.js

Requested by

Host: cdn.concert.io
URL: https://cdn.concert.io/lib/concert-ads/v2-latest/concert_ads.js

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

199.232.196.124 , United States, ASN54113 (FASTLY, US),

Reverse DNS

Software

AmazonS3 /

Resource Hash

d2abcf4ca4f543d63ed37e00a7c7daabed4a60822c15bea1d388d6b4fbfc4a5e

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000
X-Content-Type-Options	nosniff
X-Xss-Protection	1; mode=block

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

x-amz-version-id: UgszM5eLZPnljhKeeujYdbHJQ2lFaW20
date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
strict-transport-security: max-age=31536000
x-content-type-options: nosniff
age: 3031
x-cache: HIT
content-length: 44
x-xss-protection: 1; mode=block
x-served-by: cache-fra-eddf8230031-FRA
last-modified: Thu, 19 Jan 2023 20:35:41 GMT
server: AmazonS3
x-timer: S1712333250.758399,VS0,VE0
etag: "63fac8aa984b122d6d899cf2eeae0649"
content-type: application/javascript
access-control-allow-origin: *
accept-ranges: bytes
x-cache-hits: 61

GET
H2 200 config.json Show response
concertads-configs.vox-cdn.com/duet/ 87 KB
7 KB 40ms
7ms XHR
application/json 199.232.196.124
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://concertads-configs.vox-cdn.com/duet/config.json
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 199.232.196.124 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 0994224df72f23e9cdd8e4aed136aee72f0d7380326e83419b509a49abad00d6

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

x-amz-meta-cache-control: max-age=3600
content-encoding: gzip
via: 1.1 varnish
date: Fri, 05 Apr 2024 16:07:29 GMT
x-amz-request-id: QWMMNVXB2161G8FW
age: 2553
x-amz-server-side-encryption: AES256
x-cache: HIT
geo-metro: 276008
content-length: 6991
x-amz-id-2: kGDph2uZn/Pe1WZMWv4/Z20cMhaPw7mhcLiGDeUVq0yYDEJbt8myHptGjY+krYcqVdKBm8fy9NcRpxsdUaQHVHLplE9htJcWwHcMepN3+l0=
x-served-by: cache-fra-eddf8230081-FRA
last-modified: Tue, 02 Apr 2024 19:06:11 GMT
server: AmazonS3
x-timer: S1712333250.760434,VS0,VE0
etag: "4f079a3738b30e8d7fda74c4fca18767"
x-amz-meta-x-amz-meta-surrogate-control: max-age=31536000, stale-while-revalidate=30, stale-if-error=86400
vary: Accept-Encoding
content-type: application/json
access-control-allow-origin: *
geo-connection-speed: broadband
access-control-expose-headers: geo-region, geo-connection-speed, geo-metro
x-amz-meta-x-amz-meta-surrogate-key: concertadsconfigs
geo-region: DE-SN
accept-ranges: bytes
x-cache-hits: 16

GET
H2 200 profile Show response
api.parsely.com/v2/ 246 B
352 B 305ms
97ms Fetch
application/json 18.208.123.81
AMAZON-AES

General

Check archive.org

Show headers Download Go to

Full URL: https://api.parsely.com/v2/profile?apikey=theverge.com&uuid=&url=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 18.208.123.81 Ashburn, United States, ASN14618 (AMAZON-AES, US),
Reverse DNS: ec2-18-208-123-81.compute-1.amazonaws.com
Software: nginx /
Resource Hash: 6bb9c0fce3a9e155d70a7cea532bb953c5aee6cb31a5d1d8f3b8ab9f12c7c472

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

access-control-allow-origin: *
date: Fri, 05 Apr 2024 16:07:29 GMT
server: nginx
content-length: 246
content-type: application/json

GET
H2 200 embed.js Show response
theverge.coral.coralproject.net/assets/js/ 106 KB
30 KB 38ms
7ms Script
application/javascript 34.111.9.237
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL

https://theverge.coral.coralproject.net/assets/js/embed.js?v=0

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/main-a19b11f4c6f53406.js

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

34.111.9.237 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),

Reverse DNS

237.9.111.34.bc.googleusercontent.com

Software

Resource Hash

fb81a214f7895d2cac5e338d8acc633ddc013ac592a31e09f46a810391dcc5ca

Security Headers

Name	Value
Strict-Transport-Security	max-age=15552000
X-Content-Type-Options	nosniff
X-Xss-Protection	1; mode=block

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

strict-transport-security: max-age=15552000
content-encoding: gzip
x-content-type-options: nosniff
date: Fri, 05 Apr 2024 15:49:16 GMT
via: 1.1 google
age: 1093
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 30789
x-xss-protection: 1; mode=block
x-trace-id: 0efffa40-f364-11ee-bb9e-79b55fe0c9bf
referrer-policy: strict-origin-when-cross-origin
last-modified: Tue, 26 Mar 2024 15:43:07 GMT
etag: W/"7845-18e7b6df2f8"
vary: Accept-Encoding
content-language: en-US
content-type: application/javascript; charset=UTF-8
cache-control: public,max-age=1800,s-max-age=604800
accept-ranges: bytes

GET
H2 200 7470-pbjs-floors.json Show response
ads.rubiconproject.com/floors/ 54 KB
6 KB 92ms
28ms Fetch
application/json 104.64.126.246
AKAMAI-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://ads.rubiconproject.com/floors/7470-pbjs-floors.json
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 104.64.126.246 Prague, Czech Republic, ASN16625 (AKAMAI-AS, US),
Reverse DNS: a104-64-126-246.deploy.static.akamaitechnologies.com
Software: Apache/2.4.37 (rocky) OpenSSL/1.1.1k /
Resource Hash: 7b6c4048e4f17238c1c67719a20b2d8baa6f225d4c070470fcad1bb962d78e1d

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: gzip
last-modified: Fri, 05 Apr 2024 15:40:26 GMT
server: Apache/2.4.37 (rocky) OpenSSL/1.1.1k
vary: Accept-Encoding
content-type: application/json
access-control-allow-origin: *
cache-control: max-age=1500
access-control-allow-credentials: true
accept-ranges: bytes
content-length: 6189

GET
H/1.1 204
No content uspapi_delete_c2s Show response
media.grid.bidswitch.net/ 0
334 B 207ms
15ms Fetch
text/html 35.214.187.215
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL: https://media.grid.bidswitch.net/uspapi_delete_c2s
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: HTTP/1.1
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 35.214.187.215 Groningen, Netherlands, ASN15169 (GOOGLE, US),
Reverse DNS: 215.187.214.35.bc.googleusercontent.com
Software: nginx /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

Date: Fri, 05 Apr 2024 16:07:29 GMT
Server: nginx
Content-Type: text/html; charset=UTF-8
Access-Control-Allow-Origin: https://www.theverge.com
Cache-Control: no-cache, no-store, must-revalidate
Access-Control-Allow-Credentials: true
Bad-Request-Reason: Invalid 'tuuid' cookie
Connection: keep-alive

GET
H2 200 172968584 Show response
fundingchoicesmessages.google.com/i/ 180 KB
60 KB 84ms
35ms Script
application/javascript 2a00:1450:4001:806::200e
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://fundingchoicesmessages.google.com/i/172968584?ers=3

Requested by

Host: securepubads.g.doubleclick.net
URL: https://securepubads.g.doubleclick.net/pagead/managed/js/gpt/m202404030101/pubads_impl.js?cb=31082465

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:806::200e Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

ESF /

Resource Hash

6e265c7d29e79701776e532eca22399a49921abb3efc3d61e054ec99b2c36029

Security Headers

Name	Value
Content-Security-Policy	require-trusted-types-for 'script';report-uri /_/ContributorServingWebSwitchboardHttp/cspreport, script-src 'report-sample' 'nonce-daMozkPN9ENz-tg-TUs7Tw' 'unsafe-inline';object-src 'none';base-uri 'self';report-uri /_/ContributorServingWebSwitchboardHttp/cspreport;worker-src 'self', script-src 'unsafe-inline' 'self' https://apis.google.com https://ssl.gstatic.com https://www.google.com https://www.googletagmanager.com https://www.gstatic.com https://www.google-analytics.com;report-uri /_/ContributorServingWebSwitchboardHttp/cspreport/allowlist
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-security-policy: require-trusted-types-for 'script';report-uri /_/ContributorServingWebSwitchboardHttp/cspreport, script-src 'report-sample' 'nonce-daMozkPN9ENz-tg-TUs7Tw' 'unsafe-inline';object-src 'none';base-uri 'self';report-uri /_/ContributorServingWebSwitchboardHttp/cspreport;worker-src 'self', script-src 'unsafe-inline' 'self' https://apis.google.com https://ssl.gstatic.com https://www.google.com https://www.googletagmanager.com https://www.gstatic.com https://www.google-analytics.com;report-uri /_/ContributorServingWebSwitchboardHttp/cspreport/allowlist
content-encoding: gzip
x-content-type-options: nosniff
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
x-xss-protection: 0
reporting-endpoints: default="/_/ContributorServingWebSwitchboardHttp/web-reports?context=eJzjKtDikmLw0JBiOO90h-k6ENcyPGNqBWIDjedMFkD87stLJoGvL5kkgFgLiPnWTWdVAWLD9dNZI4E45vl01hQgdkqfwRoCxD71M1jjgLj15jnW6UB8csF51otAnPTvPGsJEAvxcBw8fGADm8CNGY_WMgMAlkk2Ig"
pragma: no-cache
accept-ch: Sec-CH-UA-Arch, Sec-CH-UA-Bitness, Sec-CH-UA-Full-Version, Sec-CH-UA-Full-Version-List, Sec-CH-UA-Model, Sec-CH-UA-WoW64, Sec-CH-UA-Form-Factor, Sec-CH-UA-Platform, Sec-CH-UA-Platform-Version
cross-origin-opener-policy: same-origin
server: ESF
vary: Sec-Fetch-Dest, Sec-Fetch-Mode, Sec-Fetch-Site
x-frame-options: SAMEORIGIN
content-type: application/javascript; charset=utf-8
cache-control: no-cache, no-store, max-age=0, must-revalidate
permissions-policy: ch-ua-arch=*, ch-ua-bitness=*, ch-ua-full-version=*, ch-ua-full-version-list=*, ch-ua-model=*, ch-ua-wow64=*, ch-ua-form-factor=*, ch-ua-platform=*, ch-ua-platform-version=*
timing-allow-origin: *
expires: Mon, 01 Jan 1990 00:00:00 GMT

GET
H2 200 tag Show response
btloader.com/ 80 KB
25 KB 53ms
25ms Script
application/javascript 2606:4700:10::6816:4ad8
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://btloader.com/tag?o=6315858775244800&upapi=true
Requested by: Host: cdn.concert.io
URL: https://cdn.concert.io/lib/concert-ads/v2-latest/concert_ads.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2606:4700:10::6816:4ad8 , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: d0fcf57592a004be2a06e613ffeb440530bafd2de67218f79222a96db699f82e

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: gzip
via: 1.1 google
cf-cache-status: HIT
last-modified: Fri, 05 Apr 2024 16:02:42 GMT
server: cloudflare
age: 281
etag: "6d34001c1747ebf5c7c40505b6d29ace"
vary: Origin, Accept-Encoding
content-type: application/javascript
cache-control: public, max-age=300, must-revalidate, stale-if-error=3600, stale-while-revalidate=300
accept-ranges: bytes
cf-ray: 86faca9be8e6bba3-FRA
content-length: 24827

POST
H3 200 segment Show response
cdn.concert.io/segments_prod2/v1.0/ 70 B
337 B 248ms
237ms XHR
application/json 151.101.1.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://cdn.concert.io/segments_prod2/v1.0/segment
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.1.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: uvicorn /
Resource Hash: 1cab89992a8002f31cc8a8a3d5edaa1e4a58b110bb9ce848e188b474502b0023

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
Content-Type: text/plain

Response headers

x-served-by: cache-fra-eddf8230113-FRA
pragma: no-cache
date: Fri, 05 Apr 2024 16:07:30 GMT
via: 1.1 varnish
server: uvicorn
x-timer: S1712333250.892165,VS0,VE231
vary: Accept-Encoding
x-cache: MISS
content-type: application/json
access-control-allow-origin: *
cache-control: private, no-cache, no-cache=Set-Cookie, proxy-revalidate
accept-ranges: bytes
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 70
x-cache-hits: 0

GET
H3 200 aHR0cHM6Ly93d3cudGhldmVyZ2UuY29tLzI0MDY3OTk3L3JvYm90cy10eHQtYWktdGV4dC1maWxlLXdlYi1jcmF3bGVycy1zcGlkZXJz.json Show response
cdn.concert.io/lookup/ 3 KB
1 KB 18ms
8ms XHR
application/json 151.101.1.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL

https://cdn.concert.io/lookup/aHR0cHM6Ly93d3cudGhldmVyZ2UuY29tLzI0MDY3OTk3L3JvYm90cy10eHQtYWktdGV4dC1maWxlLXdlYi1jcmF3bGVycy1zcGlkZXJz.json

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js

Protocol

Security

QUIC, , AES_256_GCM

Server

151.101.1.91 , United States, ASN54113 (FASTLY, US),

Reverse DNS

Software

Resource Hash

ac549d1ae9515085e42be96153473367ac646a875808adedf5dfe89caec84af9

Security Headers

Name	Value
Strict-Transport-Security	max-age=63072000; includeSubDomains
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

strict-transport-security: max-age=63072000; includeSubDomains
content-encoding: gzip
x-content-type-options: nosniff
date: Fri, 05 Apr 2024 16:07:29 GMT
via: 1.1 varnish
x-permitted-cross-domain-policies: none
x-backend: A
age: 53561
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 862
x-xss-protection: 0
x-request-id: 1965002d-5431-4dd8-b74c-9126ec1081cd
x-served-by: cache-fra-eddf8230113-FRA
x-runtime: 0.008491
referrer-policy: strict-origin-when-cross-origin
last-modified: Fri, 05 Apr 2024 01:14:17 GMT
x-timer: S1712333250.892149,VS0,VE1
x-download-options: noopen
x-frame-options: SAMEORIGIN
access-control-max-age: 7200
access-control-allow-methods: GET
access-control-allow-origin: *
access-control-expose-headers
cache-control: max-age=3600, public
content-type: application/json; charset=utf-8
vary: Accept, Origin, Accept-Encoding
accept-ranges: bytes
x-cache-hits: 1

POST
H3 200 segment Show response
cdn.concert.io/purchase_intent/v1.0/ 105 B
372 B 262ms
253ms XHR
application/json 151.101.1.91
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://cdn.concert.io/purchase_intent/v1.0/segment
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H3
Security: QUIC, , AES_256_GCM
Server: 151.101.1.91 , United States, ASN54113 (FASTLY, US),
Reverse DNS
Software: uvicorn /
Resource Hash: 25c7baf63defa73d2ef3da446670c3a09a28140ca60b3f9e0f9a294ca805c3f2

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
Content-Type: text/plain

Response headers

x-served-by: cache-fra-eddf8230113-FRA
pragma: no-cache
date: Fri, 05 Apr 2024 16:07:30 GMT
via: 1.1 varnish
server: uvicorn
x-timer: S1712333250.891927,VS0,VE247
vary: Accept-Encoding
x-cache: MISS
content-type: application/json
access-control-allow-origin: *
cache-control: private, no-cache, no-cache=Set-Cookie, proxy-revalidate
accept-ranges: bytes
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 105
x-cache-hits: 0

GET
H3 200 connatix.player.js Show response
cd.connatix.com/ Frame E480 756 B
578 B 52ms
15ms Script
application/javascript 172.64.146.152
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cd.connatix.com/connatix.player.js
Requested by: Host: cdn.concert.io
URL: https://cdn.concert.io/lib/concert-ads/v2-latest/concert_ads.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 172.64.146.152 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 0009cd360e34cb0a5ef4db29a6d82a2ab8679fa93e3ce933b23b54ce2a0ba5c4

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
content-encoding: br
server: cloudflare
vary: Accept-Encoding
content-type: application/javascript
cache-control: no-cache, no-store, must-revalidate, max-age=0
cf-ray: 86faca9c2d5a8ff5-FRA
access-control-allow-headers: x-sec-ch-ua-platform-version, x-sec-ch-ua-full-version-list, x-sec-ch-ua-arch, x-sec-ch-ua-bitness, x-sec-ch-ua-model
alt-svc: h3=":443"; ma=86400

GET
H2 200 outbrain.js Show response
widgets.outbrain.com/ 237 KB
86 KB 67ms
23ms Script
application/x-javascript 23.35.237.86
AKAMAI-AS

General

Check archive.org

Show headers Download Go to

Full URL

https://widgets.outbrain.com/outbrain.js

Requested by

Host: cdn.concert.io
URL: https://cdn.concert.io/lib/concert-ads/v2-latest/concert_ads.js

Protocol

Security

TLS 1.3, , AES_256_GCM

Server

23.35.237.86 Frankfurt am Main, Germany, ASN16625 (AKAMAI-AS, US),

Reverse DNS

a23-35-237-86.deploy.static.akamaitechnologies.com

Software

Resource Hash

ca998adaeefff6118b80a064ea48cc65a4d0aad3159a1105b51228762ec681a5

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubDomains; preload

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

strict-transport-security: max-age=31536000; includeSubDomains; preload
content-encoding: gzip
date: Fri, 05 Apr 2024 16:07:29 GMT
edge-cache-tag: widget-cheetah
x-traceid: 161f7f16b54186f8baf749098e1bd239
content-length: 87976
last-modified: Mon, 01 Apr 2024 06:46:38 GMT
etag: "34-H9myhjtVUHcLxzLS6IVEkQZpkbs"
vary: Accept-Encoding
access-control-allow-methods: GET,POST
content-type: application/x-javascript
access-control-allow-origin: *
cache-control: max-age=14500
access-control-allow-credentials: false
timing-allow-origin: *, *
access-control-request-headers: X-OB-STG,X-OB-PRD

GET
H2 200 3176 Show response
config.aps.amazon-adsystem.com/configs/ 531 B
797 B 32ms
6ms Script
application/javascript 18.245.31.123
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://config.aps.amazon-adsystem.com/configs/3176
Requested by: Host: c.amazon-adsystem.com
URL: https://c.amazon-adsystem.com/aax2/apstag.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 18.245.31.123 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-18-245-31-123.fra56.r.cloudfront.net
Software: CloudFront /
Resource Hash: ff42bfcb9c7a5e3de992e347e3625b28369827be57781464dc46a2e0fb74e384

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 15:08:42 GMT
via: 1.1 b7c8b552077b93dc0acaa0b82d11fa62.cloudfront.net (CloudFront)
server: CloudFront
x-amz-cf-pop: FRA56-P8
age: 3527
x-cache: Hit from cloudfront
content-type: application/javascript
cache-control: max-age=3600
content-length: 531
x-amz-cf-id: c_R4mHH1BN1GehXpIm7zemqcFtHmn6082McEbMSwxPMkwI9hCHAWTw==

GET
H2 200 config Show response
c.amazon-adsystem.com/cdn/prod/ 677 B
1 KB 7ms
6ms XHR
application/json 108.138.6.136
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c.amazon-adsystem.com/cdn/prod/config?src=3176&u=https%3A%2F%2Fwww.theverge.com
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 108.138.6.136 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-108-138-6-136.fra56.r.cloudfront.net
Software: Server /
Resource Hash: cfa873516d960d0d89ac3be1133bf304a24a2a553b4fb03850af07f7f4d32c04

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 14:14:41 GMT
via: 1.1 e016ea20838aeed1d878a5244c9e2552.cloudfront.net (CloudFront)
server: Server
x-amz-cf-pop: FRA56-P6
age: 6767
x-cache: Hit from cloudfront
content-type: application/json;charset=UTF-8
access-control-allow-origin: https://www.theverge.com
cache-control: max-age=21550, s-maxage=21600
access-control-allow-credentials: true
content-length: 677
x-amz-cf-id: Wh5f7HnWDWl66buyViS9TCZnc4aKt-KDfeImAs0S_lUvMAFGg_BU5A==

GET
H2 200 183789-71940066017360.js Show response
js-sec.indexww.com/ht/p/ 35 KB
12 KB 62ms
37ms Script
text/javascript 172.64.149.180
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://js-sec.indexww.com/ht/p/183789-71940066017360.js
Requested by: Host: cdn.concert.io
URL: https://cdn.concert.io/lib/concert-ads/v2-latest/concert_ads.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 172.64.149.180 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 59c96c32e59ef49eaec195e3846fe1ffb919330c53a2ad34af765ab4d7236b9f

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
cf-cache-status: HIT
last-modified: Fri, 05 Apr 2024 15:50:02 GMT
server: cloudflare
age: 1004
etag: W/"da1f78-8ae9-6155b68b12fbe"
vary: Accept-Encoding
content-type: text/javascript
p3p: policyref="/w3c/p3p.xml", CP="NOI DSP COR DEVa TAIa OUR BUS UNI"
edge-control: cache-maxage=1h
cache-control: public, max-age=14400
cf-ray: 86faca9c5ace4db5-FRA
expires: Fri, 05 Apr 2024 20:07:29 GMT

GET
H3 200 pub.json Show response
pub.doubleverify.com/dvtag/signals/vlp/ 113 B
270 B 41ms
41ms Fetch
application/json 2606:4700::6812:a6e0
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL

https://pub.doubleverify.com/dvtag/signals/vlp/pub.json?ctx=21236410&cmp=DV464041&url=https%3A%2F%2Ftheverge.com&vlp=1&slot-0-%2F172968584%2Fverge%2Ffront-page=300x250%2C300x600&slot-1-%2F172968584%2Fverge%2Ffront-page=300x250&slot-2-%2F172968584%2Fverge%2Ffront-page=1030x590%2C728x90%2C1060x610%2C970x250&slot-3-%2F172968584%2Fverge%2Ffront-page=728x90%2C1020x90%2C970x90&slot-4-%2F172968584%2Fverge%2Ffront-page=1030x590%2C300x250&slot-5-%2F172968584%2Fverge%2Ffront-page=200x40&slot-6-%2F172968584%2Fverge%2Ffront-page=300x100&slot-7-%2F172968584%2Fverge%2Ffront-page=200x100&token=%2B8dpMLevwOisE1rZMfTqJCL%2BlZFWvte0V5jL1NMzTitwbiJf6o95hXtvGhvQ2Lts2xDQftGDg77hsOYcHsISgramXtEoQ6P3V7fgMyn3oU4K5YTlhqq1%2FgV0uV%2Fp3YpFnC%2BkLBmu5ptAv2SUf5NF5g%3D%3D

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js

Protocol

Security

QUIC, , AES_128_GCM

Server

2606:4700::6812:a6e0 , United States, ASN13335 (CLOUDFLARENET, US),

Reverse DNS

Software

cloudflare /

Resource Hash

69d63babdc205bde69a262cb60fa589509dc79f6283d9877ca08356f1639c018

Security Headers

Name	Value
Content-Security-Policy	frame-ancestors 'self'
Strict-Transport-Security	max-age=31536000; includeSubDomains
X-Frame-Options	SAMEORIGIN

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:29 GMT
strict-transport-security: max-age=31536000; includeSubDomains
content-encoding: br
content-security-policy: frame-ancestors 'self'
server: cloudflare
vary: origin, Accept-Encoding
x-frame-options: SAMEORIGIN
content-type: application/json
access-control-allow-origin: https://www.theverge.com
access-control-expose-headers: Server-Timing, Cf-Ray
cache-control: public, max-age=43008
access-control-allow-credentials: true
timing-allow-origin: *
cf-ray: 86faca9c3abf9f54-FRA
alt-svc: h3=":443"; ma=86400

GET
H2 200 pubcid.min.js Show response
secure.cdn.fastclick.net/js/pubcid/latest/ 54 KB
17 KB 503ms
157ms Script
application/javascript 184.30.211.26
AKAMAI-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://secure.cdn.fastclick.net/js/pubcid/latest/pubcid.min.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 184.30.211.26 Frankfurt am Main, Germany, ASN16625 (AKAMAI-AS, US),
Reverse DNS: a184-30-211-26.deploy.static.akamaitechnologies.com
Software: Apache /
Resource Hash: 43f804d38a294c6df1ce8ee64fb95ad0ff5a8d6d5685d9537df02212668a1dff

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
last-modified: Mon, 23 Jan 2023 19:40:17 GMT
server: Apache
etag: "d734-5f2f3919e751f-gzip"
vary: Accept-Encoding
content-type: application/javascript
cache-control: max-age=900
accept-ranges: bytes
content-length: 17407
expires: Fri, 05 Apr 2024 16:22:30 GMT

OPTIONS
H2 200 pageview
api.sail-track.com/v1/track/event/ Frame 0
0 308ms
97ms Preflight
text/plain 75.2.104.6
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://api.sail-track.com/v1/track/event/pageview
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 75.2.104.6 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: a710cf531d4cd2506.awsglobalaccelerator.com
Software: /
Resource Hash

Request headers

Accept: */*
Access-Control-Request-Headers: authorization,content-type,x-lib-version
Access-Control-Request-Method: POST
Origin: https://www.theverge.com
Sec-Fetch-Mode: cors
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

access-control-allow-credentials: true
access-control-allow-headers: Content-Type,Authorization,X-Requested-With,Content-Length,Accept,Origin,X-Lib-Version
access-control-allow-methods: GET,POST,OPTIONS
access-control-allow-origin: https://www.theverge.com
access-control-max-age: 1800
allow: POST,OPTIONS
content-length: 13
content-type: text/plain
date: Fri, 05 Apr 2024 16:07:30 GMT

POST
H2 202 pageview Show response
api.sail-track.com/v1/track/event/ 120 B
348 B 106ms
102ms Fetch
application/json 75.2.104.6
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://api.sail-track.com/v1/track/event/pageview
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 75.2.104.6 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: a710cf531d4cd2506.awsglobalaccelerator.com
Software: /
Resource Hash: 1830f6428a2daed959c8c25bcd873c3f8a97cbd8b9a8e6a19e6abc18bd351079

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
X-Lib-Version: v1.0.1
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
Authorization: Bearer d588142387a65e9372652547c863cef3
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
Content-Type: application/json
Accept: application/json
Referer: https://www.theverge.com/
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
allowedorigins: *
content-type: application/json
access-control-allow-origin: *
allowedmethods: GET,OPTIONS
access-control-allow-credentials: true
allowedheaders: Content-Type,Authorization,X-Requested-With,Content-Length,Accept,Origin
content-length: 120

GET
H2 200 initialize Show response
api.sail-personalize.com/v1/personalize/ 91 B
332 B 100ms
98ms Fetch
application/json 99.83.154.140
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://api.sail-personalize.com/v1/personalize/initialize?pageviews=1&isMobile=0
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 99.83.154.140 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: aa7557bb34ea5624b.awsglobalaccelerator.com
Software: /
Resource Hash: 145130417691fb5746dd803a338caee0ce478d42628eaa3c400642b58da32292

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
x-lib-version: v1.0.1
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
authorization: Bearer d588142387a65e9372652547c863cef3
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: application/json
accept: application/json
Referer: https://www.theverge.com/
x-referring-url: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
allowedorigins: *
vary: Accept-Encoding
content-type: application/json
access-control-allow-origin: *
allowedmethods: GET,OPTIONS
access-control-allow-credentials: true
allowedheaders: Content-Type,Authorization,X-Requested-With,Content-Length,Accept,Origin
content-length: 91

OPTIONS
H2 200 initialize
api.sail-personalize.com/v1/personalize/ Frame 0
0 309ms
99ms Preflight
text/plain 99.83.154.140
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://api.sail-personalize.com/v1/personalize/initialize?pageviews=1&isMobile=0
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 99.83.154.140 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: aa7557bb34ea5624b.awsglobalaccelerator.com
Software: /
Resource Hash

Request headers

Accept: */*
Access-Control-Request-Headers: authorization,content-type,x-lib-version,x-referring-url
Access-Control-Request-Method: GET
Origin: https://www.theverge.com
Sec-Fetch-Mode: cors
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

access-control-allow-credentials: true
access-control-allow-headers: Content-Type,Authorization,X-Requested-With,Content-Length,Accept,Origin,X-Lib-Version,X-Referring-URL
access-control-allow-methods: OPTIONS,GET,POST,PUT,DELETE
access-control-allow-origin: https://www.theverge.com
access-control-max-age: 1800
allow: HEAD,GET,OPTIONS
content-length: 18
content-type: text/plain
date: Fri, 05 Apr 2024 16:07:30 GMT

GET
H2 200 skeleton.gif
static.adsafeprotected.com/ 43 B
483 B 39ms
6ms Image
image/gif 2600:9000:223f:f800:8:48e:53c0:93a1
AMAZON-02

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://static.adsafeprotected.com/skeleton.gif?adunitid=kbazv&adnum=936310
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2600:9000:223f:f800:8:48e:53c0:93a1 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 42b976597a2d977d0e300f6d06bc903db389e5c112d33c1c8c249690a522d9f2

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Tue, 02 Apr 2024 20:21:19 GMT
x-amz-version-id: iiN8XkcmZQdDIQeKkzAiegPwcD.5WPja
via: 1.1 22b00b5685ee1822efcb3d9e95d3c19a.cloudfront.net (CloudFront)
x-amz-cf-pop: FRA56-P5
age: 243971
x-amz-server-side-encryption: AES256
x-cache: Hit from cloudfront
x-amz-replication-status: COMPLETED
content-length: 43
last-modified: Mon, 17 Aug 2020 23:55:15 GMT
server: AmazonS3
etag: "45cf913e5d9d3c9b2058033056d3dd23"
content-type: image/gif
cache-control: max-age=315360000
accept-ranges: bytes
x-amz-cf-id: zbz-IU4WJRrRSltGZ0GCF_7aXYdhCRLdq9KTQATpbXIwXT4ygHFk1w==

GET
H2 200 uwt.js Show response
static.ads-twitter.com/ 56 KB
15 KB 67ms
7ms Script
application/javascript 146.75.120.157
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://static.ads-twitter.com/uwt.js
Requested by: Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtm.js?id=GTM-WQ5FM5W
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 146.75.120.157 Frankfurt am Main, Germany, ASN54113 (FASTLY, US),
Reverse DNS
Software: /
Resource Hash: 4d15ff2317e16ccd8ca1d3248fea7d91130e022369bb032824a84ad9967064df

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
last-modified: Fri, 22 Mar 2024 21:07:24 GMT
x-amz-server-side-encryption: AES256
etag: "bbbcf811d8437a575d796a4c1e5d4fad+gzip+gzip"
vary: Accept-Encoding,Host
x-cache: HIT, HIT
content-type: application/javascript; charset=utf-8
p3p: CP="CAO DSP LAW CURa ADMa DEVa TAIa PSAa PSDa IVAa IVDa OUR BUS IND UNI COM NAV INT"
x-tw-cdn: FT
cache-control: no-cache
accept-ranges: bytes
content-length: 15412
x-served-by: cache-iad-kiad7000168-IAD, cache-fra-eddf8230060-FRA

GET
H2 200 js Show response
www.googletagmanager.com/gtag/ 270 KB
92 KB 15ms
15ms Script
application/javascript 2a00:1450:4001:82f::2008
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://www.googletagmanager.com/gtag/js?id=G-9GXHZT6RVE&l=dataLayer&cx=c

Requested by

Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtm.js?id=GTM-WQ5FM5W

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:82f::2008 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

Google Tag Manager /

Resource Hash

16869b7de5b5ce5068e7abb9dd7949df5a486c3d05f430d7b0ad4049b9d3013e

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubDomains
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: br
strict-transport-security: max-age=31536000; includeSubDomains
server: Google Tag Manager
vary: Accept-Encoding
content-type: application/javascript; charset=UTF-8
access-control-allow-origin: *
cache-control: private, max-age=900
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
access-control-allow-headers: Cache-Control
content-length: 94081
x-xss-protection: 0
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
expires: Fri, 05 Apr 2024 16:07:30 GMT

GET
H2 200 analytics.js Show response
www.google-analytics.com/ 52 KB
21 KB 29ms
7ms Script
text/javascript 2001:4860:4802:34::178
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://www.google-analytics.com/analytics.js

Requested by

Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtm.js?id=GTM-WQ5FM5W

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2001:4860:4802:34::178 , United States, ASN15169 (GOOGLE, US),

Reverse DNS

Software

Golfe2 /

Resource Hash

de36e50194320a7d3ef1ace9bd34a875a8bd458b253c061979dd628e9bf49afd

Security Headers

Name	Value
Strict-Transport-Security	max-age=10886400; includeSubDomains; preload
X-Content-Type-Options	nosniff

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

strict-transport-security: max-age=10886400; includeSubDomains; preload
content-encoding: gzip
x-content-type-options: nosniff
date: Fri, 05 Apr 2024 15:48:08 GMT
last-modified: Tue, 12 Dec 2023 18:09:08 GMT
server: Golfe2
age: 1162
vary: Accept-Encoding
content-type: text/javascript
cache-control: public, max-age=7200
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 20994
expires: Fri, 05 Apr 2024 17:48:08 GMT

GET
H2 200 p.js Show response
cdn.parsely.com/keys/theverge.com/ 51 KB
19 KB 33ms
8ms Script
application/javascript 3.161.77.50
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://cdn.parsely.com/keys/theverge.com/p.js
Requested by: Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtm.js?id=GTM-WQ5FM5W
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 3.161.77.50 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-3-161-77-50.fra56.r.cloudfront.net
Software: nginx /
Resource Hash: 89f2521717b00ebac19a1685e8d9783df53d12f216393e05647b4316e6e293e8

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

pragma: public
date: Fri, 05 Apr 2024 05:00:59 GMT
content-encoding: gzip
via: 1.1 18a0c3f5e09e58d51d2e5d6f596d202e.cloudfront.net (CloudFront)
last-modified: Thu, 10 Aug 2023 16:55:33 GMT
server: nginx
x-amz-cf-pop: FRA56-P10
age: 39991
etag: W/"64d51685-cadb"
x-cache: Hit from cloudfront
content-type: application/javascript
cache-control: max-age=86400, public
x-amz-cf-id: 8mNECtF0_D0fEUVwR9njhXb8Ubtq8OxP41m7HGLRWx8uV6WSPk43TA==
expires: Sat, 06 Apr 2024 05:00:59 GMT

GET
H2

200

beacon.js Show response
sb.scorecardresearch.com/internal-cs/default/
Redirect Chain

https://sb.scorecardresearch.com/cs/7976662/beacon.js
https://sb.scorecardresearch.com/internal-cs/default/beacon.js

4 KB
2 KB

8ms
8ms

Script
application/javascript

18.244.18.32
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://sb.scorecardresearch.com/internal-cs/default/beacon.js
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Server: 18.244.18.32 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-18-244-18-32.fra56.r.cloudfront.net
Software: AmazonS3 /
Resource Hash: 84e5aa85594b35c4b60787f4a97e2e1eb369dacbe23d8154f61f60bb0343d465

Request headers

accept-language: de-DE,de;q=0.9
Referer: https://www.theverge.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

date: Fri, 05 Apr 2024 06:24:09 GMT
content-encoding: gzip
via: 1.1 b88a4e10ec6aa05046ba32d44beb97f2.cloudfront.net (CloudFront)
last-modified: Thu, 07 Dec 2023 12:02:23 GMT
server: AmazonS3
x-amz-cf-pop: FRA56-P11
age: 35020
x-amz-server-side-encryption: AES256
etag: W/"77ff4ede4693897337a38594321529a3"
vary: Accept-Encoding
x-cache: Hit from cloudfront
content-type: application/javascript
cache-control: max-age=86400
x-amz-cf-id: r3KIwqx860h7wzwdBMTwaKoRtvnNomv_VxsxSqeppkfe5KRnApN99A==

Redirect headers

date: Fri, 05 Apr 2024 16:07:30 GMT
via: 1.1 b88a4e10ec6aa05046ba32d44beb97f2.cloudfront.net (CloudFront)
accept-ch: UA, Platform, Arch, Model, Mobile
x-amz-cf-pop: FRA56-P11
x-cache: Miss from cloudfront
location: /internal-cs/default/beacon.js
content-length: 0
x-amz-cf-id: wE1Xz3poI48kcWo1Yw_jrNGSnncifTNGjI-lkySUu9FWmbepqOuRhQ==

GET
H2 200 fbevents.js Show response
connect.facebook.net/en_US/ 219 KB
59 KB 24ms
8ms Script
application/x-javascript 2a03:2880:f083:100:face:b00c:0:3
FACEBOOK

General

Check archive.org

Show headers Download Go to

Full URL

https://connect.facebook.net/en_US/fbevents.js

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a03:2880:f083:100:face:b00c:0:3 Frankfurt am Main, Germany, ASN32934 (FACEBOOK, US),

Reverse DNS

Software

Resource Hash

ebcc80bf5e0568d173b31bee579c02a725832f916de3656f7a36f94df865d168

Security Headers

Name	Value
Content-Security-Policy	default-src 'self' data: blob: ;script-src .facebook.com .fbcdn.net .facebook.net 127.0.0.1:* 'unsafe-inline' 'unsafe-eval' blob: data: 'self' https://.google-analytics.com .google.com;style-src data: blob: 'unsafe-inline' ;connect-src .facebook.com facebook.com .fbcdn.net .facebook.net wss://.facebook.com: wss://.whatsapp.com: wss://.fbcdn.net attachment.fbsbx.com ws://localhost: blob: .cdninstagram.com 'self' https://.google-analytics.com;img-src 'self' data: blob: * https://*.google-analytics.com;block-all-mixed-content;upgrade-insecure-requests;require-trusted-types-for 'script';
Strict-Transport-Security	max-age=31536000; preload; includeSubDomains
X-Content-Type-Options	nosniff
X-Frame-Options	DENY
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

content-security-policy: default-src 'self' data: blob: *;script-src *.facebook.com *.fbcdn.net *.facebook.net 127.0.0.1:* 'unsafe-inline' 'unsafe-eval' blob: data: 'self' https://*.google-analytics.com *.google.com;style-src data: blob: 'unsafe-inline' *;connect-src *.facebook.com facebook.com *.fbcdn.net *.facebook.net wss://*.facebook.com:* wss://*.whatsapp.com:* wss://*.fbcdn.net attachment.fbsbx.com ws://localhost:* blob: *.cdninstagram.com 'self' https://*.google-analytics.com;img-src 'self' data: blob: * https://*.google-analytics.com;block-all-mixed-content;upgrade-insecure-requests;require-trusted-types-for 'script';
content-encoding: gzip
x-content-type-options: nosniff
strict-transport-security: max-age=31536000; preload; includeSubDomains
date: Fri, 05 Apr 2024 16:07:30 GMT
document-policy: force-load-at-top
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=86400
content-length: 57928
x-xss-protection: 0
reporting-endpoints: coop_report="https://www.facebook.com/browser_reporting/coop/?minimize=0", coep_report="https://www.facebook.com/browser_reporting/coep/?minimize=0", permissions_policy="https://www.facebook.com/ajax/browser_error_reports/"
x-fb-connection-quality: EXCELLENT; q=0.9, rtt=6, rtx=0, c=12, mss=1326, tbw=2777, tp=-1, tpl=-1, uplat=0, ullat=-1
pragma: public
x-fb-debug: JvAsRhTX7kVFG9f4p40AniHa38Y2Z17Bjh0k/Fv3OUyr7laqXmbj6/FCYzo5La9j+X8LZY6Uy6ag1X6NM28iAA==
cross-origin-embedder-policy-report-only: require-corp;report-to="coep_report"
cross-origin-opener-policy: same-origin-allow-popups;report-to="coop_report"
vary: Accept-Encoding
report-to: {"max_age":2592000,"endpoints":[{"url":"https:\/\/www.facebook.com\/browser_reporting\/coop\/?minimize=0"}],"group":"coop_report","include_subdomains":true}, {"max_age":86400,"endpoints":[{"url":"https:\/\/www.facebook.com\/browser_reporting\/coep\/?minimize=0"}],"group":"coep_report"}, {"max_age":21600,"endpoints":[{"url":"https:\/\/www.facebook.com\/ajax\/browser_error_reports\/"}],"group":"permissions_policy"}
content-type: application/x-javascript; charset=utf-8
x-frame-options: DENY
cache-control: public, max-age=1200
permissions-policy: accelerometer=(), attribution-reporting=(), autoplay=(), bluetooth=(), camera=(), ch-device-memory=(), ch-downlink=(), ch-ect=(), ch-rtt=(), ch-save-data=(), ch-ua-arch=(), ch-ua-bitness=(), clipboard-read=(), clipboard-write=(), display-capture=(), encrypted-media=(), fullscreen=(self), gamepad=(), geolocation=(), gyroscope=(), hid=(), idle-detection=(), keyboard-map=(), local-fonts=(), magnetometer=(), microphone=(), midi=(), otp-credentials=(), payment=(), picture-in-picture=(), publickey-credentials-get=(), screen-wake-lock=(), serial=(), usb=(), window-management=(), xr-spatial-tracking=();report-to="permissions_policy"
timing-allow-origin: *
expires: Sat, 01 Jan 2000 00:00:00 GMT

GET
H2 200 launchpad-liveramp.js Show response
launchpad-wrapper.privacymanager.io/0d9544c1-e3df-40e3-9e69-f6a687c30eeb/ 60 KB
5 KB 33ms
7ms Script
text/javascript 3.160.150.11
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://launchpad-wrapper.privacymanager.io/0d9544c1-e3df-40e3-9e69-f6a687c30eeb/launchpad-liveramp.js
Requested by: Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtm.js?id=GTM-WQ5FM5W
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 3.160.150.11 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-3-160-150-11.fra60.r.cloudfront.net
Software: AmazonS3 /
Resource Hash: 6ea9bd65eced5a37a58cbdc926aea4f117698a6fba5bb8d43b65fb9051be753b

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

x-amz-version-id: AXH9kzTo7e25FqJWGU7wWtD0tZQ2wpEp
content-encoding: gzip
via: 1.1 88fd4dc311317996718ed4ed98e5cbda.cloudfront.net (CloudFront)
date: Fri, 05 Apr 2024 01:03:22 GMT
x-amz-cf-pop: FRA60-P7
age: 54249
x-amz-server-side-encryption: AES256
x-cache: Hit from cloudfront
x-amz-replication-status: COMPLETED
content-disposition: attachment; filename="launchpad-liveramp.js"
last-modified: Wed, 16 Aug 2023 12:37:24 GMT
server: AmazonS3
etag: W/"faf2e73c89fd8eae3e6cd8c85d8bc7d9"
vary: Accept-Encoding
content-type: text/javascript
x-amz-cf-id: FHCXfEK0ryS7GTvmU8N6OnIOfcSN5szYp531KzML_jf0rlqDmDtn4g==

GET
H2 204 state Show response
api.btloader.com/mw/ 0
101 B 147ms
122ms Fetch 130.211.23.194
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL: https://api.btloader.com/mw/state?bt_env=prod
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 130.211.23.194 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),
Reverse DNS: 194.23.211.130.bc.googleusercontent.com
Software: /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

access-control-allow-origin: *
date: Fri, 05 Apr 2024 16:07:30 GMT
via: 1.1 google
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
vary: Origin

GET
H2 200 px.gif
ad-delivery.net/ 43 B
346 B 49ms
18ms Image
image/gif 2606:4700:20::ac43:4513
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://ad-delivery.net/px.gif?ch=2
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2606:4700:20::ac43:4513 , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: cf4724b2f736ed1a0ae6bc28f1ead963d9cd2c1fd87b6ef32e7799fc1c5c8bda

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
cf-cache-status: HIT
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
age: 924211
x-guploader-uploadid: ABPtcPrux6dlODB5e_tasWROPm5jTBdL450Xz1Wts3KrxFSKJRkUiuPhL3oKK-QLBZQzrtIKB6QwkkAwAQ
x-goog-storage-class: MULTI_REGIONAL
x-goog-metageneration: 5
x-goog-stored-content-encoding: identity
content-length: 43
last-modified: Wed, 05 May 2021 19:25:32 GMT
server: cloudflare
etag: "ad4b0f606e0f8465bc4c4c170b37e1a3"
vary: Accept-Encoding
x-goog-generation: 1620242732037093
content-type: image/gif
access-control-allow-origin: *
x-goog-hash: crc32c=cpEfJQ==, md5=rUsPYG4PhGW8TEwXCzfhow==
access-control-expose-headers: *, Content-Length, Date, Server, Transfer-Encoding, X-GUploader-UploadID, X-Google-Trace
cache-control: public, max-age=86400
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v4?s=LHEghYIwCQiSBD72d%2BMbZ%2FpB%2FML1vOiAT5MDTWvy76rX8opVwLxHL%2FP%2BORdutc%2BF2hccAcA5lvKA7oBocjYw2AzJzpIVCdn3gdp9TR2ZHiiaeO%2BQutPMgv4dXwVT70JRerM9uRvyUdR%2B%2B5jqjw%3D%3D"}],"group":"cf-nel","max_age":604800}
x-goog-stored-content-length: 43
accept-ranges: bytes
cf-ray: 86faca9d4d9c2bc7-FRA
expires: Mon, 25 Mar 2024 23:55:46 GMT

GET
H3 200 favicon.ico
ad.doubleclick.net/ 1 KB
130 B 38ms
8ms Image
image/x-icon 142.250.185.70
GOOGLE

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://ad.doubleclick.net/favicon.ico?ad=300x250&ad_box_=1&adnet=1&showad=1&size=250x250

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Security

QUIC, , AES_128_GCM

Server

142.250.185.70 , United States, ASN15169 (GOOGLE, US),

Reverse DNS

fra16s48-in-f6.1e100.net

Software

sffe /

Resource Hash

d961b08e4321250926de6f79087594975fe20ad1518de8f91eb711af5d1a6ef8

Security Headers

Name	Value
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 03:51:01 GMT
content-encoding: gzip
x-content-type-options: nosniff
age: 44189
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 104
x-xss-protection: 0
last-modified: Tue, 08 May 2012 13:08:06 GMT
server: sffe
vary: Accept-Encoding
report-to: {"group":"ads-doubleclick-media","max_age":2592000,"endpoints":[{"url":"https://csp.withgoogle.com/csp/report-to/ads-doubleclick-media"}]}
content-type: image/x-icon
access-control-allow-origin: *
cache-control: public, max-age=86400
accept-ranges: bytes
cross-origin-opener-policy-report-only: same-origin; report-to="ads-doubleclick-media"
expires: Sat, 06 Apr 2024 03:51:01 GMT

GET
H2 200 px.gif
ad-delivery.net/ 43 B
925 B 48ms
18ms Image
image/gif 2606:4700:20::ac43:4513
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://ad-delivery.net/px.gif?ch=1&e=0.23725857457592037
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2606:4700:20::ac43:4513 , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: cf4724b2f736ed1a0ae6bc28f1ead963d9cd2c1fd87b6ef32e7799fc1c5c8bda

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
cf-cache-status: HIT
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
age: 924211
x-guploader-uploadid: ABPtcPrux6dlODB5e_tasWROPm5jTBdL450Xz1Wts3KrxFSKJRkUiuPhL3oKK-QLBZQzrtIKB6QwkkAwAQ
x-goog-storage-class: MULTI_REGIONAL
x-goog-metageneration: 5
x-goog-stored-content-encoding: identity
content-length: 43
last-modified: Wed, 05 May 2021 19:25:32 GMT
server: cloudflare
etag: "ad4b0f606e0f8465bc4c4c170b37e1a3"
vary: Accept-Encoding
x-goog-generation: 1620242732037093
content-type: image/gif
access-control-allow-origin: *
x-goog-hash: crc32c=cpEfJQ==, md5=rUsPYG4PhGW8TEwXCzfhow==
access-control-expose-headers: *, Content-Length, Date, Server, Transfer-Encoding, X-GUploader-UploadID, X-Google-Trace
cache-control: public, max-age=86400
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v4?s=9iee9tIMD9g%2BtKt5k%2FLPVLLlYQAvUdnuWBe0s%2Bn65quO%2Bmz%2B8zeZ%2FPOzsv5DDb3QkulUfgNNVAZnza5YefecI26G5b3IiS0Rq%2FP1eQCSKpjhjYZi389qydKsk0%2BQg8OTuzp%2FFpvpN0y6uXDh8g%3D%3D"}],"group":"cf-nel","max_age":604800}
x-goog-stored-content-length: 43
accept-ranges: bytes
cf-ray: 86faca9d4d982bc7-FRA
expires: Mon, 25 Mar 2024 23:55:46 GMT

GET
H2 200 AGSKWxVnrj09KIL__QfO-lN76kQbmtc5pRBNLZOWKC8FqpYBl_Mv13ELMuIlBH10vq12Ju3DO8F0OPNHnyMFAOtM4e8QaIRdPp1ma4bfO3EN11dPkVbENS6_A99slogUgC2g7DrnIE8gPQ== Show response
fundingchoicesmessages.google.com/f/ 386 KB
59 KB 112ms
112ms Script
application/javascript 2a00:1450:4001:806::200e
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://fundingchoicesmessages.google.com/f/AGSKWxVnrj09KIL__QfO-lN76kQbmtc5pRBNLZOWKC8FqpYBl_Mv13ELMuIlBH10vq12Ju3DO8F0OPNHnyMFAOtM4e8QaIRdPp1ma4bfO3EN11dPkVbENS6_A99slogUgC2g7DrnIE8gPQ==?fccs=W251bGwsbnVsbCxudWxsLG51bGwsbnVsbCxudWxsLFsxNzEyMzMzMjUwLDEyNTAwMDAwMF0sbnVsbCxudWxsLG51bGwsW251bGwsWzddXSwiaHR0cHM6Ly93d3cudGhldmVyZ2UuY29tLzI0MDY3OTk3L3JvYm90cy10eHQtYWktdGV4dC1maWxlLXdlYi1jcmF3bGVycy1zcGlkZXJzIixudWxsLFtbOCwiNUQwRWlxSXBlcHciXSxbOSwiZGUiXSxbMTksIjEiXSxbMTcsIlswXSJdXV0

Requested by

Host:
URL: /_/mss/boq-content-ads-contributor/_/js/k=boq-content-ads-contributor.ContributorServingResponseClientJs.de.5D0EiqIpepw.es5.O/am=wA/d=1/rs=AJlcJMxi9Vcl3yVdW3WorG6WjiCItely3w/m=kernel_loader,loader_js_executable

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:806::200e Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

ESF /

Resource Hash

0ece10ce5660b339bb20a24626799a864e392f545d623e2c7c4cc723d29e8dba

Security Headers

Name	Value
Content-Security-Policy	require-trusted-types-for 'script';report-uri /_/ContributorGlobalRouterHttp/cspreport, script-src 'report-sample' 'nonce-hQWjb4OueBmJ1YYUR3cg4A' 'unsafe-inline';object-src 'none';base-uri 'self';report-uri /_/ContributorGlobalRouterHttp/cspreport;worker-src 'self', script-src 'unsafe-inline' 'self' https://apis.google.com https://ssl.gstatic.com https://www.google.com https://www.googletagmanager.com https://www.gstatic.com https://www.google-analytics.com;report-uri /_/ContributorGlobalRouterHttp/cspreport/allowlist
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-security-policy: require-trusted-types-for 'script';report-uri /_/ContributorGlobalRouterHttp/cspreport, script-src 'report-sample' 'nonce-hQWjb4OueBmJ1YYUR3cg4A' 'unsafe-inline';object-src 'none';base-uri 'self';report-uri /_/ContributorGlobalRouterHttp/cspreport;worker-src 'self', script-src 'unsafe-inline' 'self' https://apis.google.com https://ssl.gstatic.com https://www.google.com https://www.googletagmanager.com https://www.gstatic.com https://www.google-analytics.com;report-uri /_/ContributorGlobalRouterHttp/cspreport/allowlist
content-encoding: gzip
x-content-type-options: nosniff
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
x-xss-protection: 0
reporting-endpoints: default="/_/ContributorGlobalRouterHttp/web-reports?context=eJzjKtDikmII0pBiOO90h-k6ENcyPGNqBWIDjedMFkD87stLJoGvL5kkgFgLiPnWTWdVAWLD9dNZI4E45vl01hQgdkqfwRoCxD71M1jjgLj15jnW6UB8csF51otAnPTvPGsJEAtxcxw6fGADm8CH-VtzAWS6Nds"
pragma: no-cache
accept-ch: Sec-CH-UA-Arch, Sec-CH-UA-Bitness, Sec-CH-UA-Full-Version, Sec-CH-UA-Full-Version-List, Sec-CH-UA-Model, Sec-CH-UA-WoW64, Sec-CH-UA-Form-Factor, Sec-CH-UA-Platform, Sec-CH-UA-Platform-Version
cross-origin-opener-policy: same-origin
server: ESF
vary: Sec-Fetch-Dest, Sec-Fetch-Mode, Sec-Fetch-Site
x-frame-options: SAMEORIGIN
content-type: application/javascript; charset=utf-8
cache-control: no-cache, no-store, max-age=0, must-revalidate
permissions-policy: ch-ua-arch=*, ch-ua-bitness=*, ch-ua-full-version=*, ch-ua-full-version-list=*, ch-ua-model=*, ch-ua-wow64=*, ch-ua-form-factor=*, ch-ua-platform=*, ch-ua-platform-version=*
timing-allow-origin: *
expires: Mon, 01 Jan 1990 00:00:00 GMT

GET
H3 200 elLoader.js Show response
cds.connatix.com/p/462462/ Frame E480 3 KB
2 KB 35ms
17ms Script
application/javascript 172.64.146.152
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cds.connatix.com/p/462462/elLoader.js
Requested by: Host: cd.connatix.com
URL: https://cd.connatix.com/connatix.player.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 172.64.146.152 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 8287cbeda5de6ee08fab380dceb44392a2053ef697053bd5a493411fec8e8edc

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
x-amz-version-id: 1DsNgJIABHuZLS5eSGOd3I1.9fcppSHr
content-encoding: br
cf-cache-status: HIT
x-amz-replication-status: FAILED
alt-svc: h3=":443"; ma=86400
last-modified: Fri, 05 Apr 2024 15:09:59 GMT
server: cloudflare
etag: W/"bcca60fd81e68ada07b8d05b970cd8c6"
vary: Accept-Encoding
access-control-allow-methods: *
content-type: application/javascript
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
access-control-max-age: 86400
cf-ray: 86faca9d6e7a8ff5-FRA
access-control-allow-headers: range
expires: Sat, 05 Apr 2025 16:07:30 GMT

GET
H3 200 bootstrap Show response
theverge.coral.coralproject.net/embed/ 1 KB
1 KB 123ms
108ms XHR
application/json 34.111.9.237
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL

https://theverge.coral.coralproject.net/embed/bootstrap

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js

Protocol

Security

QUIC, , AES_128_GCM

Server

34.111.9.237 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),

Reverse DNS

237.9.111.34.bc.googleusercontent.com

Software

Resource Hash

5e60a4cde4c31f24f9cffc22654390b2a1294037922bc7d27be449241ad01d68

Security Headers

Name	Value
Strict-Transport-Security	max-age=15552000
X-Content-Type-Options	nosniff
X-Xss-Protection	1; mode=block

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

x-trace-id: 9aa80360-f366-11ee-aa40-8b2e9e1d4e89
strict-transport-security: max-age=15552000
date: Fri, 05 Apr 2024 16:07:30 GMT
x-content-type-options: nosniff
referrer-policy: strict-origin-when-cross-origin
via: 1.1 google
etag: W/"413-t7lqU35jBSDmORgzq3wMHOjMN2s"
content-type: application/json; charset=utf-8
access-control-allow-origin: *
content-language: en-US
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 1043
x-xss-protection: 1; mode=block

GET
H2 200 count.js Show response
theverge.coral.coralproject.net/assets/js/ 22 KB
8 KB 109ms
109ms Script
application/javascript 34.111.9.237
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL

https://theverge.coral.coralproject.net/assets/js/count.js?ts=1712333700000

Requested by

Host: theverge.coral.coralproject.net
URL: https://theverge.coral.coralproject.net/assets/js/embed.js?v=0

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

34.111.9.237 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),

Reverse DNS

237.9.111.34.bc.googleusercontent.com

Software

Resource Hash

e9a89b51a0e1567900339da4a06cdae64dce8c23c24a9cea85b6249511b7c279

Security Headers

Name	Value
Strict-Transport-Security	max-age=15552000
X-Content-Type-Options	nosniff
X-Xss-Protection	1; mode=block

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

strict-transport-security: max-age=15552000
content-encoding: gzip
x-content-type-options: nosniff
date: Fri, 05 Apr 2024 16:07:26 GMT
via: 1.1 google
age: 4
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 8078
x-xss-protection: 1; mode=block
x-trace-id: 9874cfb0-f366-11ee-ba0a-a3e264732f43
referrer-policy: strict-origin-when-cross-origin
last-modified: Tue, 26 Mar 2024 15:41:59 GMT
etag: W/"1f8e-18e7b6ce958"
vary: Accept-Encoding
content-language: en-US
content-type: application/javascript; charset=UTF-8
cache-control: public,max-age=1800,s-max-age=604800
accept-ranges: bytes

POST
H3 204 event.png
pub.doubleverify.com/dvtag/metrics/ 0
157 B 25ms
24ms Ping
text/plain 2606:4700::6812:a6e0
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL

https://pub.doubleverify.com/dvtag/metrics/event.png?b11=success&d6=0&d7=268&b12=modern&b2=874620b&b3=&b7=f5d04ff4-7c0f-4493-afd4-1a17c0dd8664&b9=modern&b8=&b5=21236410&b6=DV464041&b4=www.theverge.com&b1=ad-request&d1=1&d2=1

Requested by

Host: pub.doubleverify.com
URL: https://pub.doubleverify.com/dvtag/21236410/DV464041/pub.js

Protocol

Security

QUIC, , AES_128_GCM

Server

2606:4700::6812:a6e0 , United States, ASN13335 (CLOUDFLARENET, US),

Reverse DNS

Software

cloudflare /

Resource Hash

e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Security Headers

Name	Value
Content-Security-Policy	frame-ancestors 'self'
Strict-Transport-Security	max-age=31536000; includeSubDomains
X-Frame-Options	SAMEORIGIN

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

content-security-policy: frame-ancestors 'self'
date: Fri, 05 Apr 2024 16:07:30 GMT
strict-transport-security: max-age=31536000; includeSubDomains
server: cloudflare
vary: Accept-Encoding
x-frame-options: SAMEORIGIN
cf-ray: 86faca9d8c37363b-FRA
alt-svc: h3=":443"; ma=86400

GET
H2 200 topics.html
widgets.outbrain.com/nanoWidget/externals/topics/ Frame 8080 0
0 39ms
13ms Document
text/html 23.35.237.86
AKAMAI-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://widgets.outbrain.com/nanoWidget/externals/topics/topics.html?r=https%3A%2F%2Fwww.theverge.com
Requested by: Host: widgets.outbrain.com
URL: https://widgets.outbrain.com/outbrain.js
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 23.35.237.86 Frankfurt am Main, Germany, ASN16625 (AKAMAI-AS, US),
Reverse DNS: a23-35-237-86.deploy.static.akamaitechnologies.com
Software: AkamaiNetStorage /
Resource Hash

Request headers

Referer: https://www.theverge.com/
Upgrade-Insecure-Requests: 1
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
accept-language: de-DE,de;q=0.9
sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-mobile: ?0
sec-ch-ua-platform: "Win32"

Response headers

accept-ranges: bytes
access-control-allow-credentials: false
access-control-allow-methods: GET,POST
access-control-allow-origin: *
access-control-request-headers: X-OB-STG,X-OB-PRD
cache-control: max-age=14400
content-length: 667
content-type: text/html
date: Fri, 05 Apr 2024 16:07:30 GMT
etag: "a52151dbf5b2ca563e40ccca1ab8228c:1711956574.418085"
expires: Fri, 05 Apr 2024 20:07:30 GMT
last-modified: Mon, 01 Apr 2024 06:45:56 GMT
server: AkamaiNetStorage
timing-allow-origin: * *

GET
H2 200 px.gif
widget-pixels.outbrain.com/widget/detect/ 43 B
371 B 22ms
14ms Image
image/gif 23.35.237.86
AKAMAI-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://widget-pixels.outbrain.com/widget/detect/px.gif?ch=1
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 23.35.237.86 Frankfurt am Main, Germany, ASN16625 (AKAMAI-AS, US),
Reverse DNS: a23-35-237-86.deploy.static.akamaitechnologies.com
Software: AkamaiNetStorage /
Resource Hash: cf4724b2f736ed1a0ae6bc28f1ead963d9cd2c1fd87b6ef32e7799fc1c5c8bda

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

expires: Sun, 05 May 2024 16:07:30 GMT
date: Fri, 05 Apr 2024 16:07:30 GMT
last-modified: Wed, 30 Sep 2020 14:22:29 GMT
server: AkamaiNetStorage
etag: "ad4b0f606e0f8465bc4c4c170b37e1a3:1601475749.911431"
access-control-allow-methods: GET,POST
content-type: image/gif
access-control-allow-origin: *
cache-control: max-age=2592000
access-control-allow-credentials: false
accept-ranges: bytes
timing-allow-origin: *, *
content-length: 43
access-control-request-headers: X-OB-STG,X-OB-PRD

GET
H2 403 / Show response
id.sv.rkdms.com/identity/ 72 B
232 B 310ms
106ms XHR
application/json 52.204.131.34
AMAZON-AES

General

Check archive.org

Show headers Download Go to

Full URL: https://id.sv.rkdms.com/identity/?vendor=idsv2&sv_cid=5274_04512&sv_pubid=VOX&sv_domain=www.theverge.com
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 52.204.131.34 Ashburn, United States, ASN14618 (AMAZON-AES, US),
Reverse DNS: ec2-52-204-131-34.compute-1.amazonaws.com
Software: awselb/2.0 /
Resource Hash: 6851edc0fca6eb99fa5fa083c37055fb96b62567bcd4730305e755e4cc0ab82a

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
Content-Type: application/x-www-form-urlencoded; charset=UTF-8

Response headers

access-control-allow-origin: https://www.theverge.com
date: Fri, 05 Apr 2024 16:07:30 GMT
access-control-allow-credentials: true
server: awselb/2.0
content-length: 72
vary: Accept-Encoding
content-type: application/json

GET
H2 200 rid Show response
match.adsrvr.org/track/ 63 B
421 B 97ms
29ms XHR
application/json 15.197.193.217
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://match.adsrvr.org/track/rid?ttd_pid=casale&fmt=json&p=183789
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 15.197.193.217 Seattle, United States, ASN16509 (AMAZON-02, US),
Reverse DNS: a12b7a488abeaa9e4.awsglobalaccelerator.com
Software: Kestrel /
Resource Hash: 89dc3a78c5fc09aa524957e19601e3989f739e8e3ea639b019d12a87e0a7e750

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
Content-Type: application/x-www-form-urlencoded; charset=UTF-8

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
server: Kestrel
vary: Origin, Accept-Encoding
content-type: application/json
access-control-allow-origin: https://www.theverge.com
cache-control: private
access-control-allow-credentials: true
access-control-allow-headers: Origin, X-Requested-With, Content-Type, Content-Length, Content-Encoding, Vary, Cache-Control, Accept
expires: Sun, 05 May 2024 16:07:30 GMT

GET
H2 451 identity Show response
api.rlcdn.com/api/ 44 B
352 B 42ms
17ms XHR
text/plain 34.120.133.55
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL

https://api.rlcdn.com/api/identity?pid=2&rt=envelope

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

34.120.133.55 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),

Reverse DNS

55.133.120.34.bc.googleusercontent.com

Software

Resource Hash

da45962a1fb4a049c9367ebe9b1b628f071d7a4c9997ee807c01d23f4866e19c

Security Headers

Name	Value
X-Content-Type-Options	nosniff

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
Content-Type: application/x-www-form-urlencoded; charset=UTF-8

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
via: 1.1 google
x-content-type-options: nosniff
access-control-allow-methods: GET, OPTIONS
content-type: text/plain; charset=utf-8
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
access-control-allow-headers: Accept, Authorization, Content-Type, Cookie, Origin, X-Requested-With
content-length: 44
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000

GET
H2 200 bid Show response
aax.amazon-adsystem.com/e/dtb/ 64 B
400 B 81ms
49ms XHR
text/javascript 13.33.173.196
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://aax.amazon-adsystem.com/e/dtb/bid?src=3176&u=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&pid=bFfV9hbdBjy2P&cb=0&ws=1600x1113&v=24.305.1002&t=1500&slots=%5B%7B%22sd%22%3A%22div-gpt-ad-medium_rectangle_variable%22%2C%22s%22%3A%5B%22300x250%22%2C%22300x600%22%5D%2C%22sn%22%3A%22%2F172968584%2Fverge%2Ffront-page%22%7D%2C%7B%22sd%22%3A%22div-gpt-ad-btf_medium_rectangle_variable_article%22%2C%22s%22%3A%5B%22300x250%22%2C%22300x600%22%5D%2C%22sn%22%3A%22%2F172968584%2Fverge%2Ffront-page%22%7D%2C%7B%22sd%22%3A%22div-gpt-ad-medium_rectangle_gamestop_desktop%22%2C%22s%22%3A%5B%22300x250%22%5D%2C%22sn%22%3A%22%2F172968584%2Fverge%2Ffront-page%22%7D%2C%7B%22sd%22%3A%22div-gpt-ad-medium_rectangle_gamestop_desktop_1%22%2C%22s%22%3A%5B%22300x250%22%5D%2C%22sn%22%3A%22%2F172968584%2Fverge%2Ffront-page%22%7D%2C%7B%22sd%22%3A%22div-gpt-ad-athena_feature%22%2C%22s%22%3A%5B%221030x590%22%2C%22728x90%22%2C%221060x610%22%2C%22970x250%22%5D%2C%22sn%22%3A%22%2F172968584%2Fverge%2Ffront-page%22%7D%2C%7B%22sd%22%3A%22div-gpt-ad-btf_leaderboard_variable%22%2C%22s%22%3A%5B%22728x90%22%2C%221020x90%22%2C%22970x90%22%5D%2C%22sn%22%3A%22%2F172968584%2Fverge%2Ffront-page%22%7D%2C%7B%22sd%22%3A%22div-gpt-ad-desktop_feature_body%22%2C%22s%22%3A%5B%221030x590%22%2C%22300x250%22%5D%2C%22sn%22%3A%22%2F172968584%2Fverge%2Ffront-page%22%7D%2C%7B%22sd%22%3A%22div-gpt-ad-desktop_feature_body_dynamic%22%2C%22s%22%3A%5B%22300x250%22%2C%221030x590%22%5D%2C%22sn%22%3A%22%2F172968584%2Fverge%2Ffront-page%22%7D%2C%7B%22sd%22%3A%22div-gpt-ad-desktop_feature_body_dynamic_1%22%2C%22s%22%3A%5B%22300x250%22%2C%221030x590%22%5D%2C%22sn%22%3A%22%2F172968584%2Fverge%2Ffront-page%22%7D%2C%7B%22sd%22%3A%22div-gpt-ad-desktop_feature_body_dynamic_2%22%2C%22s%22%3A%5B%22300x250%22%2C%221030x590%22%5D%2C%22sn%22%3A%22%2F172968584%2Fverge%2Ffront-page%22%7D%2C%7B%22sd%22%3A%22div-gpt-ad-sponsored-gift-ad%22%2C%22s%22%3A%5B%22200x100%22%5D%2C%22sn%22%3A%22%2F172968584%2Fverge%2Ffront-page%22%7D%5D&gdpre=1&gdprl=%7B%22status%22%3A%22tcfv2-success%22%7D
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 13.33.173.196 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-13-33-173-196.fra60.r.cloudfront.net
Software: Server /
Resource Hash: a4c1d1593ad1518a5ae988850f59f26dcb7cf64e823ee0fea0fb5c2f35e928cc

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
via: 1.1 ccd3e547bd5d86bbfbaca15b4307ce70.cloudfront.net (CloudFront)
server: Server
x-amz-cf-pop: FRA60-P9
x-cache: Miss from cloudfront
content-type: text/javascript;charset=UTF-8
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
timing-allow-origin: *
content-length: 64
x-amz-cf-id: LGhFluHFI9cYZInxOwF2KLUYTEcPgBdCCdDCyg_yw228AcMIQyrvKA==

GET
H/1.1 204
No content uspapi_delete_c2s Show response
media.grid.bidswitch.net/ 0
334 B 15ms
15ms Fetch
text/html 35.214.187.215
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL: https://media.grid.bidswitch.net/uspapi_delete_c2s
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: HTTP/1.1
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 35.214.187.215 Groningen, Netherlands, ASN15169 (GOOGLE, US),
Reverse DNS: 215.187.214.35.bc.googleusercontent.com
Software: nginx /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

Date: Fri, 05 Apr 2024 16:07:30 GMT
Server: nginx
Content-Type: text/html; charset=UTF-8
Access-Control-Allow-Origin: https://www.theverge.com
Cache-Control: no-cache, no-store, must-revalidate
Access-Control-Allow-Credentials: true
Bad-Request-Reason: Invalid 'tuuid' cookie
Connection: keep-alive

GET
H2 200 d2fb08da-1c03-4c8a-978f-ad8a96b4c31f-web.js Show response
cdn.permutive.com/ 567 KB
137 KB 60ms
32ms Script
application/javascript 2606:4700::6811:7711
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cdn.permutive.com/d2fb08da-1c03-4c8a-978f-ad8a96b4c31f-web.js
Requested by: Host: cdn.concert.io
URL: https://cdn.concert.io/lib/concert-ads/v2-latest/concert_ads.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2606:4700::6811:7711 , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 58a3f0dbdfe77bfa7432d4a271c48f6cc9d23b32a472dc3985e0f8afafbd4f19

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: br
cf-cache-status: HIT
x-goog-meta-oid: d2fb08da-1c03-4c8a-978f-ad8a96b4c31f
age: 0
x-guploader-uploadid: ABPtcPoiP4mFHmlw3xBOTyALnN2cf-avtcm5AHFlxHW4yHDQ3PL_tnodbsYbIJefaCmsEScvDHnuVozEYA
x-goog-storage-class: REGIONAL
x-goog-metageneration: 1
x-goog-stored-content-encoding: br
content-length: 139482
last-modified: Fri, 05 Apr 2024 01:37:47 GMT
server: cloudflare
etag: "9f01a8536c2e97d8f0d889bd43966a84"
vary: Accept-Encoding
x-goog-generation: 1712281067216117
content-type: application/javascript
x-goog-hash: crc32c=9Usf+Q==, md5=nwGoU2wul9jw2Im9Q5ZqhA==
cache-control: public, max-age=900
x-goog-stored-content-length: 139482
accept-ranges: bytes
timing-allow-origin: *
cf-ray: 86faca9e5c0e35ea-FRA
expires: Fri, 05 Apr 2024 16:22:30 GMT

GET
H2 200 country Show response
api.btloader.com/ 16 B
132 B 118ms
118ms Fetch
application/json 130.211.23.194
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL: https://api.btloader.com/country
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 130.211.23.194 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),
Reverse DNS: 194.23.211.130.bc.googleusercontent.com
Software: /
Resource Hash: a04a64eb55c4a16ed352d149385a8ac8d8c2d3291f0e5b59b0f48375443b5f24

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
via: 1.1 google
vary: Origin
content-type: application/json
access-control-allow-origin: *
cache-control: private, max-age=300, stale-while-revalidate=600, stale-if-error=600
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 16

GET
H/1.1 200
OK /
p1.parsely.com/plogger/ 43 B
257 B 124ms
28ms Image
image/gif 54.155.18.159
AMAZON-02

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://p1.parsely.com/plogger/?rand=1712333250286&plid=5ee956e6-a329-48a9-9a42-49e4c828c8fd&idsite=theverge.com&url=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&urlref=&screen=800x600%7C800x600%7C24&data=%7B%7D&sid=1&surl=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&sref=&sts=1712333250283&slts=0&title=With+the+rise+of+AI%2C+web+crawlers+are+suddenly+controversial+-+The+Verge&date=Fri+Apr+05+2024+18%3A07%3A30+GMT%2B0200+(Central+European+Summer+Time)&action=pageview&pvid=bcf1ef90-2ef8-4e6a-81a2-d0fc83c58c0a&u=pid%3D1bc8d4e1-d2c5-46d5-893d-02e382102af1
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: HTTP/1.1
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 54.155.18.159 Dublin, Ireland, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-54-155-18-159.eu-west-1.compute.amazonaws.com
Software: nginx /
Resource Hash: cf4724b2f736ed1a0ae6bc28f1ead963d9cd2c1fd87b6ef32e7799fc1c5c8bda

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

Date: Fri, 05 Apr 2024 16:07:30 GMT
Cache-Control: no-cache
Last-Modified: Friday, 05-Apr-2024 16:07:30 GMT
Server: nginx
Connection: keep-alive
Content-Length: 43
Content-Type: image/gif

GET
H2 200 linkid.js Show response
www.google-analytics.com/plugins/ua/ 2 KB
1 KB 7ms
7ms Script
text/javascript 2001:4860:4802:34::178
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://www.google-analytics.com/plugins/ua/linkid.js

Requested by

Host: www.google-analytics.com
URL: https://www.google-analytics.com/analytics.js

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2001:4860:4802:34::178 , United States, ASN15169 (GOOGLE, US),

Reverse DNS

Software

sffe /

Resource Hash

92fca55833f48b4289ac8f1cedd48752b580fce4ec4b5d81670b8193d6e51b54

Security Headers

Name	Value
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:01:36 GMT
content-encoding: br
x-content-type-options: nosniff
age: 354
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 697
x-xss-protection: 0
last-modified: Fri, 30 Jun 2023 18:58:00 GMT
server: sffe
vary: Accept-Encoding
report-to: {"group":"static-on-bigtable","max_age":2592000,"endpoints":[{"url":"https://csp.withgoogle.com/csp/report-to/static-on-bigtable"}]}
content-type: text/javascript
cache-control: public, max-age=3600
accept-ranges: bytes
cross-origin-opener-policy-report-only: same-origin; report-to="static-on-bigtable"
expires: Fri, 05 Apr 2024 17:01:36 GMT

GET
H2 200 launchpad.bundle.js Show response
launchpad.privacymanager.io/latest/ 126 KB
26 KB 37ms
7ms Script
application/x-javascript 13.32.27.115
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://launchpad.privacymanager.io/latest/launchpad.bundle.js
Requested by: Host: launchpad-wrapper.privacymanager.io
URL: https://launchpad-wrapper.privacymanager.io/0d9544c1-e3df-40e3-9e69-f6a687c30eeb/launchpad-liveramp.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 13.32.27.115 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-13-32-27-115.fra56.r.cloudfront.net
Software: AmazonS3 /
Resource Hash: c5fe4b16f14fbab784667a876b5b687b1278e692b64a5e5b04e2da18bbd3de52

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

x-amz-version-id: .0smH5v3yC0Mj5CY0Yn4_OXkkced__tN
content-encoding: br
via: 1.1 6c7a5d26be7fb35284e54d321f16b6f6.cloudfront.net (CloudFront)
date: Fri, 05 Apr 2024 15:53:08 GMT
last-modified: Mon, 26 Feb 2024 08:21:44 GMT
server: AmazonS3
x-amz-cf-pop: FRA56-C2
age: 863
x-amz-server-side-encryption: AES256
etag: W/"a92f9ecbaf5821d1d35c439a0dc33104"
vary: Accept-Encoding
x-cache: Hit from cloudfront
content-type: application/x-javascript
cache-control: must-revalidate,public,max-age=3600
x-amz-cf-id: VNvith4mhnxe_UeZH1BvwHZikjmjMioDMaQvZGaogOCM-nl3yiLdVw==

GET
H2 200 adsct
t.co/1/i/ 43 B
378 B 262ms
212ms Image
image/gif 104.244.42.133
TWITTER

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://t.co/1/i/adsct?bci=4&eci=3&event=%7B%7D&event_id=18f2f866-94b9-4618-a0bb-20da42f7bdda&integration=gtm&p_id=Twitter&p_user_id=0&pl_id=cf6f9420-fffe-4b53-939b-63cfdbc27c2e&tw_document_href=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&tw_iframe_status=0&txn_id=nzjqm&type=javascript&version=2.3.30

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.244.42.133 , United States, ASN13414 (TWITTER, US),

Reverse DNS

Software

tsa_f /

Resource Hash

ac8778041fdb7f2e08ceb574c9a766247ea26f1a7d90fa854c4efcf4b361a957

Security Headers

Name	Value
Strict-Transport-Security	max-age=0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

x-response-time: 193
date: Fri, 05 Apr 2024 16:07:29 GMT
strict-transport-security: max-age=0
server: tsa_f
content-type: image/gif;charset=utf-8
x-transaction-id: bbb5cbd2bd3a5f61
cache-control: no-cache, no-store, max-age=0
perf: 7469935968
x-connection-hash: 06e5fce2f3ad2e8a02856269f7047cb8a466657b2b7f1a79504d06bad625c127
content-length: 43

GET
H2 200 adsct
analytics.twitter.com/1/i/ 43 B
724 B 252ms
199ms Image
image/gif 104.244.42.3
TWITTER

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://analytics.twitter.com/1/i/adsct?bci=4&eci=3&event=%7B%7D&event_id=18f2f866-94b9-4618-a0bb-20da42f7bdda&integration=gtm&p_id=Twitter&p_user_id=0&pl_id=cf6f9420-fffe-4b53-939b-63cfdbc27c2e&tw_document_href=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&tw_iframe_status=0&txn_id=nzjqm&type=javascript&version=2.3.30

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.244.42.3 , United States, ASN13414 (TWITTER, US),

Reverse DNS

Software

tsa_f /

Resource Hash

ac8778041fdb7f2e08ceb574c9a766247ea26f1a7d90fa854c4efcf4b361a957

Security Headers

Name	Value
Strict-Transport-Security	max-age=631138519

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

x-response-time: 181
date: Fri, 05 Apr 2024 16:07:30 GMT
strict-transport-security: max-age=631138519
server: tsa_f
content-type: image/gif;charset=utf-8
x-transaction-id: b01135b0c1ed70d7
cache-control: no-cache, no-store, max-age=0
perf: 7469935968
x-connection-hash: 98fe14a9b902261224abccbbf4cc794c4ed736e7e6b922f46ab571b5e241de29
content-length: 43

GET
H2 200 594981607301768 Show response
connect.facebook.net/signals/config/ 58 KB
12 KB 9ms
7ms Script
application/x-javascript 2a03:2880:f083:100:face:b00c:0:3
FACEBOOK

General

Check archive.org

Show headers Download Go to

Full URL

https://connect.facebook.net/signals/config/594981607301768?v=2.9.152&r=stable&domain=www.theverge.com&hme=c3a545c63044e8e9102d4f32d84a1137594d024f28e801d670bc76dc5c075575&ex_m=67%2C112%2C99%2C103%2C58%2C3%2C93%2C66%2C15%2C91%2C84%2C49%2C51%2C158%2C161%2C172%2C168%2C169%2C171%2C28%2C94%2C50%2C73%2C170%2C153%2C156%2C165%2C166%2C173%2C121%2C14%2C48%2C178%2C177%2C123%2C17%2C33%2C38%2C1%2C41%2C62%2C63%2C64%2C68%2C88%2C16%2C13%2C90%2C87%2C86%2C100%2C102%2C37%2C101%2C29%2C25%2C154%2C157%2C130%2C27%2C10%2C11%2C12%2C5%2C6%2C24%2C21%2C22%2C54%2C59%2C61%2C71%2C95%2C26%2C72%2C8%2C7%2C76%2C46%2C20%2C97%2C96%2C9%2C19%2C18%2C81%2C53%2C79%2C32%2C70%2C0%2C89%2C31%2C78%2C83%2C45%2C44%2C82%2C36%2C4%2C85%2C77%2C42%2C39%2C34%2C80%2C2%2C35%2C60%2C40%2C98%2C43%2C75%2C65%2C104%2C57%2C56%2C30%2C92%2C55%2C52%2C47%2C74%2C69%2C23%2C105

Requested by

Host: connect.facebook.net
URL: https://connect.facebook.net/en_US/fbevents.js

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a03:2880:f083:100:face:b00c:0:3 Frankfurt am Main, Germany, ASN32934 (FACEBOOK, US),

Reverse DNS

Software

Resource Hash

63b916836d884950f752d3c4df2082f8ab887a19de20ab3483d6bb779cde1025

Security Headers

Name	Value
Content-Security-Policy	default-src 'self' data: blob: facebook.net .facebook.net fbcdn.net .fbcdn.net fbsbx.com .fbsbx.com;script-src .fbcdn.net .facebook.net 'unsafe-inline' 'unsafe-eval' blob: data: 'self';style-src data: blob: 'unsafe-inline' facebook.net .facebook.net fbcdn.net .fbcdn.net fbsbx.com .fbsbx.com;connect-src .fbcdn.net .facebook.net wss://.fbcdn.net attachment.fbsbx.com blob: 'self';img-src 'self' data: blob: facebook.net .facebook.net fbcdn.net .fbcdn.net fbsbx.com .fbsbx.com;block-all-mixed-content;upgrade-insecure-requests;report-uri https://www.facebook.com/csp/reporting/?m=c&minimize=0;require-trusted-types-for 'script';
Strict-Transport-Security	max-age=31536000; preload; includeSubDomains
X-Content-Type-Options	nosniff
X-Frame-Options	DENY
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

content-security-policy: default-src 'self' data: blob: facebook.net *.facebook.net fbcdn.net *.fbcdn.net fbsbx.com *.fbsbx.com;script-src *.fbcdn.net *.facebook.net 'unsafe-inline' 'unsafe-eval' blob: data: 'self';style-src data: blob: 'unsafe-inline' facebook.net *.facebook.net fbcdn.net *.fbcdn.net fbsbx.com *.fbsbx.com;connect-src *.fbcdn.net *.facebook.net wss://*.fbcdn.net attachment.fbsbx.com blob: 'self';img-src 'self' data: blob: facebook.net *.facebook.net fbcdn.net *.fbcdn.net fbsbx.com *.fbsbx.com;block-all-mixed-content;upgrade-insecure-requests;report-uri https://www.facebook.com/csp/reporting/?m=c&minimize=0;require-trusted-types-for 'script';
content-encoding: gzip
x-content-type-options: nosniff
strict-transport-security: max-age=31536000; preload; includeSubDomains
date: Fri, 05 Apr 2024 16:07:30 GMT
document-policy: force-load-at-top
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=86400
content-length: 11997
x-xss-protection: 0
reporting-endpoints: coop_report="https://www.facebook.com/browser_reporting/coop/?minimize=0", coep_report="https://www.facebook.com/browser_reporting/coep/?minimize=0", permissions_policy="https://www.facebook.com/ajax/browser_error_reports/"
x-fb-connection-quality: EXCELLENT; q=0.9, rtt=5, rtx=0, c=62, mss=1326, tbw=63137, tp=-1, tpl=-1, uplat=1, ullat=-1
pragma: public
x-fb-debug: iZbDojE7HnV0aC8aADgCaRa0bUUz7n+2Nysv9G9oDktafvKfqLMNFzU0DXr4paeAxfyO2DyYmSaJPy/TEXEDmw==
cross-origin-embedder-policy-report-only: require-corp;report-to="coep_report"
cross-origin-opener-policy: same-origin-allow-popups;report-to="coop_report"
vary: Accept-Encoding
report-to: {"max_age":2592000,"endpoints":[{"url":"https:\/\/www.facebook.com\/browser_reporting\/coop\/?minimize=0"}],"group":"coop_report","include_subdomains":true}, {"max_age":86400,"endpoints":[{"url":"https:\/\/www.facebook.com\/browser_reporting\/coep\/?minimize=0"}],"group":"coep_report"}, {"max_age":21600,"endpoints":[{"url":"https:\/\/www.facebook.com\/ajax\/browser_error_reports\/"}],"group":"permissions_policy"}
content-type: application/x-javascript; charset=utf-8
x-frame-options: DENY
cache-control: public, max-age=1200
permissions-policy: accelerometer=(), attribution-reporting=(), autoplay=(), bluetooth=(), camera=(), ch-device-memory=(), ch-downlink=(), ch-ect=(), ch-rtt=(), ch-save-data=(), ch-ua-arch=(), ch-ua-bitness=(), clipboard-read=(), clipboard-write=(), display-capture=(), encrypted-media=(), fullscreen=(self), gamepad=(), geolocation=(), gyroscope=(), hid=(), idle-detection=(), keyboard-map=(), local-fonts=(), magnetometer=(), microphone=(), midi=(), otp-credentials=(), payment=(), picture-in-picture=(), publickey-credentials-get=(), screen-wake-lock=(), serial=(), usb=(), window-management=(), xr-spatial-tracking=();report-to="permissions_policy"
timing-allow-origin: *
expires: Sat, 01 Jan 2000 00:00:00 GMT

GET
H3 204 pv Show response
api.btloader.com/ 0
12 B 121ms
120ms XHR
text/plain 130.211.23.194
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL: https://api.btloader.com/pv?tid=arbCQpZSn&w=5742631887831040&o=6315858775244800&cv=2.1.38-2-1-gc0fddff&widget=false&r=false&vr=1600x1113&pageURL=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&sid=n83pogdjZu&pm=true&upapi=true
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 130.211.23.194 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),
Reverse DNS: 194.23.211.130.bc.googleusercontent.com
Software: /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

access-control-allow-origin: *
date: Fri, 05 Apr 2024 16:07:30 GMT
cache-control: no-cache, no-store, must-revalidate
via: 1.1 google
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
vary: Origin

OPTIONS
H2 200 bidRequest
c2shb.pubgw.yahoo.com/ Frame 0
0 99ms
9ms Preflight 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash

Request headers

Accept: */*
Access-Control-Request-Headers: content-type,x-openrtb-version
Access-Control-Request-Method: POST
Origin: https://www.theverge.com
Sec-Fetch-Mode: cors
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

access-control-allow-credentials: true
access-control-allow-headers: X-Requested-With,Content-Type,X-Openrtb-Version
access-control-allow-methods: GET,POST,OPTIONS
access-control-allow-origin: https://www.theverge.com
access-control-max-age: 600
age: 0
content-length: 0
date: Fri, 05 Apr 2024 16:07:30 GMT
server: ATS/9.1.10.94

OPTIONS
H2 200 bidRequest
c2shb.pubgw.yahoo.com/ Frame 0
0 99ms
10ms Preflight 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash

Request headers

Accept: */*
Access-Control-Request-Headers: content-type,x-openrtb-version
Access-Control-Request-Method: POST
Origin: https://www.theverge.com
Sec-Fetch-Mode: cors
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

access-control-allow-credentials: true
access-control-allow-headers: X-Requested-With,Content-Type,X-Openrtb-Version
access-control-allow-methods: GET,POST,OPTIONS
access-control-allow-origin: https://www.theverge.com
access-control-max-age: 600
age: 0
content-length: 0
date: Fri, 05 Apr 2024 16:07:30 GMT
server: ATS/9.1.10.94

OPTIONS
H2 200 bidRequest
c2shb.pubgw.yahoo.com/ Frame 0
0 100ms
11ms Preflight 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash

Request headers

Accept: */*
Access-Control-Request-Headers: content-type,x-openrtb-version
Access-Control-Request-Method: POST
Origin: https://www.theverge.com
Sec-Fetch-Mode: cors
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

access-control-allow-credentials: true
access-control-allow-headers: X-Requested-With,Content-Type,X-Openrtb-Version
access-control-allow-methods: GET,POST,OPTIONS
access-control-allow-origin: https://www.theverge.com
access-control-max-age: 600
age: 0
content-length: 0
date: Fri, 05 Apr 2024 16:07:30 GMT
server: ATS/9.1.10.94

OPTIONS
H2 200 bidRequest
c2shb.pubgw.yahoo.com/ Frame 0
0 100ms
11ms Preflight 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash

Request headers

Accept: */*
Access-Control-Request-Headers: content-type,x-openrtb-version
Access-Control-Request-Method: POST
Origin: https://www.theverge.com
Sec-Fetch-Mode: cors
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

access-control-allow-credentials: true
access-control-allow-headers: X-Requested-With,Content-Type,X-Openrtb-Version
access-control-allow-methods: GET,POST,OPTIONS
access-control-allow-origin: https://www.theverge.com
access-control-max-age: 600
age: 0
content-length: 0
date: Fri, 05 Apr 2024 16:07:30 GMT
server: ATS/9.1.10.94

OPTIONS
H2 200 bidRequest
c2shb.pubgw.yahoo.com/ Frame 0
0 97ms
9ms Preflight 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash

Request headers

Accept: */*
Access-Control-Request-Headers: content-type,x-openrtb-version
Access-Control-Request-Method: POST
Origin: https://www.theverge.com
Sec-Fetch-Mode: cors
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

access-control-allow-credentials: true
access-control-allow-headers: X-Requested-With,Content-Type,X-Openrtb-Version
access-control-allow-methods: GET,POST,OPTIONS
access-control-allow-origin: https://www.theverge.com
access-control-max-age: 600
age: 0
content-length: 0
date: Fri, 05 Apr 2024 16:07:30 GMT
server: ATS/9.1.10.94

OPTIONS
H2 200 bidRequest
c2shb.pubgw.yahoo.com/ Frame 0
0 100ms
12ms Preflight 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash

Request headers

Accept: */*
Access-Control-Request-Headers: content-type,x-openrtb-version
Access-Control-Request-Method: POST
Origin: https://www.theverge.com
Sec-Fetch-Mode: cors
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

access-control-allow-credentials: true
access-control-allow-headers: X-Requested-With,Content-Type,X-Openrtb-Version
access-control-allow-methods: GET,POST,OPTIONS
access-control-allow-origin: https://www.theverge.com
access-control-max-age: 600
age: 0
content-length: 0
date: Fri, 05 Apr 2024 16:07:30 GMT
server: ATS/9.1.10.94

OPTIONS
H2 200 bidRequest
c2shb.pubgw.yahoo.com/ Frame 0
0 101ms
13ms Preflight 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash

Request headers

Accept: */*
Access-Control-Request-Headers: content-type,x-openrtb-version
Access-Control-Request-Method: POST
Origin: https://www.theverge.com
Sec-Fetch-Mode: cors
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

access-control-allow-credentials: true
access-control-allow-headers: X-Requested-With,Content-Type,X-Openrtb-Version
access-control-allow-methods: GET,POST,OPTIONS
access-control-allow-origin: https://www.theverge.com
access-control-max-age: 600
age: 0
content-length: 0
date: Fri, 05 Apr 2024 16:07:30 GMT
server: ATS/9.1.10.94

OPTIONS
H2 200 bidRequest
c2shb.pubgw.yahoo.com/ Frame 0
0 98ms
10ms Preflight 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash

Request headers

Accept: */*
Access-Control-Request-Headers: content-type,x-openrtb-version
Access-Control-Request-Method: POST
Origin: https://www.theverge.com
Sec-Fetch-Mode: cors
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

access-control-allow-credentials: true
access-control-allow-headers: X-Requested-With,Content-Type,X-Openrtb-Version
access-control-allow-methods: GET,POST,OPTIONS
access-control-allow-origin: https://www.theverge.com
access-control-max-age: 600
age: 0
content-length: 0
date: Fri, 05 Apr 2024 16:07:30 GMT
server: ATS/9.1.10.94

OPTIONS
H2 200 bidRequest
c2shb.pubgw.yahoo.com/ Frame 0
0 97ms
9ms Preflight 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash

Request headers

Accept: */*
Access-Control-Request-Headers: content-type,x-openrtb-version
Access-Control-Request-Method: POST
Origin: https://www.theverge.com
Sec-Fetch-Mode: cors
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

access-control-allow-credentials: true
access-control-allow-headers: X-Requested-With,Content-Type,X-Openrtb-Version
access-control-allow-methods: GET,POST,OPTIONS
access-control-allow-origin: https://www.theverge.com
access-control-max-age: 600
age: 0
content-length: 0
date: Fri, 05 Apr 2024 16:07:30 GMT
server: ATS/9.1.10.94

OPTIONS
H2 200 bidRequest
c2shb.pubgw.yahoo.com/ Frame 0
0 97ms
10ms Preflight 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash

Request headers

Accept: */*
Access-Control-Request-Headers: content-type,x-openrtb-version
Access-Control-Request-Method: POST
Origin: https://www.theverge.com
Sec-Fetch-Mode: cors
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

access-control-allow-credentials: true
access-control-allow-headers: X-Requested-With,Content-Type,X-Openrtb-Version
access-control-allow-methods: GET,POST,OPTIONS
access-control-allow-origin: https://www.theverge.com
access-control-max-age: 600
age: 0
content-length: 0
date: Fri, 05 Apr 2024 16:07:30 GMT
server: ATS/9.1.10.94

POST
H/1.1 400
Bad Request cookie_sync Show response
prebid-server.rubiconproject.com/ 49 B
320 B 124ms
14ms Fetch 69.173.144.137
RUBICONPROJECT

General

Check archive.org

Show headers Download Go to

Full URL: https://prebid-server.rubiconproject.com/cookie_sync
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: HTTP/1.1
Security: TLS 1.3, , AES_256_GCM
Server: 69.173.144.137 Frankfurt am Main, Germany, ASN26667 (RUBICONPROJECT, US),
Reverse DNS
Software: /
Resource Hash: c096a407308f10208f1283bf386d16fa88753abe15d84e7bbd4e16e8e7a4ef3e

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

access-control-allow-origin: https://www.theverge.com
Pragma: no-cache
Cache-Control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
content-encoding: gzip
content-length: 71
Expires: 0

POST
H/1.1 200
OK auction Show response
prebid-server.rubiconproject.com/openrtb2/ 172 B
468 B 117ms
15ms Fetch
application/json 69.173.144.137
RUBICONPROJECT

General

Check archive.org

Show headers Download Go to

Full URL: https://prebid-server.rubiconproject.com/openrtb2/auction
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: HTTP/1.1
Security: TLS 1.3, , AES_256_GCM
Server: 69.173.144.137 Frankfurt am Main, Germany, ASN26667 (RUBICONPROJECT, US),
Reverse DNS
Software: /
Resource Hash: a5dbb47c2bc5103f68a9dc1e550111320711963f376a86f8b30d5f1ceafce573

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

Pragma: no-cache
content-encoding: gzip
x-prebid: pbs-java/2.15.0
Content-Type: application/json
access-control-allow-origin: https://www.theverge.com
Cache-Control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
content-length: 168
Expires: 0

GET
H2 200 fastlane.json Show response
fastlane.rubiconproject.com/a/api/ 5 KB
4 KB 249ms
140ms Fetch
application/json 2602:803:c003:200::21
RUBICONPROJECT

General

Check archive.org

Show headers Download Go to

Full URL: https://fastlane.rubiconproject.com/a/api/fastlane.json?account_id=7470&site_id=337400&zone_id=1777834%3B1777850%3B1777848%3B1777858%3B1777858%3B1777858%3B1777858&size_id=15%3B15%3B2%3B213%3B213%3B213%3B213&alt_size_ids=10%3B10%3B%3B%3B%3B%3B&us_privacy=1YNY&eid_mycleanroom=1234%3A123sajflwef%5E571187&eid_pubcid.org=aaf8d230-5f88-49bf-9e86-3976eec36fd3%5E1&rf=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&tg_i.domain=theverge.com&tg_i.page=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&tg_i.position=medium_rectangle_variable%2Cbtf_medium_rectangle_variable_article%2Cmedium_rectangle_gamestop_desktop%2Cmedium_rectangle_gamestop_desktop%2Cathena_feature%2Cbtf_leaderboard_variable%2Cdesktop_feature_body%2Cdesktop_feature_body_dynamic%2Cdesktop_feature_body_dynamic%2Cdesktop_feature_body_dynamic%2Csponsored-gift-ad&tg_i.device_type=desktop&tg_i.page_type=interior_page&tg_i.keywords=with%2Cthe%2Crise%2Cof%2Cai%2Cweb%2Ccrawlers%2Care%2Csuddenly%2Ccontroversial%2Cverge%2Cfront-page%2Cai-artificial-intelligence%2Ctech%2Cai-business-week-feb-2024%2Cfeatures%2Cinternet-culture%2Cculture%2Cfeatured-story&tg_i.affiliation=general&tg_i.network=verge&tg_i.pageload_id=9e13ba65-4713-47d1-adc1-dc273f1e9940&tg_i.hostname=www.theverge.com&tg_i.entry_slug=24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&tg_i.entry_id=23832038&tg_i.entry_author=David%20Pierce&tg_i.entry_published_date=2024-02-14T14%3A00%3A00.000Z&tg_i.entry_group=front-page%2Cai-artificial-intelligence%2Ctech%2Cai-business-week-feb-2024%2Cfeatures%2Cweb%2Cinternet-culture%2Cculture%2Cfeatured-story&tg_i.hub_page=ai-artificial-intelligence%2Ctech%2Cfeatures%2Cweb%2Cculture&tg_i.entry_type=feature&tg_i.entry_title=With%20the%20rise%20of%20AI%2C%20web%20crawlers%20are%20suddenly%20controversial%20-%20The%20Verge&tg_i.cts_keyword=artificial%20intelligence%2Chealth%2Cfile%2Cattorneys%2Crobots&tg_i.cts_keyword_list=list_2%2Clist_3%2Clist_6%2Clist_8%2Clist_9%2Clist_10%2Clist_13%2Clist_14%2Clist_15%2Clist_17%2Clist_19%2Clist_21%2Clist_22%2Clist_24%2Clist_25%2Clist_28%2Clist_31%2Clist_33%2Clist_34%2Clist_35%2Clist_36%2Clist_39%2Clist_41%2Clist_43%2Clist_45%2Clist_46%2Clist_47%2Clist_49%2Clist_70%2Clist_74%2Clist_75%2Clist_89%2Clist_90%2Clist_92%2Clist_95%2Clist_96%2Clist_98%2Clist_101%2Clist_112%2Clist_118%2Clist_127%2Clist_128%2Clist_203%2Clist_239%2Clist_243%2Clist_269%2Clist_271%2Clist_277%2Clist_342%2Clist_470%2Clist_537%2Clist_591%2Clist_592%2Clist_603%2Clist_651%2Clist_808%2Clist_851%2Clist_859%2Clist_866%2Clist_905%2Clist_1000%2Clist_1017%2Clist_1018%2Clist_1020%2Clist_1023%2Clist_1025%2Clist_1026%2Clist_1029%2Clist_1063%2Clist_1064%2Clist_1065%2Clist_1068%2Clist_1069%2Clist_1073%2Clist_1076%2Clist_1079%2Clist_1082%2Clist_1117%2Clist_1118%2Clist_1119%2Clist_1120%2Clist_1124%2Clist_1125%2Clist_1126%2Clist_1130%2Clist_1133%2Clist_1135%2Clist_1137%2Clist_1138%2Clist_1139%2Clist_1140%2Clist_1141%2Clist_1147%2Clist_1148%2Clist_1151%2Clist_1184%2Clist_1192%2Clist_1193%2Clist_1195%2Clist_1196%2Clist_1201%2Clist_1204%2Clist_1237%2Clist_1239%2Clist_1240%2Clist_1243%2Clist_1246%2Clist_1247%2Clist_1253%2Clist_1254%2Clist_1257%2Clist_1263%2Clist_1273%2Clist_1280%2Clist_1286%2Clist_1321%2Clist_1322%2Clist_1324%2Clist_1327%2Clist_1329%2Clist_1330%2Clist_1333%2Clist_1334%2Clist_1335%2Clist_1338%2Clist_1340%2Clist_1341%2Clist_1342%2Clist_1343%2Clist_1345%2Clist_1346%2Clist_1347%2Clist_1382%2Clist_1383%2Clist_1384%2Clist_1385%2Clist_1387%2Clist_1388%2Clist_1389%2Clist_1391%2Clist_1393%2Clist_1394%2Clist_1395%2Clist_1396%2Clist_1399%2Clist_1433%2Clist_1439%2Clist_1440%2Clist_1441%2Clist_1445%2Clist_1446%2Clist_1447%2Clist_1449%2Clist_1450%2Clist_1451%2Clist_1457%2Clist_1459%2Clist_1460%2Clist_1461%2Clist_1462%2Clist_1463%2Clist_1464%2Clist_1465%2Clist_1466%2Clist_1501%2Clist_1502%2Clist_1503%2Clist_1504%2Clist_1509%2Clist_1511%2Clist_1512%2Clist_1513%2Clist_1517%2Clist_1519%2Clist_1521%2Clist_1524%2Clist_1525%2Clist_1529%2Clist_1532%2Clist_1533%2Clist_1534%2Clist_1536%2Clist_1540%2Clist_1542%2Clist_1546%2Clist_1548%2Clist_1551%2Clist_1560%2Clist_1593%2Clist_1594%2Clist_1595%2Clist_1596%2Clist_1600%2Clist_1622%2Clist_1623%2Clist_1624%2Clist_1662%2Clist_1664%2Clist_1665%2Clist_1666%2Clist_1669%2Clist_1671%2Clist_10740%2Clist_10772%2Clist_10805%2Clist_10838%2Clist_10871%2Clist_10904%2Clist_11201%2Clist_11234%2Clist_11267&tg_i.cts_title=The%20rise%20and%20fall%20of%20robots.txt&tg_i.cts_description=As%20unscrupulous%20AI%20companies%20crawl%20for%20more%20and%20more%20data%2C%20the%20basic%20social%20contract%20of%20the%20web%20is%20falling%20apart.&tg_i.cts_keyword_classification_enqueued_at=2024-04-05T01%3A13%3A41Z&tg_i.cts_keyword_classification_status=successful&tg_i.cts_keyword_age=under_1_day&tg_i.fins=26%2C26.3%2C26.3.7&tg_i.aupname=172968584%2Fverge%26medium_rectangle_variable%26device_type%3Ddesktop%3B172968584%2Fverge%26btf_medium_rectangle_variable%26device_type%3Ddesktop%3B172968584%2Fverge%26btf_leaderboard_variable%26device_type%3Ddesktop%3B172968584%2Fverge%26desktop_feature_body%26device_type%3Ddesktop%3B172968584%2Fverge%26desktop_feature_body%26device_type%3Ddesktop%3B172968584%2Fverge%26desktop_feature_body%26device_type%3Ddesktop%3B172968584%2Fverge%26desktop_feature_body%26device_type%3Ddesktop&tg_i.pbadslot=%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-medium_rectangle_variable%3B%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-btf_medium_rectangle_variable_article%3B%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-btf_leaderboard_variable%3B%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-desktop_feature_body%3B%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-desktop_feature_body_dynamic%3B%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-desktop_feature_body_dynamic_1%3B%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-desktop_feature_body_dynamic_2&tk_flint=dmpbjs_v8.37.0&x_source.tid=e438df62-08ca-4254-be95-9965da826cda&l_pb_bid_id=24b8a6ded78e929%3B25ab923d12b6113%3B29b028aedf324d7%3B30bd6096efda6b5%3B31c14b519806de4%3B32c4455d70dd484%3B33a45bf942abee3&p_screen_res=800x600&rp_secure=1&x_imp.ext.tid=f71d600a-ed64-4a3b-9994-74b7120fd94e%3Bc9b93917-e7c1-40f9-875a-acff85a4463a%3Bea818fc7-a307-44f9-b66f-9ecdc47783a0%3Bc6a1fc8d-92e8-4f9f-b27f-806d9962df89%3B85ed5d3d-330e-4484-838f-19c17d748887%3B6d9d8a17-e2e5-4278-827b-e89bcf30a523%3B2bcaeb5e-ddf4-423d-afd0-a5ec67c5c6ee&rp_hard_floor=0.77%3B0.75%3B0.61%3B0.61%3B0.61%3B0.61%3B0.61&rp_maxbids=1&p_gpid=%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-medium_rectangle_variable%3B%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-btf_medium_rectangle_variable_article%3B%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-btf_leaderboard_variable%3B%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-desktop_feature_body%3B%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-desktop_feature_body_dynamic%3B%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-desktop_feature_body_dynamic_1%3B%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-desktop_feature_body_dynamic_2&m_ch_ua=%22Google%20Chrome%22%7Cv%3D%22123%22%2C%22Not%3AA-Brand%22%7Cv%3D%228%22%2C%22Chromium%22%7Cv%3D%22123%22&m_ch_full_ver=%22Google%20Chrome%22%7Cv%3D%22123%22%2C%22Not%3AA-Brand%22%7Cv%3D%228%22%2C%22Chromium%22%7Cv%3D%22123%22&m_ch_mobile=%3F0&m_ch_platform=Win32&slots=7&rand=0.27692537223086866
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 2602:803:c003:200::21 Amsterdam, Netherlands, ASN26667 (RUBICONPROJECT, US),
Reverse DNS
Software: nginx/1.21.4 /
Resource Hash: 89b02c91791f2e2438fde841a5713a299c569cabea2221e5f7d428485089dd1b

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

pragma: no-cache
date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
server: nginx/1.21.4
vary: Accept-Encoding
content-type: application/json
access-control-allow-origin: https://www.theverge.com
cache-control: no-cache, no-store, max-age=0, must-revalidate
access-control-allow-credentials: true
expires: Wed, 17 Sep 1975 21:32:10 GMT

GET
H2 200 fastlane.json Show response
fastlane.rubiconproject.com/a/api/ 4 KB
2 KB 251ms
144ms Fetch
application/json 2602:803:c003:200::21
RUBICONPROJECT

General

Check archive.org

Show headers Download Go to

Full URL: https://fastlane.rubiconproject.com/a/api/fastlane.json?account_id=7470&site_id=337492&zone_id=1778458&size_id=15%3B15%3B2&alt_size_ids=%3B%3B57%2C213&us_privacy=1YNY&eid_mycleanroom=1234%3A123sajflwef%5E571187&eid_pubcid.org=aaf8d230-5f88-49bf-9e86-3976eec36fd3%5E1&rf=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&tg_i.domain=theverge.com&tg_i.page=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&tg_i.position=medium_rectangle_variable%2Cbtf_medium_rectangle_variable_article%2Cmedium_rectangle_gamestop_desktop%2Cmedium_rectangle_gamestop_desktop%2Cathena_feature%2Cbtf_leaderboard_variable%2Cdesktop_feature_body%2Cdesktop_feature_body_dynamic%2Cdesktop_feature_body_dynamic%2Cdesktop_feature_body_dynamic%2Csponsored-gift-ad&tg_i.device_type=desktop&tg_i.page_type=interior_page&tg_i.keywords=with%2Cthe%2Crise%2Cof%2Cai%2Cweb%2Ccrawlers%2Care%2Csuddenly%2Ccontroversial%2Cverge%2Cfront-page%2Cai-artificial-intelligence%2Ctech%2Cai-business-week-feb-2024%2Cfeatures%2Cinternet-culture%2Cculture%2Cfeatured-story&tg_i.affiliation=general&tg_i.network=verge&tg_i.pageload_id=9e13ba65-4713-47d1-adc1-dc273f1e9940&tg_i.hostname=www.theverge.com&tg_i.entry_slug=24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&tg_i.entry_id=23832038&tg_i.entry_author=David%20Pierce&tg_i.entry_published_date=2024-02-14T14%3A00%3A00.000Z&tg_i.entry_group=front-page%2Cai-artificial-intelligence%2Ctech%2Cai-business-week-feb-2024%2Cfeatures%2Cweb%2Cinternet-culture%2Cculture%2Cfeatured-story&tg_i.hub_page=ai-artificial-intelligence%2Ctech%2Cfeatures%2Cweb%2Cculture&tg_i.entry_type=feature&tg_i.entry_title=With%20the%20rise%20of%20AI%2C%20web%20crawlers%20are%20suddenly%20controversial%20-%20The%20Verge&tg_i.cts_keyword=artificial%20intelligence%2Chealth%2Cfile%2Cattorneys%2Crobots&tg_i.cts_keyword_list=list_2%2Clist_3%2Clist_6%2Clist_8%2Clist_9%2Clist_10%2Clist_13%2Clist_14%2Clist_15%2Clist_17%2Clist_19%2Clist_21%2Clist_22%2Clist_24%2Clist_25%2Clist_28%2Clist_31%2Clist_33%2Clist_34%2Clist_35%2Clist_36%2Clist_39%2Clist_41%2Clist_43%2Clist_45%2Clist_46%2Clist_47%2Clist_49%2Clist_70%2Clist_74%2Clist_75%2Clist_89%2Clist_90%2Clist_92%2Clist_95%2Clist_96%2Clist_98%2Clist_101%2Clist_112%2Clist_118%2Clist_127%2Clist_128%2Clist_203%2Clist_239%2Clist_243%2Clist_269%2Clist_271%2Clist_277%2Clist_342%2Clist_470%2Clist_537%2Clist_591%2Clist_592%2Clist_603%2Clist_651%2Clist_808%2Clist_851%2Clist_859%2Clist_866%2Clist_905%2Clist_1000%2Clist_1017%2Clist_1018%2Clist_1020%2Clist_1023%2Clist_1025%2Clist_1026%2Clist_1029%2Clist_1063%2Clist_1064%2Clist_1065%2Clist_1068%2Clist_1069%2Clist_1073%2Clist_1076%2Clist_1079%2Clist_1082%2Clist_1117%2Clist_1118%2Clist_1119%2Clist_1120%2Clist_1124%2Clist_1125%2Clist_1126%2Clist_1130%2Clist_1133%2Clist_1135%2Clist_1137%2Clist_1138%2Clist_1139%2Clist_1140%2Clist_1141%2Clist_1147%2Clist_1148%2Clist_1151%2Clist_1184%2Clist_1192%2Clist_1193%2Clist_1195%2Clist_1196%2Clist_1201%2Clist_1204%2Clist_1237%2Clist_1239%2Clist_1240%2Clist_1243%2Clist_1246%2Clist_1247%2Clist_1253%2Clist_1254%2Clist_1257%2Clist_1263%2Clist_1273%2Clist_1280%2Clist_1286%2Clist_1321%2Clist_1322%2Clist_1324%2Clist_1327%2Clist_1329%2Clist_1330%2Clist_1333%2Clist_1334%2Clist_1335%2Clist_1338%2Clist_1340%2Clist_1341%2Clist_1342%2Clist_1343%2Clist_1345%2Clist_1346%2Clist_1347%2Clist_1382%2Clist_1383%2Clist_1384%2Clist_1385%2Clist_1387%2Clist_1388%2Clist_1389%2Clist_1391%2Clist_1393%2Clist_1394%2Clist_1395%2Clist_1396%2Clist_1399%2Clist_1433%2Clist_1439%2Clist_1440%2Clist_1441%2Clist_1445%2Clist_1446%2Clist_1447%2Clist_1449%2Clist_1450%2Clist_1451%2Clist_1457%2Clist_1459%2Clist_1460%2Clist_1461%2Clist_1462%2Clist_1463%2Clist_1464%2Clist_1465%2Clist_1466%2Clist_1501%2Clist_1502%2Clist_1503%2Clist_1504%2Clist_1509%2Clist_1511%2Clist_1512%2Clist_1513%2Clist_1517%2Clist_1519%2Clist_1521%2Clist_1524%2Clist_1525%2Clist_1529%2Clist_1532%2Clist_1533%2Clist_1534%2Clist_1536%2Clist_1540%2Clist_1542%2Clist_1546%2Clist_1548%2Clist_1551%2Clist_1560%2Clist_1593%2Clist_1594%2Clist_1595%2Clist_1596%2Clist_1600%2Clist_1622%2Clist_1623%2Clist_1624%2Clist_1662%2Clist_1664%2Clist_1665%2Clist_1666%2Clist_1669%2Clist_1671%2Clist_10740%2Clist_10772%2Clist_10805%2Clist_10838%2Clist_10871%2Clist_10904%2Clist_11201%2Clist_11234%2Clist_11267&tg_i.cts_title=The%20rise%20and%20fall%20of%20robots.txt&tg_i.cts_description=As%20unscrupulous%20AI%20companies%20crawl%20for%20more%20and%20more%20data%2C%20the%20basic%20social%20contract%20of%20the%20web%20is%20falling%20apart.&tg_i.cts_keyword_classification_enqueued_at=2024-04-05T01%3A13%3A41Z&tg_i.cts_keyword_classification_status=successful&tg_i.cts_keyword_age=under_1_day&tg_i.fins=26%2C26.3%2C26.3.7&tg_i.aupname=172968584%2Fverge&tg_i.pbadslot=%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-medium_rectangle_gamestop_desktop%3B%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-medium_rectangle_gamestop_desktop_1%3B%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-athena_feature&tk_flint=dmpbjs_v8.37.0&x_source.tid=e438df62-08ca-4254-be95-9965da826cda&l_pb_bid_id=26a5f2716d8d363%3B27a5148f56e9886%3B287aa568f4872d2&p_screen_res=800x600&rp_secure=1&x_imp.ext.tid=7996585c-59e7-4fa4-8279-272fb8172bc8%3Be35f92dc-20f4-4f31-826d-582ae7700378%3B380f0b44-81a5-440b-82ef-4973117fa795&rp_hard_floor=0.61&rp_maxbids=1&p_gpid=%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-medium_rectangle_gamestop_desktop%3B%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-medium_rectangle_gamestop_desktop_1%3B%2F172968584%2Fverge%2Ffront-page%23div-gpt-ad-athena_feature&m_ch_ua=%22Google%20Chrome%22%7Cv%3D%22123%22%2C%22Not%3AA-Brand%22%7Cv%3D%228%22%2C%22Chromium%22%7Cv%3D%22123%22&m_ch_full_ver=%22Google%20Chrome%22%7Cv%3D%22123%22%2C%22Not%3AA-Brand%22%7Cv%3D%228%22%2C%22Chromium%22%7Cv%3D%22123%22&m_ch_mobile=%3F0&m_ch_platform=Win32&slots=3&rand=0.252943299424949
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 2602:803:c003:200::21 Amsterdam, Netherlands, ASN26667 (RUBICONPROJECT, US),
Reverse DNS
Software: nginx/1.21.4 /
Resource Hash: 1405fd803c55b53c0b86b9e0fcf1696eedcbf489d323a537477947a4512ff674

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

pragma: no-cache
date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
server: nginx/1.21.4
vary: Accept-Encoding
content-type: application/json
access-control-allow-origin: https://www.theverge.com
cache-control: no-cache, no-store, max-age=0, must-revalidate
access-control-allow-credentials: true
expires: Wed, 17 Sep 1975 21:32:10 GMT

POST
H2 200 pbjs Show response
htlb.casalemedia.com/openrtb/ 37 B
551 B 628ms
606ms Fetch
application/json 172.64.151.101
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://htlb.casalemedia.com/openrtb/pbjs?s=560961
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 172.64.151.101 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 60a07de79050cacfbea68e162efcd24609e5eb3d636c12304ecdbc8724373f9c

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

pragma: no-cache
date: Fri, 05 Apr 2024 16:07:31 GMT
cf-cache-status: DYNAMIC
nel: {"success_fraction":0.01,"report_to":"cf-nel","max_age":604800}
server: cloudflare
vary: Accept-Encoding
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v4?s=lDKPniAgRIZGQK4dOoMJWuNQrvAHG5x5DNEAAhyQ1Br%2B9lL7bMiQWr9bGRbQp%2FfK%2FwICPhZ2%2BLBSsvxWUXLTn1cdSirMT225XvYRbt2RFvy5TWe%2FUoKdAaLWWzn6gZdrZTMiRmMA"}],"group":"cf-nel","max_age":604800}
content-type: application/json
access-control-allow-origin: https://www.theverge.com
cache-control: no-cache
access-control-allow-credentials: true
cf-ray: 86faca9f2f5b1da6-FRA
alt-svc: h3=":443"; ma=86400
content-length: 37
expires: 0

POST
H2 200 prebid Show response
ib.adnxs.com/ut/v3/ 1 KB
2 KB 435ms
413ms Fetch
application/json 37.252.171.149
ASN-APPNEX

General

Check archive.org

Show headers Download Go to

Full URL

https://ib.adnxs.com/ut/v3/prebid

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js

Protocol

Security

TLS 1.2, ECDHE_ECDSA, AES_128_GCM

Server

37.252.171.149 Frankfurt am Main, Germany, ASN29990 (ASN-APPNEX, US),

Reverse DNS

984.bm-nginx-loadbalancer.mgmt.fra1.adnexus.net

Software

nginx/1.23.4 /

Resource Hash

c7da57bcfd14bb3ba72dde994f529b65553a75850a7b2831bfffa2d20ba290cf

Security Headers

Name	Value
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

pragma: no-cache
date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
an-x-request-uuid: c8d77b70-8355-4f59-a6e1-a2b8f2615bdc
server: nginx/1.23.4
accept-ch: Sec-CH-UA-Full-Version-List,Sec-CH-UA-Arch,Sec-CH-UA-Model,Sec-CH-UA-Platform-Version,Sec-CH-UA-Bitness
vary: Accept-Encoding
p3p: policyref="http://cdn.adnxs-simple.com/w3c/policy/p3p.xml", CP="NOI DSP COR ADM PSAo PSDo OURo SAMo UNRo OTRo BUS COM NAV DEM STA PRE"
content-type: application/json; charset=utf-8
access-control-allow-origin: https://www.theverge.com
cache-control: no-store, no-cache, private
access-control-allow-credentials: true
x-proxy-origin: 45.141.152.74; 45.141.152.74; 984.bm-nginx-loadbalancer.mgmt.fra1.adnexus.net; adnxs.com
x-xss-protection: 0
expires: Sat, 15 Nov 2008 16:00:00 GMT

POST
H2 200 auction Show response
tlx.3lift.com/header/ 19 B
730 B 154ms
125ms Fetch
application/json 3.124.64.248
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL

https://tlx.3lift.com/header/auction?lib=prebid&v=8.37.0&referrer=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&tmax=2040&us_privacy=1YNY

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

3.124.64.248 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),

Reverse DNS

ec2-3-124-64-248.eu-central-1.compute.amazonaws.com

Software

Resource Hash

0535c3bb3a17e4ac0fb7d29214d2181275662129dc2bdd2a89c35934e9fc5ba5

Security Headers

Name	Value
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

pragma: no-cache
content-encoding: gzip
x-auction-status: 5, 5, 5
vary: Accept-Encoding
content-type: application/json; charset=utf-8
p3p: policyref="http://cdn.3lift.com/w3c/p3p.xml", CP="NON DSP COR NID OUR DEL SAM OTR UNR COM NAV INT DEM CNT STA PRE LOC OTC"
access-control-allow-origin: https://www.theverge.com
cache-control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
x-xss-protection: 0
expires: Thu, 15 Oct 1992 20:10:00 GMT

POST
H2 200 bidRequest Show response
c2shb.pubgw.yahoo.com/ 66 B
117 B 44ms
28ms Fetch
application/json 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash: 5bc331a4adb5abcbe8c223244e4839f76b8cff343f3504283c641fe07cafa7df

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
x-openrtb-version: 2.5
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: application/json
Referer: https://www.theverge.com/
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
server: ATS/9.1.10.94
age: 0
vary: Origin, Access-Control-Request-Method, Access-Control-Request-Headers, Accept-Encoding, User-Agent
access-control-allow-methods: POST,GET,HEAD,OPTIONS
content-type: application/json;charset=utf-8
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
content-length: 82

POST
H2 200 bidRequest Show response
c2shb.pubgw.yahoo.com/ 66 B
116 B 42ms
28ms Fetch
application/json 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash: 0c20aba853934d9e744052fe25dd9ae16aa65459c116c03a7394001199bca66c

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
x-openrtb-version: 2.5
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: application/json
Referer: https://www.theverge.com/
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
server: ATS/9.1.10.94
age: 0
vary: Origin, Access-Control-Request-Method, Access-Control-Request-Headers, Accept-Encoding, User-Agent
access-control-allow-methods: POST,GET,HEAD,OPTIONS
content-type: application/json;charset=utf-8
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
content-length: 84

POST
H2 200 bidRequest Show response
c2shb.pubgw.yahoo.com/ 66 B
116 B 42ms
29ms Fetch
application/json 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash: 306fced98d78aff9777e8f229de53120cba5dfd4882971aee97d8dead092dd59

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
x-openrtb-version: 2.5
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: application/json
Referer: https://www.theverge.com/
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
server: ATS/9.1.10.94
age: 0
vary: Origin, Access-Control-Request-Method, Access-Control-Request-Headers, Accept-Encoding, User-Agent
access-control-allow-methods: POST,GET,HEAD,OPTIONS
content-type: application/json;charset=utf-8
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
content-length: 84

POST
H2 200 bidRequest Show response
c2shb.pubgw.yahoo.com/ 66 B
116 B 41ms
27ms Fetch
application/json 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash: cf029f9a9cd20a35235f3027d1c867c66fb5fdd32863f1a32046f020e7daf685

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
x-openrtb-version: 2.5
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: application/json
Referer: https://www.theverge.com/
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
server: ATS/9.1.10.94
age: 0
vary: Origin, Access-Control-Request-Method, Access-Control-Request-Headers, Accept-Encoding, User-Agent
access-control-allow-methods: POST,GET,HEAD,OPTIONS
content-type: application/json;charset=utf-8
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
content-length: 84

POST
H2 200 bidRequest Show response
c2shb.pubgw.yahoo.com/ 66 B
116 B 43ms
25ms Fetch
application/json 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash: 28137bc92d729e58b4cd0c68a3c2eda01363d097b21e281247c1a53934d24175

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
x-openrtb-version: 2.5
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: application/json
Referer: https://www.theverge.com/
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
server: ATS/9.1.10.94
age: 0
vary: Origin, Access-Control-Request-Method, Access-Control-Request-Headers, Accept-Encoding, User-Agent
access-control-allow-methods: POST,GET,HEAD,OPTIONS
content-type: application/json;charset=utf-8
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
content-length: 84

POST
H2 200 bidRequest Show response
c2shb.pubgw.yahoo.com/ 66 B
116 B 40ms
27ms Fetch
application/json 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash: adfe7f36d5b9abea5823e86e2baa1b0fd06f3ceef7c3422cb883dccbebb2cf98

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
x-openrtb-version: 2.5
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: application/json
Referer: https://www.theverge.com/
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
server: ATS/9.1.10.94
age: 0
vary: Origin, Access-Control-Request-Method, Access-Control-Request-Headers, Accept-Encoding, User-Agent
access-control-allow-methods: POST,GET,HEAD,OPTIONS
content-type: application/json;charset=utf-8
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
content-length: 84

POST
H2 200 bidRequest Show response
c2shb.pubgw.yahoo.com/ 66 B
116 B 33ms
20ms Fetch
application/json 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash: d9c201bbb86dd6e25057dc48ffb27b5b061429d4d733aa79c4cfc68d85d76dda

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
x-openrtb-version: 2.5
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: application/json
Referer: https://www.theverge.com/
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
server: ATS/9.1.10.94
age: 0
vary: Origin, Access-Control-Request-Method, Access-Control-Request-Headers, Accept-Encoding, User-Agent
access-control-allow-methods: POST,GET,HEAD,OPTIONS
content-type: application/json;charset=utf-8
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
content-length: 84

POST
H2 200 bidRequest Show response
c2shb.pubgw.yahoo.com/ 66 B
116 B 35ms
21ms Fetch
application/json 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash: b31357b0078019678c7c9177a4097fe78be39fb0f650b2dc9568f10d7ba48f35

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
x-openrtb-version: 2.5
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: application/json
Referer: https://www.theverge.com/
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
server: ATS/9.1.10.94
age: 0
vary: Origin, Access-Control-Request-Method, Access-Control-Request-Headers, Accept-Encoding, User-Agent
access-control-allow-methods: POST,GET,HEAD,OPTIONS
content-type: application/json;charset=utf-8
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
content-length: 81

POST
H2 200 bidRequest Show response
c2shb.pubgw.yahoo.com/ 66 B
116 B 35ms
20ms Fetch
application/json 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash: 4260adb4d49b196daf52b6ab6f9e0564fa021b024b0ea3c2b57f4c8338f9f8bc

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
x-openrtb-version: 2.5
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: application/json
Referer: https://www.theverge.com/
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
server: ATS/9.1.10.94
age: 0
vary: Origin, Access-Control-Request-Method, Access-Control-Request-Headers, Accept-Encoding, User-Agent
access-control-allow-methods: POST,GET,HEAD,OPTIONS
content-type: application/json;charset=utf-8
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
content-length: 84

POST
H2 200 bidRequest Show response
c2shb.pubgw.yahoo.com/ 66 B
343 B 34ms
19ms Fetch
application/json 35.157.246.167
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c2shb.pubgw.yahoo.com/bidRequest
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 35.157.246.167 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-35-157-246-167.eu-central-1.compute.amazonaws.com
Software: ATS/9.1.10.94 /
Resource Hash: 63a6ca419179f07e1a59606add9603682922d34feffd881b769f80000b58c363

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
x-openrtb-version: 2.5
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: application/json
Referer: https://www.theverge.com/
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
server: ATS/9.1.10.94
age: 0
vary: Origin, Access-Control-Request-Method, Access-Control-Request-Headers, Accept-Encoding, User-Agent
access-control-allow-methods: POST,GET,HEAD,OPTIONS
content-type: application/json;charset=utf-8
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
content-length: 84

POST
H2 200 hbjson Show response
grid.bidswitch.net/ 24 B
265 B 368ms
294ms Fetch
application/json 178.250.1.8
ASN-CRITEO-EUROPE

General

Check archive.org

Show headers Download Go to

Full URL

https://grid.bidswitch.net/hbjson?sp=trustx

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

178.250.1.8 , France, ASN44788 (ASN-CRITEO-EUROPE, FR),

Reverse DNS

Software

nginx /

Resource Hash

074fcca6b3a26b12e40ac85fe5475224ef49977328ef9ae3732bd50327f2dc28

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; preload;

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
strict-transport-security: max-age=31536000; preload;
server: nginx
content-type: application/json
access-control-allow-origin: https://www.theverge.com
cache-control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
content-length: 49

POST
H2 204 translator Show response
hbopenbid.pubmatic.com/ 0
114 B 115ms
17ms Fetch 185.64.189.112
AS-PUBMATIC

General

Check archive.org

Show headers Download Go to

Full URL: https://hbopenbid.pubmatic.com/translator?source=prebid-client
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 185.64.189.112 , United Kingdom, ASN62713 (AS-PUBMATIC, US),
Reverse DNS
Software: /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

access-control-allow-origin: https://www.theverge.com
date: Fri, 05 Apr 2024 16:07:29 GMT
cache-control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true

POST
H2 200 prebid Show response
bids.concert.io/bids/ 22 B
461 B 591ms
568ms Fetch
application/json 34.117.126.186
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL: https://bids.concert.io/bids/prebid
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 34.117.126.186 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),
Reverse DNS: 186.126.117.34.bc.googleusercontent.com
Software: Google Frontend / Express
Resource Hash: 55aabd4f133660977420281f291a1ed0c58714a47679738bdaad2e8d59c31004

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
via: 1.1 google
x-lat-long: 50.110922,8.682127
x-powered-by: Express
x-region: DE
x-city: Frankfurt
x-cipher-suite: 1301
content-length: 22
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
x-response-time: 442.296ms
x-tls-version: TLSv1.3
server: Google Frontend
etag: W/"16-6cDG702lpKxhI09DG03JuPCfUBY"
vary: Origin, Accept-Encoding
content-type: application/json; charset=utf-8
access-control-allow-origin: https://www.theverge.com
x-cloud-trace-context: ed16050abd2b0c069f86f56054c624a3/5084283639430652362
access-control-allow-credentials: true
x-region-subdivision: DEHE

GET
H2 204 b
sb.scorecardresearch.com/ 0
226 B 8ms
8ms Image
text/plain 18.244.18.32
AMAZON-02

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://sb.scorecardresearch.com/b?c1=2&c2=7976662&cs_it=b8&cv=4.0.0%2B2301240627&ns__t=1712333250430&ns_c=UTF-8&cs_fpdm=*null&cs_cmp_nc=1&cs_fpcd=1&c7=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&c8=With%20the%20rise%20of%20AI%2C%20web%20crawlers%20are%20suddenly%20controversial%20-%20The%20Verge&c9=
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 18.244.18.32 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-18-244-18-32.fra56.r.cloudfront.net
Software: /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
via: 1.1 b88a4e10ec6aa05046ba32d44beb97f2.cloudfront.net (CloudFront)
accept-ch: UA, Platform, Arch, Model, Mobile
x-amz-cf-pop: FRA56-P11
x-amz-cf-id: beGggzoU0WTECaMMUB-vW6PQqCY9weWjuEPuGJk7PyN0dDQSbw6coQ==
x-cache: Miss from cloudfront

GET
H3 200 connatix.player.dc.js Show response
cds.connatix.com/p/462462/ Frame E480 587 KB
163 KB 32ms
31ms Script
application/javascript 172.64.146.152
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/elLoader.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 172.64.146.152 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: c4df18908a4d24b9fa62b88a0133476bee85a00bc3323128579b2686d2c511cc

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
x-amz-version-id: PVUNHJHO1c4q2Ntp1SSji6q8.s3oREnx
content-encoding: br
cf-cache-status: HIT
x-amz-replication-status: FAILED
alt-svc: h3=":443"; ma=86400
last-modified: Fri, 05 Apr 2024 15:09:59 GMT
server: cloudflare
etag: W/"56809e31d747608dd6fe6a929ed6971c"
vary: Accept-Encoding
access-control-allow-methods: *
content-type: application/javascript
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
access-control-max-age: 86400
cf-ray: 86faca9f38088ff5-FRA
access-control-allow-headers: range
expires: Sat, 05 Apr 2025 16:07:30 GMT

GET
H3 200 count.js Show response
theverge.coral.coralproject.net/api/story/ 373 B
395 B 117ms
116ms Script
text/javascript 34.111.9.237
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL

https://theverge.coral.coralproject.net/api/story/count.js?callback=CoralCount.setCount&id=c5318f8a-2606-40b6-84b0-99acbd929816&ref=aHR0cHM6Ly93d3cudGhldmVyZ2UuY29tLzI0MDY3OTk3L3JvYm90cy10eHQtYWktdGV4dC1maWxlLXdlYi1jcmF3bGVycy1zcGlkZXJz&url=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders

Requested by

Host: theverge.coral.coralproject.net
URL: https://theverge.coral.coralproject.net/assets/js/count.js?ts=1712333700000

Protocol

Security

QUIC, , AES_128_GCM

Server

34.111.9.237 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),

Reverse DNS

237.9.111.34.bc.googleusercontent.com

Software

Resource Hash

cf7778611eff5ad189551f2087483a46f6095cfdb79d161366b24a3b6705e9bb

Security Headers

Name	Value
Strict-Transport-Security	max-age=15552000
X-Content-Type-Options	nosniff
X-Xss-Protection	1; mode=block

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

x-trace-id: 5c2079b0-f366-11ee-88c0-d1d33528ae8e
strict-transport-security: max-age=15552000
date: Fri, 05 Apr 2024 16:07:30 GMT
x-content-type-options: nosniff
referrer-policy: strict-origin-when-cross-origin
via: 1.1 google
age: 105
etag: W/"175-I2bYFtypCqKPrBOj1O3sWWfKXSo"
content-type: text/javascript; charset=utf-8
content-language: en-US
cache-control: no-store
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 373
x-xss-protection: 1; mode=block

GET
H2 200 css
fonts.googleapis.com/ 106 KB
6 KB 62ms
21ms Stylesheet
text/css 2a00:1450:4001:82b::200a
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

Requested by

Host:
URL: /_/mss/boq-content-ads-contributor/_/js/k=boq-content-ads-contributor.ContributorServingResponseClientJs.de.5D0EiqIpepw.es5.O/d=1/exm=kernel_loader,loader_js_executable/ed=1/rs=AJlcJMzzzrClG7wy9F2HAHeduFCuWxGqzg/m=web_iab_tcf_v2_wall_executable

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:82b::200a Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

ESF /

Resource Hash

0e2ef015de96af25db009694591ade7c1a7fc6d3401450069f85c9d13e1f403d

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

strict-transport-security: max-age=31536000
date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
x-content-type-options: nosniff
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
x-xss-protection: 0
last-modified: Fri, 05 Apr 2024 16:07:30 GMT
server: ESF
cross-origin-opener-policy: same-origin-allow-popups
x-frame-options: SAMEORIGIN
content-type: text/css; charset=utf-8
access-control-allow-origin: *
cache-control: private, max-age=86400, stale-while-revalidate=604800
timing-allow-origin: *
link: <https://fonts.gstatic.com>; rel=preconnect; crossorigin
expires: Fri, 05 Apr 2024 16:07:30 GMT

GET
H2 200 memvYaGs126MiZpBA-UvWbX2vVnXBbObj2OVTS-muw.woff2
fonts.gstatic.com/s/opensans/v40/ 47 KB
48 KB 30ms
7ms Font
font/woff2 2a00:1450:4001:80b::2003
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://fonts.gstatic.com/s/opensans/v40/memvYaGs126MiZpBA-UvWbX2vVnXBbObj2OVTS-muw.woff2

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:80b::2003 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

sffe /

Resource Hash

3c4d6a1421c7ddb7e404521fe8c4cd5be5af446d7689cd880be26612eaad3cfa

Security Headers

Name	Value
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Tue, 02 Apr 2024 00:50:53 GMT
x-content-type-options: nosniff
age: 314197
content-security-policy-report-only: require-trusted-types-for 'script'; report-uri https://csp.withgoogle.com/csp/apps-themes
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 48236
x-xss-protection: 0
last-modified: Thu, 14 Dec 2023 02:08:40 GMT
server: sffe
cross-origin-opener-policy: same-origin; report-to="apps-themes"
report-to: {"group":"apps-themes","max_age":2592000,"endpoints":[{"url":"https://csp.withgoogle.com/csp/report-to/apps-themes"}]}
content-type: font/woff2
access-control-allow-origin: *
cache-control: public, max-age=31536000
accept-ranges: bytes
timing-allow-origin: *
expires: Wed, 02 Apr 2025 00:50:53 GMT

GET
H2 200 flUhRq6tzZclQEJ-Vdg-IuiaDsNc.woff2
fonts.gstatic.com/s/materialicons/v140/ 125 KB
126 KB 35ms
13ms Font
font/woff2 2a00:1450:4001:80b::2003
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://fonts.gstatic.com/s/materialicons/v140/flUhRq6tzZclQEJ-Vdg-IuiaDsNc.woff2

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:80b::2003 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

sffe /

Resource Hash

8265f64786397d6b832d1ca0aafdf149ad84e72759fffa9f7272e91a0fb015d1

Security Headers

Name	Value
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Sat, 30 Mar 2024 12:17:00 GMT
x-content-type-options: nosniff
age: 532230
content-security-policy-report-only: require-trusted-types-for 'script'; report-uri https://csp.withgoogle.com/csp/apps-themes
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 128352
x-xss-protection: 0
last-modified: Tue, 07 Mar 2023 19:51:56 GMT
server: sffe
cross-origin-opener-policy: same-origin; report-to="apps-themes"
report-to: {"group":"apps-themes","max_age":2592000,"endpoints":[{"url":"https://csp.withgoogle.com/csp/report-to/apps-themes"}]}
content-type: font/woff2
access-control-allow-origin: *
cache-control: public, max-age=31536000
accept-ranges: bytes
timing-allow-origin: *
expires: Sun, 30 Mar 2025 12:17:00 GMT

POST
H2 204 collect
region1.analytics.google.com/g/ 0
255 B 45ms
15ms Ping
text/plain 2001:4860:4802:34::36
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL: https://region1.analytics.google.com/g/collect?v=2&tid=G-9GXHZT6RVE&gtm=45je4430v888673821z8859165105za200&_p=1712333249652&_gaz=1&gcd=13l3lPl2l1&npa=1&dma_cps=sypham&dma=1&tcfd=10001&cid=674399125.1712333250&ul=en-us&sr=800x600&ir=1&uaa=x86&uab=64&uafvl=Google%2520Chrome%3B123.0.6312.105%7CNot%253AA-Brand%3B8.0.0.0%7CChromium%3B123.0.6312.105&uamb=0&uam=&uap=Win32&uapv=10.0.0&uaw=0&pscdl=noapi&_eu=EA&_s=1&uid=&dl=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&dr=&sid=1712333250&sct=1&seg=0&dt=With%20the%20rise%20of%20AI%2C%20web%20crawlers%20are%20suddenly%20controversial%20-%20The%20Verge&tfd=1440
Requested by: Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtag/js?id=G-9GXHZT6RVE&l=dataLayer&cx=c
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2001:4860:4802:34::36 , United States, ASN15169 (GOOGLE, US),
Reverse DNS
Software: Golfe2 /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
Content-Type: text/plain;charset=UTF-8

Response headers

pragma: no-cache
date: Fri, 05 Apr 2024 16:07:30 GMT
server: Golfe2
content-type: text/plain
access-control-allow-origin: https://www.theverge.com
cache-control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 0
expires: Fri, 01 Jan 1990 00:00:00 GMT

POST
H2 204 collect
stats.g.doubleclick.net/g/ 0
255 B 62ms
19ms Ping
text/plain 2a00:1450:400c:c00::9a
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL: https://stats.g.doubleclick.net/g/collect?v=2&tid=G-9GXHZT6RVE&cid=674399125.1712333250&gtm=45je4430v888673821z8859165105za200&aip=1&dma=1&dma_cps=sypham&gcd=13l3lPl2l1&npa=1
Requested by: Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtag/js?id=G-9GXHZT6RVE&l=dataLayer&cx=c
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2a00:1450:400c:c00::9a Brussels, Belgium, ASN15169 (GOOGLE, US),
Reverse DNS
Software: Golfe2 /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

pragma: no-cache
date: Fri, 05 Apr 2024 16:07:30 GMT
server: Golfe2
content-type: text/plain
access-control-allow-origin: https://www.theverge.com
cache-control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 0
expires: Fri, 01 Jan 1990 00:00:00 GMT

POST
H3 204 AGSKWxVOthTrkjyNYejVbGqN0pWOKCPYXcdK2fLHknJX_sqrzC_THmD304J8yRApxRSdNXBmD0r-d8--_GNG5bSlQhtJ7tET0SAUzyrgrgjDkHVM0iz1GirlTqENejm66PaWIKKKD4FcBA== Show response
fundingchoicesmessages.google.com/el/ 0
29 B 40ms
20ms XHR
text/html 2a00:1450:4001:806::200e
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://fundingchoicesmessages.google.com/el/AGSKWxVOthTrkjyNYejVbGqN0pWOKCPYXcdK2fLHknJX_sqrzC_THmD304J8yRApxRSdNXBmD0r-d8--_GNG5bSlQhtJ7tET0SAUzyrgrgjDkHVM0iz1GirlTqENejm66PaWIKKKD4FcBA==

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js

Protocol

Security

QUIC, , AES_128_GCM

Server

2a00:1450:4001:806::200e Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

ESF /

Resource Hash

e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Security Headers

Name	Value
Content-Security-Policy	script-src 'report-sample' 'nonce-jL7UzlRbvpadh81atymwBw' 'unsafe-inline';object-src 'none';base-uri 'self';report-uri /_/ContributorLoggingHttp/cspreport;worker-src 'self', script-src 'unsafe-inline' 'self' https://apis.google.com https://ssl.gstatic.com https://www.google.com https://www.googletagmanager.com https://www.gstatic.com https://www.google-analytics.com;report-uri /_/ContributorLoggingHttp/cspreport/allowlist, require-trusted-types-for 'script';report-uri /_/ContributorLoggingHttp/cspreport
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
Content-Type: text/plain

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-security-policy: script-src 'report-sample' 'nonce-jL7UzlRbvpadh81atymwBw' 'unsafe-inline';object-src 'none';base-uri 'self';report-uri /_/ContributorLoggingHttp/cspreport;worker-src 'self', script-src 'unsafe-inline' 'self' https://apis.google.com https://ssl.gstatic.com https://www.google.com https://www.googletagmanager.com https://www.gstatic.com https://www.google-analytics.com;report-uri /_/ContributorLoggingHttp/cspreport/allowlist, require-trusted-types-for 'script';report-uri /_/ContributorLoggingHttp/cspreport
x-content-type-options: nosniff
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 0
x-xss-protection: 0
reporting-endpoints: default="/_/ContributorLoggingHttp/web-reports?context=eJzjktDikmII0pBiqGV4xtQKxE7pM1hDgFiIh-PQ4QMb2AQ-LH8-gQkAygcMtg"
pragma: no-cache
accept-ch: Sec-CH-UA-Arch, Sec-CH-UA-Bitness, Sec-CH-UA-Full-Version, Sec-CH-UA-Full-Version-List, Sec-CH-UA-Model, Sec-CH-UA-WoW64, Sec-CH-UA-Form-Factor, Sec-CH-UA-Platform, Sec-CH-UA-Platform-Version
cross-origin-opener-policy: same-origin
server: ESF
vary: Sec-Fetch-Dest, Sec-Fetch-Mode, Sec-Fetch-Site
access-control-max-age: 86400
access-control-allow-methods: POST, GET, OPTIONS
access-control-allow-origin: https://www.theverge.com
content-type: text/html; charset=utf-8
cache-control: no-cache, no-store, max-age=0, must-revalidate
access-control-allow-credentials: true
permissions-policy: ch-ua-arch=*, ch-ua-bitness=*, ch-ua-full-version=*, ch-ua-full-version-list=*, ch-ua-model=*, ch-ua-wow64=*, ch-ua-form-factor=*, ch-ua-platform=*, ch-ua-platform-version=*
x-frame-options: SAMEORIGIN
expires: Mon, 01 Jan 1990 00:00:00 GMT

GET
H3 200 ga-audiences
www.google.de/ads/ 42 B
63 B 53ms
31ms Image
image/gif 2a00:1450:4001:831::2003
GOOGLE

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://www.google.de/ads/ga-audiences?v=1&t=sr&slf_rd=1&_r=4&tid=G-9GXHZT6RVE&cid=674399125.1712333250&gtm=45je4430v888673821z8859165105za200&aip=1&dma=1&dma_cps=sypham&gcd=13l3lPl2l1&npa=1&z=1060332209

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Security

QUIC, , AES_128_GCM

Server

2a00:1450:4001:831::2003 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

cafe /

Resource Hash

ef1955ae757c8b966c83248350331bd3a30f658ced11f387f8ebf05ab3368629

Security Headers

Name	Value
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

pragma: no-cache
date: Fri, 05 Apr 2024 16:07:30 GMT
x-content-type-options: nosniff
server: cafe
content-type: image/gif
p3p: policyref="https://www.googleadservices.com/pagead/p3p.xml", CP="NOI DEV PSA PSD IVA IVD OTP OUR OTR IND OTC"
cache-control: no-cache, no-store, must-revalidate
cross-origin-resource-policy: cross-origin
timing-allow-origin: *
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 42
x-xss-protection: 0
expires: Fri, 01 Jan 1990 00:00:00 GMT

POST
H3 200 collect Show response
www.google-analytics.com/j/ 3 B
23 B 14ms
13ms XHR
text/plain 2001:4860:4802:34::178
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://www.google-analytics.com/j/collect?v=1&_v=j101&aip=1&a=1188147904&t=pageview&_s=1&dl=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&dr=%2F&dp=%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&ul=en-us&de=UTF-8&dt=With%20the%20rise%20of%20AI%2C%20web%20crawlers%20are%20suddenly%20controversial%20-%20The%20Verge&sd=24-bit&sr=800x600&vp=1600x1113&je=0&_u=aGBAiUAjBAAAACABI~&jid=508344443&gjid=1854392405&cid=674399125.1712333250&tid=UA-26533115-1&_gid=248744714.1712333250&_slc=1&gtm=45He4430n81WQ5FM5Wv859165105za200&cd1=23832038&cd2=story&cd3=Logged%20Out&cd4=David%20Pierce&cd5=2024-02-14T14%3A00%3A00.000Z&cd6=0&cd8=2024-02-14T14%3A00%3A00.000Z&cd10=package-116719%2Cfront-page%2Cai-artificial-intelligence%2Ctech%2Cfeatures%2Cweb%2Cinternet-culture%2Cculture%2Cfeatured-story&cd11=theverge&cd12=theverge&cd20=theverge%2Ctheverge%2Cpackage-116719%2Cfront-page%2Cai-artificial-intelligence%2Ctech%2Cfeatures%2Cweb%2Cinternet-culture%2Cculture%2Cfeatured-story%2Cai-business-week-feb-2024&cd23=0&cd36=The%20text%20file%20that%20runs%20the%20internet&cd38=With%20the%20rise%20of%20AI%2C%20web%20crawlers%20are%20suddenly%20controversial&cd39=The%20rise%20and%20fall%20of%20robots.txt&cd50=ai-business-week-feb-2024&cd53=2905&cd54=Mozilla%2F5.0%20(Windows%20NT%2010.0%3B%20Win64%3B%20x64)%20AppleWebKit%2F537.36%20(KHTML%2C%20like%20Gecko)%20Chrome%2F123.0.0.0%20Safari%2F537.36&cd55=front-page&cd56=9e13ba65-4713-47d1-adc1-dc273f1e9940&cd57=&cd58=0&cd64=0&cd113=storytelling&gcd=13l3l3l2l1&dma_cps=sypham&dma=1&npa=1&z=271431370

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js

Protocol

Security

QUIC, , AES_128_GCM

Server

2001:4860:4802:34::178 , United States, ASN15169 (GOOGLE, US),

Reverse DNS

Software

Golfe2 /

Resource Hash

1cffc2b3146584685cd72751d7f28aa030ab9ae2f1bc78f2c27909f8d8287b26

Security Headers

Name	Value
X-Content-Type-Options	nosniff

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
Content-Type: text/plain

Response headers

pragma: no-cache
date: Fri, 05 Apr 2024 16:07:30 GMT
x-content-type-options: nosniff
last-modified: Sun, 17 May 1998 03:00:00 GMT
server: Golfe2
content-type: text/plain
access-control-allow-origin: https://www.theverge.com
cache-control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 3
expires: Fri, 01 Jan 1990 00:00:00 GMT

POST
H2 200 collect Show response
stats.g.doubleclick.net/j/ 1 B
148 B 19ms
19ms XHR
text/plain 2a00:1450:400c:c00::9a
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://stats.g.doubleclick.net/j/collect?t=dc&aip=1&_r=3&v=1&_v=j101&tid=UA-26533115-1&cid=674399125.1712333250&jid=508344443&gjid=1854392405&_gid=248744714.1712333250&npa=1&_u=aGBAiUAjBAAAAGABI~&z=189253095

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:400c:c00::9a Brussels, Belgium, ASN15169 (GOOGLE, US),

Reverse DNS

Software

Golfe2 /

Resource Hash

6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b

Security Headers

Name	Value
Strict-Transport-Security	max-age=10886400; includeSubDomains; preload
X-Content-Type-Options	nosniff

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
Content-Type: text/plain

Response headers

pragma: no-cache
strict-transport-security: max-age=10886400; includeSubDomains; preload
date: Fri, 05 Apr 2024 16:07:30 GMT
x-content-type-options: nosniff
last-modified: Sun, 17 May 1998 03:00:00 GMT
server: Golfe2
content-type: text/plain
access-control-allow-origin: https://www.theverge.com
cache-control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 1
expires: Fri, 01 Jan 1990 00:00:00 GMT

GET
H2 200 /
www.facebook.com/tr/ 0
273 B 23ms
8ms Image
text/plain 2a03:2880:f176:181:face:b00c:0:25de
FACEBOOK

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://www.facebook.com/tr/?id=594981607301768&ev=PageView&dl=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&rl=&if=false&ts=1712333250599&sw=800&sh=600&v=2.9.152&r=stable&ec=0&o=4126&fbp=fb.1.1712333250598.1172465369&ler=empty&cdl=API_unavailable&it=1712333250326&coo=false&rqm=GET

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a03:2880:f176:181:face:b00c:0:25de Frankfurt am Main, Germany, ASN32934 (FACEBOOK, US),

Reverse DNS

Software

proxygen-bolt /

Resource Hash

e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubDomains

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

x-fb-connection-quality: EXCELLENT; q=0.9, rtt=5, rtx=0, c=10, mss=1326, tbw=2771, tp=-1, tpl=-1, uplat=1, ullat=0
strict-transport-security: max-age=31536000; includeSubDomains
date: Fri, 05 Apr 2024 16:07:30 GMT
server: proxygen-bolt
content-type: text/plain
access-control-allow-origin
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=86400
content-length: 0

GET
H2 200 / Show response
geo.privacymanager.io/ 30 B
626 B 7ms
7ms Fetch
application/json 13.32.99.89
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://geo.privacymanager.io/
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 13.32.99.89 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-13-32-99-89.fra60.r.cloudfront.net
Software: /
Resource Hash: e257df7266563e157bb7df93fd09c6d13afb1c9554468b21c7378e09a94d3250

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
Content-Type: application/json
Accept: application/json
Referer: https://www.theverge.com/
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 02:15:10 GMT
via: 1.1 7abd55cee48606340f570b45718202b6.cloudfront.net (CloudFront), 1.1 79272ab9b399ee696b329d4f677dca48.cloudfront.net (CloudFront)
x-amz-cf-pop: FRA56-P3, FRA60-P3
age: 49940
x-amzn-requestid: f2ee0724-2018-4a33-b1ae-61b6e6995453
x-amzn-trace-id: Root=1-660f5eae-38aa251d171ddcc1520f2d4f;Parent=5341f3ddcf7a33ba;Sampled=0;lineage=06620786:0
access-control-allow-methods: DELETE,GET,HEAD,OPTIONS,PATCH,POST,PUT
content-type: application/json
access-control-allow-origin: *
x-cache: Hit from cloudfront
x-amz-apigw-id: Vuu7TFERjoEEO3w=
content-length: 30
x-amz-cf-id: RiEYYr2iPez3sw2rIyKfXMXNDRiMB3_C5VDaB4cNlr0b60rtqeZ5bg==
access-control-allow-headers: Content-Type,Authorization,X-Amz-Date,X-Api-Key,X-Amz-Security-Token

OPTIONS
H2 200 /
geo.privacymanager.io/ Frame 0
0 113ms
86ms Preflight
application/json 13.32.99.89
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://geo.privacymanager.io/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 13.32.99.89 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-13-32-99-89.fra60.r.cloudfront.net
Software: /
Resource Hash

Request headers

Accept: */*
Access-Control-Request-Headers: content-type
Access-Control-Request-Method: GET
Origin: https://www.theverge.com
Sec-Fetch-Mode: cors
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

access-control-allow-headers: Content-Type,Authorization,X-Amz-Date,X-Api-Key,X-Amz-Security-Token
access-control-allow-methods: DELETE,GET,HEAD,OPTIONS,PATCH,POST,PUT
access-control-allow-origin: *
content-length: 0
content-type: application/json
date: Fri, 05 Apr 2024 16:07:30 GMT
via: 1.1 29f7132906866b79866659848b3a3b68.cloudfront.net (CloudFront), 1.1 79272ab9b399ee696b329d4f677dca48.cloudfront.net (CloudFront)
x-amz-apigw-id: Vwo2eEcIDoEEWeA=
x-amz-cf-id: mm6zP5KsYpV3ZYYEKjBp_Wy1gjaQ3PuEzTOFGoqYa37z12RoPAfX3A==
x-amz-cf-pop: FRA56-P3 FRA60-P3
x-amzn-requestid: 73a9360c-5a83-4d68-974a-33921ba0b522
x-cache: Miss from cloudfront

GET
H2 200 pxid Show response
d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.prmutv.co/v2.0/ 46 B
386 B 78ms
53ms XHR
application/json 35.241.9.51
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL: https://d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.prmutv.co/v2.0/pxid?k=f8d3dda6-1372-4e33-b0e4-848b39d58874
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 35.241.9.51 Kansas City, United States, ASN15169 (GOOGLE, US),
Reverse DNS: 51.9.241.35.bc.googleusercontent.com
Software: Permutive /
Resource Hash: 01fd2b4860484fe244a0c004232509bbad363b6710b49cf463435d1ec31271b6

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
via: 1.1 google
server: Permutive
vary: Origin
content-type: application/json
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 66

GET
H2 200 getuidj Show response
ib.adnxs.com/ 11 B
701 B 7ms
7ms XHR
application/json 37.252.171.149
ASN-APPNEX

General

Check archive.org

Show headers Download Go to

Full URL

https://ib.adnxs.com/getuidj

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js

Protocol

Security

TLS 1.2, ECDHE_ECDSA, AES_128_GCM

Server

37.252.171.149 Frankfurt am Main, Germany, ASN29990 (ASN-APPNEX, US),

Reverse DNS

984.bm-nginx-loadbalancer.mgmt.fra1.adnexus.net

Software

nginx/1.23.4 /

Resource Hash

31b45c462302ac175bfa43f9e5591491db780ca094f6ecdd2907f25ad578448d

Security Headers

Name	Value
X-Xss-Protection	0

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

pragma: no-cache
date: Fri, 05 Apr 2024 16:07:30 GMT
an-x-request-uuid: c69a1281-cd70-4ead-a50f-746abba87f1b
server: nginx/1.23.4
accept-ch: Sec-CH-UA-Full-Version-List,Sec-CH-UA-Arch,Sec-CH-UA-Model,Sec-CH-UA-Platform-Version,Sec-CH-UA-Bitness
p3p: policyref="http://cdn.adnxs-simple.com/w3c/policy/p3p.xml", CP="NOI DSP COR ADM PSAo PSDo OURo SAMo UNRo OTRo BUS COM NAV DEM STA PRE"
content-type: application/json; charset=utf-8
access-control-allow-origin: https://www.theverge.com
cache-control: no-store, no-cache, private
access-control-allow-credentials: true
x-proxy-origin: 45.141.152.74; 45.141.152.74; 984.bm-nginx-loadbalancer.mgmt.fra1.adnexus.net; adnxs.com
content-length: 11
x-xss-protection: 0
expires: Sat, 15 Nov 2008 16:00:00 GMT

GET
H3 200 player.renderer.2477ede498eba3947c12.js Show response
cds.connatix.com/p/462462/ Frame E480 187 KB
50 KB 21ms
20ms Script
application/javascript 172.64.146.152
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cds.connatix.com/p/462462/player.renderer.2477ede498eba3947c12.js
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 172.64.146.152 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 647d0319bbf4ab7d29f7c9f7b7e2977746574d997f669b2b3017aade81f3c094

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
x-amz-version-id: rtFUumunN6I4_O5gbWWB8b3.hWvrIOmy
content-encoding: br
cf-cache-status: HIT
x-amz-replication-status: FAILED
alt-svc: h3=":443"; ma=86400
last-modified: Fri, 05 Apr 2024 15:10:00 GMT
server: cloudflare
etag: W/"015c9f284e8c2a628fbe349cdd24902d"
vary: Accept-Encoding
access-control-allow-methods: *
content-type: application/javascript
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
access-control-max-age: 86400
cf-ray: 86facaa13a438ff5-FRA
access-control-allow-headers: range
expires: Sat, 05 Apr 2025 16:07:30 GMT

GET
H3 200 cSyncRemoteEntry.js Show response
cds.connatix.com/p/462462/ Frame E480 3 KB
2 KB 16ms
16ms Script
application/javascript 172.64.146.152
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cds.connatix.com/p/462462/cSyncRemoteEntry.js
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 172.64.146.152 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 9592320780b39ab8510ade745533bf21f6f91e8b7b9cbda9fa99d9878f3a1615

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
x-amz-version-id: Xii_8AHseQLHFd3BTbiOwXkdSJ_Pcyc2
content-encoding: br
cf-cache-status: HIT
x-amz-replication-status: FAILED
alt-svc: h3=":443"; ma=86400
last-modified: Fri, 05 Apr 2024 15:10:01 GMT
server: cloudflare
etag: W/"2db6edc11f3e3af6adb20013457ba1f8"
vary: Accept-Encoding
access-control-allow-methods: *
content-type: application/javascript
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
access-control-max-age: 86400
cf-ray: 86facaa14a458ff5-FRA
access-control-allow-headers: range
expires: Sat, 05 Apr 2025 16:07:30 GMT

GET
H3 200 si
capi.connatix.com/tr/ 0
245 B 62ms
56ms Image
application/json 172.64.146.152
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://capi.connatix.com/tr/si?token=296a68d8-38f2-4b8e-ba6c-446cfc4a35a3
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 172.64.146.152 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
cf-cache-status: DYNAMIC
server: cloudflare
vary: Accept-Encoding
content-type: application/json
cache-control: no-cache, no-store, must-revalidate, max-age=0
access-control-allow-credentials: true
cf-ray: 86facaa14a508ff5-FRA
access-control-allow-headers: x-sec-ch-ua-platform-version, x-sec-ch-ua-full-version-list, x-sec-ch-ua-arch, x-sec-ch-ua-bitness, x-sec-ch-ua-model
content-length: 0
alt-svc: h3=":443"; ma=86400

GET
H3 200 player.css
cds.connatix.com/p/462462/ 68 KB
12 KB 18ms
17ms Stylesheet
text/css 172.64.146.152
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cds.connatix.com/p/462462/player.css
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 172.64.146.152 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 9e7752189a0beea73a64f5cd46818d187f00095dc964c1c7760680afe530e0ab

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
x-amz-version-id: A5AKy5m8TMt.Qc4ZZcyNaevNQGSsTfu_
content-encoding: br
cf-cache-status: HIT
x-amz-replication-status: FAILED
alt-svc: h3=":443"; ma=86400
last-modified: Fri, 05 Apr 2024 15:09:59 GMT
server: cloudflare
etag: W/"d6a74d4a9fe35003c26c21739d639cc7"
vary: Accept-Encoding
access-control-allow-methods: *
content-type: text/css
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
access-control-max-age: 86400
cf-ray: 86facaa14a4a8ff5-FRA
access-control-allow-headers: range
expires: Sat, 05 Apr 2025 16:07:30 GMT

GET
H3 200 hls.1.5.7.1.js Show response
cds.connatix.com/a/ 290 KB
90 KB 23ms
23ms Script
application/javascript 172.64.146.152
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cds.connatix.com/a/hls.1.5.7.1.js
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 172.64.146.152 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: de10295b82a567d83bfcdb1e92a8735d14702fa66d663371262b2623840e289a

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
x-amz-version-id: 4TublFloPsJ62xWljK9kzJBl4paKOfbJ
content-encoding: br
cf-cache-status: HIT
x-amz-replication-status: FAILED
alt-svc: h3=":443"; ma=86400
last-modified: Tue, 26 Mar 2024 11:33:15 GMT
server: cloudflare
etag: W/"bff1d145f7ffb9fd3b8b6a8e39fcaa12"
vary: Accept-Encoding
access-control-allow-methods: *
content-type: application/javascript
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
access-control-max-age: 86400
cf-ray: 86facaa14a4c8ff5-FRA
access-control-allow-headers: range
expires: Sat, 05 Apr 2025 16:07:30 GMT

GET
H3 200 player.ads.ece2223c32c7134ffe9a.js Show response
cds.connatix.com/p/462462/ Frame E480 379 KB
99 KB 30ms
29ms Script
application/javascript 172.64.146.152
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cds.connatix.com/p/462462/player.ads.ece2223c32c7134ffe9a.js
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 172.64.146.152 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: a457ade2c01691a60f7c6fcdaa2d32e3b301e62e5455af849cdc3ee3cba692bd

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
x-amz-version-id: 9z.5jDpZtwkfOHOuG5SBfcKNP6q1xAjj
content-encoding: br
cf-cache-status: HIT
x-amz-replication-status: FAILED
alt-svc: h3=":443"; ma=86400
last-modified: Fri, 05 Apr 2024 15:09:59 GMT
server: cloudflare
etag: W/"4923c1b44b9d6bebe43b4bddc289ede4"
vary: Accept-Encoding
access-control-allow-methods: *
content-type: application/javascript
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
access-control-max-age: 86400
cf-ray: 86facaa14a4d8ff5-FRA
access-control-allow-headers: range
expires: Sat, 05 Apr 2025 16:07:30 GMT

GET
H2 200 get Show response
mv.outbrain.com/Multivac/api/ 53 KB
16 KB 311ms
280ms Script
text/javascript 146.75.122.132
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL

https://mv.outbrain.com/Multivac/api/get?url=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders&srcUrl=https%3A%2F%2Fwww.theverge.com%2Frss%2Findex.xml&idx=0&rand=32341&widgetJSId=AR_11&va=true&et=true&format=html&px=800&py=12034&vpd=10921&cw=1600&settings=true&recs=true&key=NANOWDGT01&tch=0&adblck=false&abwl=false&ab=0&wl=0&obRecsAbtestVars=1451:5136&activeTab=true&cha=x86&chb=64&chfv=%5B%7B%22brand%22%3A%22Google%20Chrome%22%2C%22version%22%3A%22123.0.6312.105%22%7D%2C%7B%22brand%22%3A%22Not%3AA-Brand%22%2C%22version%22%3A%228.0.0.0%22%7D%2C%7B%22brand%22%3A%22Chromium%22%2C%22version%22%3A%22123.0.6312.105%22%7D%5D&chpv=10.0.0&chp=Win32&version=2010733&sig=ffEsgB7K&apv=false&osLang=en-US&winW=1600&winH=1113&scrW=800&scrH=600&dpr=1&secured=true&cmpStat=1&ccpa=1YNY&ccpaStat=1&chs=1&ogn=https%3A%2F%2Fwww.theverge.com%2F24067997%2Frobots-txt-ai-text-file-web-crawlers-spiders

Requested by

Host: widgets.outbrain.com
URL: https://widgets.outbrain.com/outbrain.js

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

146.75.122.132 Frankfurt am Main, Germany, ASN54113 (FASTLY, US),

Reverse DNS

Software

Resource Hash

fd155eb70ee57ee04cc1ba361edf2808deb0ffcaf21559af5e09978cac570a56

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubDomains; preload

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

x-cache-hits: 0, 0
strict-transport-security: max-age=31536000; includeSubDomains; preload
content-encoding: br
via: 1.1 varnish, 1.1 varnish
date: Fri, 05 Apr 2024 16:07:31 GMT
traffic-path: NYDC1, LGA, FRA, Europe1
x-timer: S1712333251.812645,VS0,VE272
vary: Accept-Encoding, User-Agent
x-cache: MISS, MISS
content-type: text/javascript; charset=UTF-8
expires: Thu, 01 Jan 1970 00:00:00 GMT
x-traceid: e7ae231438ed71e3ad47aadafd1d624e
accept-ranges: bytes
content-length: 15754
x-served-by: cache-lga21945-LGA, cache-fra-eddf8230030-FRA

GET
BLOB 200
OK 83bb6186-0c32-4dfd-b2f9-4cd18338d552
https://www.theverge.com/ 255 KB
0 Other
text/plain

General

Check archive.org

Show headers Download Go to

Full URL: blob:https://www.theverge.com/83bb6186-0c32-4dfd-b2f9-4cd18338d552
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: BLOB
Server: -, , ASN (),
Reverse DNS
Software: /
Resource Hash: d1650c5a1b4941d6085aff09c613cf91111ae22a4037c6360604569b98a3f1ce

Request headers

accept-language: de-DE,de;q=0.9
Referer
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

Content-Length: 261022
Content-Type

GET
BLOB 200
OK bbbf1db9-cbec-4eab-85f2-5f733e7b2590
https://www.theverge.com/ 255 KB
0 Other
text/plain

General

Check archive.org

Show headers Download Go to

Full URL: blob:https://www.theverge.com/bbbf1db9-cbec-4eab-85f2-5f733e7b2590
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: BLOB
Server: -, , ASN (),
Reverse DNS
Software: /
Resource Hash: d1650c5a1b4941d6085aff09c613cf91111ae22a4037c6360604569b98a3f1ce

Request headers

accept-language: de-DE,de;q=0.9
Referer
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

Content-Length: 261022
Content-Type

GET
H2 200 geoip Show response
api.permutive.com/v2.0/ 246 B
355 B 50ms
17ms XHR
application/json 34.107.254.252
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL: https://api.permutive.com/v2.0/geoip?include=geo&include=isp&include=ip_hash&k=f8d3dda6-1372-4e33-b0e4-848b39d58874
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 34.107.254.252 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),
Reverse DNS: 252.254.107.34.bc.googleusercontent.com
Software: Permutive /
Resource Hash: f0a83b6becd906b85b94429b38e4a2211ee929a9b51cbb262328cb7b89c926c3

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
via: 1.1 google
server: Permutive
vary: Origin
content-type: application/json
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 168

POST
H2 200 watson Show response
api.permutive.com/v2.0/ 452 B
322 B 56ms
23ms XHR
application/json 34.107.254.252
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL: https://api.permutive.com/v2.0/watson?k=f8d3dda6-1372-4e33-b0e4-848b39d58874
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 34.107.254.252 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),
Reverse DNS: 252.254.107.34.bc.googleusercontent.com
Software: Permutive /
Resource Hash: 7f01fc6bf1208bf8cd7253b03daa508b70a1635abd82c21745c184503c2e41e8

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
via: 1.1 google
server: Permutive
vary: Origin
content-type: application/json
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 265

POST
H2 200 identify Show response
api.permutive.com/v2.0/ 50 B
254 B 46ms
25ms XHR
application/json 34.107.254.252
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL: https://api.permutive.com/v2.0/identify?k=f8d3dda6-1372-4e33-b0e4-848b39d58874
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 34.107.254.252 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),
Reverse DNS: 252.254.107.34.bc.googleusercontent.com
Software: Permutive /
Resource Hash: b46c7ba992c34937baef66ad5414fa1cc6e0cf8da02974f9accd474963879b38

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
via: 1.1 google
server: Permutive
vary: Origin
content-type: application/json
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 68

GET
H2 200 d2fb08da-1c03-4c8a-978f-ad8a96b4c31f-models.bin Show response
cdn.permutive.com/models/v2/ 4 KB
4 KB 37ms
23ms XHR
application/x-binary 2606:4700::6811:7711
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cdn.permutive.com/models/v2/d2fb08da-1c03-4c8a-978f-ad8a96b4c31f-models.bin
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2606:4700::6811:7711 , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: d07b43ee456c55fc2f1122cc809fbef3985ead232f2813d6caa981ffba4a707a

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
content-encoding: gzip
cf-cache-status: HIT
x-goog-meta-oid: d2fb08da-1c03-4c8a-978f-ad8a96b4c31f
age: 0
x-guploader-uploadid: ABPtcPrz4BLsj439mtJjVzPYFbiK95T2Y5-P_oSr5Byays-xhOEAlep3ULmeh371Z4KRsQnFg5k
x-goog-storage-class: REGIONAL
x-goog-metageneration: 1
x-goog-stored-content-encoding: gzip
content-length: 3200
last-modified: Wed, 13 Mar 2024 17:30:51 GMT
server: cloudflare
etag: "9c82f59febc68901b320393ed5e3f424"
vary: Accept-Encoding
x-goog-generation: 1709341940640183
content-type: application/x-binary
access-control-allow-origin: *
x-goog-hash: crc32c=cAbQuQ==, md5=nIL1n+vGiQGzIDk+1eP0JA==
access-control-expose-headers: Content-Length, Date, Server, Transfer-Encoding, X-GUploader-UploadID, X-Google-Trace
cache-control: public, max-age=900, no-transform
x-goog-stored-content-length: 3200
accept-ranges: bytes
timing-allow-origin: *
cf-ray: 86facaa21b4d4d9e-FRA
expires: Fri, 05 Apr 2024 15:23:13 GMT

GET
H3 200 151.js Show response
cds.connatix.com/p/462462/ Frame E480 66 KB
20 KB 20ms
19ms Script
application/javascript 172.64.146.152
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cds.connatix.com/p/462462/151.js
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/cSyncRemoteEntry.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 172.64.146.152 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 315aa1a94104c0f3e533e358134acdb56b1d347a327cbd2f172e316f9248a2c7

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
x-amz-version-id: mQ7MzYLMOWV7dLTmH2A396JbTJbqfHx7
content-encoding: br
cf-cache-status: HIT
x-amz-replication-status: FAILED
alt-svc: h3=":443"; ma=86400
last-modified: Fri, 05 Apr 2024 15:10:01 GMT
server: cloudflare
etag: W/"84752b72f5f3c561e0edd543d1e55c33"
vary: Accept-Encoding
access-control-allow-methods: *
content-type: application/javascript
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
access-control-max-age: 86400
cf-ray: 86facaa23b288ff5-FRA
access-control-allow-headers: range
expires: Sat, 05 Apr 2025 16:07:30 GMT

GET
H3 200 243.js Show response
cds.connatix.com/p/462462/ Frame E480 10 KB
4 KB 17ms
16ms Script
application/javascript 172.64.146.152
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cds.connatix.com/p/462462/243.js
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/cSyncRemoteEntry.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 172.64.146.152 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 1e4603211a95f67bd228f016668571442e3d5ffefdd55b36499f7e01d95f0018

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
x-amz-version-id: WCvopSpSdJ4GyMBCn6Z9oXytRBjEcwDm
content-encoding: br
cf-cache-status: HIT
x-amz-replication-status: FAILED
alt-svc: h3=":443"; ma=86400
last-modified: Fri, 05 Apr 2024 15:10:01 GMT
server: cloudflare
etag: W/"5fd20a354db8fabf1275162e3d47085c"
vary: Accept-Encoding
access-control-allow-methods: *
content-type: application/javascript
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
access-control-max-age: 86400
cf-ray: 86facaa23b298ff5-FRA
access-control-allow-headers: range
expires: Sat, 05 Apr 2025 16:07:30 GMT

GET
H3 200 787.js Show response
cds.connatix.com/p/462462/ Frame E480 3 KB
2 KB 22ms
21ms Script
application/javascript 172.64.146.152
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cds.connatix.com/p/462462/787.js
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/cSyncRemoteEntry.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 172.64.146.152 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 8112da6474931bad4370edc6b49a72dccd3ca52237af36cb6a36405a40d6ffe5

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:30 GMT
x-amz-version-id: HyU2i0rl25lBGagxlkgvRSW8AM_L6zFl
content-encoding: br
cf-cache-status: HIT
x-amz-replication-status: FAILED
alt-svc: h3=":443"; ma=86400
last-modified: Fri, 05 Apr 2024 15:10:01 GMT
server: cloudflare
etag: W/"f438fe6f1f72f43df7622d94632d4f79"
vary: Accept-Encoding
access-control-allow-methods: *
content-type: application/javascript
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
access-control-max-age: 86400
cf-ray: 86facaa23b2d8ff5-FRA
access-control-allow-headers: range
expires: Sat, 05 Apr 2025 16:07:30 GMT

POST
H2 200 audiences Show response
api.permutive.com/audience-matching/v1/id/465ceae0-8232-487d-88cc-488733588e78/ 12 B
66 B 83ms
82ms XHR
application/json 34.107.254.252
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL: https://api.permutive.com/audience-matching/v1/id/465ceae0-8232-487d-88cc-488733588e78/audiences?k=f8d3dda6-1372-4e33-b0e4-848b39d58874
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 34.107.254.252 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),
Reverse DNS: 252.254.107.34.bc.googleusercontent.com
Software: /
Resource Hash: 2b0fb0a6b3e353c69158d61221c2200e4199d0d60dd0b9d99702a22eaa917a78

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
Content-Type: text/plain;charset=UTF-8

Response headers

access-control-allow-origin: *
date: Fri, 05 Apr 2024 16:07:30 GMT
via: 1.1 google
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 12
content-type: application/json

GET
H3

200

sync Show response
capi.connatix.com/core/ Frame E480
Redirect Chain

https://capi.connatix.com/core/sync
https://capi.connatix.com/core/sync?tier=1&final=true&UserScoringType=Enabled&ImplementationType=0

7 KB
3 KB

59ms
58ms

XHR
application/json

172.64.146.152
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://capi.connatix.com/core/sync?tier=1&final=true&UserScoringType=Enabled&ImplementationType=0
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H3
Server: 172.64.146.152 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 7fda10b73ad2c61db09e67f7a0b21ee8f55610e3e4f051ca2bfac697bcc0a856

Request headers

accept-language: de-DE,de;q=0.9
Referer
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
content-encoding: br
cf-cache-status: DYNAMIC
server: cloudflare
vary: Accept-Encoding
content-type: application/json
access-control-allow-origin: https://www.theverge.com
cache-control: no-cache, no-store, must-revalidate, max-age=0
access-control-allow-credentials: true
cf-ray: 86facaa2dbde8ff5-FRA
access-control-allow-headers: x-sec-ch-ua-platform-version, x-sec-ch-ua-full-version-list, x-sec-ch-ua-arch, x-sec-ch-ua-bitness, x-sec-ch-ua-model
alt-svc: h3=":443"; ma=86400

Redirect headers

date: Fri, 05 Apr 2024 16:07:31 GMT
cf-cache-status: DYNAMIC
server: cloudflare
vary: Accept-Encoding
content-type: application/x-protobuf
location: https://capi.connatix.com:443/core/sync?tier=1&final=true&UserScoringType=Enabled&ImplementationType=0
access-control-allow-origin: https://www.theverge.com
cache-control: no-cache, no-store, must-revalidate, max-age=0
access-control-allow-credentials: true
cf-ray: 86facaa27b758ff5-FRA
access-control-allow-headers: x-sec-ch-ua-platform-version, x-sec-ch-ua-full-version-list, x-sec-ch-ua-arch, x-sec-ch-ua-bitness, x-sec-ch-ua-model
content-length: 27
alt-svc: h3=":443"; ma=86400

POST
H3 200 pls Show response
capi.connatix.com/core/ Frame E480 19 KB
7 KB 111ms
110ms XHR
application/x-protobuf 172.64.146.152
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://capi.connatix.com/core/pls?v=462462
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 172.64.146.152 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 66c42dfc1130399d17a9addf9ec66d23598cdc8d5e73eae6b6ec244aa5254734

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
Content-Type: multipart/form-data

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
content-encoding: br
cf-cache-status: DYNAMIC
server: cloudflare
vary: Accept-Encoding
content-type: application/x-protobuf
access-control-allow-origin: https://www.theverge.com
cache-control: no-cache, no-store, must-revalidate, max-age=0
access-control-allow-credentials: true
cf-ray: 86facaa27b7f8ff5-FRA
access-control-allow-headers: x-sec-ch-ua-platform-version, x-sec-ch-ua-full-version-list, x-sec-ch-ua-arch, x-sec-ch-ua-bitness, x-sec-ch-ua-model
alt-svc: h3=":443"; ma=86400

POST
H2 200 _pdfps Show response
d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.partner.permutive.app/sync/ 0
85 B 42ms
17ms XHR
text/plain 34.107.222.173
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL: https://d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.partner.permutive.app/sync/_pdfps
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 34.107.222.173 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),
Reverse DNS: 173.222.107.34.bc.googleusercontent.com
Software: nginx /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: application/x-www-form-urlencoded

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
via: 1.1 google
server: nginx
content-type: text/plain; charset=utf-8
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 0

POST
H3 200 ed3452d88f5a467e26bc0e162f01ead6017d3 Show response
monacobeatles.com/confirm/04093a5aff33155/ 303 B
330 B 40ms
24ms Fetch
application/json 2600:1901:0:4277::1
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://monacobeatles.com/confirm/04093a5aff33155/ed3452d88f5a467e26bc0e162f01ead6017d3

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js

Protocol

Security

QUIC, , AES_128_GCM

Server

2600:1901:0:4277::1 Kansas City, United States, ASN15169 (GOOGLE, US),

Reverse DNS

Software

Resource Hash

65d46cb2265da9c055d87f11b83a95e7ee2240892b4af20cc3b105e7cbd9f956

Security Headers

Name	Value
Strict-Transport-Security	max-age=15724800; preload

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
Content-Type: text/plain;charset=UTF-8

Response headers

strict-transport-security: max-age=15724800; preload
date: Fri, 05 Apr 2024 16:07:31 GMT
via: 1.1 google
x-buildnumber: 1205290244
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 303
x-datacenter: gce-europe-west1
x-buildname: hoothoot
vary: Accept-Encoding, Origin
access-control-allow-methods: POST, OPTIONS
content-type: application/json; charset=utf-8
access-control-allow-origin: https://www.theverge.com
x-hostname: fen-hoothoot-europe-west1-spot-ltqf
cache-control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
timing-allow-origin: *
access-control-allow-headers: DNT,Keep-Alive,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Cookie
expires: Fri, 05 Apr 2024 16:07:30 GMT

POST
H2 200 _pdfps Show response
d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.partner.permutive.app/sync/ 0
161 B 20ms
16ms XHR
text/plain 34.107.222.173
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL: https://d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.partner.permutive.app/sync/_pdfps
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 34.107.222.173 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),
Reverse DNS: 173.222.107.34.bc.googleusercontent.com
Software: nginx /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: application/x-www-form-urlencoded

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
via: 1.1 google
server: nginx
content-type: text/plain; charset=utf-8
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 0

POST
H2 200 _pdfps Show response
d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.partner.permutive.app/sync/ 0
287 B 17ms
16ms XHR
text/plain 34.107.222.173
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL: https://d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.partner.permutive.app/sync/_pdfps
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 34.107.222.173 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),
Reverse DNS: 173.222.107.34.bc.googleusercontent.com
Software: nginx /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: application/x-www-form-urlencoded

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
via: 1.1 google
server: nginx
content-type: text/plain; charset=utf-8
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 0

POST
H2 200 _pdfps Show response
d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.partner.permutive.app/sync/ 0
161 B 15ms
14ms XHR
text/plain 34.107.222.173
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL: https://d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.partner.permutive.app/sync/_pdfps
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 34.107.222.173 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),
Reverse DNS: 173.222.107.34.bc.googleusercontent.com
Software: nginx /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: application/x-www-form-urlencoded

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
via: 1.1 google
server: nginx
content-type: text/plain; charset=utf-8
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 0

POST
H3 200 segment Show response
api.permutive.com/adv/v2/ 36 B
50 B 30ms
30ms XHR
application/json 34.107.254.252
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL: https://api.permutive.com/adv/v2/segment?new-session=true&k=f8d3dda6-1372-4e33-b0e4-848b39d58874
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 34.107.254.252 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),
Reverse DNS: 252.254.107.34.bc.googleusercontent.com
Software: Permutive /
Resource Hash: 95ad89143c22c60442bfab4646c8a5e85cef5f091e0f26405a160e2197f73706

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

access-control-allow-origin: *
date: Fri, 05 Apr 2024 16:07:31 GMT
via: 1.1 google
server: Permutive
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 36
content-type: application/json

POST
H3 200 d25e7906f57bc78d4f37315797e9fcd1b55be1ea6443ba118393 Show response
monacobeatles.com/ 3 B
29 B 21ms
20ms Fetch
application/json 2600:1901:0:4277::1
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://monacobeatles.com/d25e7906f57bc78d4f37315797e9fcd1b55be1ea6443ba118393

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js

Protocol

Security

QUIC, , AES_128_GCM

Server

2600:1901:0:4277::1 Kansas City, United States, ASN15169 (GOOGLE, US),

Reverse DNS

Software

Resource Hash

ca3d163bab055381827226140568f3bef7eaac187cebd76878e0b63e9e442356

Security Headers

Name	Value
Strict-Transport-Security	max-age=15724800; preload

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
Content-Type: text/plain;charset=UTF-8

Response headers

strict-transport-security: max-age=15724800; preload
date: Fri, 05 Apr 2024 16:07:31 GMT
via: 1.1 google
x-buildnumber: 1205290244
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 3
x-datacenter: gce-europe-west1
x-buildname: hoothoot
vary: Accept-Encoding, Origin
access-control-allow-methods: POST, OPTIONS
content-type: application/json; charset=utf-8
access-control-allow-origin: https://www.theverge.com
x-hostname: fen-hoothoot-europe-west1-spot-ltqf
cache-control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
timing-allow-origin: *
access-control-allow-headers: DNT,Keep-Alive,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Cookie
expires: Fri, 05 Apr 2024 16:07:30 GMT

POST
H2 200 _pdfps Show response
d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.partner.permutive.app/sync/ 0
170 B 16ms
15ms XHR
text/plain 34.107.222.173
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL: https://d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.partner.permutive.app/sync/_pdfps
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 34.107.222.173 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),
Reverse DNS: 173.222.107.34.bc.googleusercontent.com
Software: nginx /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: application/x-www-form-urlencoded

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
via: 1.1 google
server: nginx
content-type: text/plain; charset=utf-8
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 0

GET
H3 200 insights.bin Show response
ins.connatix.com/00d7c615-e0a5-467f-a4c0-36c7dd155b56/3/ Frame E480 605 B
674 B 61ms
25ms XHR
application/x-protobuf 104.18.41.104
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://ins.connatix.com/00d7c615-e0a5-467f-a4c0-36c7dd155b56/3/insights.bin
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 104.18.41.104 -, , ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 1995b181b412f1ddd4c4fbd887faa8e9504858180da5458fcf6cc095bfb7b84e

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
content-encoding: br
cf-cache-status: HIT
last-modified: Wed, 31 May 2023 12:33:49 GMT
server: cloudflare
etag: W/"801495e0ca0b2e597418102b12288bf6"
access-control-max-age: 86400
access-control-allow-methods: GET, HEAD
content-type: application/x-protobuf
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
vary: Accept-Encoding
cf-ray: 86facaa37a9635ed-FRA
alt-svc: h3=":443"; ma=86400
expires: Sat, 05 Apr 2025 16:07:31 GMT

GET
H3 200 insights.bin Show response
ins.connatix.com/98b126f4-5dc3-49fc-aa04-d90ae1157571/3/ Frame E480 569 B
649 B 56ms
21ms XHR
application/x-protobuf 104.18.41.104
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://ins.connatix.com/98b126f4-5dc3-49fc-aa04-d90ae1157571/3/insights.bin
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 104.18.41.104 -, , ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 3e62fcaf3bf8574b9259d0ad4eab504c8d33277799d6e623a27fbea6318d1dd3

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
content-encoding: br
cf-cache-status: HIT
last-modified: Wed, 31 May 2023 12:33:49 GMT
server: cloudflare
etag: W/"b2161d604cd9d9330a0c32f8bb7e2db4"
access-control-max-age: 86400
access-control-allow-methods: GET, HEAD
content-type: application/x-protobuf
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
vary: Accept-Encoding
cf-ray: 86facaa37a8b35ed-FRA
alt-svc: h3=":443"; ma=86400
expires: Sat, 05 Apr 2025 16:07:31 GMT

GET
H3 200 insights.bin Show response
ins.connatix.com/efa3abcd-699d-4907-8754-b10634d48f32/3/ Frame E480 533 B
664 B 55ms
20ms XHR
application/x-protobuf 104.18.41.104
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://ins.connatix.com/efa3abcd-699d-4907-8754-b10634d48f32/3/insights.bin
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 104.18.41.104 -, , ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 39f6c2c5fa24275ff0945d39f2892618cb8cfc6d8a4090d9d458a7209bb80a43

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
content-encoding: br
cf-cache-status: HIT
last-modified: Wed, 29 Mar 2023 17:21:44 GMT
server: cloudflare
etag: W/"979dabd74effd5f6ea7f8d3a2680b3a7"
access-control-max-age: 86400
access-control-allow-methods: GET, HEAD
content-type: application/x-protobuf
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
vary: Accept-Encoding
cf-ray: 86facaa37a8a35ed-FRA
alt-svc: h3=":443"; ma=86400
expires: Sat, 05 Apr 2025 16:07:31 GMT

GET
H3 200 insights.bin Show response
ins.connatix.com/6645557a-0ff4-403d-95e6-126f03c55b48/3/ Frame E480 497 B
615 B 56ms
22ms XHR
application/x-protobuf 104.18.41.104
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://ins.connatix.com/6645557a-0ff4-403d-95e6-126f03c55b48/3/insights.bin
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 104.18.41.104 -, , ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: e376cf7724ee9ff9e87975f543470828ae54f4bdc2be579617b9ce9afb43dd81

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
content-encoding: br
cf-cache-status: HIT
last-modified: Fri, 10 Mar 2023 20:11:54 GMT
server: cloudflare
etag: W/"d2b5902c8a9755a46de073d9630f5858"
access-control-max-age: 86400
access-control-allow-methods: GET, HEAD
content-type: application/x-protobuf
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
vary: Accept-Encoding
cf-ray: 86facaa37a8935ed-FRA
alt-svc: h3=":443"; ma=86400
expires: Sat, 05 Apr 2025 16:07:31 GMT

GET
H3 200 insights.bin Show response
ins.connatix.com/9694291f-d482-4f35-a1a8-04586694c1d7/3/ Frame E480 425 B
576 B 63ms
27ms XHR
application/x-protobuf 104.18.41.104
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://ins.connatix.com/9694291f-d482-4f35-a1a8-04586694c1d7/3/insights.bin
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 104.18.41.104 -, , ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: c116c82588aa096611fc88ec3110f70fada02bd05df71d3e90706cc4304c7de2

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
content-encoding: br
cf-cache-status: HIT
last-modified: Wed, 31 May 2023 12:33:49 GMT
server: cloudflare
etag: W/"bd3568c8e4ab64e36e13c7fff77d7d5e"
access-control-max-age: 86400
access-control-allow-methods: GET, HEAD
content-type: application/x-protobuf
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
vary: Accept-Encoding
cf-ray: 86facaa37a9c35ed-FRA
alt-svc: h3=":443"; ma=86400
expires: Sat, 05 Apr 2025 16:07:31 GMT

GET
H3 200 insights.bin Show response
ins.connatix.com/8ffb59d5-b093-4d68-aa90-1dd263c5d84d/4/ Frame E480 389 B
561 B 58ms
23ms XHR
application/x-protobuf 104.18.41.104
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://ins.connatix.com/8ffb59d5-b093-4d68-aa90-1dd263c5d84d/4/insights.bin
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 104.18.41.104 -, , ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 60604ab669f63a672fc4b7ba7df2b04752d16f1ca893297d9f97b4be041045aa

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
content-encoding: br
cf-cache-status: HIT
last-modified: Mon, 12 Jun 2023 12:19:23 GMT
server: cloudflare
etag: W/"85d1e4e64fb4923d839e16c0961b5c3f"
access-control-max-age: 86400
access-control-allow-methods: GET, HEAD
content-type: application/x-protobuf
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
vary: Accept-Encoding
cf-ray: 86facaa37a9835ed-FRA
alt-svc: h3=":443"; ma=86400
expires: Sat, 05 Apr 2025 16:07:31 GMT

GET
H3 200 insights.bin Show response
ins.connatix.com/7cb41cf9-2def-4a72-9d3e-9987dca07dc7/3/ Frame E480 461 B
598 B 55ms
20ms XHR
application/x-protobuf 104.18.41.104
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://ins.connatix.com/7cb41cf9-2def-4a72-9d3e-9987dca07dc7/3/insights.bin
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 104.18.41.104 -, , ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 4fb3e8618b9e45cca770ecab0205c879f4bf1df4ed00b8eff82c456c5b07ed9c

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
content-encoding: br
cf-cache-status: HIT
last-modified: Wed, 31 May 2023 12:33:49 GMT
server: cloudflare
etag: W/"fb0534772cca5d38dd93b755063793fb"
access-control-max-age: 86400
access-control-allow-methods: GET, HEAD
content-type: application/x-protobuf
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
vary: Accept-Encoding
cf-ray: 86facaa37a9b35ed-FRA
alt-svc: h3=":443"; ma=86400
expires: Sat, 05 Apr 2025 16:07:31 GMT

GET
H3 200 insights.bin Show response
ins.connatix.com/76587f97-6063-4883-8616-639b447794c3/4/ Frame E480 461 B
597 B 57ms
22ms XHR
application/x-protobuf 104.18.41.104
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://ins.connatix.com/76587f97-6063-4883-8616-639b447794c3/4/insights.bin
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 104.18.41.104 -, , ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 1634e871af99fe3ba2f1bb42327c5143622f7795894eaba1a7f8f1e1344a26db

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
content-encoding: br
cf-cache-status: HIT
last-modified: Mon, 12 Jun 2023 12:28:43 GMT
server: cloudflare
etag: W/"04a6d6ae355d0a6e72839bbed384c796"
access-control-max-age: 86400
access-control-allow-methods: GET, HEAD
content-type: application/x-protobuf
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
vary: Accept-Encoding
cf-ray: 86facaa37a9335ed-FRA
alt-svc: h3=":443"; ma=86400
expires: Sat, 05 Apr 2025 16:07:31 GMT

GET
H3 200 insights.bin Show response
ins.connatix.com/83a6bb80-30f8-42b2-9743-eaf339a8d3ff/4/ Frame E480 533 B
631 B 57ms
23ms XHR
application/x-protobuf 104.18.41.104
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://ins.connatix.com/83a6bb80-30f8-42b2-9743-eaf339a8d3ff/4/insights.bin
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 104.18.41.104 -, , ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 463c25b6c7c1c9a7d06397e8528f944250c89c0991a4c2db3e1844ee4ec5ae41

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
content-encoding: br
cf-cache-status: HIT
last-modified: Mon, 12 Jun 2023 12:51:24 GMT
server: cloudflare
etag: W/"3b3b16cfa80f617748dbdd54ad6d1a63"
access-control-max-age: 86400
access-control-allow-methods: GET, HEAD
content-type: application/x-protobuf
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
vary: Accept-Encoding
cf-ray: 86facaa37a9135ed-FRA
alt-svc: h3=":443"; ma=86400
expires: Sat, 05 Apr 2025 16:07:31 GMT

GET
H3 200 insights.bin Show response
ins.connatix.com/90e9dda1-3354-43a7-932b-c195990ffc3a/3/ Frame E480 209 B
470 B 56ms
22ms XHR
application/x-protobuf 104.18.41.104
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://ins.connatix.com/90e9dda1-3354-43a7-932b-c195990ffc3a/3/insights.bin
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 104.18.41.104 -, , ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 8f6649564d1408551c2e92bfea8e51e39aa19720100fe11c4a541120301bfed7

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
content-encoding: br
cf-cache-status: HIT
last-modified: Wed, 01 Mar 2023 23:09:58 GMT
server: cloudflare
etag: W/"8a17370ab2beff99f91ac22b3401684c"
access-control-max-age: 86400
access-control-allow-methods: GET, HEAD
content-type: application/x-protobuf
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
vary: Accept-Encoding
cf-ray: 86facaa37a8d35ed-FRA
alt-svc: h3=":443"; ma=86400
expires: Sat, 05 Apr 2025 16:07:31 GMT

GET
H3 200 3_media.bin Show response
vid.connatix.com/pid-296a68d8-38f2-4b8e-ba6c-446cfc4a35a3/00d7c615-e0a5-467f-a4c0-36c7dd155b56/ Frame E480 1 KB
1 KB 62ms
22ms XHR
application/x-protobuf 172.64.146.152
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://vid.connatix.com/pid-296a68d8-38f2-4b8e-ba6c-446cfc4a35a3/00d7c615-e0a5-467f-a4c0-36c7dd155b56/3_media.bin
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 172.64.146.152 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 65ddf5e3399edf4c341afc838845700aa5d6cbbb30bcb0b9967d152c21d95d5a

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
content-encoding: br
cf-cache-status: HIT
alt-svc: h3=":443"; ma=86400
last-modified: Wed, 31 May 2023 12:33:48 GMT
server: cloudflare
etag: W/"5c76bc13097fd5805377b52482f65851"
vary: Origin, Access-Control-Request-Headers, Access-Control-Request-Method, Accept-Encoding
access-control-allow-methods: *
content-type: application/x-protobuf
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
access-control-max-age: 86400
cf-ray: 86facaa38b7118db-FRA
access-control-allow-headers: range
xpid: 296a68d8-38f2-4b8e-ba6c-446cfc4a35a3
expires: Sat, 05 Apr 2025 16:07:31 GMT

GET
H3 200 iframe.integration.destroy.1.0.0.js Show response
cds.connatix.com/a/ 532 B
686 B 17ms
17ms Script
application/javascript 172.64.146.152
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cds.connatix.com/a/iframe.integration.destroy.1.0.0.js
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 172.64.146.152 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: e6792eb9fa0d27e8c8ac7eaa0467637d03626dc4dbc7e534f7650df58905d112

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
x-amz-version-id: GILjFHZO3ya.fkxmcDvoowhqGKSuvqw1
content-encoding: br
cf-cache-status: HIT
x-amz-replication-status: FAILED
alt-svc: h3=":443"; ma=86400
last-modified: Tue, 13 Feb 2024 09:43:45 GMT
server: cloudflare
etag: W/"60333bd2ad851fbc9ac8ab37b809fd47"
vary: Accept-Encoding
access-control-allow-methods: *
content-type: application/javascript
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
access-control-max-age: 86400
cf-ray: 86facaa34c618ff5-FRA
access-control-allow-headers: range
expires: Sat, 05 Apr 2025 16:07:31 GMT

GET
H3 200 blockedDomains_1.bin Show response
lit.connatix.com/2b7cc2be-6e33-45f1-a993-4edc3bdaed58/ Frame E480 13 B
372 B 59ms
20ms XHR
application/x-protobuf 104.18.41.104
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://lit.connatix.com/2b7cc2be-6e33-45f1-a993-4edc3bdaed58/blockedDomains_1.bin
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 104.18.41.104 -, , ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: aadf2fdd0fcb02dd08b4160905bc3fa1fdaaef1e145ddf28ef8074f6fd1dca5e

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
x-amz-version-id: null
cf-cache-status: HIT
alt-svc: h3=":443"; ma=86400
content-length: 13
last-modified: Mon, 28 Aug 2023 19:20:25 GMT
server: cloudflare
etag: "1e1210c1fb09dc80c1dfdfdf15061bf9"
access-control-max-age: 86400
vary: Accept-Encoding
content-type: application/x-protobuf
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
accept-ranges: bytes
cf-ray: 86facaa38e0d4d25-FRA
expires: Sat, 05 Apr 2025 16:07:31 GMT

GET
H3 200 insights.bin Show response
ins.connatix.com/6cc0a73a87f6663b2b07c4e933079258/ Frame E480 432 B
548 B 53ms
21ms XHR
application/x-protobuf 104.18.41.104
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://ins.connatix.com/6cc0a73a87f6663b2b07c4e933079258/insights.bin
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 104.18.41.104 -, , ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: f1083caadfd9049720c3453e687b5ae0edbff8e64b8d76c026b60fc764e23aac

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
content-encoding: br
cf-cache-status: HIT
last-modified: Wed, 06 Mar 2024 15:10:32 GMT
server: cloudflare
etag: W/"e15010abb4bd3bc7b9e4e9fa771dc910"
access-control-max-age: 86400
access-control-allow-methods: GET, HEAD
content-type: application/x-protobuf
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
vary: Accept-Encoding
cf-ray: 86facaa37a8c35ed-FRA
alt-svc: h3=":443"; ma=86400
expires: Sat, 05 Apr 2025 16:07:31 GMT

GET
H2 200 eyJpdSI6IjY2Yzc1MzU2N2EyZGIwM2I1NzIxOGI5ZDcyODA1MGNkZTVmNmMwN2JjZjY0NzBhYTk1ZjRlMWI5OWFjODEyN2EiLCJ3IjoyNTAsImgiOjI1MCwiZCI6MS4wLCJjcyI6MiwiZiI6NX0.mp4
images.outbrainimg.com/transform/v3/ 64 KB
64 KB 63ms
13ms Image
video/mp4 23.32.101.241
AKAMAI-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://images.outbrainimg.com/transform/v3/eyJpdSI6IjY2Yzc1MzU2N2EyZGIwM2I1NzIxOGI5ZDcyODA1MGNkZTVmNmMwN2JjZjY0NzBhYTk1ZjRlMWI5OWFjODEyN2EiLCJ3IjoyNTAsImgiOjI1MCwiZCI6MS4wLCJjcyI6MiwiZiI6NX0.mp4

Requested by

Host: widgets.outbrain.com
URL: https://widgets.outbrain.com/outbrain.js

Protocol

Security

TLS 1.3, , AES_256_GCM

Server

23.32.101.241 Frankfurt am Main, Germany, ASN16625 (AKAMAI-AS, US),

Reverse DNS

a23-32-101-241.deploy.static.akamaitechnologies.com

Software

Resource Hash

e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubDomains; preload

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

strict-transport-security: max-age=31536000; includeSubDomains; preload
date: Fri, 05 Apr 2024 16:07:31 GMT
last-modified: Fri, 06 Oct 2023 08:07:33 GMT
access-control-allow-methods: GET,POST
content-type: video/mp4
access-control-allow-origin: *
cache-control: max-age=2113741
access-control-allow-credentials: false
x-traceid: ed025e40d756095b19d8f6374076f36d
timing-allow-origin: *, *
content-length: 165279

GET
H2 200 ob_logo_67x12.png
widgets.outbrain.com/images/widgetIcons/ 2 KB
3 KB 20ms
18ms Image
image/png 23.35.237.86
AKAMAI-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://widgets.outbrain.com/images/widgetIcons/ob_logo_67x12.png
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 23.35.237.86 Frankfurt am Main, Germany, ASN16625 (AKAMAI-AS, US),
Reverse DNS: a23-35-237-86.deploy.static.akamaitechnologies.com
Software: AkamaiNetStorage /
Resource Hash: 487aec7746a83542b3573383df65747e31c494d8412103b5675329f3d4befaeb

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

expires: Sun, 05 May 2024 16:07:31 GMT
date: Fri, 05 Apr 2024 16:07:31 GMT
last-modified: Sun, 25 Feb 2024 08:33:18 GMT
server: AkamaiNetStorage
etag: "c52b07e749f7a09fa7b97b7e195e06ce:1708851052.798399"
access-control-allow-methods: GET,POST
content-type: image/png
access-control-allow-origin: *
cache-control: max-age=2592000
access-control-allow-credentials: false
accept-ranges: bytes
timing-allow-origin: *, *
content-length: 2326
access-control-request-headers: X-OB-STG,X-OB-PRD

GET
H2 200 achoice.svg
widgets.outbrain.com/images/widgetIcons/ 990 B
1 KB 20ms
19ms Image
image/svg+xml 23.35.237.86
AKAMAI-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://widgets.outbrain.com/images/widgetIcons/achoice.svg
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 23.35.237.86 Frankfurt am Main, Germany, ASN16625 (AKAMAI-AS, US),
Reverse DNS: a23-35-237-86.deploy.static.akamaitechnologies.com
Software: AkamaiNetStorage /
Resource Hash: 9ba56f5ffa579747efde1d2a429b325a9fb7220d30f4268e4a44ecbe4a9bf034

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

expires: Sun, 05 May 2024 16:07:31 GMT
date: Fri, 05 Apr 2024 16:07:31 GMT
last-modified: Sun, 25 Feb 2024 08:33:18 GMT
server: AkamaiNetStorage
etag: "5ab8e16b5f46213840bcd403e349419c:1708851030.144644"
access-control-allow-methods: GET,POST
content-type: image/svg+xml
access-control-allow-origin: *
cache-control: max-age=2592000
access-control-allow-credentials: false
accept-ranges: bytes
timing-allow-origin: *, *
content-length: 990
access-control-request-headers: X-OB-STG,X-OB-PRD

GET
H/1.1 200
OK l Show response
mcdp-nydc1.outbrain.com/ 2 B
429 B 357ms
87ms Fetch
text/plain 64.202.112.127
AS-OUTBRAIN

General

Check archive.org

Show headers Download Go to

Full URL

https://mcdp-nydc1.outbrain.com/l?token=acb5c57a1788aa3c5e5963172595dbc2_8071_1712333251025_1&tm=889&eT=0&widgetWidth=1100&widgetHeight=324&widgetX=250&widgetY=12034&wRV=2010733&pVis=1&lsd=-1&eIdx=&cnsnt=no_consent&ccpa=1YNY&cheq=0&rtt=316&oo=true&lo=910&obreq=858&mvreq=1680&mvres=1996&cet=4g&to=1712333249098&ll=0&chs=1&ab=0&wl=0

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js

Protocol

HTTP/1.1

Security

TLS 1.2, ECDHE_RSA, AES_128_GCM

Server

64.202.112.127 , United States, ASN22075 (AS-OUTBRAIN, US),

Reverse DNS

ny.outbrain.com

Software

Resource Hash

2689367b205c16ce32ed4200942b8b8b1e262dfc70d9bc9fbc77c49699a4f1df

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubDomains; preload

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

Date: Fri, 05 Apr 2024 16:07:31 GMT
content-encoding: br
Strict-Transport-Security: max-age=31536000; includeSubDomains; preload
Vary: Origin, Access-Control-Request-Method, Access-Control-Request-Headers
Content-Type: text/plain; charset=UTF-8
Access-Control-Allow-Origin: *
Access-Control-Expose-Headers: content-range
X-TraceId: 835be181bbd8e5933db58f092ac13638
Content-Length: 6

GET
H2 200 clip.js Show response
widgets.outbrain.com/nanoWidget/2010733/module/ 2 KB
1 KB 15ms
14ms Script
application/x-javascript 23.35.237.86
AKAMAI-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://widgets.outbrain.com/nanoWidget/2010733/module/clip.js?e=1
Requested by: Host: widgets.outbrain.com
URL: https://widgets.outbrain.com/outbrain.js
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 23.35.237.86 Frankfurt am Main, Germany, ASN16625 (AKAMAI-AS, US),
Reverse DNS: a23-35-237-86.deploy.static.akamaitechnologies.com
Software: AkamaiNetStorage /
Resource Hash: 1d71e7b94532bee6339e156ec77ff3062dc42324947fbe6f38cc2b4c404ec510

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

access-control-request-headers: X-OB-STG,X-OB-PRD
date: Fri, 05 Apr 2024 16:07:31 GMT
content-encoding: gzip
content-length: 887
last-modified: Mon, 01 Apr 2024 06:45:56 GMT
server: AkamaiNetStorage
etag: "e163295f7cea715dfa4c39065f85c108:1711956537.587949"
vary: Accept-Encoding
access-control-allow-methods: GET,POST
content-type: application/x-javascript
access-control-allow-origin: *
cache-control: max-age=604800
access-control-allow-credentials: false
accept-ranges: bytes
timing-allow-origin: *, *
expires: Fri, 12 Apr 2024 16:07:31 GMT

GET
H2 206 eyJpdSI6IjY2Yzc1MzU2N2EyZGIwM2I1NzIxOGI5ZDcyODA1MGNkZTVmNmMwN2JjZjY0NzBhYTk1ZjRlMWI5OWFjODEyN2EiLCJ3IjoyNTAsImgiOjI1MCwiZCI6MS4wLCJjcyI6MiwiZiI6NX0.mp4
images.outbrainimg.com/transform/v3/ 161 KB
162 KB 81ms
52ms Media
video/mp4 23.32.101.241
AKAMAI-AS

General

Check archive.org

Show headers Download Go to

Full URL

https://images.outbrainimg.com/transform/v3/eyJpdSI6IjY2Yzc1MzU2N2EyZGIwM2I1NzIxOGI5ZDcyODA1MGNkZTVmNmMwN2JjZjY0NzBhYTk1ZjRlMWI5OWFjODEyN2EiLCJ3IjoyNTAsImgiOjI1MCwiZCI6MS4wLCJjcyI6MiwiZiI6NX0.mp4

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Security

TLS 1.3, , AES_256_GCM

Server

23.32.101.241 Frankfurt am Main, Germany, ASN16625 (AKAMAI-AS, US),

Reverse DNS

a23-32-101-241.deploy.static.akamaitechnologies.com

Software

Resource Hash

e1d19f514038dfd00901259ae158e3cf26b4085f0d5e35277cfc12a2b85567e3

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubDomains; preload

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Accept-Encoding: identity;q=1, *;q=0
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
Referer: https://www.theverge.com/
Range: bytes=0-
sec-ch-ua-platform: "Win32"

Response headers

strict-transport-security: max-age=31536000; includeSubDomains; preload
date: Fri, 05 Apr 2024 16:07:31 GMT
last-modified: Fri, 06 Oct 2023 08:07:33 GMT
access-control-allow-methods: GET,POST
content-type: video/mp4
access-control-allow-origin: *
Content-Range: bytes 0-165278/165279
cache-control: max-age=2113741
access-control-allow-credentials: false
x-traceid: ed025e40d756095b19d8f6374076f36d
timing-allow-origin: *, *
Content-Length: 165279

GET
H2 200 PolySans-Median.woff2
cdn.vox-cdn.com/shared_fonts/verge-duet/ 30 KB
31 KB 240ms
232ms Font
application/octet-stream 199.232.196.124
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL

https://cdn.vox-cdn.com/shared_fonts/verge-duet/PolySans-Median.woff2

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

199.232.196.124 , United States, ASN54113 (FASTLY, US),

Reverse DNS

Software

AmazonS3 /

Resource Hash

dc757f26a467bd808d0c219455878a95317b28474ee415798fb4c166b31a8c12

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

x-amz-version-id: zOMZHAV.kxBdP_3BZpeAuq4ONjClfHvr
content-encoding: gzip
via: 1.1 varnish
date: Fri, 05 Apr 2024 16:07:31 GMT
strict-transport-security: max-age=31536000
x-amz-request-id: 9VME06S3VC3QG3WP
age: 0
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 31244
x-amz-id-2: 1Gc5uA0qEQTU6vKLM7ArXOvQDk/CR6sMjBsLO4P3KR/gQOjMhU0kzBUHTB5PmLuSH28ZTbRHCrw=
x-served-by: cache-fra-eddf8230081-FRA
last-modified: Thu, 11 Aug 2022 15:05:37 GMT
server: AmazonS3
x-timer: S1712333251.172333,VS0,VE224
etag: "3b6618bfd42acd05220d37ebd9cde3af"
vary: Accept-Encoding
x-amz-meta-md5_checksum: e93b99db8951dbdd35a6d3e41a0acb7e
content-type: text/plain
access-control-allow-origin: *
cache-control: public, max-age=3153600
accept-ranges: bytes
x-cache-hits: 1

GET
H2 200 PolySans-Neutral.woff2
cdn.vox-cdn.com/shared_fonts/verge-duet/ 30 KB
31 KB 16ms
8ms Font
application/octet-stream 199.232.196.124
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL

https://cdn.vox-cdn.com/shared_fonts/verge-duet/PolySans-Neutral.woff2

Requested by

Host: www.theverge.com
URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

199.232.196.124 , United States, ASN54113 (FASTLY, US),

Reverse DNS

Software

AmazonS3 /

Resource Hash

f2087eba07b2ed3cdaed421506744188ea861e7f773cfa941be00e043715c3e4

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
Origin: https://www.theverge.com
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

x-amz-version-id: cAhYv_z_3FViKEYqWVEkX4YC.uONYAjF
content-encoding: gzip
via: 1.1 varnish
date: Fri, 05 Apr 2024 16:07:31 GMT
strict-transport-security: max-age=31536000
x-amz-request-id: 14VVBMHEES49QF2F
age: 46
x-cache: HIT
alt-svc: h3=":443";ma=86400,h3-29=":443";ma=86400,h3-27=":443";ma=86400
content-length: 30892
x-amz-id-2: 9qKGA09r6OBnOg0XpWmL/uk38pVVljlD+ovPFgeflDcNJY6h9qoJ1pxUmwjdW4vStOIf0iGLBwxwSkFx4jGwEA==
x-served-by: cache-fra-eddf8230081-FRA
last-modified: Thu, 11 Aug 2022 15:05:35 GMT
server: AmazonS3
x-timer: S1712333251.172154,VS0,VE1
etag: "2e8e22519c3379a6fcb8a48f8ffc8db9"
vary: Accept-Encoding
x-amz-meta-md5_checksum: f4ddc24ff215e947b707db50409a8177
content-type: text/plain
access-control-allow-origin: *
cache-control: public, max-age=3153600
accept-ranges: bytes
x-cache-hits: 1

GET
H3 200 player.lit.ui.js Show response
cds.connatix.com/p/462462/ 172 KB
43 KB 20ms
19ms Script
application/javascript 172.64.146.152
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cds.connatix.com/p/462462/player.lit.ui.js
Requested by: Host: cds.connatix.com
URL: https://cds.connatix.com/p/462462/connatix.player.dc.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 172.64.146.152 San Francisco, United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: fa36179531ddbbf5dd45d9fd8d22ac3dca8321aaf9267b72934f4a520203a3cc

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
Referer: https://www.theverge.com/
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
sec-ch-ua-platform: "Win32"

Response headers

date: Fri, 05 Apr 2024 16:07:31 GMT
x-amz-version-id: J1Zq0_L32Lce_QJBUkOy2MimmkXjkjKQ
content-encoding: br
cf-cache-status: HIT
x-amz-replication-status: FAILED
alt-svc: h3=":443"; ma=86400
last-modified: Fri, 05 Apr 2024 15:10:00 GMT
server: cloudflare
etag: W/"0092af81705c80d97eb103b3fb1f92a2"
vary: Accept-Encoding
access-control-allow-methods: *
content-type: application/javascript
access-control-allow-origin: *
cache-control: public,max-stale=31536000,stale-while-revalidate=31536000,immutable,max-age=31536000
access-control-max-age: 86400
cf-ray: 86facaa3ecf28ff5-FRA
access-control-allow-headers: range
expires: Sat, 05 Apr 2025 16:07:31 GMT

POST
H3 200 events Show response
api.permutive.com/v2.0/batch/ 101 B
130 B 16ms
16ms XHR
application/json 34.107.254.252
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL: https://api.permutive.com/v2.0/batch/events?enrich=false&sdkp=true&k=f8d3dda6-1372-4e33-b0e4-848b39d58874
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 34.107.254.252 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),
Reverse DNS: 252.254.107.34.bc.googleusercontent.com
Software: Permutive /
Resource Hash: f033677341f4495c02bd0c7f5539b4583a4cc04a76cfcc812495d158083b60f8

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

date: Fri, 05 Apr 2024 16:07:32 GMT
content-encoding: gzip
via: 1.1 google
server: Permutive
vary: Origin
content-type: application/json
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 112

POST
H3 200 state Show response
api.permutive.com/v1.0/ 0
34 B 53ms
52ms XHR
text/plain 34.107.254.252
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL: https://api.permutive.com/v1.0/state?fetch_unseen=true&k=f8d3dda6-1372-4e33-b0e4-848b39d58874
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 34.107.254.252 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),
Reverse DNS: 252.254.107.34.bc.googleusercontent.com
Software: Permutive /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

access-control-allow-origin: *
date: Fri, 05 Apr 2024 16:07:33 GMT
content-encoding: gzip
via: 1.1 google
server: Permutive
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 20

GET
H2 200 13292 Show response
check.analytics.rlcdn.com/check/ 25 B
385 B 61ms
34ms Fetch
application/json 143.204.98.66
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://check.analytics.rlcdn.com/check/13292
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 143.204.98.66 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-143-204-98-66.fra50.r.cloudfront.net
Software: /
Resource Hash: 8a9ba7bbc88ec23d81a2d63845638a3b6603de473261872f301803cef84ef335

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

date: Fri, 05 Apr 2024 16:07:33 GMT
via: 1.1 b83a899c16a2f53127e152fe5fc783a4.cloudfront.net (CloudFront)
x-amz-cf-pop: FRA50-C1
x-amzn-trace-id: Root=1-661021c5-533df49d030cb99f3bbf9946
x-amzn-requestid: 13b43de0-5ecf-4241-b28e-bb092d6a3549
x-cache: Miss from cloudfront
content-type: application/json
access-control-allow-origin: *
x-amz-apigw-id: Vwo22Hw2joEEjJA=
content-length: 25
x-amz-cf-id: BzA0fIuXun8ByjW2dz_Z3v8m7zg1g6qu71DwmskYCFyMhIFPXdaelA==

GET
H2 200 envelope Show response
lexicon.33across.com/v1/ 49 B
251 B 120ms
96ms Fetch
application/json 35.244.193.51
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL: https://lexicon.33across.com/v1/envelope?pid=0014000000xvEfSAAU&gdpr=0&src=pbjs&ver=8.37.0&coppa=0&us_privacy=1YNY
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 35.244.193.51 Kansas City, United States, ASN15169 (GOOGLE, US),
Reverse DNS: 51.193.244.35.bc.googleusercontent.com
Software: /
Resource Hash: d0d2e098cd489ef7bc528c86de8ab5c51b5d6cdf9b76a8b08766036992f0d2f4

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

date: Fri, 05 Apr 2024 16:07:33 GMT
via: 1.1 google
vary: origin
content-type: application/json
access-control-allow-origin: https://www.theverge.com
cache-control: private, must-revalidate, max-age=28800
access-control-allow-credentials: true
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 49

GET
H2 451 envelope Show response
api.rlcdn.com/api/identity/ 0
48 B 17ms
16ms Fetch 34.120.133.55
GOOGLE-CLOUD-PLAT...

General

Check archive.org

Show headers Download Go to

Full URL: https://api.rlcdn.com/api/identity/envelope?pid=13292
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 34.120.133.55 Kansas City, United States, ASN396982 (GOOGLE-CLOUD-PLATFORM, US),
Reverse DNS: 55.133.120.34.bc.googleusercontent.com
Software: /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

date: Fri, 05 Apr 2024 16:07:34 GMT
via: 1.1 google
access-control-allow-methods: GET, OPTIONS
access-control-allow-origin: https://www.theverge.com
access-control-allow-credentials: true
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
access-control-allow-headers: Accept, Authorization, Content-Type, Cookie, Origin, X-Requested-With
content-length: 0

GET
H2 403 / Show response
prebid.sv.rkdms.com/identity/ 89 B
248 B 114ms
105ms Fetch
application/json 52.204.131.34
AMAZON-AES

General

Check archive.org

Show headers Download Go to

Full URL: https://prebid.sv.rkdms.com/identity/?sv_domain=theverge.com&sv_pubid=7470&ssp_ids=534404531
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 52.204.131.34 Ashburn, United States, ASN14618 (AMAZON-AES, US),
Reverse DNS: ec2-52-204-131-34.compute-1.amazonaws.com
Software: awselb/2.0 /
Resource Hash: 7a36f803f13eaf0a08e94413bc7c98e5d87cc5cab9cc277d9ca0306bda96db78

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

access-control-allow-origin: https://www.theverge.com
date: Fri, 05 Apr 2024 16:07:34 GMT
access-control-allow-credentials: true
server: awselb/2.0
content-length: 89
vary: Accept-Encoding
content-type: application/json

GET
H2 200 rid Show response
match.adsrvr.org/track/ 63 B
421 B 30ms
29ms Fetch
application/json 15.197.193.217
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://match.adsrvr.org/track/rid?ttd_pid=rubicon&fmt=json
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 15.197.193.217 Seattle, United States, ASN16509 (AMAZON-02, US),
Reverse DNS: a12b7a488abeaa9e4.awsglobalaccelerator.com
Software: Kestrel /
Resource Hash: b1f384f12a8fdca4dcba767cb5d92ffaac6b8081b71361938b904b1f4651c6e2

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: text/plain

Response headers

date: Fri, 05 Apr 2024 16:07:34 GMT
content-encoding: gzip
server: Kestrel
vary: Origin, Accept-Encoding
content-type: application/json
access-control-allow-origin: https://www.theverge.com
cache-control: private
access-control-allow-credentials: true
access-control-allow-headers: Origin, X-Requested-With, Content-Type, Content-Length, Content-Encoding, Vary, Cache-Control, Accept
expires: Sun, 05 May 2024 16:07:34 GMT

POST
H2 204 event Show response
prebid-a.rubiconproject.com/ 0
125 B 16ms
15ms Fetch 18.159.242.25
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://prebid-a.rubiconproject.com/event
Requested by: Host: www.theverge.com
URL: https://www.theverge.com/_next/static/chunks/pages/_app-837ad8814bd2fa6a.js
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 18.159.242.25 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-18-159-242-25.eu-central-1.compute.amazonaws.com
Software: /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

sec-ch-ua: "Google Chrome";v="123", "Not:A-Brand";v="8", "Chromium";v="123"
sec-ch-ua-platform: "Win32"
Referer
accept-language: de-DE,de;q=0.9
sec-ch-ua-mobile: ?0
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36
content-type: application/json

Response headers

access-control-allow-origin: *
date: Fri, 05 Apr 2024 16:07:36 GMT
vary: Origin, Access-Control-Request-Method, Access-Control-Request-Headers

OPTIONS
H2 200 event
prebid-a.rubiconproject.com/ Frame 0
0 40ms
7ms Preflight 18.159.242.25
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://prebid-a.rubiconproject.com/event
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 18.159.242.25 Frankfurt am Main, Germany, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-18-159-242-25.eu-central-1.compute.amazonaws.com
Software: /
Resource Hash

Request headers

Accept: */*
Access-Control-Request-Headers: content-type
Access-Control-Request-Method: POST
Origin: https://www.theverge.com
Sec-Fetch-Mode: cors
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36

Response headers

access-control-allow-headers: content-type
access-control-allow-methods: POST
access-control-allow-origin: *
access-control-max-age: 1800
allow: GET, HEAD, POST, PUT, DELETE, OPTIONS, PATCH
content-length: 0
date: Fri, 05 Apr 2024 16:07:36 GMT
vary: Origin Access-Control-Request-Method Access-Control-Request-Headers

Verdicts & Comments Add Verdict or Comment

121 JavaScript Global Variables

These are the non-standard "global" variables defined on the window object. These can be helpful in identifying possible client-side frameworks and code.

40 Cookies

Cookies are little pieces of information stored in the browser of a user. Whenever a user visits the site again, he will also send his cookie values, thus allowing the website to re-identify him even if he changed locations. This is how permanent logins work.

Domain/Path	Expires	Name / Value
d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.partner.permutive.app/sync	1970-01-20 21:48:29	Name: _pdfps Value: %5B%2214285%22%2C%2228940%22%2C%2234913%22%2C%2234914%22%2C%2234916%22%2C%2234917%22%2C%22112572%22%2C%22adv%22%2C%22bhnl%22%5D
www.theverge.com/	1970-01-20 19:40:19	Name: _chorus_geoip_continent Value: EU
.www.theverge.com/	1970-01-21 05:14:53	Name: vmidv1 Value: c544b51e-5efe-479e-a425-af664f7449bd
.theverge.com/	1970-01-21 05:14:53	Name: vmidv1 Value: 6ec34f11-0175-407c-877b-5dd663514e5f
.memberful.com/	1970-01-20 19:38:55	Name: __cf_bm Value: d6d8hX1yfHHBOW36YANjsDzYAu.BhjrAbm95csMEqAU-1712333249-1.0.1.1-5ZLzf5k5S9mdhzmsr3FF.xGMceGv1qytFHOLRNjAxtntm2HLoJw409Y58PI6N_dK4bOfRlP_MNuIdeY5ZemyEA
www.theverge.com/	1970-01-20 19:38:55	Name: sailthru_pageviews Value: 1
.theverge.com/	1970-01-20 21:48:29	Name: _gcl_au Value: 1.1.2083223707.1712333250
.theverge.com/	1970-01-20 19:38:55	Name: _parsely_session Value: {%22sid%22:1%2C%22surl%22:%22https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders%22%2C%22sref%22:%22%22%2C%22sts%22:1712333250283%2C%22slts%22:0}
.theverge.com/	1970-01-21 05:08:17	Name: _parsely_visitor Value: {%22id%22:%22pid=1bc8d4e1-d2c5-46d5-893d-02e382102af1%22%2C%22session_count%22:1%2C%22last_session_ts%22:1712333250283}
.theverge.com/	1970-01-20 19:40:19	Name: _gid Value: GA1.2.248744714.1712333250
.theverge.com/	1970-01-21 05:14:53	Name: _ga_9GXHZT6RVE Value: GS1.1.1712333250.1.0.1712333250.60.0.0
.theverge.com/	1970-01-21 05:14:53	Name: _ga Value: GA1.1.674399125.1712333250
.3lift.com/	1970-01-20 21:48:29	Name: receive-cookie-deprecation Value: 1
.3lift.com/	1970-01-20 21:48:29	Name: tluid Value: 4017292926291855653805
.twitter.com/	1970-01-21 05:14:53	Name: guest_id_marketing Value: v1%3A171233325043035586
.twitter.com/	1970-01-21 05:14:53	Name: guest_id_ads Value: v1%3A171233325043035586
.twitter.com/	1970-01-21 05:14:53	Name: personalization_id Value: "v1_gnD4wywgHOtEqrNov4V27A=="
.twitter.com/	1970-01-21 05:14:53	Name: guest_id Value: v1%3A171233325043035586
.t.co/	1970-01-21 05:14:53	Name: muc_ads Value: 6642a2fd-3db5-40d1-9d77-4eda3fe9adf3
.theverge.com/	1970-01-20 19:38:53	Name: _dc_gtm_UA-26533115-1 Value: 1
.theverge.com/	1970-01-20 21:48:29	Name: _fbp Value: fb.1.1712333250598.1172465369
www.theverge.com/	1970-01-21 04:24:29	Name: sailthru_content Value: 6cc0a73a87f6663b2b07c4e933079258
www.theverge.com/	1970-01-21 04:24:29	Name: sailthru_visitor Value: 04a3226b-c7bf-4472-a796-ff53a47e1036
.rubiconproject.com/	1970-01-21 04:24:29	Name: khaos Value: LUMV082Q-1Y-1YPP
.rubiconproject.com/	1970-01-21 04:24:29	Name: audit Value: 1\|naVuGyos1qr/1j4odx6yi2WQ0NNjmqbPd94gXYLevqI6zpY9svvDruGIFwGqIfjXPnE4U4/NPXOY63pr0Wh1gOBxGCOXoSK1WLcRlTzddwoijy0RC4Zd8Ri5j99IjSR+
.theverge.com/	1970-01-21 00:02:24	Name: permutive-id Value: 465ceae0-8232-487d-88cc-488733588e78
.adnxs.com/	1970-01-21 05:14:53	Name: receive-cookie-deprecation Value: 1
.d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.prmutv.co/	1970-01-20 21:49:55	Name: pxid Value: e0b60349-928d-47dc-b6bd-a36ca5e9e0d5
.adnxs.com/	1970-01-20 21:48:29	Name: XANDR_PANID Value: W0Oq_w0AKdvzbIixaSqzerWsvNjyBRi7CJDb9D-9F0OPSwE4yHyf8oqVmurS01K-BNeBWUzcWuIRXXdY_2PA3N54yqhMNkDD8BDaP2mMNN4.
.adnxs.com/	1970-01-20 21:48:29	Name: icu Value: ChgI9tlvEAoYASABKAEwwsPAsAY4AUABSAEQwsPAsAYYAA..
.adnxs.com/	1970-01-20 21:48:29	Name: uuid2 Value: 4204837024092122585
.connatix.com/	1970-01-20 20:22:05	Name: cnx_userId Value: bac24b292894419687b13f03ba8d1bff
.theverge.com/	1970-01-21 05:07:41	Name: _awl Value: 2.1712333251.5-ef582533c07faedfcba0d7850bb6e090-6763652d6575726f70652d7765737431-0
www.theverge.com/	1970-01-20 19:40:19	Name: _lr_sampling_rate Value: 100
www.theverge.com/	1970-01-20 19:38:56	Name: _lr_retry_request Value: true
www.theverge.com/	1970-01-20 20:22:05	Name: _lr_env_src_ats Value: false
.theverge.com/	1970-01-20 20:22:05	Name: pbjs_sharedId Value: aaf8d230-5f88-49bf-9e86-3976eec36fd3
.theverge.com/	1970-01-20 20:22:05	Name: pbjs_sharedId_cst Value: 1izpLMgsJw%3D%3D
www.theverge.com/	1970-01-20 20:22:05	Name: pbjs_unifiedID Value: %7B%22TDID_LOOKUP%22%3A%22FALSE%22%2C%22TDID_CREATED_AT%22%3A%222024-04-05T16%3A07%3A34%22%7D
www.theverge.com/	1970-01-20 20:22:05	Name: pbjs_unifiedID_cst Value: 1izpLMgsJw%3D%3D

47 Console Messages

A page may trigger messages to the console to be logged. These are often error messages about being unable to load a resource or execute a piece of JavaScript. Sometimes they also provide insight into the technology behind a website.

Source	Level	URL Text
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
network	error	URL: https://api.rlcdn.com/api/identity?pid=2&rt=envelope Message: Failed to load resource: the server responded with a status of 451 ()
network	error	URL: https://prebid-server.rubiconproject.com/cookie_sync Message: Failed to load resource: the server responded with a status of 400 (Bad Request)
network	error	URL: https://id.sv.rkdms.com/identity/?vendor=idsv2&sv_cid=5274_04512&sv_pubid=VOX&sv_domain=www.theverge.com Message: Failed to load resource: the server responded with a status of 403 ()
other	warning	URL: https://connect.facebook.net/signals/config/594981607301768?v=2.9.152&r=stable&domain=www.theverge.com&hme=c3a545c63044e8e9102d4f32d84a1137594d024f28e801d670bc76dc5c075575&ex_m=67%2C112%2C99%2C103%2C58%2C3%2C93%2C66%2C15%2C91%2C84%2C49%2C51%2C158%2C161%2C172%2C168%2C169%2C171%2C28%2C94%2C50%2C73%2C170%2C153%2C156%2C165%2C166%2C173%2C121%2C14%2C48%2C178%2C177%2C123%2C17%2C33%2C38%2C1%2C41%2C62%2C63%2C64%2C68%2C88%2C16%2C13%2C90%2C87%2C86%2C100%2C102%2C37%2C101%2C29%2C25%2C154%2C157%2C130%2C27%2C10%2C11%2C12%2C5%2C6%2C24%2C21%2C22%2C54%2C59%2C61%2C71%2C95%2C26%2C72%2C8%2C7%2C76%2C46%2C20%2C97%2C96%2C9%2C19%2C18%2C81%2C53%2C79%2C32%2C70%2C0%2C89%2C31%2C78%2C83%2C45%2C44%2C82%2C36%2C4%2C85%2C77%2C42%2C39%2C34%2C80%2C2%2C35%2C60%2C40%2C98%2C43%2C75%2C65%2C104%2C57%2C56%2C30%2C92%2C55%2C52%2C47%2C74%2C69%2C23%2C105(Line 97) Message: Unrecognized feature: 'attribution-reporting'.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: https://www.theverge.com/24067997/robots-txt-ai-text-file-web-crawlers-spiders Message: Third-party cookie will be blocked. Learn more in the Issues tab.
other	warning	URL: about:blank Message: Third-party cookie will be blocked. Learn more in the Issues tab.
network	error	URL: https://api.rlcdn.com/api/identity/envelope?pid=13292 Message: Failed to load resource: the server responded with a status of 451 ()
network	error	URL: https://prebid.sv.rkdms.com/identity/?sv_domain=theverge.com&sv_pubid=7470&ssp_ids=534404531 Message: Failed to load resource: the server responded with a status of 403 ()

Security Headers

This page lists any security headers set by the main page. If you want to understand what these mean and how to use them, head on over to this page

Header	Value
Content-Security-Policy	frame-ancestors https://voxmedia.stories.usechorus.com 'self'

Indicators

This is a term in the security industry to describe indicators such as IPs, Domains, Hashes, etc. This does not imply that any of these indicate malicious activity.

aax.amazon-adsystem.com
ad-delivery.net
ad.doubleclick.net
ads.rubiconproject.com
ak.sail-horizon.com
analytics.twitter.com
api.btloader.com
api.parsely.com
api.permutive.com
api.rlcdn.com
api.sail-personalize.com
api.sail-track.com
apps.voxmedia.com
bids.concert.io
btloader.com
c.amazon-adsystem.com
c2shb.pubgw.yahoo.com
capi.connatix.com
cd.connatix.com
cdn.concert.io
cdn.parsely.com
cdn.permutive.com
cdn.vox-cdn.com
cds.connatix.com
check.analytics.rlcdn.com
concertads-configs.vox-cdn.com
config.aps.amazon-adsystem.com
connect.facebook.net
d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.partner.permutive.app
d2fb08da-1c03-4c8a-978f-ad8a96b4c31f.prmutv.co
d35xxde4fgg0cx.cloudfront.net
duet-cdn.vox-cdn.com
fastlane.rubiconproject.com
fonts.googleapis.com
fonts.gstatic.com
fundingchoicesmessages.google.com
geo.privacymanager.io
grid.bidswitch.net
hbopenbid.pubmatic.com
htlb.casalemedia.com
ib.adnxs.com
id.sv.rkdms.com
images.outbrainimg.com
ins.connatix.com
js-sec.indexww.com
js.memberful.com
launchpad-wrapper.privacymanager.io
launchpad.privacymanager.io
lexicon.33across.com
lit.connatix.com
match.adsrvr.org
mcdp-nydc1.outbrain.com
media.grid.bidswitch.net
micro.rubiconproject.com
monacobeatles.com
mv.outbrain.com
p1.parsely.com
polyfill.io
prebid-a.rubiconproject.com
prebid-server.rubiconproject.com
prebid.sv.rkdms.com
pub.doubleverify.com
region1.analytics.google.com
sb.scorecardresearch.com
secure.cdn.fastclick.net
securepubads.g.doubleclick.net
static.ads-twitter.com
static.adsafeprotected.com
static.narrativ.com
stats.g.doubleclick.net
t.co
theverge.coral.coralproject.net
tlx.3lift.com
vid.connatix.com
widget-pixels.outbrain.com
widgets.outbrain.com
www.facebook.com
www.google-analytics.com
www.google.de
www.googleoptimize.com
www.googletagmanager.com
www.googletagservices.com
www.theverge.com
104.18.41.104
104.244.42.133
104.244.42.3
104.64.126.246
108.138.6.136
13.32.27.115
13.32.99.89
13.33.173.196
130.211.23.194
142.250.185.70
143.204.98.66
146.75.120.157
146.75.122.132
15.197.193.217
151.101.1.91
151.101.129.91
172.64.146.152
172.64.149.180
172.64.151.101
178.250.1.8
18.159.242.25
18.208.123.81
18.244.18.32
18.245.31.123
18.66.112.84
18.66.122.25
184.30.211.26
185.64.189.112
199.232.196.124
2001:4860:4802:34::178
2001:4860:4802:34::36
23.32.101.241
23.35.237.86
2600:1901:0:4277::1
2600:9000:223f:f800:8:48e:53c0:93a1
2600:9000:236e:fc00:9:674:7440:21
2602:803:c003:200::21
2606:4700:10::6816:4ad8
2606:4700:20::ac43:4513
2606:4700:3110::6812:341b
2606:4700::6810:457d
2606:4700::6811:7711
2606:4700::6812:a6e0
2a00:1450:4001:806::200e
2a00:1450:4001:80b::2003
2a00:1450:4001:80f::2002
2a00:1450:4001:811::200e
2a00:1450:4001:81d::2002
2a00:1450:4001:82b::200a
2a00:1450:4001:82f::2008
2a00:1450:4001:831::2003
2a00:1450:400c:c00::9a
2a03:2880:f083:100:face:b00c:0:3
2a03:2880:f176:181:face:b00c:0:25de
3.124.64.248
3.160.150.11
3.161.77.50
34.107.222.173
34.107.254.252
34.111.9.237
34.117.126.186
34.120.133.55
35.157.246.167
35.214.187.215
35.241.9.51
35.244.193.51
37.252.171.149
52.204.131.34
54.155.18.159
64.202.112.127
69.173.144.137
75.2.104.6
99.83.154.140
0009cd360e34cb0a5ef4db29a6d82a2ab8679fa93e3ce933b23b54ce2a0ba5c4
01fd2b4860484fe244a0c004232509bbad363b6710b49cf463435d1ec31271b6
0535c3bb3a17e4ac0fb7d29214d2181275662129dc2bdd2a89c35934e9fc5ba5
06b99248a163333e36980a6cfb756f1a7de60fa49517162b87b1a44d5d48f844
074fcca6b3a26b12e40ac85fe5475224ef49977328ef9ae3732bd50327f2dc28
0994224df72f23e9cdd8e4aed136aee72f0d7380326e83419b509a49abad00d6
0afdd055573d02ec33ed9ccfd582c5aa34d4d997ff549742e67f6a4c566d466a
0c20aba853934d9e744052fe25dd9ae16aa65459c116c03a7394001199bca66c
0e2ef015de96af25db009694591ade7c1a7fc6d3401450069f85c9d13e1f403d
0ece10ce5660b339bb20a24626799a864e392f545d623e2c7c4cc723d29e8dba
118c31a6f73280143f6a1091c1731383f7ca164999e3c09199070b0265c0130c
1405fd803c55b53c0b86b9e0fcf1696eedcbf489d323a537477947a4512ff674
145130417691fb5746dd803a338caee0ce478d42628eaa3c400642b58da32292
1634e871af99fe3ba2f1bb42327c5143622f7795894eaba1a7f8f1e1344a26db
16869b7de5b5ce5068e7abb9dd7949df5a486c3d05f430d7b0ad4049b9d3013e
1830f6428a2daed959c8c25bcd873c3f8a97cbd8b9a8e6a19e6abc18bd351079
1995b181b412f1ddd4c4fbd887faa8e9504858180da5458fcf6cc095bfb7b84e
1b20b46a4104acb0c120279fc766b735d3a889db7f459062f1453bd71fa06bd1
1cab89992a8002f31cc8a8a3d5edaa1e4a58b110bb9ce848e188b474502b0023
1cd096a8e75476195113ec5bc0cd3457c3d8f87f976f14c551127a55b6e019e4
1cffc2b3146584685cd72751d7f28aa030ab9ae2f1bc78f2c27909f8d8287b26
1d71e7b94532bee6339e156ec77ff3062dc42324947fbe6f38cc2b4c404ec510
1e4603211a95f67bd228f016668571442e3d5ffefdd55b36499f7e01d95f0018
1e90773659154acb549e8940a59b9550ed2dec593f8330ee9215a888e09947ba
1f3f985cba0434b27db683698eb8b95ffbeb9de057865268b55dd51b567ce6e4
1f9b6c01922110e0aa655584c7ddbcfd1e9c09b78bf30687af6901be82a1efe6
25c7baf63defa73d2ef3da446670c3a09a28140ca60b3f9e0f9a294ca805c3f2
2689367b205c16ce32ed4200942b8b8b1e262dfc70d9bc9fbc77c49699a4f1df
28137bc92d729e58b4cd0c68a3c2eda01363d097b21e281247c1a53934d24175
2b0fb0a6b3e353c69158d61221c2200e4199d0d60dd0b9d99702a22eaa917a78
2b53e8eda1adcbcc9643b097216113950216db082803e2d603ea9f2598f274c8
2d938572c4e9f49e56b0511a9d63c85616a275d2de872fb913978300e766facc
2da2864bac6604dd9bf39ff9355424bbfeaf76d1941c68899cce34f20419719f
306fced98d78aff9777e8f229de53120cba5dfd4882971aee97d8dead092dd59
315aa1a94104c0f3e533e358134acdb56b1d347a327cbd2f172e316f9248a2c7
31b45c462302ac175bfa43f9e5591491db780ca094f6ecdd2907f25ad578448d
337070c9ec6e978d98b76e4ae93576aabcaee891df19e9e393dbbc7bb43baea7
37ee9c33d5b941f4d78f7aa9bbb2abc9b734519f80d0acdf696145c99b41a16a
39f6c2c5fa24275ff0945d39f2892618cb8cfc6d8a4090d9d458a7209bb80a43
3adca7885fd8a12cf46029ce311749c79f4c61d4ad37cd09e8a19ff78cb3c78e
3c4d6a1421c7ddb7e404521fe8c4cd5be5af446d7689cd880be26612eaad3cfa
3c55607e14730bc2245dd9e38ed728a1078892e52f00026bb33e0dbfe537c048
3d805275e8a3db2682328026393c4931c18996892256b1de74f8a5e89f773a0c
3e62fcaf3bf8574b9259d0ad4eab504c8d33277799d6e623a27fbea6318d1dd3
422710db345d658f032dc1c71f6aade54bb77bbb0c5e73fccbf55faf3bb99957
4260adb4d49b196daf52b6ab6f9e0564fa021b024b0ea3c2b57f4c8338f9f8bc
42b976597a2d977d0e300f6d06bc903db389e5c112d33c1c8c249690a522d9f2
43f804d38a294c6df1ce8ee64fb95ad0ff5a8d6d5685d9537df02212668a1dff
44da173d8bbcbdc1271e7a16861ab0ca8cf2889e994b1ef348594bb94c1665c9
463c25b6c7c1c9a7d06397e8528f944250c89c0991a4c2db3e1844ee4ec5ae41
48781768efb0eedf8395965b1b24e5276867988701cefcaa0dea8b34b7494efc
487aec7746a83542b3573383df65747e31c494d8412103b5675329f3d4befaeb
4bea6800604a37c7b6d8fe66dd5e7d947cbafb6e3707fd7dd2a717682b14aef3
4ce1f595ea044b955619f6839a22ac34a22d80efde699f84f044976baa4831e3
4d15ff2317e16ccd8ca1d3248fea7d91130e022369bb032824a84ad9967064df
4e14c1c026dc10618fad33f60c4e3483b3fea7cf03c69d69cc6a4f9454b54c72
4fb3e8618b9e45cca770ecab0205c879f4bf1df4ed00b8eff82c456c5b07ed9c
4fe452a194227dee8b7d70e7080248c6cb8181a0c99764c897f5facbb1441cea
5125918873d03e6a8253cc71ed0b23fe4f42d2e3b7a78e9c20ba457f7f810d22
535535d875141da2658a22a90f2d2e32380e7c40332af837a37df9288d097562
55aabd4f133660977420281f291a1ed0c58714a47679738bdaad2e8d59c31004
589000ad6b7c3b2c9f2b9ba72201c6cf2769bd4b45135e934666ed1ced443098
58a3f0dbdfe77bfa7432d4a271c48f6cc9d23b32a472dc3985e0f8afafbd4f19
59c96c32e59ef49eaec195e3846fe1ffb919330c53a2ad34af765ab4d7236b9f
5bc331a4adb5abcbe8c223244e4839f76b8cff343f3504283c641fe07cafa7df
5ca4082ec82e42e06128725e7d921d16f6aae3f470866ddd2563030667b8e732
5e60a4cde4c31f24f9cffc22654390b2a1294037922bc7d27be449241ad01d68
60604ab669f63a672fc4b7ba7df2b04752d16f1ca893297d9f97b4be041045aa
60a07de79050cacfbea68e162efcd24609e5eb3d636c12304ecdbc8724373f9c
63a6ca419179f07e1a59606add9603682922d34feffd881b769f80000b58c363
63b916836d884950f752d3c4df2082f8ab887a19de20ab3483d6bb779cde1025
63e7d22ddb417c868fe594d2dd0a21bf2f929592584b02bbb555b733a0304225
640a7ef5bbeb843975b3d11016ce2bc57c9d43deee3022feb047e3d4802e90c9
647d0319bbf4ab7d29f7c9f7b7e2977746574d997f669b2b3017aade81f3c094
65d46cb2265da9c055d87f11b83a95e7ee2240892b4af20cc3b105e7cbd9f956
65ddf5e3399edf4c341afc838845700aa5d6cbbb30bcb0b9967d152c21d95d5a
66c42dfc1130399d17a9addf9ec66d23598cdc8d5e73eae6b6ec244aa5254734
683cfbce49088ed0d0ec6b9ef26054ac37ea07a641bec02ea5ef31aab56ce21d
6851edc0fca6eb99fa5fa083c37055fb96b62567bcd4730305e755e4cc0ab82a
69d63babdc205bde69a262cb60fa589509dc79f6283d9877ca08356f1639c018
6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b
6bb9c0fce3a9e155d70a7cea532bb953c5aee6cb31a5d1d8f3b8ab9f12c7c472
6c68769e8470ce89a0f2270529a5d47db00917e3ef9df946dca202098f09d0a2
6e265c7d29e79701776e532eca22399a49921abb3efc3d61e054ec99b2c36029
6ea9bd65eced5a37a58cbdc926aea4f117698a6fba5bb8d43b65fb9051be753b
6f5b4aa00d2f8d6aed9935b471806bf7acef464d0c1d390260e5fe27f800c67e
797032a498995d9236119df83db23add3071d56271ee07ae86a6ae9c6a1493f5
7a36f803f13eaf0a08e94413bc7c98e5d87cc5cab9cc277d9ca0306bda96db78
7b6c4048e4f17238c1c67719a20b2d8baa6f225d4c070470fcad1bb962d78e1d
7e84004cb9a09bdf399c0aadb573f151b739141dd8a2a082d042c567c85c2501
7f01fc6bf1208bf8cd7253b03daa508b70a1635abd82c21745c184503c2e41e8
7fda10b73ad2c61db09e67f7a0b21ee8f55610e3e4f051ca2bfac697bcc0a856
8112da6474931bad4370edc6b49a72dccd3ca52237af36cb6a36405a40d6ffe5
8265f64786397d6b832d1ca0aafdf149ad84e72759fffa9f7272e91a0fb015d1
8287cbeda5de6ee08fab380dceb44392a2053ef697053bd5a493411fec8e8edc
84e5aa85594b35c4b60787f4a97e2e1eb369dacbe23d8154f61f60bb0343d465
888797a9c9a7b048514405e6012888d8cc4f3aba71c1f48f19415d680733379b
88d82bd41ab6773bfd2f4a32472a0b8a8b854ddb6367ba8a96cde336673baabe
890d645e6cd19d98974029eb8e82ee4da4524143ddd076b328c9361197ad11ca
89b02c91791f2e2438fde841a5713a299c569cabea2221e5f7d428485089dd1b
89dc3a78c5fc09aa524957e19601e3989f739e8e3ea639b019d12a87e0a7e750
89f2521717b00ebac19a1685e8d9783df53d12f216393e05647b4316e6e293e8
8a9ba7bbc88ec23d81a2d63845638a3b6603de473261872f301803cef84ef335
8bbbca8d193c13abacd58d5711b339fe70db245d50fe532707a999d02a1745ca
8f6649564d1408551c2e92bfea8e51e39aa19720100fe11c4a541120301bfed7
904dfce8a5b458f3652485aca3bb0fe3f6ff4b9334f15baf7a13eefcec71e0c5
92fca55833f48b4289ac8f1cedd48752b580fce4ec4b5d81670b8193d6e51b54
9592320780b39ab8510ade745533bf21f6f91e8b7b9cbda9fa99d9878f3a1615
95a6a7a3afc926ff989f37d14a67be9403cebc023a6ea8adee0441d3cb9aba25
95ad89143c22c60442bfab4646c8a5e85cef5f091e0f26405a160e2197f73706
9803cd4df168f908d4bc5d9749180b33af2cc649325bdaba7a51fbbdfcd036a6
994ca135d53ac6723507c3feed7a2b4b342826c22043ed050a4cc098427e18c1
9ba56f5ffa579747efde1d2a429b325a9fb7220d30f4268e4a44ecbe4a9bf034
9e7752189a0beea73a64f5cd46818d187f00095dc964c1c7760680afe530e0ab
a04a64eb55c4a16ed352d149385a8ac8d8c2d3291f0e5b59b0f48375443b5f24
a457ade2c01691a60f7c6fcdaa2d32e3b301e62e5455af849cdc3ee3cba692bd
a4c1d1593ad1518a5ae988850f59f26dcb7cf64e823ee0fea0fb5c2f35e928cc
a5dbb47c2bc5103f68a9dc1e550111320711963f376a86f8b30d5f1ceafce573
a83431825ec58cce1345a5d293df9474beda786a3525323eed1b1e19a15fdd9a
aadf2fdd0fcb02dd08b4160905bc3fa1fdaaef1e145ddf28ef8074f6fd1dca5e
ac549d1ae9515085e42be96153473367ac646a875808adedf5dfe89caec84af9
ac8778041fdb7f2e08ceb574c9a766247ea26f1a7d90fa854c4efcf4b361a957
adfe7f36d5b9abea5823e86e2baa1b0fd06f3ceef7c3422cb883dccbebb2cf98
ae1643c852b5c2ebf992b43b71b286e452ef49b20b965260d677957e83e84805
b07662b2a6108d2872de909e1f5b02eb0c39c34b2c3e61b07ea45dbcaaba1f63
b1f384f12a8fdca4dcba767cb5d92ffaac6b8081b71361938b904b1f4651c6e2
b251ec1f89a3144d5e00f5b813bbb531284a50bb3f48880118e69fb784062ad3
b31357b0078019678c7c9177a4097fe78be39fb0f650b2dc9568f10d7ba48f35
b46c7ba992c34937baef66ad5414fa1cc6e0cf8da02974f9accd474963879b38
b5c7801b11b8891b93d883ef8969cc1cee772b8d88f393eeeb6ffaeedb95961e
b5d2f12da5c8464fdfe44f547d73ede31f3d31cf9ea77296fcece8114a593320
b96d2b33d9597778624fc74cd2b6772ef53f115f13ab35d42b6ca42ef9fdd2ca
ba4530f1d5cdb22f1fe206dc780e62000253665d9b2bb0974695aebd82f7a5d9
bd52adb9be2bf9382f3710227409b2e13bcfd5751e170f8dc653c8ab5b102db8
c096a407308f10208f1283bf386d16fa88753abe15d84e7bbd4e16e8e7a4ef3e
c116c82588aa096611fc88ec3110f70fada02bd05df71d3e90706cc4304c7de2
c2a9c1dec1a24dd650f7b3b74a5c8ab1f6b68b653deef124accbde1c8a24abf0
c4df18908a4d24b9fa62b88a0133476bee85a00bc3323128579b2686d2c511cc
c58a61e32be78b4f3a47d9e4eec3af2c6d03c35ae74217f3006a4f7d2ee7c272
c5fe4b16f14fbab784667a876b5b687b1278e692b64a5e5b04e2da18bbd3de52
c7da57bcfd14bb3ba72dde994f529b65553a75850a7b2831bfffa2d20ba290cf
ca3d163bab055381827226140568f3bef7eaac187cebd76878e0b63e9e442356
ca998adaeefff6118b80a064ea48cc65a4d0aad3159a1105b51228762ec681a5
cf029f9a9cd20a35235f3027d1c867c66fb5fdd32863f1a32046f020e7daf685
cf4724b2f736ed1a0ae6bc28f1ead963d9cd2c1fd87b6ef32e7799fc1c5c8bda
cf7778611eff5ad189551f2087483a46f6095cfdb79d161366b24a3b6705e9bb
cfa873516d960d0d89ac3be1133bf304a24a2a553b4fb03850af07f7f4d32c04
d07b43ee456c55fc2f1122cc809fbef3985ead232f2813d6caa981ffba4a707a
d0d2e098cd489ef7bc528c86de8ab5c51b5d6cdf9b76a8b08766036992f0d2f4
d0fcf57592a004be2a06e613ffeb440530bafd2de67218f79222a96db699f82e
d1650c5a1b4941d6085aff09c613cf91111ae22a4037c6360604569b98a3f1ce
d2abcf4ca4f543d63ed37e00a7c7daabed4a60822c15bea1d388d6b4fbfc4a5e
d61e4a8f703530a9c2c22216a8531f5ca6850dee608b6117493abe7c0407419b
d7a34e28e15bb1db09875565f4384397042d59bf38a4a2442e7264653f75a9fe
d961b08e4321250926de6f79087594975fe20ad1518de8f91eb711af5d1a6ef8
d9c201bbb86dd6e25057dc48ffb27b5b061429d4d733aa79c4cfc68d85d76dda
da45962a1fb4a049c9367ebe9b1b628f071d7a4c9997ee807c01d23f4866e19c
da564905b9c2a54a99fd4ab7255ecfa6a5f401b9088915d54b4c90a478f3eb2d
dc211aeaa9d2304a65fd072a8ac1d57c8ff5098ea0dbfcf848aa1b352a4352ac
dc757f26a467bd808d0c219455878a95317b28474ee415798fb4c166b31a8c12
de10295b82a567d83bfcdb1e92a8735d14702fa66d663371262b2623840e289a
de36e50194320a7d3ef1ace9bd34a875a8bd458b253c061979dd628e9bf49afd
e161fcc4448cdfdb56de65d63e9216fae76f96f9684d6509a5d13b1e8f84571a
e1d19f514038dfd00901259ae158e3cf26b4085f0d5e35277cfc12a2b85567e3
e257df7266563e157bb7df93fd09c6d13afb1c9554468b21c7378e09a94d3250
e2d7f0397e7f14b8d24b1957c023b4bda2c3529107bc23cf42ac9c44f3c42880
e376cf7724ee9ff9e87975f543470828ae54f4bdc2be579617b9ce9afb43dd81
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
e4b608f3ab4953e6da65353db61acc5d27b1a5bb8d4d1f202edd33e3db7d013a
e54b8ee1982fab63149c7dd288792a0919bfe858ac5c36cee53206859c892813
e6792eb9fa0d27e8c8ac7eaa0467637d03626dc4dbc7e534f7650df58905d112
e9a89b51a0e1567900339da4a06cdae64dce8c23c24a9cea85b6249511b7c279
ebcc80bf5e0568d173b31bee579c02a725832f916de3656f7a36f94df865d168
ef1955ae757c8b966c83248350331bd3a30f658ced11f387f8ebf05ab3368629
efd79635ac9b4234b5236d40f7aa147e1b28e565d4845d1ffbed7b7e72b96067
f033677341f4495c02bd0c7f5539b4583a4cc04a76cfcc812495d158083b60f8
f0a83b6becd906b85b94429b38e4a2211ee929a9b51cbb262328cb7b89c926c3
f0b9d890208cf1b7529a510707c53fa5f7ee153ef95718756a970f05cc428287
f1083caadfd9049720c3453e687b5ae0edbff8e64b8d76c026b60fc764e23aac
f2087eba07b2ed3cdaed421506744188ea861e7f773cfa941be00e043715c3e4
f3beba70bdc28cec09d67181837a74dbaba0696a02e96a126e45919965a4ec27
fa36179531ddbbf5dd45d9fd8d22ac3dca8321aaf9267b72934f4a520203a3cc
fb81a214f7895d2cac5e338d8acc633ddc013ac592a31e09f46a810391dcc5ca
fc2929254ff94aaa1062683619792846e3be704b8d958a9ba9bb8b06949680a7
fd155eb70ee57ee04cc1ba361edf2808deb0ffcaf21559af5e09978cac570a56
ff42bfcb9c7a5e3de992e347e3625b28369827be57781464dc46a2e0fb74e384
ffb541c0a258571df3ec42dac8f308e0dd156c73fdc4a753abf0243278e9820e

www.theverge.com Open in urlscan Pro 151.101.129.91 Public Scan

Summary

urlscan.io Verdict: No classification

Domain & IP information

Screenshot Live screenshot Full Image

Detected technologies

Page Statistics

229 Requests

98 %HTTPS

32 %IPv6

54 Domains

83 Subdomains

73 IPs

9 Countries

3914 kBTransfer

10911 kBSize

40 Cookies

0 Outgoing links

Redirected requests

229 HTTP transactions Everything HTML Script AJAX CSS Image Expand all 0 data transactions

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

www.theverge.com Open in urlscan Pro
151.101.129.91 Public Scan

Screenshot
Live screenshot

Full Image

229
Requests

98 %
HTTPS

32 %
IPv6

54
Domains

83
Subdomains

73
IPs

9
Countries

3914 kB
Transfer

10911 kB
Size

40
Cookies

229 HTTP transactions
0 data transactions