urlscan.io logo urlscan.io
SecurityTrails logo

www.metacrawler.com Open in urlscan Pro
52.17.173.115  Public Scan

Go To Rescan Add Verdict Report
Submitted URL: http://metacrawler.com/
Effective URL: http://www.metacrawler.com/
Submission: On April 19 via manual from US
 Behaviour Indicators
Similar DOM Content API
Verdicts

Summary

This website contacted 8 IPs in 2 countries across 8 domains to perform 7 HTTP transactions. The main IP is 52.17.173.115, located in Dublin, Ireland and belongs to AMAZON-02 - Amazon.com, Inc., US. The main domain is www.metacrawler.com.
This is the only time www.metacrawler.com was scanned on urlscan.io!

urlscan.io Verdict: No classification

Domain & IP information

IP Address AS Autonomous System
1 1 52.216.138.11 16509 (AMAZON-02)
1 52.17.173.115 16509 (AMAZON-02)
1 2a00:1450:400... 15169 (GOOGLE)
1 54.192.94.208 16509 (AMAZON-02)
1 2 2a00:1450:400... 15169 (GOOGLE)
1 54.192.94.205 16509 (AMAZON-02)
1 1 2a00:1450:400... 15169 (GOOGLE)
1 1 2a00:1450:400... 15169 (GOOGLE)
1 2a00:1450:400... 15169 (GOOGLE)
1 2600:9000:200... 16509 (AMAZON-02)
7 8
1    52.216.138.11 (Ashburn, United States)

ASN16509 (AMAZON-02 - Amazon.com, Inc., US)
PTR: s3-website-us-east-1.amazonaws.com
metacrawler.com
1    52.17.173.115 (Dublin, Ireland)

ASN16509 (AMAZON-02 - Amazon.com, Inc., US)
PTR: ec2-52-17-173-115.eu-west-1.compute.amazonaws.com
www.metacrawler.com
1    2a00:1450:4001:815::2008 (Ireland)

ASN15169 (GOOGLE - Google LLC, US)
www.googletagmanager.com
1    54.192.94.208 (Seattle, United States)

ASN16509 (AMAZON-02 - Amazon.com, Inc., US)
PTR: server-54-192-94-208.fra2.r.cloudfront.net
s.flocdn.com
2    2a00:1450:4001:81c::200e (Ireland)

ASN15169 (GOOGLE - Google LLC, US)
www.google-analytics.com
1    54.192.94.205 (Seattle, United States)

ASN16509 (AMAZON-02 - Amazon.com, Inc., US)
PTR: server-54-192-94-205.fra2.r.cloudfront.net
s.flocdn.com
1    2a00:1450:400c:c08::9a (Ireland)

ASN15169 (GOOGLE - Google LLC, US)
stats.g.doubleclick.net
1    2a00:1450:4001:81e::2004 (Ireland)

ASN15169 (GOOGLE - Google LLC, US)
www.google.com
1    2a00:1450:4001:81f::2003 (Ireland)

ASN15169 (GOOGLE - Google LLC, US)
www.google.de
1    2600:9000:200c:d000:1:af78:4c0:93a1 (United States)

ASN16509 (AMAZON-02 - Amazon.com, Inc., US)
vendorlist.consensu.org
Domain Requested by
2 www.google-analytics.com 1 redirects www.googletagmanager.com
2 s.flocdn.com www.metacrawler.com
s.flocdn.com
1 vendorlist.consensu.org s.flocdn.com
1 www.google.de www.metacrawler.com
1 www.google.com 1 redirects
1 stats.g.doubleclick.net 1 redirects
1 www.googletagmanager.com www.metacrawler.com
1 www.metacrawler.com
1 metacrawler.com 1 redirects
7 9

This site contains links to these domains. Also see Links.

Domain
www.infospace.com
system1.com
Subject Issuer Validity Valid
*.google-analytics.com
Google Internet Authority G3		 2019-03-26 -
2019-06-18		 3 months crt.sh
*.flocdn.com
Amazon		 2018-05-31 -
2019-06-30		 a year crt.sh
www.google.de
Google Internet Authority G3		 2019-03-26 -
2019-06-18		 3 months crt.sh
vendorlist.consensu.org
Amazon		 2019-03-06 -
2020-04-06		 a year crt.sh

This page contains 1 frames:

Primary Page: http://www.metacrawler.com/
Frame ID: A82DCF372BE0BEAFBA29E42E1BAA2844
Requests: 9 HTTP requests in this frame

Screenshot
Live screenshot
Full Image

Page URL History Show full URLs

  1. http://metacrawler.com/ HTTP 301
    http://www.metacrawler.com/ Page URL

Detected technologies

Overall confidence: 100%
Detected patterns
  • headers server /openresty(?:\/([\d.]+))?/i
Overall confidence: 100%
Detected patterns
  • headers server /openresty(?:\/([\d.]+))?/i
Overall confidence: 100%
Detected patterns
  • headers server /openresty(?:\/([\d.]+))?/i
Overall confidence: 100%
Detected patterns
  • script /google-analytics\.com\/(?:ga|urchin|(analytics))\.js/i
  • env /^gaGlobal$/i
Overall confidence: 100%
Detected patterns
  • env /^google_tag_manager$/i

Page Statistics

7
Requests

71 %
HTTPS

60 %
IPv6

8
Domains

9
Subdomains

8
IPs

2
Countries

113 kB
Transfer

369 kB
Size

3
Cookies

Page URL History

This captures the URL locations of the websites, including HTTP redirects and client-side redirects via JavaScript or Meta fields.

  1. http://metacrawler.com/ HTTP 301
    http://www.metacrawler.com/ Page URL

Redirected requests

There were HTTP redirect chains for the following requests:

Request Chain 6
  • https://www.google-analytics.com/r/collect?v=1&_v=j73&a=123184990&t=pageview&_s=1&dl=http%3A%2F%2Fwww.metacrawler.com%2F&ul=en-us&de=UTF-8&dt=Metacrawler&sd=24-bit&sr=1600x1200&vp=1600x1200&je=0&_u=IEBAAUAB~&jid=1909610684&gjid=690679743&cid=180381017.1555692520&tid=UA-123175321-1&_gid=584207722.1555692520&_r=1&gtm=2ou490&z=1591406710 HTTP 302
  • https://stats.g.doubleclick.net/r/collect?v=1&aip=1&t=dc&_r=3&tid=UA-123175321-1&cid=180381017.1555692520&jid=1909610684&_gid=584207722.1555692520&gjid=690679743&_v=j73&z=1591406710 HTTP 302
  • https://www.google.com/ads/ga-audiences?v=1&aip=1&t=sr&_r=4&tid=UA-123175321-1&cid=180381017.1555692520&jid=1909610684&_v=j73&z=1591406710 HTTP 302
  • https://www.google.de/ads/ga-audiences?v=1&aip=1&t=sr&_r=4&tid=UA-123175321-1&cid=180381017.1555692520&jid=1909610684&_v=j73&z=1591406710&slf_rd=1&random=1437250562

7 HTTP transactions

Resource
Path		 Size
x-fer		 Type
MIME-Type
Primary Request /
www.metacrawler.com/
Redirect Chain
  • http://metacrawler.com/
  • http://www.metacrawler.com/
57 KB
22 KB 		Document
General
Check archive.org
Download Go to
Full URL
http://www.metacrawler.com/
Protocol
HTTP/1.1
Server
52.17.173.115 Dublin, Ireland, ASN16509 (AMAZON-02 - Amazon.com, Inc., US),
Reverse DNS
ec2-52-17-173-115.eu-west-1.compute.amazonaws.com
Software
openresty/1.11.2.2 /
Resource Hash
85568bda0cc0d732ff6922456d43a14cc4aa649fa0d70c678aa176ff230e76aa

Request headers

Host
www.metacrawler.com
Connection
keep-alive
Pragma
no-cache
Cache-Control
no-cache
Upgrade-Insecure-Requests
1
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
Accept
text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8
Accept-Encoding
gzip, deflate
Upgrade-Insecure-Requests
1
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

Content-Encoding
gzip
Content-Type
text/html; charset=utf-8
Date
Fri, 19 Apr 2019 16:48:39 GMT
ETag
W/"36b3fb46a34995dae43c27445f3fdf1b"
Server
openresty/1.11.2.2
Vary
Accept-Encoding
transfer-encoding
chunked
Connection
keep-alive

Redirect headers

x-amz-id-2
1DTKW2OZVA6c0g+NDYt4CCgSI9nvK9Q69rTq+Emx2to1z6N+HGP7TDRoqMAqjQO++RXZ4IpfHdo=
x-amz-request-id
02669C7CA6BF61DC
Date
Fri, 19 Apr 2019 16:48:40 GMT
Location
http://www.metacrawler.com/
Content-Length
0
Server
AmazonS3
js
www.googletagmanager.com/gtag/ 		63 KB
24 KB 		Script
General
Check archive.org
Download Go to
Full URL
https://www.googletagmanager.com/gtag/js?id=UA-123175321-1
Requested by
Host: www.metacrawler.com
URL: http://www.metacrawler.com/
Protocol
H2
Security
TLS 1.2, ECDHE_RSA, AES_128_GCM
Server
2a00:1450:4001:815::2008 , Ireland, ASN15169 (GOOGLE - Google LLC, US),
Reverse DNS
Software
Google Tag Manager (scaffolding) /
Resource Hash
e859d03901db11f9f64fe2e398e1d22ab13926c4df4a0ec3c3b3aff8bc2249a0
Security Headers
Name Value
X-Xss-Protection 0

Request headers

Referer
http://www.metacrawler.com/
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

date
Fri, 19 Apr 2019 16:48:39 GMT
content-encoding
br
last-modified
Fri, 19 Apr 2019 01:21:38 GMT
server
Google Tag Manager (scaffolding)
access-control-allow-origin
http://www.googletagmanager.com
vary
Accept-Encoding
content-type
application/javascript; charset=UTF-8
status
200
alt-svc
quic=":443"; ma=2592000; v="46,44,43,39"
cache-control
private, max-age=900
access-control-allow-credentials
true
access-control-allow-headers
Cache-Control
content-length
24776
x-xss-protection
0
expires
Fri, 19 Apr 2019 16:48:39 GMT
loader.js
s.flocdn.com/cmp/0.0.3-modal/ 		1 KB
1 KB 		Script
General
Check archive.org
Download Go to
Full URL
http://s.flocdn.com/cmp/0.0.3-modal/loader.js
Requested by
Host: www.metacrawler.com
URL: http://www.metacrawler.com/
Protocol
HTTP/1.1
Server
54.192.94.208 Seattle, United States, ASN16509 (AMAZON-02 - Amazon.com, Inc., US),
Reverse DNS
server-54-192-94-208.fra2.r.cloudfront.net
Software
AmazonS3 /
Resource Hash
49ac055a0e7961cf4a735167fc3a4bb07a259060a99ad02abcdeb0f2e178cfcb

Request headers

Referer
http://www.metacrawler.com/
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

x-amz-version-id
0iSURntPblqe.1C5FA2c4BfAqV6l89lD
Content-Encoding
gzip
Last-Modified
Fri, 02 Nov 2018 16:55:12 GMT
Server
AmazonS3
Age
58514
ETag
"d3b43b05dcbfa540a1eeb50b7278b8e4"
X-Cache
Hit from cloudfront
Content-Type
application/javascript; charset=UTF-8
Via
1.1 7e6ac12144acebd1fc302708f2ecfad6.cloudfront.net (CloudFront)
Cache-Control
immutable
Date
Fri, 19 Apr 2019 00:58:34 GMT
Connection
keep-alive
Content-Length
597
X-Amz-Cf-Id
bYy_bXQy4GDUnOP7A34ADy9IYy2sXuORGR-DU12TMEX5VE797cvURg==
truncated
/ 		4 KB
0 		Image
General
Check archive.org
Download Go to Show image
Full URL
data:truncated
Protocol
DATA
Server
-, , ASN (),
Reverse DNS
Software
/
Resource Hash
748131dfc543c1943cff964d37ce92f00770cc017fca729bd0879441e9c2f193

Request headers

Referer
http://www.metacrawler.com/
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

Content-Type
image/svg+xml;charset=utf-8
truncated
/ 		469 B
0 		Image
General
Check archive.org
Download Go to Show image
Full URL
data:truncated
Protocol
DATA
Server
-, , ASN (),
Reverse DNS
Software
/
Resource Hash
ef49e9a1d79a2e7c98976fa2c84fe5dfe0ce3f05fedfab07c4d900765041d1de

Request headers

Referer
http://www.metacrawler.com/
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

Content-Type
image/svg+xml;charset=utf-8
analytics.js
www.google-analytics.com/ 		43 KB
17 KB 		Script
General
Check archive.org
Download Go to
Full URL
https://www.google-analytics.com/analytics.js
Requested by
Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtag/js?id=UA-123175321-1
Protocol
H2
Security
TLS 1.2, ECDHE_RSA, AES_128_GCM
Server
2a00:1450:4001:81c::200e , Ireland, ASN15169 (GOOGLE - Google LLC, US),
Reverse DNS
Software
Golfe2 /
Resource Hash
3e552578c7d450b023f2cd9d28f830be4335c3acc6c4ab6dadda0769f09e5f22
Security Headers
Name Value
Strict-Transport-Security max-age=10886400; includeSubDomains; preload
X-Content-Type-Options nosniff

Request headers

Referer
http://www.metacrawler.com/
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

strict-transport-security
max-age=10886400; includeSubDomains; preload
content-encoding
gzip
x-content-type-options
nosniff
last-modified
Wed, 16 Jan 2019 20:01:45 GMT
server
Golfe2
age
4572
date
Fri, 19 Apr 2019 15:32:27 GMT
vary
Accept-Encoding
content-type
text/javascript
status
200
cache-control
public, max-age=7200
timing-allow-origin
*
alt-svc
quic=":443"; ma=2592000; v="46,44,43,39"
content-length
17543
expires
Fri, 19 Apr 2019 17:32:27 GMT
cmp.js
s.flocdn.com/cmp/0.0.3-modal/ 		121 KB
33 KB 		Script
General
Check archive.org
Download Go to
Full URL
https://s.flocdn.com/cmp/0.0.3-modal/cmp.js
Requested by
Host: s.flocdn.com
URL: http://s.flocdn.com/cmp/0.0.3-modal/loader.js
Protocol
H2
Security
TLS 1.2, ECDHE_RSA, AES_128_GCM
Server
54.192.94.205 Seattle, United States, ASN16509 (AMAZON-02 - Amazon.com, Inc., US),
Reverse DNS
server-54-192-94-205.fra2.r.cloudfront.net
Software
AmazonS3 /
Resource Hash
7c05dced1ff0baacf48eef0c03507348ee9dd55530af4911a4957c54018c690c

Request headers

Referer
http://www.metacrawler.com/
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

x-amz-version-id
5HNG9REzZyRoM.bFhxhsW9N5BtxYGSRw
content-encoding
gzip
last-modified
Fri, 02 Nov 2018 16:55:12 GMT
server
AmazonS3
age
61215
etag
"b71bb86c5de6b316396d7f836ce6c667"
x-cache
Hit from cloudfront
content-type
application/javascript; charset=UTF-8
status
200
cache-control
immutable
date
Fri, 19 Apr 2019 00:13:20 GMT
content-length
33699
via
1.1 ed522e38bfbcd76f653d4691110d92a1.cloudfront.net (CloudFront)
x-amz-cf-id
r6ALTp23NWnhyowKVmOuyt2UeO_qDUrK4Yi1sQVSZZ2-eEQkYPeoUw==
ga-audiences
www.google.de/ads/
Redirect Chain
  • https://www.google-analytics.com/r/collect?v=1&_v=j73&a=123184990&t=pageview&_s=1&dl=http%3A%2F%2Fwww.metacrawler.com%2F&ul=en-us&de=UTF-8&dt=Metacrawler&sd=24-bit&sr=1600x1200&vp=1600x1200&je=0&_u...
  • https://stats.g.doubleclick.net/r/collect?v=1&aip=1&t=dc&_r=3&tid=UA-123175321-1&cid=180381017.1555692520&jid=1909610684&_gid=584207722.1555692520&gjid=690679743&_v=j73&z=1591406710
  • https://www.google.com/ads/ga-audiences?v=1&aip=1&t=sr&_r=4&tid=UA-123175321-1&cid=180381017.1555692520&jid=1909610684&_v=j73&z=1591406710
  • https://www.google.de/ads/ga-audiences?v=1&aip=1&t=sr&_r=4&tid=UA-123175321-1&cid=180381017.1555692520&jid=1909610684&_v=j73&z=1591406710&slf_rd=1&random=1437250562
42 B
109 B 		Image
General
Check archive.org
Download Go to Show image
Full URL
https://www.google.de/ads/ga-audiences?v=1&aip=1&t=sr&_r=4&tid=UA-123175321-1&cid=180381017.1555692520&jid=1909610684&_v=j73&z=1591406710&slf_rd=1&random=1437250562
Requested by
Host: www.metacrawler.com
URL: http://www.metacrawler.com/
Protocol
H2
Security
TLS 1.2, ECDHE_RSA, AES_128_GCM
Server
2a00:1450:4001:81f::2003 , Ireland, ASN15169 (GOOGLE - Google LLC, US),
Reverse DNS
Software
cafe /
Resource Hash
ef1955ae757c8b966c83248350331bd3a30f658ced11f387f8ebf05ab3368629
Security Headers
Name Value
X-Content-Type-Options nosniff
X-Xss-Protection 0

Request headers

Referer
http://www.metacrawler.com/
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

pragma
no-cache
date
Fri, 19 Apr 2019 16:48:39 GMT
x-content-type-options
nosniff
content-type
image/gif
server
cafe
p3p
policyref="https://www.googleadservices.com/pagead/p3p.xml", CP="NOI DEV PSA PSD IVA IVD OTP OUR OTR IND OTC"
status
200
cache-control
no-cache, no-store, must-revalidate
timing-allow-origin
*
alt-svc
quic=":443"; ma=2592000; v="46,44,43,39"
content-length
42
x-xss-protection
0
expires
Fri, 01 Jan 1990 00:00:00 GMT

Redirect headers

pragma
no-cache
date
Fri, 19 Apr 2019 16:48:39 GMT
x-content-type-options
nosniff
server
cafe
timing-allow-origin
*
location
https://www.google.de/ads/ga-audiences?v=1&aip=1&t=sr&_r=4&tid=UA-123175321-1&cid=180381017.1555692520&jid=1909610684&_v=j73&z=1591406710&slf_rd=1&random=1437250562
p3p
policyref="https://www.googleadservices.com/pagead/p3p.xml", CP="NOI DEV PSA PSD IVA IVD OTP OUR OTR IND OTC"
status
302
cache-control
no-cache, no-store, must-revalidate
content-type
text/html; charset=UTF-8
alt-svc
quic=":443"; ma=2592000; v="46,44,43,39"
content-length
0
x-xss-protection
0
expires
Fri, 01 Jan 1990 00:00:00 GMT
vendorlist.json
vendorlist.consensu.org/ 		79 KB
15 KB 		Fetch
General
Check archive.org
Download Go to
Full URL
https://vendorlist.consensu.org/vendorlist.json
Requested by
Host: s.flocdn.com
URL: https://s.flocdn.com/cmp/0.0.3-modal/cmp.js
Protocol
H2
Security
TLS 1.2, ECDHE_RSA, AES_128_GCM
Server
2600:9000:200c:d000:1:af78:4c0:93a1 , United States, ASN16509 (AMAZON-02 - Amazon.com, Inc., US),
Reverse DNS
Software
AmazonS3 /
Resource Hash
5cf931522604c2fd9bb71b09f2dd9fba453d98d82751faa33240b26b983d4ac2

Request headers

User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
Referer
http://www.metacrawler.com/
Origin
http://www.metacrawler.com

Response headers

date
Fri, 19 Apr 2019 13:07:35 GMT
content-encoding
gzip
vary
Accept-Encoding,Origin,Access-Control-Request-Headers,Access-Control-Request-Method
age
13265
x-cache
Hit from cloudfront
status
200
access-control-allow-origin
*
last-modified
Thu, 18 Apr 2019 16:00:19 GMT
server
AmazonS3
access-control-max-age
86400
access-control-allow-methods
GET
x-amz-version-id
08aPFHn5PHaD1pAthXGQkD3hBwbK58iF
via
1.1 1a483cde6df004748f3e5c80dc46df26.cloudfront.net (CloudFront)
cache-control
max-age=259200
content-type
application/json; charset=utf-8
x-amz-cf-id
37QqFuZfKbA36-wSeOTCJXowOCHleNmk0yOpLo7Zp7Z7DfqXsfOisQ==

Verdicts & Comments Add Verdict or Comment

27 JavaScript Global Variables

These are the non-standard "global" variables defined on the window object. These can be helpful in identifying possible client-side frameworks and code.

object| onselectstart object| onselectionchange function| queueMicrotask object| __core-js_shared__ object| core boolean| isIE11 function| debounce function| updateUrlParameter function| getUrlParameterByName function| removeUrlParameter function| smoothScroll function| createPostForm function| updateSearchPreferences function| hide function| show object| dataLayer object| google_tag_manager string| GoogleAnalyticsObject function| ga function| cmp function| __cmp string| onConsentChangedUrl function| showConsentTool object| google_tag_data object| gaplugins object| gaGlobal object| gaData

3 Cookies

Domain/Path Name / Value
.metacrawler.com/ Name: _gat_gtag_UA_123175321_1
Value: 1
.metacrawler.com/ Name: _gid
Value: GA1.2.584207722.1555692520
.metacrawler.com/ Name: _ga
Value: GA1.2.180381017.1555692520