OK
https://www.redditstatic.com/robots.txt
United States
Country
Network
April 04, 2025, 04:28 PM UTC
Date & Time
Websites
Websites
Runtime: 1.7s
On April 04, 2025, 04:28 PM UTC, https://www.redditstatic.com/robots.txt was accessible when tested on AS17 in United States.

Failures

HTTP Experiment
null
DNS Experiment
null
Control
null

DNS Queries

Resolver:
208.69.36.210
Query:
IN A www.redditstatic.com
Engine:
system
Name
Class
TTL
Type
DATA
@
IN
A
151.101.65.140
@
IN
A
151.101.193.140
@
IN
A
151.101.129.140
@
IN
A
151.101.1.140

TCP Connections

Connection to 151.101.1.140:443 succeeded.
Connection to 151.101.129.140:443 succeeded.
Connection to 151.101.193.140:443 succeeded.
Connection to 151.101.65.140:443 succeeded.

HTTP Requests

URL
GET https://www.redditstatic.com/robots.txt
Response Headers
Accept-Ranges:
bytes
Content-Length:
507
Content-Type:
text/plain
Date:
Fri, 04 Apr 2025 16:27:13 GMT
Nel:
{"report_to": "w3-reporting-nel", "max_age": 14400, "include_subdomains": false, "success_fraction": 0.02, "failure_fraction": 0.02}
Report-To:
{"group": "w3-reporting-nel", "max_age": 14400, "include_subdomains": true, "endpoints": [{ "url": "https://w3-reporting-nel.reddit.com/reports" }]}, {"group": "w3-reporting", "max_age": 14400, "include_subdomains": true, "endpoints": [{ "url": "https://w3-reporting.reddit.com/reports" }]}, {"group": "w3-reporting-csp", "max_age": 14400, "include_subdomains": true, "endpoints": [{ "url": "https://w3-reporting-csp.reddit.com/reports" }]}
Retry-After:
0
Server:
snooserv
Vary:
Origin
Via:
1.1 varnish
Response Body
User-Agent: *
Disallow: /
Allow: /desktop2x/img/favicon/*
Allow: /favicon.ico
Allow: /icon.png
Allow: /new-icon.png
Allow: /desktop2x/img/social-sharing/*
Allow: /talk/assets/social-sharing/*
Allow: /marketplace-assets/*

User-agent: Googlebot
User-agent: AdsBot-Google
User-agent: AdsBot-Google-Mobile
User-agent: AdsBot-Google-Mobile-Apps
User-agent: Googlebot-Image
User-agent: Googlebot-Video
User-agent: Applebot
User-agent: ClarityBot
Disallow:

User-agent: bingbot
User-agent: MSNBot-Media
Allow: /

Resolver

Resolver ASN
AS36692
Resolver IP
208.69.36.210
Resolver Network Name
Cisco OpenDNS, LLC
Report ID
20250404T162316Z_webconnectivity_US_17_n1_dcILcT4QOjNhNOO0
Platform
android
Software Name
ooniprobe-android-unattended (5.0.5)
Measurement Engine
ooniprobe-engine (3.24.0)

Raw Measurement Data

{
"annotations":{
...
}
"data_format_version":
string"0.2.0"
"input":
string"https://www.redditstatic.com/robots.txt"
"measurement_start_time":
string"2025-04-04 16:28:50"
"probe_asn":
string"AS17"
"probe_cc":
string"US"
"probe_ip":
string"127.0.0.1"
"probe_network_name":
string"Purdue University"
"report_id":
string"20250404T162316Z_webconnectivity_US_17_n1_dcILcT4QOjNhNOO0"
"resolver_asn":
string"AS36692"
"resolver_ip":
string"208.69.36.210"
"resolver_network_name":
string"Cisco OpenDNS, LLC"
"software_name":
string"ooniprobe-android-unattended"
"software_version":
string"5.0.5"
"test_helpers":{
...
}
"test_keys":{
...
}
"test_name":
string"web_connectivity"
"test_runtime":
float1.653044218
"test_start_time":
string"2025-04-04 16:24:54"
"test_version":
string"0.4.3"
}