OK
https://s.gr-assets.com/robots.txt
Websites
Runtime: 1.5s
On April 23, 2025, 09:09 PM UTC, https://s.gr-assets.com/robots.txt was accessible when tested on AS37705 in Tunisia.
Failures
HTTP Experiment
null
DNS Experiment
null
Control
null
DNS Queries
Resolver:
172.253.228.149
Query:
IN A s.gr-assets.com
Engine:
system
Name
Class
TTL
Type
DATA
@
IN
A
18.161.114.233
TCP Connections
Connection to 18.161.114.233:443 succeeded.
HTTP Requests
URL
GET https://s.gr-assets.com/robots.txt
Response Headers
Cache-Control:max-age=0, private, must-revalidateContent-Type:text/plain; charset=utf-8Date:Wed, 23 Apr 2025 21:09:59 GMTEtag:W/"e707b8608d13583ad661ee4d823218d4"Server:ServerStrict-Transport-Security:max-age=63072000; includeSubDomains; preloadVary:Accept-EncodingVia:1.1 6591bb6087db05f5a246aab03dfdcc86.cloudfront.net (CloudFront), 1.1 830a57eccbd3fe5dbe1beff515179f28.cloudfront.net (CloudFront)X-Amz-Cf-Id:HOo6v0GTjQBxJSSuXj3uk1JYkNBsZ_mvFalx3STVWeqSxk__QKW2ZA==X-Amz-Cf-Pop:MRS52-P6X-Amz-Rid:FQDXTP73MWCY2FGRRJQVX-Cache:Miss from cloudfrontX-Content-Type-Options:nosniffX-Frame-Options:ALLOWALLX-Request-Id:FQDXTP73MWCY2FGRRJQVX-Runtime:0.034924X-Xss-Protection:1; mode=block
Response Body
# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file User-agent: EtaoSpider Disallow: / User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: facebookexternalhit Allow: /user/year_in_books User-agent: Mediapartners-Google Disallow: /about/team_member/ Disallow: /admin Disallow: /api Disallow: /blog/list_rss Disallow: /book/reviews/ Disallow: /book_link/follow/ Disallow: /buy_buttons/ Disallow: /ebooks Disallow: /friend/add_as_friend Disallow: /home/index_rss Disallow: /oggiPlayerLoader.htm Disallow: /photo/group/ Disallow: /quotes/list_rss Disallow: /review/list Disallow: /review/list_rss Disallow: /review/rate Disallow: /shelf/user_shelves Disallow: /tooltips Disallow: /track Disallow: /trivia/answer Disallow: /user/updates_rss Disallow: /*reviewFilters User-agent: * Allow: /work/editions Allow: /work/quotes Disallow: /about/team_member/ Disallow: /admin Disallow: /api Disallow: /blog/list_rss Disallow: /book/reviews/ Disallow: /book_link/follow/ Disallow: /buy_buttons/ Disallow: /ebooks Disallow: /friend/add_as_friend Disallow: /home/index_rss Disallow: /oggiPlayerLoader.htm Disallow: /photo/group/ Disallow: /quotes/list_rss Disallow: /review/list Disallow: /review/list_rss Disallow: /review/rate Disallow: /review/show Disallow: /search Disallow: /shelf/user_shelves Disallow: /tooltips Disallow: /track Disallow: /trivia/answer Disallow: /user/updates_rss Disallow: /user/year_in_books Disallow: /videos/ Disallow: /work Disallow: /*reviewFilters Sitemap: https://www.goodreads.com/siteindex.author.xml Sitemap: https://www.goodreads.com/siteindex.author_community_question.xml Sitemap: https://www.goodreads.com/siteindex.award.xml Sitemap: https://www.goodreads.com/siteindex.blog.xml Sitemap: https://www.goodreads.com/siteindex.book_community_question.xml Sitemap: https://www.goodreads.com/siteindex.genre.xml Sitemap: https://www.goodreads.com/siteindex.giveaway.xml Sitemap: https://www.goodreads.com/siteindex.group.xml Sitemap: https://www.goodreads.com/siteindex.index.xml Sitemap: https://www.goodreads.com/siteindex.interview.xml Sitemap: https://www.goodreads.com/siteindex.list.xml Sitemap: https://www.goodreads.com/siteindex.quote.xml Sitemap: https://www.goodreads.com/siteindex.quote_tag.xml Sitemap: https://www.goodreads.com/siteindex.related_work.xml Sitemap: https://www.goodreads.com/siteindex.topic.xml Sitemap: https://www.goodreads.com/siteindex.user.xml
Resolver
Resolver ASN
AS15169
Resolver IP
172.253.228.149
Resolver Network Name
Google LLC
Report ID
20250423T210531Z_webconnectivity_TN_37705_n1_Ini1PdN367ocO9r7
Platform
android
Software Name
ooniprobe-android-unattended (5.0.5)
Measurement Engine
ooniprobe-engine (3.24.0)