If you’d like to learn how to hide a website from Google’s search results (or even just hide it from Google and other people), there are 3 ways to do so.
Earlier today (November 24th, 2021), Google released a tweet about a video they just made:
Here’s what John (host of the video above) said (with some editing for clarity):
“Aman asks whether it's possible to hide a website in search while still letting users access it.
“In short, yes, you can.
“There are three ways that you can do that: use a password block, crawling, or block indexing.
“Let's take a quick look at them.”
Password Protection Is the First Way to Hide a Site From Google...and Others
“Locking a website down with a password is often the best approach if you want to keep your site private--neither search engines nor random web users would be able to see your content, so it's quite secure.”
Blocking Crawling Is the Second Way
“Blocking crawling is another approach. This is done with the robots.txt file. Random users of the Web would still be able to use your website, while well-behaved search engines would know not to access it. This isn't an ideal approach, since search engines might still index the address of the website without accessing the content; it's rare, but it can happen.”
Blocking Indexing Is the Third Way to Hide Your Site From Google
“Blocking indexing is the other option for this. You add a noindex robots meta tag to your pages. This tells search engines not to index that page after they crawl it. Users don't see the meta tag, and can still access the page normally.
“Overall, for private content, our recommendation is to use password protection: it's easy to check that it's working, and it prevents anyone from accessing your content.”
But What If You Only Want to Block a Portion of Your Site?
“Blocking crawling or indexing are good options when the content isn't private or if they're just parts of a website which you'd like to prevent from appearing in search.”
So, if you wanted to know how to block your site from Google search, we just showed you 3 ways to do so.