Jump to content

Do a search engine have access to all web servers?


Alphaplus

Recommended Posts

Do a search engine have access to all web servers?

No.

Search engine downloads pages only that are publicly available from other websites by links, or available on the list of pages revealed by owner of website.

Owner can tell Google search engine bot, that some links should not be downloaded and analyzed.

 

If page is every time generated from scratch, and contains completely different content, such page should not be analyzed by search engine bot.

Words present in such page, will be not found, the next time user or bot is visiting it.

 

Searching engine bot does not have any special privileges, like admin or hacker could get, to website server or pages.

It has the same read-only access like any normal user client web browser.

Edited by Sensei
Link to comment
Share on other sites

Are you confusing cookies and search bots? Take <link removed> as an example. The cookies collect information about the user, while the search engines analyze the quality of the site.

Edited by imatfaal
Don't post spammy links even as an example
Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.