You are viewing limited content. For full access, please sign in.

Question

Question

Laserfiche Cloud Public Portal - stop site from being crawled?

asked on January 24, 2024

Hello everyone,

 

A client came to me that other day and asked this question.  So with Weblink on-prem you could edit the robots.txt file on the IIS site for the portal and in theory, prevent the site from being crawled by bots (e.g., Google, Yahoo, etc.).  Has anyone run up against this with Cloud Public Portal?  Is there any way to prevent this?  I'm guessing that because it is hosted via AWS that no but wanted to check.

 

Thanks!

Brian

0 0

Replies

replied on January 24, 2024

There isn't any way to discourage a repository from being crawled. Can you say more about what the user is trying to accomplish?

0 0
replied on January 26, 2024

So over the years we have clients who have asked us to submit their Portal site to Google for indexing and we have had others who don't want the site crawled - some of it related to licensing (e.g., the bot takes one up) to they simply don't want their site crawled.  I will, however, dig in deeper with this particular client - thanks Brian!

0 0
replied on January 26, 2024

Public portal does not require a paid user license in Laserfiche Cloud, so bots tying up licenses would not be an issue.

0 0
replied on February 1, 2024

I talked with the client and the records in question are public, but said records do have data pertaining to accident reports on them that the customer would rather not have broadcast via Google.

0 0
replied on September 19, 2024

I too have a client that would like to use the Cloud Public portal as a way to communicate to the 4000 strong ever-changing Workforce. The documents they Publish here would typically be on a sharepoint server or Intranet, however the Client would like to house them in the LF cloud. One thing they do not want is Google or other Search engines to crawl the content and make it available through Search Engine searches. they simply want to keep that function within the LF Cloud Public Portal. Is there a way to accomplish this? I need to provide a definitive answer. Thanks in advance. Also if there is any documentation about this, please provide me with the document or point me to it.  Milton

0 0
You are not allowed to follow up in this post.

Sign in to reply to this post.