Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add robots.txt file to disallow indexing of /entries/* #21

Open
qurbat opened this issue May 9, 2022 · 1 comment
Open

Add robots.txt file to disallow indexing of /entries/* #21

qurbat opened this issue May 9, 2022 · 1 comment

Comments

@qurbat
Copy link

qurbat commented May 9, 2022

I know that entries are meant to be public if the URL is shared with someone, however, currently, the search query for site:deardiary.ai inurl:entry on Google indexes at least 5 entries, which in my opinion should not be visible, even if the entries have been linked on a public website. Creating a robots.txt file which disallows search engine indexing of /entries/* should take care of this. Please let me know if further information is required. Thank you!

@StephenHaney
Copy link
Owner

Great idea, thanks for bringing this up.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants