i'd like to add some more vaguely "private" pages ...
# devlog-together
i
i'd like to add some more vaguely "private" pages to my website. private in the "obscure" sense, not "secure". like, i'm going to leave breadcrumbs so interested people can find them, and i'm legit fine with anyone finding them, but i don't want them to be out in the open. the site source is going to be on indexed code-hosting social networks (like github), but i don't want shit coming up in search results. i'm thinking of doing, like, rot13 in a git hook? that might be fine? curious what ya'll would suggest i do instead.
👀 1
m
robots.txt?
i
Oh yeah, right. I don't want AIs training on this shit. Hmmmm well there goes that idea.
e
robots.txt has successfully kept my ENORMOUS blog out of search indexes. AI crawlers are defo, though, 100% ignoring robots.txt
Here is my robots.txt for ref. It specifically allows and disallows a bunch of different things
m
You can save stuff as images. Robots don't like that.
j
I've used basic http auth for that kind of stuff.
i
these are all great suggestions. how should i secure this stuff in source control? encrypt it, somehow?
t
https://github.com/getsops/sops is the one we use professionally for encrypting github. So then you the developer has the secret. The CI has the secret, and you can both access the encrypted documents inside the repo