Register
Blog
How hidden is hidden Interesting threads on search, indexing etc. I just wondered, how hidden is an unlinked tel folder stored on dns as compared with a normal unlinked web page. Both have urls, both would not be indexed unless they have a link to them somewhere else. The web page still exists on a server and can be found. Does the hidden .tel page exist if its not called. Might seem a silly question, but could have quite a few implications and or uses. |
it does exist - you can call the enter the direct url into your browser and navigate to the page.... no difference between that and a path to a file on your webserver you don't link to |
Quote:
If you don't have the url though?[/size] |
its no different to not having the url to the file on your webserver for a traditional site... the data is in the dns and should you know the url you can access it or query it. note: if using the soap api, you can return all the subdomains which would return even the hidden subdomains url. think of it as doing an ls or dir on your webserver file system or looking at the urls in your htaccess file. |
Thanks dottel, all is clear. |
no worries - always happy to help |
Don't rely on "hidden" folders for any serious amount of privacy. You can't prevent other people from linking (if they know it), but even despite this there may be other ways "hidden" domains could leak into search indexes: * Logs from web proxies (I seem to remember AOL fed these into search back in the day?) * DNS resolvers keep query logs - do ISPs do anything with the data? I don't know. * Tracking toolbars (e.g. Alexa) that generate public usage reports (which could get crawled). * Who knows, maybe Google scrapes links from Gmail messages to feed its index? Quote:
"If a tree falls in a forest". I don't really know what you're getting at..[/size] |
If you don't want something public don't put it on line. This includes 1024 bit encrypted sites which are only as strong as the person/s that knows the password and the machine it is entered on. Ps if a tree falls in the wood and know one sees it, it still exists, as a path may be cut past it one day and then it would be found and always have existed. |
Quote:
Yesterday's answer to this question confirms it. Cheers![/size] |
