I was going through IIS logs and and trying to figure out how hackers from the internet where able able find a directory/file that was hidden through obscurity. I ran sensepost against the website and it indicates that the directories/site is not indexable. So how did they find it. The names were extremely uncommon.
A friend with a great deal of experience tells me the indexing of website cannot be turned off and is part of the w3 standard.
Any insight would be really appreciated. I am really trying to figure out how this want found. Thanks.