Welcome to WebmasterWorld Guest from 54.81.68.240

Forum Moderators: goodroi

New "Well-Known Uniform Resource Identifiers"

Well-Known Uniform Resource Identifiers are defined in RFC-5785

     
7:54 pm on Nov 26, 2017 (gmt 0)

New User from RU 

joined:Feb 17, 2016
posts:14
votes: 0


Once, Bing and Google would find, for the search string ".well-known" webpages that had references to the string ".well-known". Which many WebmasterWorld users had seen references to in their log files.

GoogleBot started doing these:


GET /.well-known/apple-app-site-association
GET /apple-app-site-association


And many people were wondering what was up with that...

RFC-5785 explains them as "Well-Known Uniform Resource Identifiers" and how to implement them and why.

After testing, I have found that this works for GoogleBot:


Disallow: /.well-known/
Disallow: /apple-app-site-association/


As an aside, as a test, I added
/.well-known/
to the end of some popular CMS sites, like Joomla, to see what they would do. Joomla served up a (very large) "Page not found" page - obviously Joomla's entire code base loaded and ran only to then find out the request did not exist. (That is a fault of many CMS programs.)

My point being that Web Developers really need to detect some obviously never-will-exist requests *before they load their entire code base* (which are usually tens of megabytes of PHP/Perl code).

But I digress...

(Joomla now detects and (properly) ignores
/.well-known/
.)
7:59 pm on Nov 26, 2017 (gmt 0)

New User from RU 

joined:Feb 17, 2016
posts:14
votes: 0


Ugh! I need to edit that post. Is there an edit post feature? I can't seem to find one. (No need to reply as this is a comment to self...)
12:25 am on Dec 6, 2017 (gmt 0)

New User from RU 

joined:Feb 17, 2016
posts:14
votes: 0


P.S. If everybody already knows about this, my apologies for dumb post.

Last month, when I saw ".well-known/" requests by Google I searched for, duh, ".well-known" in Bing and Google. Both returned links to several sites with people asking "I'm seeing requests for '.well-known' in my logs! What it this?"

(Which is why I posted this, albiet probably much too late.)

But now, though, searching for ".well-known" on Bing and Google BOTH TRANSLATES the request to "well known" -- even +".well-known" does not work.

So, Never Mind.
7:55 am on Dec 6, 2017 (gmt 0)

Moderator from US 

WebmasterWorld Administrator keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:11470
votes: 692


Not sure what you're asking or reporting, but .well-known should be a hidden directory.
6:19 pm on Dec 8, 2017 (gmt 0)

New User from RU 

joined:Feb 17, 2016
posts:14
votes: 0


Sometimes I am not clear in my words. (I'm like apologizing like all the time for that...)

Here is a link describing this: [gaj.design...]

Quite right, a leading "." is a hidden file/directory for *nix, that does not mean that having such a name in a request will not look for and find it if it exists, and cause a server/website to issue a 404 if not. Again, look to RFC-5785 for more information.

When Bing and Google returned searches for ".well-known" many were from Server Fault, Stack Exchange, Stack Overflow, Apple Developer and even Google Products Forum of the "What are these and should I be worried?" nature.

Well, time passed as this no longer seems a concern to anyone.