Webmaster SEO – Blog, Tips, Latest News and more

Search Engine Optimization and Tips

Discovering Sitemaps

<P class=MsoNormal style="MARGIN: 0in 0in 0pt"><FONT face=Calibri size=3>When we first teamed up with Google and Yahoo to support sitemaps as an </FONT><A href="http://blogs.msdn.com/livesearch/archive/2006/11/15/microsoft-google-yahoo-unite-to-support-sitemaps.aspx" mce_href="http://blogs.msdn.com/livesearch/archive/2006/11/15/microsoft-google-yahoo-unite-to-support-sitemaps.aspx"><FONT face=Calibri color=#0000ff size=3>industry standard</FONT></A><FONT face=Calibri size=3>, it was with the express intention of driving the protocol forward.  Making it into a simple, effective way to tell all search engines about the structure of your site.</FONT></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><?xml:namespace prefix = o ns = "urn:schemas-microsoft-com:office:office" /><o:p><FONT face=Calibri size=3> </FONT></o:p></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><FONT face=Calibri size=3>Today, I'm happy to announce the latest addition to the protocol: Sitemap Autodiscovery.  Autodiscovery gives siteowners the ability to easily share their sitemaps with all search engines at once, without the overhead of manually submitting them to each one.  In order to share your sitemap with the crawlers at large, you simply provide the following line in your robots.txt file:</FONT></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><o:p><FONT face=Calibri size=3> </FONT></o:p></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><FONT face=Calibri size=3>                Sitemap: <sitemap_location></FONT></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><o:p><FONT face=Calibri size=3> </FONT></o:p></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><FONT face=Calibri size=3>Where <sitemap_location> is the complete URL of your Sitemap Index File (or your sitemap file, if you don't have an index file).  This directive is independent of the user-agent. so as long as it is present in the robots.txt file, all engines will be able to find your sitemaps.  I see this as an important extension to the protocol, as it removes the need to individually submit sitemaps to each engine - simply add one line to your robots.txt file, and we will find your new and updated sitemaps automatically. </FONT></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><o:p><FONT face=Calibri size=3> </FONT></o:p></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><FONT face=Calibri size=3>Although we aren't ready to start consuming sitemaps quite yet, I encourage you to build a sitemap and add the "sitemap" directive to your robots.txt. As soon as we roll out support (before the end of the year), we will be able to start crawling your sitemap files immediately.  If you want more detail on the sitemaps protocol, including autodiscovery, check out </FONT><A href="http://www.sitemaps.org/" mce_href="http://www.sitemaps.org/"><FONT face=Calibri color=#0000ff size=3>www.sitemaps.org</FONT></A><FONT face=Calibri size=3>. </FONT></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><o:p><FONT face=Calibri size=3> </FONT></o:p></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><FONT face=Calibri size=3>As always, we are eager to hear your feedback and suggestions.  Please send them our way using </FONT><A href="http://feedback.live.com/eform.aspx?productkey=wlsearch&page=wlfeedback_home_form" mce_href="http://feedback.live.com/eform.aspx?productkey=wlsearch&page=wlfeedback_home_form"><FONT face=Calibri color=#0000ff size=3>this link</FONT></A><FONT face=Calibri size=3>. </FONT></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><o:p><FONT face=Calibri size=3> </FONT></o:p></P> <P class=MsoNormal style="MARGIN: 0in 0in 0pt"><I><FONT size=3><FONT face=Calibri>Brent Hands, Program Manager, Live Search<o:p></o:p></FONT></FONT></I></P><img src="http://blogs.msdn.com/aggbug.aspx?PostID=2085917" width="1" height="1">

When we first teamed up with Google and Yahoo to support sitemaps as an industry standard, it was with the express intention of driving the protocol forward.  Making it into a simple, effective way to tell all search engines about the structure of your site.


 


Today, I’m happy to announce the latest addition to the protocol: Sitemap Autodiscovery.  Autodiscovery gives siteowners the ability to easily share their sitemaps with all search engines at once, without the overhead of manually submitting them to each one.  In order to share your sitemap with the crawlers at large, you simply provide the following line in your robots.txt file:


 


                Sitemap: <sitemap_location>


 


Where <sitemap_location> is the complete URL of your Sitemap Index File (or your sitemap file, if you don’t have an index file).  This directive is independent of the user-agent. so as long as it is present in the robots.txt file, all engines will be able to find your sitemaps.  I see this as an important extension to the protocol, as it removes the need to individually submit sitemaps to each engine – simply add one line to your robots.txt file, and we will find your new and updated sitemaps automatically.


 


Although we aren’t ready to start consuming sitemaps quite yet, I encourage you to build a sitemap and add the “sitemap” directive to your robots.txt. As soon as we roll out support (before the end of the year), we will be able to start crawling your sitemap files immediately.  If you want more detail on the sitemaps protocol, including autodiscovery, check out www.sitemaps.org.


 


As always, we are eager to hear your feedback and suggestions.  Please send them our way using this link.


 


Brent Hands, Program Manager, Live Search