Hi,
I'm using a crawler to create my sitemaps (GsiteCrawler on Windows).
Each time I change a few tens of pages, I re-crawl the site, then I go to the Google webmaster page to tell it to grab it again (thus I can see how many pages Google considers among the number of pages I submit to it).
And I do use the robots.txt files to tell the crawler where to fint it too.
Sitemap:
http://www.mysite.com/sitemap.xml
Sitemap:
http://www.mysite.com/sitemap.xml.gz
And when I launch a new site, I submit it to ask.com, yahoo.com and live.com
Ask.com Sitemap submission successful
http://search.yahooapis.com/SiteExpl...om/sitemap.xml
Submit sitemap - Webmaster ToolsLive Search
The question still open is how to create different sitemaps for a same site and how to spilt a big sitemap file (with like 30,000 links).
And why Google does not index all the submitted links.
For example, I have a site with 12,000 links in its sitemap but only 4,500 are really linked by Google (checked with the site: instruction)