"Veryfy a Site" error - Crawling, indexing, and ranking

Message from discussion "Veryfy a Site" error

webado

View profile

More options Jul 18 2008, 10:18 am

From: webado

Date: Thu, 17 Jul 2008 20:18:39 -0700 (PDT)

Local: Fri, Jul 18 2008 10:18 am

Subject: Re: "Veryfy a Site" error

Forward | Print | View thread | Report this message | Find messages by this author

Take thsi out from the robots.txt file:

Allow: /

It contradicts what the other directives say.

Your text sitemap is incorrect.

A text sitemap must only contain urls, one per line, not anything
else.

If you want to specify priority and other informaiton then you must
use the xml sitemap format, and that has to be as per:
http://www.sitemaps.org/protocol.php

On Jul 17, 11:10 pm, syl wrote:

> Thank you.

> I add robots.txt in may site.
> Checking server for "URL=http://www.sanalyst.kr/robots.txt" return
> 200 result.
> But, "Verify a site" result show same error message : "Our system has
> experienced a temporary problem."

> My sitemap is "http://www.sanalyst.kr/sitemap.txt". For ".txt" format,
> is there any problem?

> On Jul 18, 9:35 am, webado wrote:

> > The server is not responding correctly for a non-existent url:

> >http://oyoy.eu/page/headers/?full=1&url=http%3a%2f%2fwww.sanalyst.kr%...

> > It's doing a 302 redirection and then a 200. It should respond with a
> > 404 and no redirections.

> > This is probably due to the .htaccess file (or a higher up serevr
> > setting) which probably has this in it:

> > ErrorDocument 404http://hosting.paran.com/error/404.html

> > Your .htaccess file should have:

> > ErrorDocument: 404 /your-error-page.html

> > And make an error page for yourself, on your own domain.

> > Google check your robtlos.txt file but it cannot reach it, nor is it
> > given a 404 so it would know you dont' have one.
> > You need to fix the error response.

> > It would also be beneficial to actually have a robots.txt file, even
> > if it only contains this:

> > User-agent: *
> > Disallow:

> > Sitemap:http://www.sanalyst.kr/your_sitemap.xml

> > The sitemap line is optional, but if you use it, make sure your
> > sitemap is at the address given.

> > On Jul 17, 7:16 pm, Autocrat wrote:

> > > :bump:

> > > On Jul 17, 6:32 am, syl wrote:

> > > > I'm a webmaster of site "www.sanalyst.kr". For many days, I am seeing
> > > > the message :
> > > > "Our system has experienced a temporary problem."

> > > > On my kowlege, may site is normal. How can I solve this problem.

> > > > Help me, please!!!!- Hide quoted text -

> > > - Show quoted text -- Hide quoted text -

> > - Show quoted text -- Hide quoted text -

> - Show quoted text -

Forward