Google Spiders

Mon Oct 27, 2003 3:49 pm

Hello Everyone,

Thank you for your previous
review of my site. Good ideas.

My site has been live for 3 months.
Google has not yet spidered my site.

How long has it taken other people's
sites to be spidered by google?

Do I need to do something to be more
spiderable for google?

I have been spidered by MSN, Inktomi, but
not listed yet. Do I need to pay to get listed
in them.

I am listed in Alta Vista.


Posts: 439
Joined: Sat Oct 25, 2003 5:37 am
Location: New York

Mon Oct 27, 2003 5:49 pm

Hi Jeremy,

The wait seems like forever doesn't it. :)

Do you have any links from other sites that are listed in Google?

That is the way to get that 'ol Google spider to your site.

Hope this helps.

All the best,
Larry Chamberlain
Larry Chamberlain
Posts: 1192
Joined: Fri Aug 01, 2003 8:06 pm
Location: London, England

Mon Oct 27, 2003 9:14 pm


As this forum is regularly and frequently indexed by Google (at least according to Big Allan), why not include a "followable", well-anchored link in your posts.

As an example, you could create a link like this...

lose weight build muscle including the following in your message...

Code: Select all
[url=]lose weight build muscle[/url]

Then again, if Google does follow links from here, maybe you won't need to anymore. :wink:

(Note even if links from forums aren't counted anymore, they are still followed. This means they can help you get found.)

Hope this helps,
Posts: 3293
Joined: Fri Aug 22, 2003 5:53 pm
Location: UK

Mon Oct 27, 2003 10:49 pm

For some quick links, search for your topic words like so (on Google)

+"topic word" +"add link" or you can use "add url"
find a few good places to quickly add your url (some may require a link back)

Once your link is live on their site, just submit that one page your link is on to Google at:

This can help speed up the process of finding backlinks, and helping you get spidered as well.

Posts: 4253
Joined: Sat Aug 16, 2003 11:59 pm
Location: NY

Thank you

Tue Oct 28, 2003 3:51 am

Thanks for your great ideas
for my site lose weight build muscle

I'll try them.

Posts: 439
Joined: Sat Oct 25, 2003 5:37 am
Location: New York

Thu Mar 10, 2011 5:09 pm

A site plan will follow a clear path for the spider. Also, someone should put an easy to follow text links, which will be directed to the main pages of the website. Do not take the spider is stupid. If you think you can easily con spider into thinking how to do it, you're probably shooting themselves in the foot. Make sure the rich content relevant keywords you. If the spider finds no anomaly in the written content, and keywords used, you will immediately understand their website as irrelevant to the keyword.
Posts: 10
Joined: Wed Mar 09, 2011 3:03 pm

Tue Apr 19, 2011 2:44 pm

You can also sign up for Google Webmaster tools for free and submit a sitemap directly to Google.

Some hosting companies (I use 1and1) will generate and submit the sitemap for you for free.
Posts: 10
Joined: Tue Apr 19, 2011 12:54 am

Tue May 17, 2011 10:07 am

its a good idea to sign up and submit site map directly.
Posts: 7
Joined: Wed Mar 23, 2011 7:13 am

Thu Aug 04, 2011 2:31 pm

Indeed, I completely agree with stoneman, you should submit your sitemap to the Google Webmasters Tools. Once you are done with that bookmark your website on popular social bookmarking sites, it will also help in getting your site crawled and indexed.
Posts: 43
Joined: Tue Jul 12, 2011 6:38 am


Fri Mar 16, 2012 10:08 am

I think you should go in search webmaster tool and submit your website there, then also upload robots and sitemap in your website in root folder.
Posts: 13
Joined: Wed Dec 01, 2010 11:02 am


Tue May 01, 2012 5:49 am

How do i get a Google Spider to go to my website?
I want my website to be with google, but I don't know how to make spiders visit it? Some one help!
Posts: 2
Joined: Tue May 01, 2012 5:46 am

Re: Hi Guys...

Tue Jun 12, 2012 9:38 am

How can i get google spiders to go to my site?
Posts: 2
Joined: Tue Jun 12, 2012 9:33 am

Mon Dec 10, 2012 8:40 pm

You just wait or go to this link and add your site
Posts: 119
Joined: Fri Feb 25, 2011 8:56 pm

Tue Jan 22, 2013 6:57 am

usually it takes weeks to crawl a site but it definitely should crawl and yeah building up some back links is definitely a good way to make sure that Google crawlers come to your site..
Posts: 2
Joined: Tue Jan 22, 2013 6:54 am

Wed Jan 23, 2013 6:30 am

Spiders is a name for the robots (automatic programs) that scan web and save the information in websites to a database. Hence, "Google spiders" is another name for "Google indexing bots".
Posts: 3
Joined: Mon Oct 01, 2012 10:28 am


Return to Site Build It

Who is online

Users browsing this forum: No registered users and 0 guests