How do I invite Google Bot?

Discussion in 'Indie Basics' started by AlexN, Aug 27, 2005.

  1. AlexN

    Original Member

    Joined:
    Jun 25, 2005
    Messages:
    210
    Likes Received:
    0
    Apparentlly last time when Google Bot crawled my website, it was when my site was down thanks to my webhost. Now that I search sphinxmedia, it doesn't appear corrently. Worst, it seems that my company name SphinxMedia Software has been wiped from Google. (It used to my site when I search SphinxMedia, or SphinxMedia Software)

    I know yahoo has a "submit your site" link, but I can't find it on Google. How do I invite Google Bot to re-crawl my site?
     
  2. soniCron

    Indie Author

    Joined:
    May 4, 2005
    Messages:
    3,664
    Likes Received:
    0
  3. Chris Evans

    Moderator Original Member

    Joined:
    Jul 26, 2004
    Messages:
    1,167
    Likes Received:
    1
    I'm sure Add Url will work (eventually), but they're far less effective than they used to be.

    The best and fastest way to get your site crawled by Google (and other search engine bots) is to set up a link exchange with a few other sites. When Google crawls any of the other sites (which is usually every couple of days for most sites), it will find your site through their link section and you'll be "On the Map" within a few days.

    Exchange links with someone who has a PageRank of 5 or more and you'll be ready to go in no time. Much faster than using the "Add URL" submission forms. Some webmasters even joke that Google automatically blacklists sites that use that form. :)
     
  4. soniCron

    Indie Author

    Joined:
    May 4, 2005
    Messages:
    3,664
    Likes Received:
    0
    I'd eat my hat if he can find anybody with a pagerank of 5 or greater to link to his site before he puts anything on it.
     
  5. AlexN

    Original Member

    Joined:
    Jun 25, 2005
    Messages:
    210
    Likes Received:
    0
    Thanks. :)
     
  6. AlexN

    Original Member

    Joined:
    Jun 25, 2005
    Messages:
    210
    Likes Received:
    0
    Ah! Don't be mean. I'm working on it. ;)
     
  7. soniCron

    Indie Author

    Joined:
    May 4, 2005
    Messages:
    3,664
    Likes Received:
    0
    No, no, no, no!! No "mean"! :) I'm saying nobody will link to a blank page, that's all! No "mean"! :)
     
  8. AlexN

    Original Member

    Joined:
    Jun 25, 2005
    Messages:
    210
    Likes Received:
    0
    Yeah, I know. ;)
     
  9. revve

    Original Member

    Joined:
    Jul 4, 2005
    Messages:
    219
    Likes Received:
    0
    I had a bit of a fight trying to get one of my sites on Google a couple of months ago. This is what I learned.

    1.) The Add URL will tell Google about your site, and they'll crawl it.
    2.) If you want to be listed higher than page 12 (or so), you need people to link to your page. Either a couple of links from sites with high pageranks, or many, many links from sites with low pageranks.
    3.) Pages with only lots of links to other pages are ignored by Google, for ranking reasons.
    4.) (Obviously) Banners doesn't count, unless they link DIRECTLY to your page (not via some banner management script)
    5.) Getting listed in directories like DMOZ and Yahoo (surprisingly) helps a LOT
    6.) Google works on it's own timetable. Have your site submitted to them now, they'll crawl you in three weeks and list you a month later. You must be patient.
    7.) Apparently the GoogleBot can sence incomplete or "under construction" sites, and will not include a site such as this in it's database.
     
  10. mot

    mot
    Indie Author

    Joined:
    Oct 21, 2004
    Messages:
    439
    Likes Received:
    0
    https://www.google.com/webmasters/sitemaps/

    This can help Google improve the way they crawl your website. For instance you can tell Google bot to crawl a page more frequently if it contains stuff that is changing very often (a news page etc.)

    It's a XML file that you put in the root of your website and register it with Google. The site listed above contains some Python tools for doing that.
     
  11. Didier

    Original Member

    Joined:
    May 23, 2005
    Messages:
    159
    Likes Received:
    0
    It's true and that is no joke.
    They don't blacklist your site but your rankings will be limited when you do this.

    So, don't submit to Google, let Google come to you.

    Submit to Dmoz directory and eventually google will find you ;-)

    Didier
     
  12. Martoon

    Original Member

    Joined:
    Nov 5, 2004
    Messages:
    329
    Likes Received:
    0
    Interesting. I didn't know that. Could you post your source for this information? I'd like to read more about it.
     
    #12 Martoon, Aug 27, 2005
    Last edited: Aug 27, 2005
  13. Didier

    Original Member

    Joined:
    May 23, 2005
    Messages:
    159
    Likes Received:
    0
    Check out Seochat.com

    There's an article about it.

    Didier
     
  14. fog4711

    Original Member

    Joined:
    Apr 1, 2005
    Messages:
    131
    Likes Received:
    0
    @AlexN

    IMHO you don't have to do anything at all. There is already a link to your site from this presumably high ranking site :) (Indiegamer). So no doubt Google will find you. Like someone else here said, be patient. Mayhaps the best thing to do is to spend the time and efforts on improving your site further and creating more interesting content for it.
     
  15. Savant

    Original Member

    Joined:
    Feb 8, 2005
    Messages:
    1,674
    Likes Received:
    0
    I have to question this sort of thing when I hear it. Why would Google do that? What's their motivation? I can't think of a single way in which doing that helps Google.
     
  16. soniCron

    Indie Author

    Joined:
    May 4, 2005
    Messages:
    3,664
    Likes Received:
    0
    That's hardly a useful source to give when the title page has no less than 6 1280x1024 screens full of double column article links, and only go back to mid July. I can't imagine what the archive looks like. Either way, the only real information about this I could find on Seochat.com was this link, found using Google. I'll post the relevant information here:
     
  17. soniCron

    Indie Author

    Joined:
    May 4, 2005
    Messages:
    3,664
    Likes Received:
    0
    Well, I ran across that article you were talking about. (Here) From what I can tell, there's no basis for his statement, he doesn't back it up, and when questioned about it in the comments section, he states it as fact and leaves it at that. Hardly convincing.
     
  18. Didier

    Original Member

    Joined:
    May 23, 2005
    Messages:
    159
    Likes Received:
    0
    That's as far as it will ever get.
    Google will never post this info on their site because no-one will ever submit again via their "ADD URL" form.


    Found here: http://www.seochat.com/showblog/10563/How-to-Steal-to-the-Top-of-Google-part-2

    That's pretty clear to me.

    Now i don't know about you but these guys are dealing with SE's like we deal with games every day.

    I think the info on the site is pretty useful and up-to-date so i believe the guy.

    Didier
     
  19. AlexN

    Original Member

    Joined:
    Jun 25, 2005
    Messages:
    210
    Likes Received:
    0
    Holy monther of... I submitted my site to Add URL yesterday, and now my rank has been lowered. Crap, it used to be the first result when I search sphinxmedia on google, now it's only the third.

    But why would they do that? ...
     
  20. Savant

    Original Member

    Joined:
    Feb 8, 2005
    Messages:
    1,674
    Likes Received:
    0
    Two posts above that one he says:

    So ... is it harmful or not? He's really unclear in the way he writes.
     

Share This Page

  • About Indie Gamer

    When the original Dexterity Forums closed in 2004, Indie Gamer was born and a diverse community has grown out of a passion for creating great games. Here you will find over 10 years of in-depth discussion on game design, the business of game development, and marketing/sales. Indie Gamer also provides a friendly place to meet up with other Developers, Artists, Composers and Writers.
  • Buy us a beer!

    Indie Gamer is delicately held together by a single poor bastard who thankfully gets help from various community volunteers. If you frequent this site or have found value in something you've learned here, help keep the site running by donating a few dollars (for beer of course)!

    Sure, I'll Buy You a Beer