Apparentlly last time when Google Bot crawled my website, it was when my site was down thanks to my webhost. Now that I search sphinxmedia, it doesn't appear corrently. Worst, it seems that my company name SphinxMedia Software has been wiped from Google. (It used to my site when I search SphinxMedia, or SphinxMedia Software) I know yahoo has a "submit your site" link, but I can't find it on Google. How do I invite Google Bot to re-crawl my site?
I'm sure Add Url will work (eventually), but they're far less effective than they used to be. The best and fastest way to get your site crawled by Google (and other search engine bots) is to set up a link exchange with a few other sites. When Google crawls any of the other sites (which is usually every couple of days for most sites), it will find your site through their link section and you'll be "On the Map" within a few days. Exchange links with someone who has a PageRank of 5 or more and you'll be ready to go in no time. Much faster than using the "Add URL" submission forms. Some webmasters even joke that Google automatically blacklists sites that use that form.
I'd eat my hat if he can find anybody with a pagerank of 5 or greater to link to his site before he puts anything on it.
I had a bit of a fight trying to get one of my sites on Google a couple of months ago. This is what I learned. 1.) The Add URL will tell Google about your site, and they'll crawl it. 2.) If you want to be listed higher than page 12 (or so), you need people to link to your page. Either a couple of links from sites with high pageranks, or many, many links from sites with low pageranks. 3.) Pages with only lots of links to other pages are ignored by Google, for ranking reasons. 4.) (Obviously) Banners doesn't count, unless they link DIRECTLY to your page (not via some banner management script) 5.) Getting listed in directories like DMOZ and Yahoo (surprisingly) helps a LOT 6.) Google works on it's own timetable. Have your site submitted to them now, they'll crawl you in three weeks and list you a month later. You must be patient. 7.) Apparently the GoogleBot can sence incomplete or "under construction" sites, and will not include a site such as this in it's database.
https://www.google.com/webmasters/sitemaps/ This can help Google improve the way they crawl your website. For instance you can tell Google bot to crawl a page more frequently if it contains stuff that is changing very often (a news page etc.) It's a XML file that you put in the root of your website and register it with Google. The site listed above contains some Python tools for doing that.
It's true and that is no joke. They don't blacklist your site but your rankings will be limited when you do this. So, don't submit to Google, let Google come to you. Submit to Dmoz directory and eventually google will find you ;-) Didier
Interesting. I didn't know that. Could you post your source for this information? I'd like to read more about it.
@AlexN IMHO you don't have to do anything at all. There is already a link to your site from this presumably high ranking site (Indiegamer). So no doubt Google will find you. Like someone else here said, be patient. Mayhaps the best thing to do is to spend the time and efforts on improving your site further and creating more interesting content for it.
I have to question this sort of thing when I hear it. Why would Google do that? What's their motivation? I can't think of a single way in which doing that helps Google.
That's hardly a useful source to give when the title page has no less than 6 1280x1024 screens full of double column article links, and only go back to mid July. I can't imagine what the archive looks like. Either way, the only real information about this I could find on Seochat.com was this link, found using Google. I'll post the relevant information here:
Well, I ran across that article you were talking about. (Here) From what I can tell, there's no basis for his statement, he doesn't back it up, and when questioned about it in the comments section, he states it as fact and leaves it at that. Hardly convincing.
That's as far as it will ever get. Google will never post this info on their site because no-one will ever submit again via their "ADD URL" form. Found here: http://www.seochat.com/showblog/10563/How-to-Steal-to-the-Top-of-Google-part-2 That's pretty clear to me. Now i don't know about you but these guys are dealing with SE's like we deal with games every day. I think the info on the site is pretty useful and up-to-date so i believe the guy. Didier
Holy monther of... I submitted my site to Add URL yesterday, and now my rank has been lowered. Crap, it used to be the first result when I search sphinxmedia on google, now it's only the third. But why would they do that? ...
Two posts above that one he says: So ... is it harmful or not? He's really unclear in the way he writes.