OK, it's probably an Internet or computer term I and not familiar with but,
Who's Online
5 registered 2 guests...
0 Spiders???????
2012 Mustang Boss 302 #1918, Competition Orange. FGF replacement 2006 Mustang V6 Pony, Vista Blue. Factory ordered. 2019 BMW X3 (Titled to the wife, but I'm always driving it for her. So I'm claiming it) Old projects, gone but not forgotten: 1967 FB 400, original CA car. After 22 years of work, trashed by the guy who was supposed to paint it. I had to sell it. 1980 Turbo Trans Am 1970 Mustang fastback, 351C 4Bbl, auto 1988 Mustang GT, 5 speed 1983 F-150 4x4, built 302 1994 Chevy K2500 HD 4x4, 454 TBI
2012 Mustang Boss 302 #1918, Competition Orange. FGF replacement 2006 Mustang V6 Pony, Vista Blue. Factory ordered. 2019 BMW X3 (Titled to the wife, but I'm always driving it for her. So I'm claiming it) Old projects, gone but not forgotten: 1967 FB 400, original CA car. After 22 years of work, trashed by the guy who was supposed to paint it. I had to sell it. 1980 Turbo Trans Am 1970 Mustang fastback, 351C 4Bbl, auto 1988 Mustang GT, 5 speed 1983 F-150 4x4, built 302 1994 Chevy K2500 HD 4x4, 454 TBI
spiders crawl the web and are the internet version of computer bugs... you have to spray the apple machines every few months but the EPA of course dillutes the formula so it doesn't give mice cancer.. so it never really kills the spiders... just makes them sick but it slows them down so you can step on them...
Spiders crawl the web for content and what a lot of the search sites do to look for updated content. With that said, you should always see zero as long as they "listen" to my settings to "ignore" this board.
2012 Mustang Boss 302 #1918, Competition Orange. FGF replacement 2006 Mustang V6 Pony, Vista Blue. Factory ordered. 2019 BMW X3 (Titled to the wife, but I'm always driving it for her. So I'm claiming it) Old projects, gone but not forgotten: 1967 FB 400, original CA car. After 22 years of work, trashed by the guy who was supposed to paint it. I had to sell it. 1980 Turbo Trans Am 1970 Mustang fastback, 351C 4Bbl, auto 1988 Mustang GT, 5 speed 1983 F-150 4x4, built 302 1994 Chevy K2500 HD 4x4, 454 TBI
ya know people pay big money to se companies now...
but do I understand you as saying even with a <meta name = "robots" content = "noindex"> you are still getting searched?
I have confidential price lists on my website and the last thing I want is some google spider outting me!
hmm, I just looked at your source and didn't see the code in the header? aren't we comparing apples to apples on this one? how do you hide from spiders?
I was using the robots.txt and do not have it in the page coding. I took it out to see what it would do and if I liked the Google search better than the board search feature as I use Google as the site search engine.
I didn't like google as a search because they posted competitors in the paid advertisements next to the results of my website... so I use the hosts index to search...
anyways my website is no where near your level of traffic, but I'm definately interested in search engine ranking... I do use robots.txt, headers, keywords.. the pages have little graphics and long summaries, filenames and directories are keywords..