So what’s cached?
If you visit Googl and find your website, you can click on cached link. That will open new window and at the top it will tell you last time spiders actually visited that page.
If they visited the page like a year ago – something is not very well with that page. They should come often, like every 1-2 weeks.
So how to index first of all internal pages and then get spiders to crawl them regularly?
First of all any page you have on your website should be linked at least one time from some other page.
The content of the page – if it’s a duplicate content of something already on your website or external website – make content unique and relevant to your site.
Meta tags, make them unique – unique meta title and description at least, descriptive to the page.
Create xml sitemap and submit it to Google. Create website sitemap and list all pages neatly and organized.
Remember here you are not trying to trick search engines, whatever you do you must input quality factors, your visitors in mind.
Those are the most common things why your pages are not indexed.
Let spiders move from page to page easily so they find all your pages. A website sitemap helps a lot.
You can also get backlinks to the pages that are not indexed. Probably the best way from articles so link to inner pages as well in bio section, sometimes.
Indexing internal pages is a matter of allowing spiders to reach them, showing spiders the content is worth indexing and valuable for users and telling spiders that other people or websites like the content (they are linking to it) by getting backlinks.
Adding fresh content on your website is the reason why your website cached copy is fresh. If it’s old, like a year ago that spiders last visited your website you have to add more fresh content.
Nothing special here, no hidden secrets, if your website is not having quality for your visitor why do spiders have to index or visit it regularly anyway?
Spiders come to see if you have anything new on your site.
Pinging blog is a way to call them if you add something new on your blog… always ping if you add new posts something spiders will see. Don’t call them if you just added a new picture.
I ping after posting always. There are many free pinging tools to use.
All blogs have an rss or atom feed too, which you can add to the pinging too. I also ping my content not just the blog. If I add really useful content that I think spiders should see quickly, I ping the page as well. Not just the blog.
That helps generate spider activity.
Check out Karl Sultana’s search engine ranking tips. He has plenty of free resources on his blog, including a free newsletter, Karl’s SEO Gossip.
