Quick Tip: How To Know If Google Is Indexing My Articles Or Posts

How to know if Google is indexing my articles? I think this is one of the most common questions I see in most of the bloggers group I’ve been into such as Facebook, forums, and even in small discussions with other bloggers. First, I wanted to share with you all that Google seems to have been very busy these last few days and I am not only talking about their Google Search department but also with their Google Adsense. But I am not going to discuss anything about Google Adsense here and let’s focus more about the question above.  It’s not a silly question and with Google Panda and Penguin around I bet even the old bloggers out there are becoming more and more paranoid with each articles they post on their websites.

Google Spider

Before you go out asking people questions like “is Google crawling my website and is it indexing my articles?”, you need to do some initial checking by yourself.  Also before you search on SEO and driving traffic into your website, you still need to know the basics of putting up a blog site.  And here is a list of possible checklist that you should consider first.  Note that these are all applicable for WordPress users but the same rule applies if you are using another platform.  And these are all just basic checklist that you can use. If you have more suggestions, it will be very much appreciated.

Sitemap

Yes even without a sitemap, search engine bots like Googlebots and other web spiders can still crawl your website and cache it but it will take a little while before you’d see your pages coming out from SERP (Search Engine Results Page).  A sitemap can be a document or XML that acts as a Table of Contents of your website. It consists all the available posts, pages, tags, categories, images, and videos you have on your entire blog site.  Having a sitemap on your root or public_html directory makes it easier for search engine bots to crawl and know the pages from your website. There are many free WordPress plugins that does the job. Personally, I’ve tried Google XML Sitemaps and Yoast WordPress SEO.  But the latter is a whole package and sitemap is only a part of it while the aforementioned focuses only on creating a sitemap for your website. There’s also a separate sitemap creator for videos, mobile, and images from Amit Agarwal that you can use.eyes4tech sitemap

Then you need to register or submit these created sitemap to search engines like Google or Bing (they use the same webmaster tools as with Yahoo!).

Robots.txt

This is yet another basic file that you need to ensure you have on your public_html or root directory.  It is a small configuration file that tells search engine bots which to crawl and which not to.  You also need to define your sitemap files within the robots.txt.  Whenever a search engine bot or spider visits your website, the first thing it checks aside from your .htaccess file is the robots.txt. The bot checks which can be crawled within your entire website and which are prohibited. With the sitemap defined within your robots.txt, you are helping and guiding the spider bots which to crawl.

robots-txt

Sitemap Submission

As I’ve mentioned above (under Sitemap), once you already have a sitemap in place you need to submit them to various search engines’ webmasters tools – i.e. Google and Bing.  These two search engines offers an online tool for webmasters and blog owners. You can submit your sitemaps and monitor it from there if it is being indexed or not. Along with this feature, you can also use some of the other tools within like the internal links, external links, crawling stats, your website’s health condition, and many more.

How can I check now if Google is indexing my articles?

Recently, Google Webmaster Central Blog announced the latest and newest addition to Google Webmasters Tools – Index Status (Dashboard -> Health -> Index Status). This is now the part wherein you’ll see and monitor if Google is indeed crawling and indexing your website.  If you are updating your website regularly and resubmitting your sitemap on every post then you should see from your monitor an inclining line graph.  I suggest you use the Advanced tab to get a more clearer picture.  This is one way of checking it.

Index Status

But the quickest way to check is by going to Google search engine website and check if your latest post if it is already indexed.  I have here an example recent post (posted just a few hours while I am writing this article).

site:www.eyes4tech.com “Top 5 Best Features of Apple iOS 6”

Google Indexed Articles

Or just type in the search field the title of your post enclosed in quotes, like:

Top 5 Best Features of Apple iOS 6

Both should show your post but the first one is a little more specific.

You can also submit your new post to Google Webmasters Tools’ Crawl URL. But there’s no guarantee that Google can and will index your page right away.  But there’s no harm doing it, so I won’t stop you.

Again, these are just the basic and I am excluding all other factors like if you made your entire website bearing a noindex attribute or if you have been affected by Google Panda or Penguin, or even worse if you have been sandbox.  It’ll be a different story.

Basically, that’s it. Check your own website now and have fun blogging!

About Arsie Organo

Arsie Organo also known as RC,is freelancer tech blogger who writes any tech updates, gadget reviews, tips and tricks, and many more. He also owns and founded Eyes4Tech.com and TechGazine.com - both tech blogs. For more information, you can follow his updates on Google+.

Comments

  1. Hi, When i search my site using “site:thedripple.com” it shows my latest posts, but when I search only for title, it shows nothing. Also I did not get any single traffic from search engine in last month, may be because my blog is new! Any tips?

    • Bro, I tried site:thedripple.com “Motorola Photon Q 4G LTE announced” on and I see your latest post.

    • Gautham Nekkanti says

      Hi Nik, If you mean your site doesn’t appear for the title without “site:” quotes you should probably work on off-site SEO and also on-site optimization.

      • Thank you for reply, I will be doing that only, does buying SEO packs from other companies helps?

        • Gautham Nekkanti says

          If you are going to target low competition keywords, it can be achievable by yourself. Guest Blogging and Blog commenting on High PR blogs will help (It is also great for traffic), I gave a quick look through your blog and found out you aren’t targeting any keywords, For example your post title ‘Windows 8 Coming on OCT 8″ Could be “Windows 8 Release Date”. And they are very competitive, you would need months of SEO services. E-mail for more help

  2. Thanks Bro for posting this.

  3. Shazida Khatun says

    Wonderful topics but information is not clear,so my request ,if possible then update the article such as
    1.How Google indexes page(s).
    2.Where from takes the urls
    3.What does happen the page
    4.How site admin confirm
    [please don’t mind for my un wanted suggestions ]

    • Thanks for your suggestions but this article is intended for those new interested bloggers. I’ve known some bloggers from my circle of friends who tried to put up their own self-hosted website but they were wondering why their posts are still not on SERP. I wanted to help them by providing the basics.

  4. Raaj Trambadia says

    Is this still necessary even for greatly optimized frameworks such as Thesis (I’m using that one)?? Nice tutorial BTW!

    • Thanks bro!

      • Raaj Trambadia says

        Excuse me? I asked you something Arsie! Are you sure that reply was for me?

        • Yes that is to acknowledge what you have said about the tutorial. About that question, is that really a question? I thought that it was a sarcastic statement because of the “??”. I was assuming that you don’t need this article since as you’ve said you are already using a “greatly optimized frameworks such as Thesis”.

          Well, from what I see when I checked your website you already have a sitemap and your latest post is already indexed in Google. 🙂

  5. Great tips. I searched and checked, luckily Google is indexing my posts all right. 🙂

  6. Nice to know about it but I think if you paste whole url of the post in Google then you will get to know if the post is indexed or not.

    By the way Nice post!

  7. PrIyAnGsHu says

    Hi Arsie, you have cited above almost all the possible methods to check whether an URL is indexed on Google or not. And as per Atish suggested, pasting the whole URL in the search box also lets us check its indexing status.

  8. Naser @ Tech Blazes says

    Hello Arsie, these tips are really helpful for newbie bloggers. I use BWP Google XML sitemaps on my blog, it is a lightcode version of the original Google XML sitemaps plugin but performs all the functions of the original version.

    • I haven’t tried that one but it’s good to know that there are other options for our fellow bloggers.

  9. Ehsan @ SEO Tips 2012 says

    Hey Arsie,
    This is nice information, but I would like to ask that is it important to use Google XML sitemap plugin to create a sitemap file?
    Personally, I have never tried any plugin for my sitemap, Instead I always used online sitemap generator websites to create a sitemap and uploaded it to my public_html folder!

    Your views on this?

    • @ehsan, from me experience it really doesn’t matter whether you do it manually or with a plugin for as long as it is there in your public_html and it is well configured. The only advantage of having a plugin (which if more helpful for beginners) is that they just need to install it, tweak a little and that’s it. The plugin will do the rest.

  10. I applied your tricks & my latest post is showing. Thanks for share

  11. devinder maheshwari says

    I got my articles indexed but it takes some time, why this happens?

  12. This is the one you added on your robots.txt
    Sitemap: http:// thetecnica. com/post-sitemap.xml
    But this page is not available.

  13. vishvast says

    hello
    Arsie Organo
    nice tips i tried a lot to check but i think google is not indexing my posts 🙁 thnx for this nice tips

    • My dear friend, have you checked your sitemap? I checked it and it only contains tags and your pages… check –

      And in your robots.txt I suggest add another line

      Sitemap:
      Sitemap:

      Then resubmit your sitemap to Google.

  14. sai krishna says

    Well explained again 🙂 But in these days search engine crawler rate is decreasing day by day. Only indexing quickly if its a well ranked blog with regular updates.

    • I agree with you about that, but there’s a way through GWT to adjust the crawl rate.

    • rakesh kumar says

      i do not agree with you sai krishna, if your blog / site is adding some thing every day, these crawlers comes everyday to index your site. Check it from you awast stats from cpanel.

  15. I followed the same steps to submit sitemap for my new site and it took just 5 hours to index my site with my first post.

  16. Ravi Shankar says

    I agree with you Arsie, these pandas and penguins are really taking the heck out of bloggers these days, one affected by any of these sinks down with very little hopes to recovers. As for the crwal thing, one must get his/her sitemaps in the eyes of the google bot, best way is to add a link of sitemaps on the homepage + addition of sitemap at GWT and addition of the sitemaps at the robots.txt file. Indeed a very useful article, newbies will surely benefit from this.

  17. Tejindra singh says

    Well written Arsie. Yeah GWT is the best way to index faster for a new post. many time i forget to submit my sitemap in GWT then its take a long time to index.

    • Yeah I noticed that also that when I am not submitting my latest sitemap to GTW there are times that it takes time before the Big g indexed it.

  18. rakesh kumar says

    The best part of your whole article is “How to check your indexed article” using site:” your article title”.

  19. I was little bit nervous aboy my site indexing. I follow your steps now I get to know that some of pages has been indexed.

  20. Nice article. I paste entire url on google search box to check if its indexed or not ..simple nothing else.Some time webmaster tool indexing factor not shows you latest data.

  21. That’s really nice info. I am stuck with google not indexing my posts on time and even for days. I dont have a robots txt file and definitely put it in my root directory.

  22. Jithin Johny George says

    I had followed all these steps, (i had done it already ).

    But google takes more than 7 days to index the new post..

    please help me.

  23. Jeet Dholakia says

    Hey thanks for showing this methods as I was looking for the same, many a times I couldn’t get it whether my article is listed or not but I like the way you have explained the methods and especially the last 🙂 which is quick and fast.

  24. Narender Chopra@Keyword Research Guide says

    Well I think frequently posting and regular pinging is the best way to increase crawl rate. My blog gets crawled every 30 Seconds.

  25. After how many hours or days google index our new post?

Speak Your Mind

*