It is that time of the month again. Three months on in this personal site experiment, and it has been a bit of an adventurous month, even if a slower one on the traffic front.
Traffic
Traffic levels reduced even further this month. There were no sudden spikes or surges, but the steady trickle continued for my ever popular article on Taking Professionl Photographs. Other articles got some action too, most of which are mentioned in the Best of SamirBharadawaj.com list in the sidebar. Check them out.
Over all, my traffic reduced by half from last month’s average, but that statistic is very skewed by the fact that the first week of June had my higest traffic figures by many magnitudes, as compared to the weeks that followed. It has really been more of a gradual decline rather than a dramatic crash. Also, part of the traffic reduction might have to do with the server troubles I had during the month of July, which I will talk about shortly.
Blog Carnivals
Due to my increased submission activity over the past month, it was simply not feasible to wait for an entire month to list blog carnival inclusions for articles on this site. So, on two different occasions in July, I posted lists of links to the various carnivals. Those lists can be found here:
Carnivale! July 18, 2007
Carnivale! July 31, 2007
CPU Load Adventures
Towards the middle of the month I got a dreaded email from tech support at my web host Lunarpages that my account was contributing too much to the CPU load on my server. But as was my previous experiences with the support staff, they were extremely helpful and methodical about the issue. They had seamlessly moved my sites to a temporary holding server while I figured out what I could do to reduce the load and bring my account back into compliance with the usage limits.
I host a few sites at my account but all the others are really in the test phase and act more as holding spots for now. I was pretty sure my other sites had no chance of causing the computational load since they got almost no traffic. That meant that this very site, and specifically some element of my WordPress blog install was causing the trouble. The problem was that even back then I knew I was getting the least traffic I had ever gotten and so this was the most unlikely time for the core of WordPress to be leeching on server resources.
I set out to figure out what had triggered the Intel-spasm, with the ever available CPU usage reports and help from the Lunarpages team. My server logs showed no spike in activity, but I knew something had to have caused the sudden change so I dug deeper. Finally, I went to Google’s Webmaster Tools and there discovered that the GoogleBot had come visiting on the day in question. But, I knew that that in itself was not a remarkable occurance. The GoogleBot visited often without setting off any alarm bells, so what was so distressing about this particular occasion?
Ultimately I narrowed it down to the fact that I had the Global Translator Plugin running on my site. The plugin allows a site to be automatically translated into other languages, along with the ability for search engines to crawl that translated content. Like others I too realised the need to enable caching in the plugin to prevent access errors very early on. This meant that the translation was stored on the server rather than carried out dynamically with every request. It made things a bit faster and less intensive for the translation sites, but what about my server? It would all be fine if regular browsers hit the translated pages erratically and the translated pages were cached over a period of time, but when a search bot sequentially looks through hundreds of translated pages which haven’t been cached, suddenly the server has to deal with the mammoth task of reading, fetching and creating cached versions of hundreds of pages at one go. To the best of my knowledge and guess work, that is exactly what happend on the fateful day, and it shot my server CPU usage through the roof setting off all the right warning lights over at Lunarpages.
I removed the translation plugin, and in a few days the Lunarpages support staff reinstated my account into the original server because CPU usage had reduced to acceptable levels. It is a shame really, because almost all of my site including the cumulative mass of thousands of translated pages across many languages had been indexed by Google over the two preceding months. I was even getting a trickle of traffic through foreign language searches which would have increased with time. Now I have been forced to forego that and negatively affect my search engine status due to the large chunk of missing pages.
I might try this or a similar translation plugin again in the future because I still like the idea, but I won’t tackle that untill I have some way to prevent something like this from happening again. In the meanwhile, after the fact I also loaded WP-Cache to run more universal caching on the WordPress site just to be extra safe.
Over all no harm done, other than the search engine set backs that I have yet to fully fathom. I certainly learnt a few lessons in web hosting, and my thanks to the good people of the Lunarpages tech team for all their help along the way.
ToDo
Traffic, traffic, and traffic. The most important asset of any site, and I am in need of plenty of it. That is what I need to work on, along with plenty of new content. I really have given up on any artificial rules about daily posting frequency, because at the end of the day that is simply not the way I work, and forcing myself to stick to that kind of schedule will just make me miserable. Instead I plan on sticking to coming up with truly useful and well-put-together content. That will satisfy me more than anything else and hopefully the readership will follow with a little marketing. Plenty of plans brewing on that front.
Part of the long term plan of growing an interested and engaged audience with good content is to increase RSS feed subscribers. One step I took towards that this month was to convert this site over to a full text RSS feed so that more people might sign up for the updates. If you haven’t done so yet, please subscribe to my full feed RSS to keep track of all the great stuff coming here soon.
Meanwhile, on a more frivolous note, John Chow mentioned a passing glitch over at Technorati that (at least at the time of this writing) was displaying every blog as ranked number 1, and so also included in the Top 100. Woohoo! The requisite screenshot was taken for posterity, ego boosting, and all those chicks I plan on impressing with my little high-resolution photographic glossy-paper print out of my new found faux Technorati success.
Watch out ladies. My Technorati rank is bigger than yours.
If you enjoyed this post, make sure you subscribe to my RSS feed!
