Author Archives: ModernStreet

Using robots.txt file to prevent search engine spidering

When a search engine spider vists a site, say http://www.YourSite.com/, first of all, it checks for YourSite.com/robots.txt. If the robots.txt file exists (you actually created one) it will look for this code. User-agent: * Disallow: / Sometimes, for certain reasons such as: sales pages site rules disclaimers privacy policies private pages contact pages (prevent spamming)… Read More: Using robots.txt file to prevent search engine spidering »

Domain basics

I have something to reveal, I’m a domaining enthusiast. Although I don’t claim to be a pro at it, but domaining is something that got me a lot more fixated with the web a long time ago and instantly gave me a presence on the web. Just register a domain and “voila!” you have an… Read More: Domain basics »

First post

I have been involved in learning online business for a while now; over one year to be more precise and during that time I have learned a lot about how the net works and of course, online business. But that isn’t to say I’m a pro, but rather I am just about getting into the… Read More: First post »