Robots.txt files are very basic in structure but play an important role in telling search engine crawlers what content they can and cannot crawl for indexing. The main purpose of this file is to prevent certain content within your website’s directories from being indexed and displayed in search engine results pages.

While there is no governing body that enforces whether crawlers are accessing content they shouldn’t, most crawlers are good and abide by the rules set forth in the robots.txt file.

When a crawler reaches your site, it first looks for this file which should reside in the main directory of your site only and nowhere else. If it finds one, it quickly scans the contents and its rules and proceeds if it is allowed.

Here is an example of how Google’s robots.txt file looks. You’ll see on the very first line some text that says “User-agent: *”. In simple terms, User-agent is a web crawler and the asterisk is a kind of “wild card” that states that ANY crawler can access the site for indexing purposes. There are ways to tell some crawlers they have the green light but block others within this first line, but for today we are just focusing on the simpler method of allowing all crawlers.

In order to determine if your site should be using a robots.txt file, take a look at your remote files and folders for your website. If you see directories such as /admin/ or /includes/ then they should probably be blocked from crawlers since they do not have any relevant content specific to search. An example of how this would look in your robots.txt file would be this:

User-agent: *

Disallow: /admin/
Disallow: /includes/

Here’s an example of how the URL would look if you wanted to review it in your browser:

http://www.yoursite.com/robots.txt

And that’s it! There are some other elements, however, that you can include in robots.txt such as your xml Sitemap location. This should not be confused with an HTML site map that lists the URLs of your site for easy navigation, though! I’ll be talking more about the importance of an xml Sitemap and how they differ from “site maps” in my next blog post.

Drupal

This CMS is a full scale website creation and management system. Drupal, which was released as an open source project in 2001, is built for easy web community integration and allows for large scale customizations. It has a large following, especially among developers who are very passionate about the system. Because of this, there are many custom built add-ons (known as modules) available. There are also many sites available for support and tutorials, which is helpful because of the steep learning curve associated with Drupal. Websites that require a lot of customizations will find Drupal to be a good solution.

Wordpress

Wordpress is another open source CMS that is often used as blogging software. With the recent release of version 3.0, there are new features that allow users to have more freedom when adding content other than blog posts, making it a robust content management system. Similar to Drupal, Wordpress has add-ons called widgets that can be customized and placed in different areas on the site without having to use code. Wordpress has a versatile templating system with many themes available. This CMS is perfect for blog-based websites with additional information pages and some unique functionality.

Joomla

Another popular open source CMS is Joomla, which was released in 2005. There are many free and commercial plug-ins available for the system that allow for customization of your website. Multiple templates are available for Joomla sites, which are easy to install and switch between. As with Drupal, there tends to be more of a learning curve, but it can be easily mastered with the proper set-up. Joomla can be a good solution for simple websites, member based websites, and sites that need a little bit of customization.

If you are interested in learning more about any or all of these systems then keep an eye out for the upcoming webinars on our webinar listing page. The Introduction to Drupal webinar will be held on Tuesday, July 13th and you can register for it here. I look forward to talking CMS with you!

Creature feature, the browser gods approve!

This new language has been given the thumbs up by major browsers with the guidance of the W3C organization (although not all support every single feature 5 has to offer). HTML5 is not a completed product, however it does lend some excellent features for developers to use.

• Specific tag names (header, nav, section, article, footer)
• New Doctype specification
• Specific field types for forms (url, email)
• Geolocation support

Dive-Into-HTML5 does a great job aggregating all of the functional detections for the new language.

Nice job, nerd…what does this mean for our company website?

Whether you have personally created and maintain your company’s website or if you have a web company do it, HTML5 creates the opportunity for your company website to give your users a more interactive experience using simplified code tags and multimedia compatibility.

The important thing to remember is that you don’t NEED to switch your entire company website to HTML5! You are able to use HTML5 attributes as they are fully compatible with HTML4.

What’s this all about Steve Jobs and Adobe Flash?

Basically, Mr. Jobs has a major problem with the proprietary animation software and it’s inability to function on his products. Touting his products compatibility with open standards languages (HTML5), Jobs gives a detailed description of Apple’s relationship with the animation software provider in an open letter this past April. What does this mean for HTML5? Widespread community support for fans of the major operating systems.

Want to see HTML5 in action?

First, check to see if your browser is HTML5 compatible with a compatibility test.
View some HTML5 demonstrations.

For news on HTML5 features and updates view these resources:

• http://www.htmlfive.net/
• http://www.w3.org/TR/html5-diff/
• http://html5.alltop.com/

Both the title and description should include keywords that you have selected for your website. Make sure your CMS gives you the ability to edit these on each individual page so that you can customize them and make sure there are no duplicates.

2. Has Friendly URLs for Content
Often when a CMS is installed the urls will have page id numbers and other system information in them. The ability to have useful urls that reflect page content is a must. Some CMSs allow you to specify what you want in each page url while others automatically use the article name. For example hallme.com/my-great-article is much better than hallme.com/articles.php?id=6054. Just make sure it is informative for both users and search engines.

3. Only One H1 Tag Per Page
The H1 tag is the header that appears in the page content as the title. It is important to have an informative and keyword rich header because this tells visitors what they are about to read and is also one of the first things that spiders crawl on your website. Some CMSs allow for multiple h1 tags or will automatically put the tag around your logo in the header. Others do not use h1 tags at all! You may need to configure your template so that it uses one h1 tag and then uses other tags (h2, h3, etc.) for the rest of the headers.

4. Ability to Edit Page Content
This should be an easy one to check off because if a CMS does not allow you to edit your content then it is really not a CMS. I have included this though because of how important it is to make sure that you use your CMS to create quality content using keywords.

Before even beginning development on your website you should be thinking about what keywords will be used throughout your site. Think about your target audience and what people will be typing in to search engines to find your content. Base your content on those keywords so that visitors see that you have what they want and stay on your site.

Last night the presenter told us that you do not want “false traffic” because you will have a higher bounce rate, so make sure your content is relevant. If you change your web strategy at any time, make sure to go in and edit page content so that it continues to reflect your keywords and calls to action.

5. Easy Site Map Generation
There are two types of site maps; an xml site map that is generated for Google and a site map that is a page on your website with links to all of your content. It is important to have an xml site map submitted to Google so that it is easier for robots to crawl your site. There are programs to create these for you and some CMSs include modules to create xml site maps, which can be handy. Having a visible site map on your website is also important so that users can find information quickly. It can be a pain to update the site map every time a new page is added so try to find a module for your CMS that automatically creates a site map.

6. Access to 301 Redirects
Use 301 redirects on your site to point any old urls to new pages on your site if you are doing a redevelopment. These are also used to point a www domain to a non-www domain or vice-versa. For example www.hallme.com and hallme.com both go to the same page, but if you look up in the url you will notice that the www is always there, even if you typed in the latter. It doesn’t matter which one you use, as long as you pick one and make sure that people can type in both to get to your page. Some CMSs allow you to make that redirect in the system while with others you have to use a .htaccess file. Find out what your CMS does and make sure you are comfortable with it.

How Does Your CMS Rate?

If you were able to check off each point for your CMS then you are doing great! If not, you may not have to dump your CMS, but you should do some research to find out how to apply these important elements. Just remember if your urls, headers, content, and site usability are good for the people who visit you website, then it is good for SEO!

Whether you are designing a brand new website, redesigning, or just have some web maintenance that needs to be completed, you should always keep in mind who your users are and how they will be using your site. You can balance the goals you’ve set out for your website with the goals your users have when they are using your website.

There are so many ways to enhance user experience on the web. Here a few things to keep in mind when thinking about creating the ultimate experience for your web users:

1. Easy to Find Resources
Make the key areas of your website easy to find and access. Always make sure the information on your site is organized in a manner that is logical to the user. Try not to bury content using sub-sub-sub pages – you don’t want your users to feel like they need a treasure map to navigate your site.

photo credit: Brymo

2. Customize & Personalize
Some websites allow the user to change preferences and customize the page with information specific to them. When I set up my Verizon wireless account online I was able to select my phone and my plan. Whenever I log in, the options given to me on my home screen always align with the products and services I have available to me depending on my current service plan. Now I don’t have to go searching around to find car charges and phone covers that are adaptable to my phone – Verizon has done it for me. Also, we have seen websites, such as Netflix, have much success personalizing their site by tailoring the movie options for the customer based on previous rentals.

3. Segment Your Users
If you are able to define specific web users that frequent your site, build pages on your website specific to them. Then, once they arrive on your site, filter them to those areas. This allows them to find the resources they are seeking easier and more efficiently.

4. Relatable
This can refer to the design and the language that you use on your website. You need to know who your users are and design your site in a way that makes them feel comfortable. Layout, color scheme, font, and imagery can help create an environment that relates to the demographic that uses your site. If there is data available to understanding how your users consume content, keep that in mind as well for help creating the layout. For example, there are very distinct differences on ESPN’s website and Martha Stewart’s website, based on the fact that there are two very different demographics using the sites.

photo credit: pursuethepassion

5. Good Navigation and Site Search
Poor navigation can crush a user’s experience on your site. A user should always know where they are, where they have been and where they want to go when they are on your site. We all know how frustrating it is to get lost when driving in unfamiliar territory, so make sure you use signals and give clear direction. If you have a particularly large website with many pages, a good site search function could come in handy. Think about it, if you have an e-commerce site and someone can’t find the product they are looking for (in a timely manner) they will not purchase it and you’ve lost a sale to your competitors.

User experience goes hand in hand with good customer service and in one way or another. In all human business, there is a level of customer service that is expected and desired. Any time we interact with a person representing a business it alters the perception we have of that business. The same is true for your website. When people come to your website you want to ensure they feel at ease and can easily reach their goals; whether they are researching or purchasing. You want them to leave your site knowing that they can conveniently find what they are looking for using your site and a good perception of who you are as a business.

The best thing you can do is to be aware of reviews people are putting out there (google your company every now and then) and make sure you provide effective success stories and testimonials that can be found on your site.

Using client testimonials on your site builds trust and credibility in your business; it shows that others value the service that you provide or the product you sell. A recent blog post, The Secret Life of Testimonials, published by copyblogger, discusses making testimonials more believable by using a “reverse testimonial” method. They suggest that admitting skepticism in the product or service in the beginning may, in fact, make your testimonial more compelling. The article makes some good points about using testimonials in the same manner that we talk to our friends about products we buy or services we use.

After working with a client or selling them a product you should request their feedback and ask for permission to use it on your website. Not only will the feedback help you improve your goods and services, but by putting it on your website you can provide future customers with an idea of what they can expect from your products or what it’s like to work with you.

Here are a few things to keep in mind when you put a testimonial on your website:

Use real people.

Include the customer’s  name and location with the testimonial. If it’s in context, add the  business name and a link to the company’s website. This shows that other people back up your work and builds credibility for your business. Be sure to ask for permission before putting this information on your website.

Keep it simple.

When you receive a testimonial from a client, you may need to refine it (with their permission, of course). Don’t use industry jargon, use the language you would use when you talk to your friends; in layman’s terms. Steer away from including overenthusiastic praises and overused adjectives. Do you ever watch those infomercials and notice how “passionate” the customers are and you ask yourself, “Real person or actor?” Most people can spot a phony right away, so make sure that the testimonial won’t sound fake to others. An authentic, easy to read testimonial should only include the most necessary information to relay a clear picture of the way the person felt about the product you delivered or the service they received.

Use examples.

Make the testimonial helpful by using examples of how your product or service has benefited them. Explain what their business was like before they bought your service or problems they were having before they purchased your product. You can enhance a testimonial by including hard evidence your client has noticed, like an increase in sales or the ability to provide better customer service.

Short and sweet.

No one likes to read a text-heavy website page, we are skimmers. Keeping your testimonials short and sweet (and to the point) increases the likeliness that people will actually read them. When refining a testimonial provided by the client, you should try to take key points that will demonstrate conclusive evidence.

Sometimes you don’t even have to ask for client feedback to gather a good testimonial for your site. If you get an email from a client you are working with who acknowledges your attention to detail or the timeliness of your responses, ask them if you can display their compliment on your site. Clients may also thank you publicly on Twitter or Facebook by tweeting or posting an appreciative message that you may want to re-purpose as a testimonial for your site.

Ask for permission.

Always, always, always ask for permission before putting someone’s personal information or a testimonial they have written on your site. Always. Nuff said.

Where to put testimonials?

Many websites use a specific page dedicated to testimonials and success stories. You might also want to think about matching a testimonial with the content on the page. For example, put a testimonial about someone’s experience with a product on the product specific page. This benefits the user because while they are obtaining information about the product they can see how it has positively effected someone else.  (Little secret, it might even help increase your website’s goal conversions.)

Using client testimonials will help build trust in your business, but they must be constructed and refined properly to be effective. They don’t have to be filled with fluff; just simple and factual so people will read them, and probably believe them. Then, most importantly, validate those testimonials with the work that you do and the products you provide.

More and more these days I am finding that clients are coming to developers with requests for using specific content management systems for their new site before they even think of what they want on their site. For example, “I would like a Wordpress/Joomla/Drupal site because everyone uses them and I heard that there is a great community around it.”

Any of those may be the perfect tool for many, but did that person think about what will happen if his site changes direction? What if that person wants to add community management or other custom tools? The original CMS choice may not be the best solution after all. There are many great CMSs out there to get any job done, but they are all essentially just tools.

Before you even begin to think about which system you want to use, make sure you have a solid goal for your website and a strategy in place to reach it.

Get Your Goals in Order

The first step to creating your new website is to think of your goals, both for the site launch and in the future. Why do you want a website? What will it do for your business? Consider your target audience and why they would want to visit your website. Spend time thinking about what you want your visitors to do once they are on the site and what impression they will get from your site. Don’t just put up a website because everyone has a website now-a-days and you just “need” one to survive. Make sure your website is up on the web with a purpose!

What is Your Strategy?

Once you have determined what you want to achieve from your site, plan a strategy to get there. Decide what type of content you will be putting on the site and come up with action items that will get visitors to interact with your company in the way that you want. Think about how will you be highlighting your products and services so that visitors will complete the action you have intended for them. Don’t get caught up in the details of “how” yet, figure out what you will be communicating and the response you want first.

Find that CMS!

Now that you have determined your website goals and overall strategy you can start thinking about the tools you intend to use to reach those goals. Create a list of requirements for your website. Did you decide that you are going to use images to display your product? Then make sure a photo gallery is listed as a requirement. Will customers be contacting you through the website? Add a contact form to your list. Think carefully about all the tools you will need to achieve your goals. If you are not sure what the best tool will be to help you with your strategy then brainstorm what you would envision on the website. Your web team can help you determine what tool will best fit your vision.

Of course picking the best CMS for your site is quite a process in itself. But if you know exactly what you need it to do for you then you should be able to select one that will work perfectly. Having the correct tools will be a great help in achieving your web goals, but no matter how great the CMS is, it can not make up for a poor web strategy.

While this is a widely used method of contact on the interwebs, it is not the best option available to you. They are the simplest form of communication between a user and company, but when the cons of this method are introduced you can start to see why your other options are better.

1. Spam Scrapers are little robots that come to your website and look for email addresses they can spam. When you have “Email Links” on your site, that address is vulnerable to these attacks. Coding Languages like JavaScript can be used to hide this information from the Scrapers though.
2. Not everyone has a Desktop Email Client installed on their machine. “Email Links” use a locally installed Email Clients like Microsoft Outlook or Mozilla Thunderbird to send mail. If your user does not have one of these programs installed, these links will be useless to them, and will not work as you intended. This problem can create unnecessary support calls for you and your team about “website issues”.
3. Managing your Business Contacts is becoming more and more important in today’s fast moving business world. When using “Email Links” on your site, you have to manually add each new contact that you receive mail from into your Contact List or System. This process is cumbersome and time consuming.

The most efficient way for users to contact you on your website are using Contact Forms. Contact Forms are more specific, and give you the opportunity to ask specific questions of the user. The addition of required fields allows you to guarantee you get all the information necessary for you Contact List or System. Generally you want to keep the required questions to a minimum, as the more information you require, the more users will decide to not fill out your form.

Contact Forms solve a lot of the problems with “Email Links”. The use of a Captcha Field on a Contact Form allows you to fool most Spam Scrapers and Robots trying to spam your email address. Captcha Fields are the images of letters, numbers, and words you sometimes see at the bottom of forms you fill out when surfing the internet.

Contact Forms are processed entirely in your Internet Browser and do not require any third party software in order for the user to complete. The information filled in by the user is automatically emailed to the specified email address for that form.

Contact Forms also make it much easier to automatically update the user’s contact information into your preferred system. This information can be stored in a number of different ways including but not limited to: Databases, Text Files, XML Data Sheets, etc. Hall has created a product called Contact that tracks all of your email contacts on any form filled out on your website. All the data is stored in an easy to access admin section, with options to view or export data from all your forms or any specific form on your website.

Bring your website back up to speed by switching to Contact Forms. You will save yourself the hassle of answering unnecessary support calls, reduce the amount of spam you receive in your email inbox, and will have the opportunity to start collecting your client contact information automatically. It’s a win-win-win.