Your Source for Learning
Technology, Strategy, and News
    [Forgot Password?]
ARTICLES      
RSS feed RSS feed

Research for Practitioners: How Expert Designers Design

“The contexts of academic and corporate designers are different—the cultures are different, and the organizational goals and objectives are different. While prioritization of design principles for successful projects in academic versus corporate setting may differ, the actual principles are quite consistent across both.”

Let’s be honest. Not everyone who is creating training or learning materials or experiences has actual training in instructional design (ID).

Sometimes, by virtue of subject matter expertise, people find themselves placed in a position to develop training without the benefit of understanding instructional design. These are instructional designers “by assignment” rather than by training. So for those in such a position, how do we help them to at least understand how instructional designers design?

The question

What do instructional designers actually do when designing competency-based learning environments? A study by Paul Kirschner, Chad Carr, and Jeroen van Merrienboer looked for an answer.

Some definitions, according to this study:

Competencies: abilities that enable learners to recognize and define new problems in their domain of study and future work as well as solve problems.

Instructional design: the ideas, plans, and rules of what has to be done or could be done in order to develop instruction of knowledge, skills, and/or attitudes—the explanations and assignments to promote learning and reach a learning outcome that is described in advance.

The study

Kirschner, Paul, Carr, Chad, and van Merrienboer, Jeroen. 2002. How Expert Designers Design. Performance Improvement Quarterly, 15(4), 86-104.

The background

In their review of the literature, the authors shared their findings about how designers actually design. They found some common themes. Instructional designers (1) design in an iterative, solution-oriented, and context-sensitive fashion; (2) are selective in  their choice of ID model prescriptions; (3) stress the importance of communication, especially with stakeholders; (4) greatly differ in expert performance; and (5) are influenced by their theoretical background (frame of reference).

The method

The three investigators designed a two-part study focused on (1) determining the priorities of expert designers and (2) identifying their actual approach to design. Participants were expert instructional designers—nine from an academic environment and six from a corporate or consulting environment.

Experiment #1

From a list of 16 design principles, participants were to determine their top three, the ones that they considered the “most important to the success of a design project,” and then the top three that “need the most improvement.”

Experiment #1 results

Table 1 shows the aggregated results of the important design principles and those needing most improvement from Experiment #1 (in order of importance). While there are commonalities in the choice of principles involved in good design, the prioritization within each environment differs.

Table 1 Experiment #1 results (aggregated)

Design Principles

Academic priorities

Corporate priorities

Important

  1. Start with learner needs, rather than a content-oriented structure.
  2. Consider possible alternate solutions, even if there is a potential solution idea at the start of the process.
  3. Make a prototype early in the design process.
  4. Split the design process into phases
  5. Create ownership with clients and stakeholders (buy-in).
  6. Base work in scientific knowledge and principles as much as possible.
  7. Show products from previous projects to help clients choose solution or set specifications.
  1. Make a prototype early in the design process.
  2. Create ownership with clients and stakeholders (buy-in).
  3. Show products from previous projects to help clients choose solution or set specifications.
  4. Start with learner needs, rather than a content-oriented structure.

Needs Improvement

  1. Create ownership with clients and stakeholders (buy-in).
  2. Base work in scientific knowledge and principles as much as possible.
  3. Start with learner needs, rather than a content-oriented structure.
  1. Consider possible alternate solutions, even if there is a potential solution idea at the start of the process
  2. Show products from previous projects to help clients choose solution or set specifications.
  3. Start with learner needs, rather than a content-oriented structure.
  4. Consider possible pitfalls or problems of design and implement phases during analysis.

Experiment #2

The investigators assigned the subjects to a specific task: to create a preliminary design for a post-graduate program in environmental consulting for a consulting firm. Designers were supplied with a task description, high-level generic competencies, and the goal of the consulting firm regarding their need for training, along with competency elements and performance criteria. In teams of two, participants had 90 minutes to complete the preliminary design.

Experiment #2 results

Even though the identification of design principles for successful projects was overlapping between the groups, their actual approaches to design were different. While the academic group focused more on task analysis, the corporate group focused more on the client and gaining buy-in through a showcase of successful projects.

Initial design approaches of the academic teams:

  • Team A1 conducted a detailed task analysis, mapping problem-solving approaches used by experts plus generation of learning tasks.
  • Team A2 made an inventory of tasks normally carried out by expert environmental consultants (the inventory is also known as a task analysis).
  • Team A3 produced a project plan for client approval consisting of problem description, audience analysis, gap analysis (knowledge and skills), project constraints, and sequencing of learning tasks.

Initial design approaches of the corporate teams:

  • Team C1 conducted a general needs assessment (hypothesis generation plus validating through focus groups and observation) followed by gaining client buy-in for work yet to be performed (showing successful projects and presenting “what works”).
  • Team C2 identified best practices within organizational policy to create an objective or competency map, followed by a target audience analysis.

Implications for eLearning design

The contexts of academic and corporate designers are different—the cultures are different, and the organizational goals and objectives are different. While prioritization of design principles for successful projects in academic versus corporate setting may differ, the actual principles are quite consistent across both. If you are just starting out with your eLearning design, include these among the principles that you follow:

  1. Start your design with consideration of the learner needs rather than a focus on the content of the specific domain.
  2. Prototype early in the design process (it’s an iterative process).
  3. Establish and maintain good communication with stakeholders and clients to ensure buy-in.

(42)
I appreciate this article

Comments

Login or subscribe to comment

Be the first to comment.

Related Articles

It’s easy to be overwhelmed by all the new technologies coming into eLearning: mobile apps, 3-D virtual worlds, geolocation, MOOCs, new development tools, and on and on. But the value of any eLearning project rests on effective instructional design, not on technology. Twelve experts provide their top design tips in this eBook and in the upcoming Online Forum (February 21 – 22, 2013).
Looking for a new career? Think you have what it takes to be an eLearning specialist or manager of eLearning? Here are the nine things you need to know on your first day in your new career … or maybe the nine things it would still be good to know even if you’re already on the job.
Many of us start a new year with resolve to do better things and to do things better. Jane kicks off 2013 for Learning Solutions Magazine with three excellent resolutions and some concrete suggestions about how to make good on them.