WorkingKnowledge

I intend to provide a public forum for instructional design ideas and theories, as well as a structured reflective space. Comments are encouraged.

Name:
Location: Atlanta, Georgia, United States

Sunday, May 29, 2005

Nuggets: Training Video

I'm cheating today, because I'm moving into my new house.

This is a training video on how to use a dial telephone. It was made back in 1927 (If I remember correctly).

My thought: they completely miss the attitudinal domain - their first demo should have been somebody happily reaching their party.

Sunday, May 22, 2005

SMART Goals

I first learned about SMART goals about two years ago. I learned that they were Specific, Measurable, Agreed-upon, Realistic and Time-bound.

About three month later, I came across a new definition: Specific and Measurable, Attainable, Relevant, and Time-bound. Since then, I have seen a plethora of SMART goals, each with its own combination of adjectives.

I think that all of the definitions are very good, and they are all trying to describe the same thing. This post is designed to be a definitive list. My aim is not to achieve a consensus as to what a SMART goal is, but to provide a list of adjectives that you can mix and match to suit your needs.

Please comment if you know of another definition.

S
Specific - Who, What, Why, When, Where, How
Specific and Measurable
Specific performance area

M
Measurable - Concrete criteria for measuring progress toward the attainment of each goal, measurable in ratio or interval terms
Motivating

A
Attainable - A stretch goal, but not an extreme goal
Agreed upon - All stakeholders agree to the goal
Achievable - Realistic given the situation, resources and time
Action oriented - Contains action steps
Aligned - Goals should align with the organization goals
Audacious

R
Realistic - Achiever is willing and able to complete goal; Goal is possible
Relevant - Goal is aligned with the company mission
Results focused

T
Tangible - Experienced through the five senses, does not involve personality or behavior
Time bound (Time framed) - Realistic time frames; Time table; attainable within a certain time period
Timely (Time stamped) - Target date is set
Trackable - Progress can be monitored

(E encompassing
R Reviewed frequently)

------------------------------------------------------------------------------------------------
09/18/07

Here's one for the designers among us:

Dance of Objectives:
R - Reasonable
U - Understandable
M - Measureable
B - Behavioral
A - Attainable

If you ask me, there's way too much lipstick on that pig. Good objectives can be graded on three easy tests:
  • What must the learner do with the information/skills after the training?
  • Of this, what can you guarantee the learner will be able to do after the training?
  • Of this, what can you test in the training environment?

Labels: ,

Sunday, May 15, 2005

Chaos and Complexity Theory

Chaos and Complexity Theory by T.J. Titcomb was published in the 1998 Annual ASTD Info-line.

The article provides a brief overview of Chaos and Complexity Theory, then applies it to managing organizations.

She defines Chaos as
"The study of behavior in systems that appears random but reveals orderly
patterns at deeper levels. In a business sense, it describes random,
inherently unpredictable sequences over time in the performance indicators of an
organization."

As I was reading the article, I connected these thoughts back to my thought-experiement "Is Structure Important" and also to a discussion about feedback loops that I had in a graduate Social Psychology course.

Systems with feedback loops are self-balancing. The analogy my professor used was that of a theromstat. If it gets too hot, the heater shuts off. If it gets too cold, the heater turns on. If you contrast that to an open flame on your stove, which does not stop heating food when the temperature exceeds a certain level, but will continue to increase the temperature until the house burns down. Feedback systems are self-organizing and have the potential to "learn."

This made me think of the BugBots at MIT. Instead of writing a huge, complex central governing program, which is preprogrammed for all possible responses to the environment, the scientists/engineers at MIT wrote a bunch of small simple programs for reflex-like actions, then linked them all together with a feedback loop. Essentially the robot "learned" to walk each time it was turned on. It would run random programs and assess its motion. If it was moving forward, it would continue running that series of programs. If it was not moving forward, it would continue to try different random patterns of programs. It was very simple, elegant solution and it allowed the robots to operate in real-world environments. Before, using the central governing program, the robots could only respond in very specific environments to very specific cues. Essentially, the MIT people created a chaotic system that was self-organizing through feedback loops.

Feedback loops also made me think of the Thiagi workshop. Beyond the games and the interactions and the content, the one thing that he emphasized as being absolutely essential was the tests. That was where we were to concentrate everything we knew about instructional design. All of his training courses had the criteria that the students HAD to pass the test to pass the course. So if the tests were instructionally sound and really, truly measured the behavior that we wanted to change, then it didn't matter how the students learned the content: if they passed the test, they were able to do what they needed to do.

That is the key to the Thiagi design methodology and the answer to "Is Structure Important?" Structure is no more important than having a perfectly designed central governing program. Structured designs are efficient, programmer-centric and limited. It's the feedback loops, the tests that count, because that is where students measure and change their behavior.

Cubicle Farm Supplies: 3M Mounting Squares

I love office supplies. I spend valuable time thinking about what I need to make my worklife easier. I also think about how my office supplies could be made better.

One item that I wouldn't change at all are my Cubicle Mounting Squares. They have a sticky side to stick on your documents or pictures and a velcro side to stick on your cubie wall. It makes it very convenient to keep your reference documents handy. Then, when you want to file your documents away, you just peel off the mounting squares and use them on your new important documents. The mounting squares don't damage your walls and can be carefully peeled off your documents without damage.

Your documents and pictures will have clean, professional appearance as compared to your coworker's combinations of tape, thumbtacks and paperclips. I'm sure you will also find other ways to use them. I know I have. I'm on my fourth package of 35 squares.

Saturday, May 14, 2005

Nuggets: The Wisdom of Crowds

For much of my life, I knew that the consensus was the right way to make a decision and that popular culture always chose the mediocre. I laughed up my sleeve at one of my schoolmates who thought that Michael Jackson was amazing, then took up Prince as Prince became more popular. She swore that she was choosing artists based on ability, but it was apparent to me that she was picking the most popular ones. But, you know, Prince really is one of the best pop artists of his generation.

By the time I realized that, I was preparing myself to become a Social Psychologist. I learned all about group-think, decisions made using faulty heuristics and how to sway people's attitudes. I learned just how dumb people can be. But, you know, people aren't that bad at surviving in the world.

The Wisdom of Crowds, by James Surowiecki, has finally convinced me that M.J. and Prince really are the great artists that they appear and that groups of people really are smart enough to survive in the world. And maybe consensus really isn't best.

Friday, May 13, 2005

Wicked Problems: Naming the Pain in Organizations (Nuggets)

http://www.touchstone.com/tr/wp/wicked.html

5/2/05
Some problems are so complex that you have to be highly intelligent and well informed just to be undecided about them. -Laurence J. Peter

This article offers insight into why some projects - especially project meetings - are so difficult. The insights suggest clues about how to dimish the pain and allow people to be more productive. I found it to be a stimulating source of ideas.

5/13/05
Today at lunch I had a conversation that clarified my thoughts about this article. One instructional designer mentioned a colleague who was unable to accept continually shifting project parameters. She stated that you had to accept a certain amount of change as part of life. Another colleague agreed, but added that the change should be minimized.

After reading "Wicked Problems," I have a new perspective: perceiving change as something bad or to be avoided misses the point. The question is not whether change is good or bad. It's an intrinsic part of creative work - no change, no creativity, no problem-solving. The questions are "What are you changing?", "Why?", and "Can you still meet the deadline?"

If you wake up one morning with a terrific idea for a module - one that is interactive, exciting,
can be taught in half the time as the one planned, and will result in better participant understanding - do you toss the idea because it wasn't on the design document and will take an extra day to create? Or do you ask yourself "Can I meet all my deadlines?" and work your butt off creating an exemplary product?

Right, I thought that was your answer. And if you have a design project where that doesn't happen then you need to get new designers.

Thursday, May 12, 2005

Thought Experiment: Tsunami

5/12/2005
Another thought experiment:

You have been given the task of creating a training program to educate some villages located on the Indian Ocean about the warning signs of a tsunami and to set up a grassroots alert system. Currently, there are several ambitious projects in the works but it is likely these will be abandoned over the years due to scarce resources or civil unrest. This is especially true as the memory of the tragedy fades and officials start assessing the small probability that a tsunami will occur again in the Indian Ocean.

You would like to create a training program that is not dependent on outside resources, but is something that villagers will adopt on their own to train upcoming generations.

There is a reasonable amount of time and resources available to complete the program.

What would you do?

6/14/2005
In my scenario, I had a couple thoughts:
  • It unlikely that another tsunami will happen sooner than a decade, so it would be easy for any knowledge to become rusty with disuse.
  • The enterprise needs to be bottom-up and self-sustaining.

This means that the training should become an important cultural element of the villages. Thus, much of my analysis would be focused on the learner and his/her society. I would try to discover in my analysis:

  • What sorts of oral teaching traditions the culture has already? Perhaps the story of the tsunami, already of high emotional value, could be part of the village's saga and could include the warning signs of the tsunami with the correct actions.
  • What type of person is most likely to spend their day on or near the beach? Watching for the warning signs of a tsunami could become an official or an informal component of this role.
  • Nuggets: Beyond Bullet Points

    I just participated in an online seminar: "Beyond BulletPoints." I am awed, almost teary. This is the "right" way to create PowerPoints.

    I've known for a long time that the Power Points I produce are wrong. I personally use a very lean style when I present, a few words, a few bullet points, and I try to hold thoughts together with graphics. I know it could be better, but I'm not sure how.

    "Beyond BulletPoints" is the culmination of what I've been trying to achieve. It lays out the step-by-step process for developing electric, compelling presentations. In fact, I see it as offering a quick and dirty way to design and develop instructional content - it effortlessly fulfills the ARCS model.

    In many of the projects I've worked on, Power Points are on-screen student guides. We actually create the student guide by copying the Power Points into a Word document with room for notes. This never felt right: it wasn't presenting the information in the most learner-friendly format. It was very passive for the learner. "Beyond BulletPoints" provides a methodology to eliminate that horrible practice, but also reducing the time it takes to update or correct our presentations.

    This is a must-read. This will be state-of-the-art in a very few years.

    You can view the seminar here

    Tuesday, May 10, 2005

    Change or Die: An analysis of people and change (Nuggets)

    This is one of those life-changing articles that awakens the truth beneath the jargon.

    This is what Daily Links said about it:

    "I finally got a chance to read this heavily blogged article. This is one of those articles that give me the Aha! feeling. Change and change management has always been viewed as a complicated subject, but as this article shows, it’s just about being humane. Here are the three steps: 1) re-frame the reasons for change to make it beneficial, 2) accelerate the change process so that changes are visible, and 3) support the change."

    Monday, May 09, 2005

    Is structure important?: Testing the limits of instructional design

    After Thiagi's workshop in Vancouver, I proposed a thought experiment. One of the tasks of the training department is to train our new, inexperienced salespeople. So, what would happen if we didn't "train" our participants, but asked them to construct the learning on their own?


    The students would be given an agenda at the beginning of the workshop. This includes pre-scheduled session dates (such as the distance learning sessions or scheduled expert assistance) and a list of graded deliverables including tests.


    All current resources would be available:



    • Computers connected to our intranet

    • Current facilitator guides

    • Current facilitator PowerPoints

    • Facilitator available to respond to questions and requests

    • Product information

    • Top student deliverables from previous classes with the grade noted.

    • All online and CD based demos, etc.

    • Distance learning schedule

    • Resource books

    • Other expert assistance available

    At the beginning of each day, students would receive a practice test with 10 questions from each content area. An answer key would be available upon request. The students could work separately or together to learn the material on the test and answer the test questions.


    At the end of each day, the students would individually complete a graded on-line practice test with 10 unique questions from each content area for that day. The score would be part of their feedback, but would not be recorded in any way. The students would be educated that their scores would not be a part of their evaluation.


    At the end of each of the two weeks, the students would take a cumulative exam testing each content area addressed that week. The week one and the week two tests plus the graded deliverables would constitute their final grade. A serious number of points would be deducted if their work appeared to be a close copy of the sample deliverables. If the students do not pass the class with an 85 percent or better score, they would not become salespeople with the company. They would be informed of this standard at the beginning of the training workshop.


    The feedback I received on this thought-experiment was that students, given two weeks to learn the material in this way, would spend all their time complaining about learning the material this way and so would learn nothing.


    This provides a very down-to-earth critique of forcing the students to provide all of their own structure. I think that this posited reaction is due to a perceived violation of an unspoken contract between learner and teacher. The teacher is "hired" to provide information in digestible chunks for the students. If the students could learn the material independently, then they shouldn't have to come together for a training workshop. There is also the heuristic: The training was hard, thus I learned a lot. Forcing a learning experience on students that are not culturally ready would be counter-productive.


    On the other hand, knowledge doesn't come from the mouth of the facilitator. It comes from the mouth of the student. By this I mean that the best lecture in the world is a waste of air, unless the participant is able to remember and apply the knowledge and skills they were supposed to learn. If they can do this, then it really doesn't matter how they learned it.


    The thought-experiment points out that, though the student needs to own the material, foisting complete responsibility for the learning process on an unreceptive audience is not the answer. On the other hand, it asks me to evaluate whether each module or lesson needs to be as structured as it is today. Are there areas where the student might be engaged by increased responsibility?

    Sunday, May 01, 2005

    Putting Meat in Your Models: Back to the basics

    Models. They list steps, key points, features or act as memnotics. To name a few,

    RICE: Rest, Ice, Compression, Elevation

    ARCS: Attention, Relevancy, Confidence, Satisfaction

    SPIN Selling: Situation, Problem, Implication, and Need-payoff

    ADDIE: Analysis, Design, Development, Implementation, Evaluation

    Three body types:

    • Ectomorph – Model-thin, without much muscle

    • Mesomorph – Muscular, athletic

    • Endomorph – Curvy, easily puts on extra pounds

    These are all great tools to simplify complex concepts or processes so that key features can be taugh, or to provide a language for basic discussion. Unfortunately, many times models are taught as an end in themselves.

    For example, when I was growing up, I learned the three body types and that I was an Ectomorph. What does it really mean that I'm an Ectomorph, besides that I was skinny? What choices should I make based on this information? Did I change body types as I became 30 lbs overweight? I didn’t know; I just knew the model. It was a nice-to-know.

    Years later, when I learned about the body types in the context of fat cells and muscle cells, it all became clear. The number of fat cells in your body remains constant: when you get fatter, the fat cells get bigger. Muscles do grow, but each body grows them at a different rate. Endomorphs are naturally “blessed” with a lot of fat cells and less muscle, Mesomorphs are just the opposite: lots of fast-growing muscle cells and fewer fat cells, and Ectomorphs don’t have many of either. Understanding the impact of my natural fat and muscle potential took me beyond the model and into real-life decisions. When I say that I’m an Ectomorph, I’m not saying that I’m thin and don’t have much muscle right now – I might be gaining weight or working out – I’m saying that no amount of working out will give me huge muscles. It also means that it’s a bit harder to gain weight and easier to lose it than some people. This is useful, relevant information: a need-to-know. The model now helps me determine whether my exercise program is successful or whether I should work harder, for instance.

    The model allowed me to recognize general body types, but I needed more to apply this knowledge in a useful way. We can't assume that reciting the model gives our students the ability to make more informed choices. We need to explicitly draw the connection between the model and the real world.

    Low trust situations are another area where models are misused. The designers and SMEs don’t trust trainers or students. The trainers don’t trust themselves or the students. And the students don’t know any better. In this environment models are easily used to teach basic content regardless of the students’ prior knowledge. In many cases, the model gets between students and the correct performance.

    In one workshop, front line managers, who - as a group - knew basic and intermediate communication principles, were unable to apply their existing knowledge on the job. They would yell or close off communication with their employees. To fix this, they were taught four different, new, communication models. While it may have been useful to teach them the Seven Levels of Severity and Urgency (i.e. when it’s really appropriate to yell), it may have been much more effective for the students to build their own model, testing it against a variety of pre-written “difficult” scenarios. Not only would they “own” the model but it would be tailor-made to the participants’ unique job challenges. As a group they had the knowledge and ability to do this, but instead were given yet more knowledge. Though, to be fair, they did role-play with the new knowledge.

    The fundamental problem with the workshop was that the trainers weren’t comfortable with “touchy-feely” content; neither were the SMEs, who also felt that the managers wouldn’t be open to unstructured content; and the designers were focused on writing good multiple-choice questions.

    To find the answer to both types of model misapplication, lack of relevance and underestimating the learner, we must return to the fundamental principles of instructional design: learning is a change in behavior. It is behavior that will close the performance gap. And that’s what you should test - the performance gap:

    • “What results should you expect from a good exercise program?”

    • “Your employee forgot to put out a ‘wet floor’ sign for the third time, creating substantial liability for your company. You have less than five minutes to deal with him today. Make sure that this doesn’t happen again.”

    The focus on the problem - not the model - and the appropriate testing that goes hand-in-hand with this focus, allows us to trust that our students will develop the "right" answer on their own.

    I'm not saying that models are useless. As I stated in the beginning, they can provide missing expertise, speeding our students’ ability to problem-solve in the real world. But without the focus on the performance gap, the testing, and the trust, models become Endomorphs: lots of fat but no meat.