Superstition Ain’t the Way

Definition of a Superstitious Behavior: Accidentally or unintentionally reinforced behavior where a behavior is reinforced but the reinforcement occurred by random chance instead of in accordance with a specific contingency.   —From the Association of Animal Behavior Professionals glossary

My little black cat Arabella never brought me bad luck

I wrote when I started this blog that I was going to share my mistakes in the hopes of helping others learn. Here are some nice big embarrassing ones, but at least they date mostly from my earlier training days.

When one of my agility buddies encouraged me in 2008 to start using a clicker, I didn’t know that I should practice timing. I didn’t know that there was mechanical and observational skill involved. It just seemed like a fun thing and I had heard that dogs really got motivated and enjoyed it. So I also didn’t know that it might be a good idea to start with something relatively unimportant, perhaps with gross motor movements that would be easy for me to perceive and mark.

What I did was to get a really loud box clicker and decided right away that my first project would be to click Summer for eye contact.

Uh oh.

The very first behavior I actually _got_ with a clicker was a head nod. I realized this after a couple of weeks. But even though she did learn (despite me) that I was clicking for eye contact, the head nod remained, but drifted to the period after the click and before treat delivery. The sequence went: eye contact, click, head nod, treat. The nod, immediately preceding the food, accordingly got a ton of reinforcement.

Four years later, I still get little nods from Summer. Interestingly, she doesn’t offer it in shaping sessions. When it comes back, it is in its old place between the marker and the treat when I have just clicked her for something else.

It has faded some over the years but I found a couple examples. Want to see?

This is an example of a superstitious behavior.  And it turns out that I am really good at creating those!

B.F. Skinner first described superstitious behaviors in experiments with pigeons in 1948. When he set the feeding mechanism to trip at variable intervals that had nothing to do with the actions of the pigeons, the pigeons nonetheless started repeating behaviors that had been accidentally marked and reinforced by the mechanism. Richard Dawkins explains it here in a short clip. There was actually some subsequent debate about Skinner’s interpretation of what was happening. But the term “superstitious behavior” remained and is now used informally to refer to any behavior that is accidentally reinforced. A couple of the behaviors in this post stretch the definition, but if they aren’t technically superstitious, they are nonetheless accidental or at least poorly thought out on my part.

The following is a behavior that would have been very difficult to teach, had I intended to do so.

In the course of teaching Zani agility weaves using the two by two method, I would tend to mark with a “yes” the moment she committed to the last weave, the moment I was absolutely sure she was going to complete the behavior correctly. That’s a natural time to mark. Except early on she did a few little jumps through the last pair of poles. I marked, and you can see what happened. But what is the most fascinating is that she only does it when I am on her right side. When I am on her left and she does an “off-side” entry, she doesn’t do her thing between the last poles. I speculate that since she is very spatially sensitive, she is less likely to go hurling out of the weaves when I am over there in the area where she will emerge. Or perhaps I just didn’t mark the exit as much when we practiced on that side.

These first two are pretty cute. This upcoming behavior of Clara’s that I accidentally reinforced is rather unfortunate.

Clara has always been pushy and when she was about three months old I started a deliberate project of teaching her to back off (and get reinforced for it) when I was interacting with another dog. I started off with the other dogs in crates and was very systematic about it, drawing lines on the floor for my own benefit so as to keep consistent criteria. We did lots and lots of sessions of this.

It would have been better if I had taught a default down or Go to Mat, or at least thrown the treat away from our immediate area. What I ended up doing was unintentionally reinforcing a circling behavior. She would walk a few steps away, turn and reorient at the desired distance. I marked the turn (way too often) and treated her when she faced us again. What I wanted for her was just to back off. But that is not a well defined behavior, so I ended up clicking a definable moment, when she turned back to me. Dang.

What is so unfortunate about this is that it also either morphed into a stress behavior or it was one already. But I have seen a lot more of it ever since those many sessions. She tends to do it when I do not mark a behavior that she expects to be marked. She will immediately whirl around (usually counterclockwise), then often retreat to a mat. It is impossible to tease apart how much of this is due to it becoming almost a default behavior because of all that early reinforcement, and how much is that it is a natural stress behavior for her. I do wish I hadn’t trained so many 180 and 270 turns when she was young. When I set out to teach her spinning as a trick, it was dead easy. I gave that a second thought and decided not to use that trick.

I even did it with Cricket. I tried to train a paw lift as a trick (wave), but then it started recurring in her “sit” as a superstitious behavior. Once it started, I kept accidentally reinforcing it. I didn’t know anything about stimulus control and not much about cues so I had no idea how to get rid of it. The way I taught the behavior in the first place was not great either. A friend had suggested holding a treat in my hand and clicking her for pawing at it, then fading the hand and treat. Such a bad idea in so many ways. Teaching an enthusiastic digging terrier to paw at my hand? Great! And it worked. It worked so well that she almost never put her left front foot down when she sat again.

I wish I could give some succinct, pithy advice that would keep other newish trainers from doing this. With regard to choosing what behaviors to teach, I think it takes experience to learn to predict the ramifications. I didn’t have a teacher to ask at the time of most of these (Clara’s behaviors being an exception). Even when you do, you don’t always think to ask them everything. Here are the questions I can think of to ask oneself.

  • Is there a persistent side effect that is happening when I train this behavior?
  • What’s going to happen if it sticks around?
  • How can I get rid of it?
  • This trick I am deciding to train–what if it becomes a really strong behavior? What might it interfere with?

If you don’t have a teacher, you can learn a lot by videotaping your training sessions, and if you are brave, showing those recordings to online friends if you don’t have a teacher or local training buddy. People can give much better counsel if they actually see what you and the animal have been doing. Most of us humans could use a lot of work on our observation and description skills. Cameras do a lot better job for a lot of us.

One behavior that I got right: I started training that “backing up the stairs or wall” trick that was going around a while back. Zani just loved it and started getting good at it. It was great for hind end awareness. But then one day when we were practicing our two on, two off agility contacts, she overran them and happily backed up into position. That would be a fault in many agility venues. I immediately stopped training the trick. A more experienced or patient trainer could certainly have both behaviors, but sometimes I realize my limitations. The risk wasn’t worth it to me.

Here is one more of Clara’s. This is an example of something that is very cute when a puppy does it, but can get pretty tiresome in a grown dog. Of course it’s still cute, but who wants their fingers licked Every. Single. Time. they go to open a crate door?

OK folks, please tell me I’m not the only one who trains silly behaviors by accident. Anybody want to say what they have done? Or all you all perfect?

(Here’s a link to a one minute video that shows all five behaviors, to make my humiliation complete.)

Discussions coming soon:

Share Button

About eileenanddogs

Passionate amateur dog trainer, writer, and learning theory geek. Eileen Anderson on Google+
This entry was posted in Clicker, Dog training hints, Operant conditioning and tagged , , , , . Bookmark the permalink.

26 Responses to Superstition Ain’t the Way

  1. It’s very, very easy to train “bark&sit” or “bark&anything”. Ask me how I know 🙂

  2. OMG, Eileen, another great post. You win my award for bravest dog blogger. You keep showing all the mistakes you made to help the rest of us feel normal and realize all trainers are mortal.

    Gosh, let’s see…. I only learned *after* starting to teach Barnum to file his nails that he would try a raking/scratching behavior for anything paw-related after. Oops. Did manage to *mostly* extinguish that, but still. In the future, I will teach the paw thwack BEFORE the nail file.

    I also accidentally taught Gadget to “sing in the shower.” You see, I was training him to shake on cue, so as to reduce the amount of water in his coat before the towel off. And at some point, maybe twice, I clicked him for vocalizing instead of or while starting a shake. And then forever after, he would go, “Moo. Moo! MOOOOO! [shake shake shake].” I think this was in part because the internal “gearing up” that often goes with a shake and a bark were similar for him. We did get it on video, but sadly the video is lost to time. It didn’t help that everyone else thought it was hilarious and did their best to reinforce it and interfere in my attempts to extinguish it.

    • Thanks, Sharon! It’s just so easy to find all these bad examples. I think soon I may surprise everybody by showing some decent training (what I think is decent, anyway).

      Oh yeah, the paw rake! I’ve gotten some of that from Summer. And a very pleased look after she does it, too. Wish you still had the video of Gadget’s Moo and shake dance. Sounds wonderful.

  3. Pingback: Nobody’s perfect… | Wissen-macht-wau

  4. Pingback: Replacing a Poisoned Cue | eileenanddogs

  5. You know, I didn’t think I had a superstitious behavior with Lobo, but it turns out… I do! Backing up. Every single time we go to do a training session, Lobo backs up. I don’t really know when it started, though. It doesn’t really get in the way of anything, other than being mildly irritating, haha. But I don’t mind too much.

    • Hi April, that’s funny because I had to go through a whole retraining to get Summer and Zani to stop defaulting to backing up when we were shaping. With us I finally figured out that I had worked on all this duration backing up (trying to get distance) so wasn’t marking anything until they backed up considerably. I had done way too much uncued backing up trying to get duration behavior before I got the cue. (I didn’t want to have to repeat the cue over and over.) So when I adopt a “whaddaya got for me?” demeanor in shaping, there they would go, like squid.

      • Like squid! LOL! I want to see video of that, Eileen!
        I, too, have shaped an unintentional backup — when cueing “sit.” Because my “sit” and “backup” hand signal looked too similar. I eventually changed my back-up cue to something that was more easily distinguishable, but I never put in the work to retrain the cue without the backing up, so his sit often involves several steps back into a sit. It seems to depend how we are positioned. Some positions he will just plunk his butt down and others he backs into the sit. (Not so much like a squid. More like a dog in reverse. That would make him God, I guess. ;-))

        • I searched my old footage and I do indeed have some squid moves by Summer. I’ll put together a little montage one of these days. She also has this sort of trick that is on cue: Rewind. She does this backwards inchworm thing while in a down on the floor. The queen of backing up!

  6. Pingback: Training Levels: Making it My Own | eileenanddogs

  7. Pingback: Does Your Dog REALLY Want to be Petted? | eileenanddogs

  8. Pingback: Welcome! | eileenanddogs

  9. Pingback: Dogs Notice Everything | eileenanddogs

  10. Pingback: Fixing What I Broke | eileenanddogs

  11. Pingback: Poop in my Pocket: Life with an Old, Old Dog | eileenanddogs

  12. Pingback: Peek-a-Boo! A Hint for Training Eye Contact | eileenanddogs

  13. Pingback: Dog/Dog Resource Guarding in Slow Motion | eileenanddogs

  14. Pingback: The Missed Cue: Attack of the Zen Field | eileenanddogs

  15. Pingback: Ant-Sized Treats | eileenanddogs

  16. Pingback: Lumping It: A Public Service Announcement | eileenanddogs

  17. Pingback: 6 Ways I Messed Up My Dog’s Targeting | eileenanddogs

  18. Pingback: Using a Training Plan to Retrain Summer’s “Target” | eileenanddogs

  19. michellefui says:

    Oh, the mistakes I’ve made… I just want to bang my head against the wall sometimes.

    This is a great cautionary take Eileen. Thanks so much for sharing.

    I was thinking though, thank goodness my boy has a great reinforced sit which he uses as his default behaviour. But then I remember, somewhere along the line he has got sit confused with backing up and sometimes sits and shuffles back when I ask for a sit. Depending upon the context. Ah, got some work to figure out what’s gone wrong there… I have a suspicion though. Time to check those tapes. And then fix it.

    • Eileen Anderson says:

      Oh, backing up is a tough one! Once you reinforce it, it creeps (backwards!) into everything. Good luck in tracking it down!

Comments are closed.