eileenanddogs

Tag: applied behavior analysis

Accidental Punishment

Accidental Punishment

The various outcomes of our shaping sessions, punishment notwithstanding
Can you guess which dog got accidentally punished during a shaping session?

I charged straight into a positive punishment scenario by accident recently.

I’ve been somewhat in the training doldrums lately, probably because I am putting so much energy into finishing my book. I have several training activities that I fall back on when I don’t have much energy. They are fairly unchallenging for me (read: I can’t mess them up too badly) but still fun for the dogs. Even those have been hard to do lately.

But the other day I had some time and energy and decided to play a shaping game with each dog. We don’t shape that often, but they all enjoy it, and it gives their minds a good challenge.

Two of the dogs, Summer and Zani, used to have a default backing up behavior that they would offer in excess whenever I set up shaping games. This was my fault: my shaping setup resembled my backing up setup too much. They had similar setting factors, if you want to get technical about it.  I managed to get the dogs unstuck a while back with some carefully arranged object interaction sessions. (It’s easier to get the idea to go forward instead of backward if there is something to go forward **to**.)

So I decided to set up an object interaction session again. I set out a target stick, a plastic lidded box, and a laundry basket with a plastic dumbbell in it. I put the plastic box on top of one of their mats so it wouldn’t skid around.  I had an idea of a behavior for each dog, but was also willing to decide on the fly if someone did something unexpected.

Clara’s Shaping Session

Clara’s session was easy. The dumbbell in the laundry basket was for her: she loves to pick things up. I stood about 15 feet from the array of objects and it took Clara only a few clicks/treats to get over there. I stayed at a distance. This helps the dogs learn that the reinforcement zone is not always right on me, and also sets me up to practice my treat tossing.

It didn’t take much to get Clara over to the basket and looking in. The basket wanted to skid on the floor so I did go over there and brace it, at which time Clara was happy to put her two front feet in. Then I shaped her into picking up the dumbbell. This is normally very easy, but it was a slight challenge with her front end in the basket and back end out. A good time was had by all.

Summer’s Shaping Session

Summer is my super-duper shaper, which is interesting since she is my crossover dog. Crossover dogs are often reluctant to offer behaviors, but what can I say? Summer got over it. And turned out to be a creative genius when it came to thinking up stuff to do. But this session didn’t require a virtuoso performance. I shaped her to go to the target stick, which I had put behind the other stuff. She still got to it in a minimum of clicks. I needed to make more of a challenge, so I put the stick in the laundry basket with the dumbbell. She needed to hop in the basket to nudge the stick, and that she did. She’s great about getting in things.

Zani’s Shaping Session: Punishment Happened!

You knew it would be Zani, right? My easy dog/problem child.

So I had intended the plastic box for her. She’s done quite a bit of perch work and enjoys it. No big deal. We messed around a bit: she investigated the target stick and the laundry basket. Finally she noticed the box. She was directly facing me, with the box between us, and put her two front feet up on it. Yay! Click, toss the treat. Then she got on again! Ditto. On the third time, I had a sudden thought to treat in position rather than tossing the treat to reset her. So as she was placing her feet on the box, I charged right over there straight at her. She’s my pressure sensitive dog. She backed off the box in shock and scooted backwards, though she did collect the treat I had hastily thrown.

I retreated back to my area, but would she approach the box again? Nooooo. So I quickly went back to rewarding other behaviors. About 15 treats later, she was willing to go to the box again. I didn’t charge at her. It took about 5 more treats to get her putting her feet on the box.

Wanta Play Behavior Analysis?

Four quadrants of operant conditioning
Four processes of operant conditioning

OK, here we go. We could do at least two different analyses, because not only did a behavior decrease with positive punishment, but a behavior increased/maintained as a result of my aversive high speed approach too! I’ll leave that one as an exercise for interested commenters. Let’s go over the punishment.

We always start with the behavior that changed. What was it? Zani putting her feet on the box. Increase or decrease? Decrease. Can we identify why? Pretty sure it was my running full tilt at her. Why did she put her feet on the box in the first place? We were having a shaping session and there was a box there. So the ABC looks like this:

  • A. Antecedent: There’s a lidded box on the floor
  • B. Behavior: Zani puts her two front feet on top of the box
  • C. Consequence: Eileen abruptly runs straight at her
  • Prediction: Zani putting her feet on the box will decrease

Did the behavior decrease? Oh yeah it did! Zani loves to get on things and has been reinforced plenty for it. She had just gotten in the groove of offering “box” behaviors but stopped offering them after I charged at her and didn’t interact with the box again for quite a while. That’s a decrease. There was also a decrease in her behavior in general. She got tentative and ever so slightly shut down after my barging into her space.

Why is it called “positive” punishment? Remember that positive and negative in operant learning terminology refer to whether a stimulus is added or taken away. In this case Eileen charging at Zani was an added stimulus.

So How Bad Was It?

Positive punishment is the learning process that we pretty much try to avoid at all costs. So how hard should I be knocking my head against the wall?

As usual, we ask the dog, and we do this by observing her response. Did we see side effects? Referring to the list on my post “7 Effects of Punishment,” we probably got small doses of # 1, avoidance, and #4, apathy. It remains to be seen whether we will see any avoidance of me outside of training, but I could easily see her getting sensitized about my approaching her. During the session I saw a decrease in behavior from her in general, which could fit under #4. Luckily, this was only over a brief period. Zani started offering behaviors again, and then was getting back on the box willingly (i.e., no pressure from me) within about two minutes. Susan Friedman points out that when an animal has a large reinforcement history and “trust account,” the animal can typically handle life’s little unpleasantnesses well. So this probably wasn’t a horrendous tragedy.

On the other hand, I have worked very hard to pair my approaching and entering Zani’s space with good stuff since she is sensitive to body pressure. We play games where I invite her to enter my own space as well, especially when I am standing up directly facing her. That’s just hard for her, polite little dog that she is. So chalking up another “Eileen is a boorish clod and she scares me sometimes” experience was not ideal. Even just that one time may set us back just a bit in the work I do to make her comfortable with me. In other words, there is a good chance that there is some fallout of the avoidance type, though it may be subtle.

The side effects of punishment listed are generally overt behaviors. There’s also the basic issue that it can scare or hurt an animal. Whatever the animal’s behavioral response, that’s not a good thing.

So how to think about this? I don’t think being alarmist is helpful. Yes, I punished my dog, but it’s over and done with and wasn’t a tragedy (even from Zani’s point of view, I’m pretty sure, which is the one that counts). But neither do I think this is the kind of thing to brush off.  It set us back just a little bit. Zani might be a little extra wary with me in certain situations for a while. I’ll have to work that much harder to make approaching her in various ways into a happy thing.

Accidentally running up in my dog’s face is not something most people would design as a deliberate punishment. People who do use positive punishment in training would probably be amused that I am even classifying it as such. But one of my points is that even such a benign-sounding action can have fallout. Why use punishment to decrease one behavior when it will simultaneously create problems with others? You are left always trying to fill a leaky jug.

And Zani, though sensitive, has a pretty solid temperament and is used to my ways. What if I had been working with a fearful dog or even one who was new to me? A mishap like this could have meant a setback of days or weeks.

Anyone want to share their own accidents? I’m not asking for true confessions about deliberate aversive use. Plenty of us have those in our histories. Let’s talk about that another time. I’m more interested in the boo-boos. I bet I’m not the only one….

Related Posts

Eileenanddogs on YouTube

Copyright 2015 Eileen Anderson

What’s an Antecedent Arrangement?

What’s an Antecedent Arrangement?

One of the classifications in Dr. Susan Friedman’s Humane Hierarchy that is pretty unfamiliar to most of us dog trainers is called “Antecedent Arrangements.” And look, it is on the more desirable end of the hierarchy! There’s no speed bump, caution sign, or stop sight. There’s an inviting little arrow. Worth looking into, don’t you think?

The Humane Hierarchy
The Humane Hierarchy

We are accustomed to manipulating consequences when trying to effect behavioral change, but that’s not the only thing we can do. We can make changes to the antecedents, the things that set the stage for behaviors. Antecedent arrangement is on the desirable end of the Humane Hierarchy because it is less intrusive. You are not actually trying to change the animal’s behavior via reinforcement, punishment, or extinction. You are manipulating the environment to enhance the likelihood of the behavior you want.

How do you do this? The three types of antecedents are cues, setting events, and motivating operations.

  • Cues: You can remove something that serves as a discriminative stimulus for a behavior that you don’t want, or don’t want right then and there. Or you can add something that will better signal the behavior you do want.
  • Setting events: You can make the behavior you want easier by changes in the environment, and make the undesired behavior more difficult.
  • Motivating operations: You can do something that affects the animal’s motivation, either to perform the behavior you want more, and/or to do the behavior you don’t want less.

I have an example of antecedent arrangement in my second post about the Humane Hierarchy.  But another one fell in my lap lately, so I thought I would share it.

The Dread Back Door

Undesirable door behavior
Undesirable door behavior

Since Clara became an adolescent, then a young adult, I have struggled with back door behavior with my three dogs. Actually, since before then, since Summer is reactive and sometimes can’t respond well when she’s worried about what might be down in the yard.

My goal has always been for Clara and Summer to lie down in assigned places close to the back door. Zani can sit or lie down wherever she wants, because she already has nice door manners,  isn’t pushy, and had no agenda other then earning a treat if one is available. Summer needs to be back from the door to help her keep calm, and Clara is back from the door to keep her from bashing everybody else. Theoretically.

This is a generalization of a known behavior. I teach my dogs to get on mats and stay there as a stationing behavior, starting the day they come to me, in all sorts of situations. All around the house I use soft bath mats with rubber backing as dog stations, and they are like magnets to my dogs since they have been reinforced so highly for getting on them, lying down, and relaxing. But I was not able to use them to mark the places I had designated for Summer and Clara at the back door. This was because the den was the one room in the house in which Clara had free range as a youngster, and she would chew them up if not completely supervised. So I bought a couple of rubber non-skid bath inserts, like you put in the bottom of your tub or shower. They made decent station markers but were not attractive for her to chew.

I worked for a long time to get Clara to stay on her mat at the door. It was an “expensive” behavior for her, as Sue Ailsby calls it. There was just too much fun to be had dashing towards the door and knocking the other dogs aside like bowling pins. So it took a high level treat at first and some very consistent practice to get a nice wait on a mat. By the way, using going out of the door as the reinforcer didn’t work as an initial training strategy. Much too exciting. I needed to build the behavior up using high value treats. And since we went out the door many times a day, sometimes with very little preparation, Clara did get some chances to practice the undesirable things. I.e., I couldn’t always have great stuff and I had a hard time being consistent.

Summer trying to make eye contact at the back door
An old photo of Summer trying to make eye contact at the back door when her whole body and mind are already outside

Finally I did some intensive work  over a couple of weeks and got some pretty consistent behavior. Once I got Clara’s behavior in shape, I started working on Summer. That was just as hard, in a different way, because I was working against some emotional patterning. Summer is anxious and predatory, and easily gets worked up into quite a state, anticipating what kind of animal might be in the back yard, especially at night.

So I finally got the general idea across to both of them (along with perfect little Zani), but the reliability of the behavior was not where I wanted it. My walking toward the back door was the main cue, but we were a long way from three dogs slamming into their places. I was still putting up with charging ahead from Clara every once in a while and glassy eyed standing around from Summer more often than that.

Then I had a bright idea. I got our door behavior very close to 100% without a struggle. The short video shows the solution. With one change, I got an improved  cue and setting. Note that in this example, as in much of life, there is not just one learning process happening. The change in antecedent worked in tandem with the positive reinforcement (and differential reinforcement of an incompatible behavior) that had already been going on. But it sure gave it a huge boost!

Link to the video for email subscribers.

Link to a script of the movie for those who can’t view it.

And that’s the power of antecedent arrangement.

I bet some of you out there have some good examples. How about sharing?

Coming up:

Eileenanddogs on YouTube

Copyright Eileen Anderson 2014

Theme: Overlay by Kaira Extra Text
Cape Town, South Africa