Tag: extinction

Does Ignoring Bad Behavior Really Work?

Does Ignoring Bad Behavior Really Work?

Not usually and not by itself. And contrary to popular belief, “ignoring” behavior doesn’t play a huge part in positive reinforcement-based training. There is a lot of confusion about ignoring, so I’m going to have a go at clarifying a bit.

Have you seen this asserted in discourse? “Positive trainers just ignore bad behavior”? It’s a natural misunderstanding Continue reading “Does Ignoring Bad Behavior Really Work?”

Summer Learns An Alternative to Being the Fun Police

Summer Learns An Alternative to Being the Fun Police

Sweet little Summer
Sweet little Summer

I have mentioned before that my dog Summer is reactive. Reactive has come to refer to a dog who reacts strongly (and inappropriately in the human’s view), usually with an aggressive display, to some specific triggers. Some of Summer’s triggers are strange dogs (in some settings), strange men (in even more settings), delivery trucks, certain noises other dogs make, and rowdy play on the part of her housemates. The latter earns her the moniker of a “Fun Police” dog. She tries to stop the other dogs when they do things that bother her, and she is not very nice about it.

Continue reading “Summer Learns An Alternative to Being the Fun Police”
We Don’t Need to Stop Discussing “The Quadrants”

We Don’t Need to Stop Discussing “The Quadrants”

Every so often, in the midst of a discussion about operant learning,  someone will write,

The quadrants* don’t matter. Talking about the quadrants just confuses people and makes them pay more attention to theory than what is going on in front of them. To be truly humane we need to pay attention to the individual dogs and how they react to each teaching method.

I really wonder about that.

Of course the dog is the arbiter of what is pleasant and what is aversive and to what degree. But how good are most people at reading dogs, really? How many pictures and videos can you find on the Internet in 30 seconds that look roughly like the one below?

Head shot of handsome young man smiling with his eyes closed and holding a dog (black and rust; perhaps a min pin) with their heads very close. Dog's ears are back, mouth is tight, and it does not look happy.The background appears to be a swimming pool. The photo appears "slick" and staged and is titled, "True Friends."
Public Domain Image of Unhappy Dog Being Held Too Close By a Human

[If you are new to the blog or new to the concepts or nomenclature of operant learning, you may just want to skip down to the movie. It is an example of what I will be discussing here: using theory to inform our practice. It is particularly geared towards folks to whom the theory is new. Or if you really want to go for it, here is a whole post, including a video, that gives examples of all the processes of operant learning.]

Setting up “the quadrants” and observation of the dog as exclusive from one another is a false dichotomy. That is a rhetorical fallacy that implies that there are only two choices when there are actually more, or implies that two choices are mutually exclusive. It doesn’t have to be either or, folks, and I will put forth that that attitude can be harmful.

Learning theory and dog body language observation inform each other. Why encourage people to depend on just one and not the other? Why leave a gap in people’s understanding about the processes of learning, certain ones of which have been shown repeatedly in research and real life to have undesirable side effects?

I know that many pet owners who have hired trainers look at them like they have two heads if they start speaking about learning theory. I get that. Clients often just want a method to solve the problem. But when someone is eager to learn and serious about working with their dog, I think it’s a disservice not to share the nuts and bolts of how animals and humans learn. And it’s a disservice to discourage Internet discussions about the processes of learning. Yes, I know they can be tiresome. But just like with any other aspect of humane training, there are always people new to the subject who can benefit.

The more I see people objecting to “the quadrants”, the more I notice that most of them are attempting to veil their use of less humane techniques.

Here are the two main reasons I think teaching people about the processes of operant learning is important:

  1. Generalization of a behavior is one of the steps to fluency. One of our ongoing goals with dogs is to help them generalize. So I hope that trainers and teachers would want to help their human students generalize as well. With the humans it’s not only about generalizing behaviors, but about learning concepts and generalizing them as well. Studying the processes of learning and recognizing and naming them helps with this. If negative punishment in one situation stressed my dog out, wouldn’t I want to keep a special eye out for other negative punishment scenarios? Why would I not want that conceptual assistance?
  2. I also know from painful personal experience, and observation of, like, all of YouTube, that reading the body language of a dog and getting past one’s own assumptions is a difficult and time-consuming task. It’s easy for an experienced trainer to say, “Just look at the dog.” But can all students really do that and perceive what the dog is saying? I don’t think my observation skills are below average, but I gotta say, it took me lots less time to get the basics of operant learning processes than it did to learn to read dogs well. I’m still working very hard on that. Being informed by the theory about what kinds of situations to look out for can really make a difference for anyone who is  learning to observe and learning the language.

There was a video making semi-viral rounds on the clicker training community recently, often accompanied by comments like, “The power of positive reinforcement!” The video has an adorable, tiny young Yorkie with a bow in her hair doing all sorts of tricks. I saw it posted on a list of thousands of people, and not one person spoke up to discuss the stress signals the dog seemed to be throwing. (Not to mention that some of the tricks might have been physically too demanding for a pup.) Perhaps people were just being polite. I didn’t say anything myself because I had dealt with enough controversy that week, sigh. But the dog did not appear delighted with the training interaction at all.

I’m not linking to the video here, but will send a link privately to any curious folk who make a request through email (sidebar) or a comment.

It sure confirms my doubts about the advisability of just having everybody depend on “watching the dog.”

Examples

The following two stories are true. They both happened to me. One tells how my observation of dog body language led me to analyze and classify the reason for my dog’s stress. After the classification I could be alert to other similarly stressful situations. The other example tells how being informed of what quadrant/process I was using made me question a decision I had made, gain more empathy for my dog, and change my behavior. My (beginner) knowledge of learning processes helped in both cases.

Example #1: From Body Language To Learning and Generalization

My puppy Clara has always loved doing stuff with me and has great attention and a great work ethic. However, I have noticed that shaping can be quite stressful for her. I even wrote a post about shaping and stress. I started thinking about why it might be so. I realized that with my imperfect skills, the changing of criteria was hard on her. Riding the little extinction trails where one version of something ceases to be marked and reinforced and another behavior is desired was quite hard for her.

In the photos, Clara is doing a fast counterclockwise circle, which is a default stress behavior for her. Ironically, the behavior we were working on was, “Relax.” (We’re doing a lot better with that now.)

Clara circle 1
Clara circling during a shaping session (1)

Clara circle 3
Clara circling during a shaping session (2)

I have since learned more about shaping and know that if it’s done with careful manipulation of the environment like Skinner suggested and the great trainers can do, there can be much less of this type of stress. I like to think that my skills have improved. Clara has also grown up a little, and doesn’t think the world will end when she doesn’t get clicked.

But my realization that extinction in shaping was hard on Clara made me both more empathetic to her situation and also proactive in avoiding extinction in other scenarios. Her stressed body language made me analyze the cause of the stress, and being able to put a term to it allowed me to learn more about it and look for similar problems in other situations.

(Extinction is not one of the four operant learning processes that people call the quadrants. Extinction is when a behavior that has been previously reinforced ceases to get reinforcement. It is a process that can happen with both operantly learned and classically conditioned behavior. What’s important for my point is that it is a learning method that is often under my control and that I can choose whether or not to employ, and one that can definitely be stressful.)

Example #2: From Quadrants to Empathy

Early in my life with my dog Zani I picked her up and carried her into a public place. She is very friendly and immediately started to struggle to get me to put her down. Since I was just learning about reinforcement, and had learned that what you reinforce is what you get, I decided to hold onto her until she stopped. I didn’t want to positively reinforce her struggling by giving her immediately what she wanted. She finally stopped, I waited a few seconds, then put her down.

I mentioned this episode to my teacher, who said, ah yes, you used negative reinforcement instead! Up until that moment it had not trickled into my head that I had been using a mild aversive. Zani did not want to be held. She was struggling to get away. I not only hung onto her but I had tightened my grip until she figured out that struggling wouldn’t work. (There could be an element of positive punishment in here as well. But the duration of the tight grip, and the requirement for Zani to come up with a different behavior to escape it, even if the behavior was relaxing her body–these indicate that the major process was that of negative reinforcement.)

I grew up spending a lot of time in the country and was around a fair number of small animals and farm animals. Holding or holding down a struggling animal with force was just something you took for granted. You had to do it sometimes “for their own good” and it was something I was absolutely comfortable with.  I was 50 years old before I realized that there are things you can do to help prevent you and your animal from getting into this situation in the first place, and ways you can give them more of a say about things. And it was in part because my teacher reminded me of the different processes of operant learning. This led to empathy for Zani on my part, and for me not only to work on that specific situation but to be more aware of the negative reinforcement moments in the future.

Education about Learning Theory

Here is an example of the kind of thing that I believe can be helpful. This is a video I made that demonstrates what negative reinforcement can look like, and shows the same behavior trained with negative reinforcement vs positive reinforcement. It is a modest attempt at linking the theory, practice, and dog body language.

I’d be interested to know what the rest of you think. Can we train humanely without knowing learning theory? For me, the theory definitely helps.

Four quadrants of operant conditioning
Four quadrants of operant conditioning

*NOTE “The quadrants” is not optimal nomenclature in learning theory. I use the term throughout this piece because that is how the argument is almost always stated, and people might not know what I was talking about otherwise. Better nomenclature is “the processes of operant learning.” “The quadrants” is just a description of the shape of the diagram they fit in, as Dr. Susan Friedman points out.

Thanks for reading!

Coming up:

Eileenanddogs on YouTube

Shaping and Stress

Shaping and Stress

Zani rolling over in a shaping session that we both enjoyed

This is an expansion of a post about a possible cause of stress in shaping that I sent to the Training Levels Yahoo group.

Shaping involves extinction. That is, ceasing to reward something that has been repeatedly rewarded. In the real world, for humans and observably for other animals, that is stressful. The classic examples are when an elevator stops coming when the button is pushed, or when a candy machine just sits there after you put in the correct change and push the button. What usually follows? In the elevator case, repeated pushing of the button. Harder, faster. With the candy machine, all that, and possibly pounding, shaking, yelling. If you think about an animal’s behavior being tied to survival, something suddenly not working anymore is a danger signal. Oh oh, this place or this method that I was relying on no longer provides food. I’m going to have to start all over again and find somewhere or something else.

We are taught that when we suddenly stop rewarding something that a dog has been rewarded for, to be ready for an extinction burst. That is, the behavior rises in frequency and intensity before it fades away. Extinction is not fun for the dog in this circumstance! It is frustrating.

OK, back to shaping. When we shape, we are introducing tiny little extinctions over and over again. That’s how we get successive approximations to the final behavior.  “Fido, THAT behavior is not getting paid for anymore, it is up to you to figure out something that is.”

When I see the really great trainers shape, there is another characteristic besides their ability to detect the tiniest behaviors and differences in behaviors to reinforce. Another skill is that they are constantly watching the animal’s demeanor, as much as its actual movement, and are responding to that. They can keep that extinction process as gentle as possible and keep the animal trusting that the world hasn’t come to an end when they stop clicking for something. And of course these two skills go together. Seeing and responding to the tiniest movements does tend to keep the rate of reinforcement high.

Also they think empathetically. There is a clinically proven human tendency (the “curse of knowledge”) to assume that when we have something visualized or auralized in our heads, that the others around us automatically will see it, hear it, understand it quickly. Great teachers learn that this isn’t the case. And great shapers keep in mind all the time that the animal may not have a CLUE to what they themselves have so clearly in their heads.

Finally, with our pet, service, and performance dogs (i.e. dogs who live with us) it comes down to the trust account. It needs to be very high for some animals to enjoy shaping as much as we ourselves might. They have to trust us that the lack of a click, and a little extinction, is not the end of the world.  I will admit to making mistakes about this. Shaping is so cool; it’s like being handed a shiny new toolbox with all sorts of fun things inside. I’m a pretty empathetic person but I will tell you that I have gotten overexcited about this tool and plowed on through signs of big frustration from my animals. I have recordings that I will probably never show anyone else of shaping sessions I did very early on with both Zani and Clara. They went on for several minutes. We got to our goal (MY goal). But neither dog was having fun after the first minute or so. They were showing stress and frustration. Zani was whining. Clara was spinning, which is her superstitious and stress related behavior. I was pressing on towards the goal insensitively.

Another thing to keep in mind is that the shaping process is usually reinforcing–to the human! Shaping is incredibly cool! We dangle it in front of trainers who are considering “crossing over.” Look what you’ll get to do with your dog! Many of us need to be careful about going overboard.

Just like any other activity, some dogs are going to intrinsically enjoy shaping more than others. But we are trainers, right? If using shaping is important to us, we need to find ways to make sure it is fun for the dog. A little stress may be a good thing in life, but if an animal is chronically averse to training activity we like, it’s time to do something about it. We probably need to gentle down the extinction process. And mind our trust accounts.

A few thoughts on how to do this:

  • Watch the dog and get to know her signals.
  • Pay attention to how long you are waiting if you are withholding the click. That’s when the extinction stress can build up.
  • Start with very short sessions: just a few clicks.
  • Be willing to stop before achieving a pre-ordained goal (This is a hard one! We tend to be so goal oriented.)
  • Have an environmental cue that lets the animal know when you are shaping and when you aren’t.
  • My friend Lynn says, Teach it! Think of it from the learner’s point of view.
  • Lynn also says do little sessions of “shaping nonsense.” Make sure both you and the dog approach it as a game.
  • Don’t do like I did with Zani and start shaping with a brand new rescue dog just because you can. I wish I had built up our trust a little better before doing that.

Here are my three submissions to ShapeFest 2012 a few months ago. I’m pleased with my dogs’ demeanor in all of these. Clara is still the most serious,  but showed only a few little stress signs. Her main stress behavior is a counterclockwise spin. She does a couple of spins starting at 2:20 but it’s hard to tell how much is stress and how much is just a behavior she is trying. Since her pace is not frenetic, my guess it that they were mostly offered behaviors.

Shaping Zani to roll over

Shaping Summer to mount a platform, using playing in the hose as the reinforement

Shaping Clara to do a distant paw touch

I bet some of you out there have some other suggestions about making sure shaping is fun. Care to share?

Discussions coming up:

  • Is It Really Just a Tap? (shock collar content)
  • “Errorless learning”
  • Canine Cognitive Dysfunction

Thanks for reading!

Copyright 2021 Eileen Anderson All Rights Reserved By accessing this site you agree to the Terms of Service.
Terms of Service: You may view and link to this content. You may share it by posting the URL. Scraping and/or copying and pasting content from this site on other sites or publications without written permission is forbidden.