Note: I have been working on this paper for 18 months. Today when I published it, I was unaware that Dr. Perone was the head of a recent task force that concluded that contingent electric skin shock of of a population that could include people with developmental disabilities, emotional disorders, and autistic-like behaviors could be part of an “ethically sound treatment program.” It casts his paper in a different light. I’m leaving my writeup published for now because I think we need these answers to what is an often quoted paper. Please don’t consider it in support of Dr. Perone in any way.
“The Negative Effects of Positive Reinforcement” by Dr. Michael Perone is a scholarly article some trainers like to use to muddy the waters about positive reinforcement training. They throw out Dr. Perone’s article title like a bogeyman and use it to defend aversive methods in dog training. That usually indicates they haven’t read it. It’s a thoughtful article and has some interesting things to consider, but it doesn’t say what they seem to think it does. Not even close.
Rinnnggg! I learned to expect something nice when I heard that sound. Then things went south.
The Sound
When I first started out as a blogger in 2012, I used a hosting site called WordPress.com. Their smartphone app has a pleasant little notification sound effect. I soon learned that the app played the sound when I got comments, likes, or follows.
Lewis watching a man in the neighborhood move his trash can
I’ve been walking two to three dogs every day since April 2021. One of my goals is to give them the most fun and freedom possible within the constraints of walking on leash in a suburban neighborhood. I have a post in the works about the ways I work on these goals. But in the meantime, I’m sharing this fun contrast in the behavior of three dogs.
Thank you to the readers who helped me with this paper. Any mistakes are my own.
Some terminology in behavior science is notoriously hard to get one’s head around. One of these terms is negative reinforcement. Not only is this learning process itself a challenge to understand, but the terminology itself is counterintuitive. Behavior scientists specialize in training, teaching, and learning, so naturally, if a term from their own field trips people up, they are going to analyze the problem. The terminology for negative reinforcement has already been changed once, in the 1950s to early 1960s. There has been more discussion since then. This post is about the article that started the more recent discussion, and how it is often misunderstood in the animal training community.
This is a story from a client of one of my professional trainer friends. Let’s call my friend “Phoebe.” My friend had met the client for some coaching for her young, exuberant dog, Raven. But it was a very long distance for the client to come. My friend received this email after she hadn’t heard from the client in a while. Some details were altered for privacy, but I’ve left the email essentially as the client wrote it because she tells the story so eloquently.
When I crossed over to training with positive reinforcement, I had no idea how much my behavior and even my belief system would need to change. I had to question my faith in some long-held cultural assumptions and learn to rely on scientific observation and analysis.
Crossing over was a lengthy process for me, and even now, after more than 10 years, I occasionally fall back onto old assumptions and behaviors. I wonder sometimes if I am the only one so vulnerable to cultural programming. But a quick look around social media says no, I’m probably not.
I’ve written a lot about the behavior science definitions of reinforcement and punishment. That’s because they can trip us up so easily. Something can be attractive, but not always reinforce behavior. Something can be unpleasant, but not serve to decrease behavior even when it looks like it should. This story is about a natural consequence that seemed like it would decrease behavior but didn’t.
A recent discussion on an Association of Zoos and Aquariums listserv, (specifically their ‘training’ list) caught my eye and my keystrokes, and one that has apparently become a commonplace discussion among many bridge trainers. The discussion emerged as a simple inquiry by another list member on whether it was appropriate to use a bridge without being followed by a “treat”, (whether food or some other backup reinforcer). I quickly answered that anything less than a 1:1 pairing would weaken the reinforcing value of the bridge, and put the subject to rest. But a strange thing happened. As I continued to read the posts on this listserv, many other list members took the exact opposite stance: that it was ok to ‘click’ and not treat, and that such ‘click or treating’ may even strengthen the bridge. Astounded by the ensuing discussions and arguments, I decided to gather up the data and attempt a thorough review of what was the appropriate way to go about this business of clicks with or without a treat. The following is the result.
This article was first published by Clean Run – The Magazine for Dog Agility Enthusiasts, in August 2017. I changed the title after publication in this version. Please see the note about that at the end of the article.
If I’ve trained recall on a variable ratio reinforcement schedule, how likely are my dogs to come away from the fascinating distraction behind the fence?
Do I have to carry around treats or toys forever?
This is a common question from trainers who are new to positive reinforcement techniques. And most of us have heard the following typical answer.
This 2003 edition book is $4.89 on Amazon. Contents: priceless.
There is a science that deals directly with how organisms learn and how to use that information to change the environment in order to change behavior. It’s called applied behavior analysis (ABA). It is the applied version of behavior analysis, which was referred to as the experimental analysis of behavior earlier in the 20th century. It is descended from the work of the behaviorists such as Skinner and is now classified as natural science.
It is a rich field of study. Universities offer graduate degrees. At the same time, it is approachable. Many of the entry-level ABA college textbooks currently in use are readable to someone with a strong high school education and certainly to someone with a college education. They are generally self-contained, in that they don’t require a lot of previous exposure to terminology to be able to work through. The books contain fascinating information about what makes us tick, why we do what we do, and how we might go about changing behavior if we needed to. They also teach skills in ethics and kindness.
Because experts in learning write them, the texts are generally well organized, interesting, and approachable. A sidebar in Paul Chance’s Learning and Behavior starts off, “What would you do if, while camping miles from the nearest hospital, you were bitten by a poisonous snake?” It goes on to discuss superstitious behavior. Other sidebars are titled “Punks and Skinheads,” “Variable Ratio Harassment,” and “Learning from Lepers.” I’ll leave you to go find out the subject matter. This topic is a goldmine for the curious. It is relevant to everyday life and can teach knowledge and skills that are very practical. If you buy older editions of textbooks, as I usually do, the prices are quite reasonable. (For instance, here’s a link to Paul Chance’s Learning and Behavior, with the oldest editions first. You can scroll forward to newer editions as your pocketbook allows. The most recent edition is 2013.)
Like any field of study, ABA has its own terminology. When we first encounter it, two things typically happen. First, we think we know it already. Who doesn’t know what punishment is, right? Motivating operation—doesn’t sound too hard to figure out! Then we go a little deeper, and even though the words are familiar, the concepts may not be. Some are extremely unfamiliar. That can cause dismay. One of the problems in the dog training world is that a lot of people get stuck at that point.