Testing Creative Concepts and how to do it
Is there an effective means of testing creative concepts?
This quote can easily be applied to testing creative concepts. “A sovereign’s first duty is doubtless to conform with the wishes of the people; but what the people say is scarcely ever what they wish: their desires and their wants cannot be learned from their own mouths so well as they are to be read in the heart of their prince.” -Napoleon Bonaparte
When To Conduct Research
However, we do everything in our power to convince our clients not to test brand theme lines. And, not to test logos, and marks. Once the belief systems in the marketplace have already been uncovered, learned and mastered, you can only judge creative work based on how effectively it fulfills the strategy.
In our experience, there exists no satisfactory method of determining the true equity in these important creations. Despite all claims by research firms to the contrary.
We Have Been Guilty Too
Over the years, we have conducted many focus groups, one-on-one interviews and conjoint analysis. All on behalf of well-meaning clients to ascertain, the value and limitations of logos and brand theme lines. And we have found all methodology lacking in the ability to deliver value.
We have found the best methodology is to test the strategy and preceptive values behind the equities. Do this before the creation of them .And we have created our process to do just that.
The vast majority of brand development firms do this in reverse. First, they create the marks and lines, then they attempt to test the validity of the creative without understanding whether the strategy itself is correct. This is akin to having a waiter bring your meal to the table before you’ve selected something from the menu.
Logos and Theme Line when Testing Creative Concepts
Qualitative research on brand theme lines, logos and marks is not worth the paper upon which it is printed.
Failure resides not just in the methodology, but in the backward process leading to the testing creative concepts study.
John Wooden, the former UCLA Basketball Coach Emeritus, and winner of 10 NCAA National Championships, was fond of admonishing that we should “never mistake activity for achievement.”
And all research studies used to understand the acceptability of a logo, mark, and theme line are just that. They are exercises in activity rather than accomplishment. They make us feel better because we are doing something. And, not because we are gaining anything of value.
We are surprised many companies still insist we conduct it. These research projects are a benign waste of their money (see number 1 below). And, many times, the results are quite simply cancerous (see number 2 below).
Testing Creative Concepts. Scenario Number One
The movie and TV industry is famous for testing pilots and pre-release versions of movies and TV series.
They spend millions of dollars on this, tweaking names, endings, plot lines, and casting. And yet the end result has more failures than successes. The reason for this failure is that when asked, test subjects will voice opinions.
However, these opinions are always viewed in a vacuum. And, the importance or validity of those opinions cannot be measured.
The problem with testing creative concepts is that no one knew if they cared about the subject matter in the first place. And, that’s something that should have been be done much earlier. The end result is that failure occurs more often then success appears.
We believe that the research examining what the market values and believes should have been conducted long before. Before the image was burned onto the celluloid.
When this is done in advance, experience tells us, there are more successes than failures. Because the industry knew what was wanted. And it was of interest before the screenplay was written. Not the other way around.
The process of testing after the fact means it could be testing the wrong strategy. It is also at best a waste of money and at its worst destructive. That part of the story is found in number 2
Scenario Number Two
In number 1 above, we stated that “when asked, test subjects will voice opinions. However, these opinions are always viewed in a vacuum and the importance or validity of those opinions cannot be measured.”
The opinions voiced very often eviscerate the power in the brand. And this is much more likely when research is conducted on theme lines than it is when testing marks.
Our experience with theme testing and testing creative concepts is that the end result is a vanilla reduction of the original idea.
Testing, by its very nature, is a study in caution. And, more often than not, the raw power of a theme that is designed to ignite passion gets reduced to its lowest common denominator. By removing all that “offends” and sparks passion, you remove everything that is memorable. And everything meaningful. If you believe, as we do, that “the price of clarity is the risk of offense” then testing your “pre-tested” strategic theme is putting your future in the hands of amateurs.
It Gets Worse
To make matters worse, often, this kind of research uses focus groups.
Focus groups are comparable to hand towels with regard to coverage. They might be functional after dinner, but utterly futile after a long shower.
Research should prove projectable, and focus groups most certainly are not. Neither positive response nor negative response from focus groups is reliable.
Within one focus group, there will be a wide spectrum of responses. Responses ranging from positive to negative and everything in between. Many ideas are hailed because the focus group approves of them. Or, they disregard them immediately.
Napoleon concludes, “Nothing is more difficult, and therefore more precious, than to be able to decide.”
With focus groups, a scapegoat is produced. And marketers feel a false sense of security when in reality, rock, paper, scissors would be equally as effective.
Testing Creative Concepts. Be Right In The First Place.
Beliefs direct human behavior. And we insist on the completion of behavior modeling before conducting any research. The modeling projects preceptive beliefs that affect brand purchases. These beliefs affect trial, and loyalty. Only after we recognize these possibilities do we embark upon the creation of the brand equities.
We look to incite what “can be” or “should be” in addition to what IS.
Most research acts as a snapshot of the existing market. But, the real value of research lies in the testing of possibilities.
When looking to build a brand that steals market share and changes behavior, it is imperative to challenge everything. And, observe the problem dispassionately. Research is a crucial element of the brand development model. And yet most of the existing equity research is worthless. Often, tainted with bias before it even has a chance to use its legs.
Great research is revealing, connecting the brand to significant consumer beliefs.
This connection, however, does not happen by chance.
It requires understanding consumer beliefs and testing them.
Not in the representations of the strategy, elements that may produce positive results because some likes purple, for example. Don’t confuse those responses with reasons for preference.