What Is a Blind Panel and Why Is It Essential?
The nose can be fooled. Brand, bottle, price tag — even a comment from the person sitting nearby — can shape a decision before a single sniff is taken. A blind panel is a sensory test in which the evaluator is given no information whatsoever about the sample. The sole objective: eliminate bias and leave only the scent.
Trusting your own nose before bringing a formula to market is not enough. You are in love with what you have created; that love blinds not your eyes but your nose. A blind test reverses that blindness.
There are two fundamental blinding layers. If the evaluator does not know the identity of the sample, it is single-blind; if neither the evaluator nor the person administering the test knows the codes, it is double-blind. Double-blinding also eliminates the unconscious facial expressions and vocal cues of the presenter.
Setting Up a Panel: Venue, People, Conditions
A good panel starts with a good environment. Fragrance evaluation is a precise measurement; if the surroundings are compromised, the data is worthless.
The space must be odour-free. Coffee, cigarette smoke, food, scented cleaning products — even fresh paint — can distort judgement. Ventilation should be simple and constant. Lighting should be neutral; coloured lighting has an indirect effect on perception.
The number of panellists depends on the objective. For a quick preliminary screening, 5–8 people is workable; if you need statistical confidence, 20 or more is preferred. With trained noses (see Training Your Nose: Scent Recognition and Memory), even a small panel is powerful; for an untrained consumer panel, increase the numbers.
Panellists should be neither hungry nor overly full, must not have applied fragrance before the session, and should avoid coffee beforehand. Before each session, stepping outside into clean air or smelling the skin of one's own forearm is a small but effective reset for the nose.
Sample Coding and Blinding Technique
Coding is the heart of blinding. An incorrectly coded sample is a beam of light that pierces the blindfold.
Label samples with three-digit random codes (e.g. 482, 137, 905). Avoid sequential codes such as A/B/1/2; the human brain interprets a sequence as "the first one is the main product." Bottles must be the same colour, the same size and the same volume — even a difference in the glass can serve as a clue.
Randomise the presentation order for each panellist. If everyone smells samples in the same sequence, "first-sample bias" kicks in. The first sample assessed tends to have an advantage; distribute this effect by rotating the order.
- Preparation
Present each sample diluted to the same concentration in the same carrier. If one is concentrated and another diluted, the test measures concentration, not fragrance design.
- Coding
Assign a three-digit random code. Write the code–formula key on a separate sheet and keep it away from the panellists. In a double-blind setup, the presenter must not see this key either.
- Blotter preparation
Mark test strips (blotters) with the sample code and dip the scent band from the end furthest from the mark (see How to Use a Test Strip Correctly).
- Presentation
Hand out samples in a mixed order. Have each panellist smell each one and fill in the form; allow a neutralising break between samples.
- Reveal
Once all forms have been collected, decode the samples. Data first, identity second. This sequence is sacred.
Test Types and Reading the Data
The question you ask determines which test you run. The wrong test produces the wrong answer dressed up as the right one.
| Test Type | What It Measures | Use Case | Min. Panellists |
|---|---|---|---|
| Triangle Test | Is there a detectable difference between two samples? | Checking whether a formula change is noticeable | ~12–24 |
| Paired Preference | Which sample is preferred? | A/B formula comparison | ~15–30 |
| Ranking | Preference order among multiple samples | Screening more than two variants | ~10–20 |
| Descriptive | Scent profile, note intensity, perceived longevity | Profiling with a trained panel | ~5–10 (trained) |
The triangle test is the most robust difference test: you present three samples, two of which are identical, and the panellist identifies the odd one out. Because the probability of guessing correctly is 1/3, statistics filter out chance. It provides the most honest answer to the question "Is a new raw material changing the scent of the existing formula?"
When asking panellists for notes in a descriptive test, a shared vocabulary is essential. "Nice" is not data; "resinous, balsamic, lightly smoky" is data. The Guide to Describing a Scent in Words can help align your panel's vocabulary.
Common Mistakes and Frequently Asked Questions
The value of a blind panel comes from its discipline. A single weak link corrupts the entire chain. Here are the most common stumbling points in practice.
Presenting samples at different stages of maturity. Placing a freshly mixed formula side by side with one that has undergone two weeks of maceration is unfair. Maceration is not merely waiting; the scent settles through alcohol–fragrance oil interaction and esterification, and the raw "alcohol bite" softens. Samples should be at the same stage of maturity after maceration (at room temperature, ~15–20 °C), protection from light, and cold filtration.
Failing to standardise dilution. Samples must be presented in the same carrier at the same concentration. Note: adding too much water to high-strength ethanol impairs solubility, causing cloudiness and phase separation. Keep the water ratio low, start with a small amount, test for clarity, and use an appropriate perfumer's alcohol/solvent if needed. A cloudy sample also provides a visual cue during the panel, piercing the blind.
Continuing with an exhausted nose. Discriminatory ability declines after 4–6 samples. Take a break and split the session.
How many samples can I blind-test in a single session?
Does a blind test result guarantee IFRA compliance?
I work alone — how do I set up a double-blind test?
Related Articles
Training Your Nose: Scent Recognition and Memory
Practical exercises for developing a professional nose.
Read →How to Use a Test Strip (Blotter) Correctly
Evaluation, labelling and comparison method using blotters.
Read →A Guide to Describing a Scent in Words
The language of scent description and the skill of writing product copy.
Read →