How to improvise over chords: target notes, guide tones, and scales as candidates

Improvising over chords means inventing melody in the moment, in conversation with the harmony that is sounding. It is not about memorizing a scale and running it up and down: it is about knowing which notes define each chord, choosing where the phrase wants to land, and connecting those points with rhythm, breathing room and intention. Players who master this process are asking three questions all the time: what is this chord, where is it going, and which note tells that story best.

The minimum vocabulary: chord tones

Every chord has a skeleton. In Cmaj7, for instance, that skeleton is made of C, E, G and B — in other words, the root, third, fifth and seventh. These are the so-called chord tones: when a phrase rests on one of them, the ear recognizes the harmony immediately, even with no accompaniment. That is why the first step for any improviser is not to stockpile scales, but to be able to locate and sing these notes in every chord of the progression they intend to play.

Guide tones: the most economical map of the harmony

Inside the skeleton, two notes work harder than the others: the third and the seventh. They are called guide tones because, on their own, they reveal the quality of the chord — that is, whether it sounds major, minor or dominant — and point to where the harmony is headed. In the progression Dm7–G7–Cmaj7, the seventh of Dm7 (the note C) drops a half step and becomes the third of G7 (the note B); then the seventh of G7 (the note F) drops a half step and becomes the third of Cmaj7 (the note E). Improvising along that thread already produces phrases that tell the whole progression with very few notes.

Target notes: choose the destination before you leave

A target note is the destination you choose for an important point in the bar — usually the strong beat or the moment the chord changes. In practice, you decide in advance: when G7 arrives, I want to be on B. The path there can use scale steps, chromaticism or a leap; what gives the phrase meaning is the arrival. This habit reverses the beginner's usual logic: instead of playing lots of notes and hoping one of them works, you play few notes with a clear direction.

Scales are candidates, not rules

The relationship between a chord and a scale is never an absolute rule: it is a candidacy that depends on conditions. Over a G7, the Mixolydian scale is a strong candidate when the song is in C major; in a minor context, or when the melody calls for altered tensions, other options describe the moment better. The same goes for pentatonics: they are practical and sound good in many styles, but they are no universal solution — a phrase convinces through rhythm, articulation and target notes, not through the scale it came from. The scale offers the alphabet; you are the one writing the phrase.

• Check the key and the chord's function in the passage — put simply, where it is heading;
• look at the song's original melody, which may call for or advise against certain tensions;
• consider the style: the same note can be seasoning in one genre and noise in another;
• test whether you can hear the scale resolving into a chord tone — if it doesn't resolve, it's a weak candidate.

Tensions and approach notes: color and motion

Tensions are the chord's extensions — the ninth, eleventh and thirteenth, natural or altered. They add color, but they demand direction: a ninth over Dm7 (the note E) sounds beautiful precisely because it can slide into a tone of the neighboring chord. Chromatic approaches, in turn, work like stepping stones: a half step below or above the target note, they create expectation and resolve it right away. A classic device is the enclosure: play the note above, then the note below, and only then the target. Tension without a planned resolution is not sophistication — it's a gamble.

A progressive practice roadmap

• Play a single note per chord of the progression — and choose it well;
• improvise using only thirds and sevenths, following the guide-tone thread;
• approach each target note by a half step, from below or from above;
• use a full scale, but rest only on chord tones;
• record a short improvisation and check whether the progression is recognizable without accompaniment.

At each stage, start slow and only speed up once sound, rhythm and intention stay clear — the body memorizes mistakes too. And remember that silence is musical material: short phrases, with breathing room between them, communicate more than a continuous stream of notes. A good test is to sing the phrase before playing it; if you can't sing it, it isn't yours yet.

Do I need to know every scale before I start improvising?

No. You can improvise musically knowing only the chord tones and the guide-tone thread. Scales expand your vocabulary and help connect destinations, but they come in after the skeleton is secure — not before.

Why does my improvisation sound like a scale going up and down?

Almost always it lacks rhythm and a target note. Limit yourself to a few notes, create a short rhythmic cell and repeat it, varying one element at a time. A phrase gains identity when it has a beginning, a direction and an arrival — not when it runs through the whole scale.

Is playing a note outside the chord always a mistake?

Not necessarily. A non-chord tone sounds like seasoning when it soon resolves into a structural note, and like an accident when it's left hanging. The difference lies in the resolution and the rhythm, not in the note itself.

On your instrument

If this scale won you over, the Chord & Fret app plays it along with you — any key, any tuning. Look it up on the stores.

References

Content reviewed against the standard harmony literature — verified bibliography below.

• Carlos Almada — Harmonia Funcional (Editora da Unicamp, 2009; 2ª ed. 2012)
• Bohumil Med — Teoria da Música (Musimed)
• Stefan Kostka; Dorothy Payne; Byron Almén — Tonal Harmony (McGraw-Hill)
• Edward Aldwell; Carl Schachter; Allen Cadwallader — Harmony and Voice Leading (Cengage)
• Jerry Coker — Elements of the Jazz Language for the Developing Improvisor (Alfred, 1991)
• Open Music Theory

Updated July 9, 2026