Quantitative Analysis/ Regression
Modelling ordered outcomes

What is ordinal regression? Theory, calculation and application

Ordinal regression models outcomes with a natural order, such as satisfaction ratings or severity levels. This guide covers the latent-variable view, the proportional odds assumption and how to check it, how to read odds ratios and cut points, and how to run it in AnalyZ Solutions.

14 min read Regression Advanced

01What is ordinal regression?

Ordinal regression is a method for studying outcomes with ordered categories, such as ratings from low to high. It shows which factors are linked to a higher or lower category, how strongly, and how likely each category is for a particular person.

Many outcomes are ordered: satisfaction from very dissatisfied to very satisfied, pain from mild to severe, agreement on a five-point scale. The order matters, but the distances between the categories are unknown. The thing you want to explain is the outcome, and the factors you use to explain it are the predictors.

An example

Suppose 400 people rate a service as Low, Medium or High satisfaction. You also know each person's gender, their age, and whether they use the service online. You want to know three things. Do women and men rate it differently once age and use are taken into account? Does satisfaction rise with age? And what are the chances of Low, Medium and High for a woman aged 40 who uses the service online? Ordinal regression answers all three.

Why not use another method?

Linear regression treats the categories as numbers, such as 1, 2 and 3, and assumes the gap between each pair is equal. Is the gap between very dissatisfied and dissatisfied really the same as the gap between satisfied and very satisfied? Nobody knows. Multinomial regression avoids that assumption but throws away the order. Ordinal regression respects the order without assuming equal gaps.

What you get out of it

  1. Direction
    Whether each predictor moves people towards higher or lower categories.
  2. Size
    How much, usually as an odds ratio, which a later section explains.
  3. Confidence
    Whether the pattern could easily be chance, shown by a significance level and a confidence interval.
  4. Prediction
    The chance of each category for any combination of predictor values.
Results are adjusted for the other predictors. The effect of each predictor is the effect among people who are the same on the others, so differences in those do not distort it.

02When to use it

Use ordinal regression when the outcome has three or more ordered categories and you want to relate it to predictors. Common examples are Likert items, income bands or severity categories, education levels, and severity ratings.

If the outcome has only two categories, use logistic regression. If the categories have no order, use multinomial regression. If the outcome is a sum of several Likert items and has many distinct values, linear regression is often acceptable. For comparing groups without predictors, the Kruskal-Wallis and Mann-Whitney tests are simpler options.

Ordinal compared with linear and multinomial regression

How the three models treat an ordered outcome
FeatureLinear regressionOrdinal regressionMultinomial regression
OutcomeNumericThree or more ordered categoriesThree or more unordered categories
Use of the orderTreats the codes as numbers with equal gapsUses the order without assuming equal gapsIgnores the order
Coefficients per predictorOneOneOne for each category except the reference
Key assumptionEqual gaps and normal errorsProportional oddsNone about the order
Effect measureDifference in the scoreOdds ratioRelative risk ratio
Number of parametersFewFewMany

03The building blocks: cumulative chances, cut points and a hidden scale

Ordinal regression rests on two ideas: working with cumulative chances instead of the chance of each category on its own, and picturing the categories as slices of a hidden scale.

Cumulative chances

Instead of the chance of each category separately, the model works with the chance of being at or below each point on the scale. For a man aged 40 who does not use the service online, that might be a 51% chance of being at Low, a 77% chance of being at Low or Medium, and a 100% chance of being at High or below. The chance of a single category is the difference between neighbouring cumulative chances. Medium is 77% minus 51%, which is 26%, and High is 100% minus 77%, which is 23%.

The latent-variable view

Behind an ordered answer sits a hidden continuous scale, such as how satisfied a person really is. Cut points divide that scale into the categories people actually report: below the first cut point the person says Low, between the two cut points Medium, and above the second High. Predictors move a person's position on the hidden scale. Among people with the same predictors, positions follow a logistic curve.

The figure shows two profiles drawn over the same cut points. For the profile on the right, the whole curve has moved to the right, so more of it lies beyond the second cut point. The High category grows and the Low category shrinks. Only the position of the curve changes between people. The cut points are fixed and shared, which keeps the model simple and is exactly what the proportional odds assumption describes.

Figure 1. Cut points divide an unobserved scale into the ordered categoriesTwo logistic curves over the same cut points. In the right panel the curve is shifted to the right, so more of its area lies in the High category.Man aged 40, does not use the servicecut point 1cut point 2average 0.71Low51%Medium26%High23%Unobserved satisfaction scaleWoman aged 40, uses the servicecut point 1cut point 2average 1.56Low31%Medium29%High41%Unobserved satisfaction scale
Figure 1. Cut points divide an unobserved scale into the ordered categories

04The proportional odds idea

The most common version, and the one in AnalyZ Solutions, is the proportional odds model. It imagines a series of cut points that divide the scale, for example between dissatisfied and neutral, between neutral and satisfied, and so on. Each predictor is assumed to have the same effect at every cut point.

In practice, this gives you a single odds ratio for each predictor. If the odds ratio for women compared with men is 1.8, women have 80% higher odds of being in a higher satisfaction category than men, and this holds whether you are looking at the boundary between low and middle, or between middle and high.

This is a strong assumption, and it can fail. A change to a service might help people move from low to middle satisfaction but do nothing to move them from middle to high. When the assumption fails, a single odds ratio hides that pattern.

Checking the assumption informally

AnalyZ Solutions does not currently test the assumption, so check it yourself. Split the scale at each cut point into two groups, run a logistic regression for each split, and compare the odds ratios for your key predictors. In the example, satisfaction has three levels, so there are two splits: Medium or High against Low, and High against Low or Medium.

Odds ratios from the ordinal model and from separate logistic regressions at each split
PredictorOrdinal modelSplit 1: Medium or High against LowSplit 2: High against Low or Medium
Gender: Female (ref: Male)1.65 (1.14 to 2.39)1.81 (1.20 to 2.73)1.44 (0.94 to 2.20)
Age (per 10 years)1.20 (1.04 to 1.37)1.28 (1.10 to 1.50)1.09 (0.93 to 1.27)
Uses the online service (ref: No)1.42 (0.97 to 2.07)1.37 (0.89 to 2.09)1.40 (0.91 to 2.15)

The ratios from the two splits are broadly similar, and every interval overlaps the ordinal estimate. Age shows the largest gap, 1.28 against 1.09, but the intervals overlap widely, so there is no clear evidence against proportional odds. A warning sign would be ratios that point in different directions, or intervals that do not overlap, for example a ratio of 3 for one split and 1 for the other.

Figure 2. Checking the proportional odds assumption by splitting the scaleDot and whisker chart. For each predictor, the odds ratios from two separate logistic regressions are shown with a diamond for the single ordinal model ratio. The intervals overlap.0.811.523Gender: Female (ref: Male)Age (per 10 years)Uses the online service (ref: No)Split 1: Medium or High, against LowSplit 2: High, against Low or MediumOrdinal model, one ratio for both splitsOdds ratio with 95% confidence interval (log scale)
Figure 2. Checking the proportional odds assumption by splitting the scale

These separate regressions are a check, and you should not report them in place of the ordinal model. If the assumption clearly fails, you can report the splits separately, merge categories, or use multinomial regression and give up the ordering. AnalyZ Solutions fits only the proportional odds version.

05The model and how it is calculated

The model

Ordinal regression models the cumulative chance of being at or below each level. For three levels (Low, Medium, High) there are two cumulative probabilities, the chance of Low and the chance of Medium or lower. Each cut point θ divides the scale, and the same predictor index is used for every cut point.

index = b1 × x1 + b2 × x2 + ...
ln( P(level ≤ j) / P(level > j) ) = θj - index
P(level ≤ j) = 1 / ( 1 + e^-(θj - index) )

The minus sign means a higher index pushes people towards higher levels. The chance of a single level comes from subtracting neighbouring cumulative probabilities. The coefficients and the cut points are found together by maximum likelihood, and e^b is the odds ratio.

Making a prediction

Take a woman aged 40 who uses the online service, with cut points θ₁ = 0.752 and θ₂ = 1.948.

  1. Index
    0.500 × 1 + 0.178 × 4 + 0.352 × 1 = 1.565, where age is measured in decades.
  2. Chance of Low
    1 ÷ (1 + e^-(0.752 - 1.565)) = 0.307.
  3. Chance of Medium or lower
    1 ÷ (1 + e^-(1.948 - 1.565)) = 0.595.
  4. Single levels
    Low = 0.307. Medium = 0.595 - 0.307 = 0.287. High = 1 - 0.595 = 0.405.

For a man aged 40 who does not use the service, the index is 0.713, and the same steps give Low 51%, Medium 26%, and High 23%. The gap between the two profiles combines the effects of gender, age and use of the service across the whole scale.

The odds ratio for gender is e^0.500 = 1.649. Because one set of coefficients serves every cut point, this ratio is assumed to be the same at each step of the scale. That is the proportional odds assumption.

06Assumptions

Ordinal regression rests on a few assumptions. Breaking them does not stop the model from running, but it can mislead.

07Reading the output

Odds ratios

Each predictor's effect is reported as an odds ratio with a 95% confidence interval and a significance level, with a toggle for raw coefficients on the log-odds scale. An odds ratio above 1 means higher values of the predictor go with a higher position on the outcome scale. Below 1 means a lower position. For a categorical predictor, the comparison is with the reference category.

Read the direction against the way the scale is coded. If your outcome is coded from 1 for very satisfied to 5 for very dissatisfied, an odds ratio above 1 means more dissatisfaction.

An odds ratio of 1.65 for women does not mean women are 65% more likely to be in the High category. It means their odds of being above any given cut point are 65% higher. The effect on the probability of each category depends on where the person starts.

Cut points

The table lists cut points, also called thresholds, which mark the boundaries between adjacent categories. They are on the log-odds scale. In the example the cut points are 0.752 and 1.948, so a person whose index is 0 would have a 68% chance of the Low category. They are structural parts of the model and not results to interpret, and you do not need to report them in a findings summary. They are needed to calculate predicted probabilities, as in the worked prediction above.

What happens to the middle category

When a predictor raises the index, probability moves out of the lowest category and into the highest. The middle category can rise or fall, because it gains people from Low and loses people to High. In the figure, the chance of High rises steadily with age in both profiles and the chance of Low falls, while Medium barely moves.

Figure 3. Predicted chance of each satisfaction level by age for two profilesTwo stacked bar charts. In both, the share in the High category rises with age, and women who use the service have a larger High share than men who do not.Man, does not use the service0%25%50%75%100%602317205525203051262340472826504229296038293370AgeWoman, uses the service0%25%50%75%100%392932203529363031294140272845502427496021265470AgeLowMediumHigh
Figure 3. Predicted chance of each satisfaction level by age for two profiles

When your readers need to see this, report predicted probabilities for example profiles next to the odds ratios.

Model fit

The summary gives the number of cases, the number of outcome levels, the log-likelihood, a likelihood-ratio test, a pseudo R-squared, and AIC.

08How to run it in AnalyZ Solutions

Open Inferential Analysis, choose Regression, then Ordinal Regression.

  1. Select the dependent variable
    Choose an ordered outcome with three or more categories. The page lists the detected levels in order below the selector, so you can check that the order is correct.
  2. Select the independent variables
    Choose numeric or categorical predictors.
  3. Set reference categories
    Categorical predictors are converted to comparisons against a reference category automatically. Pick the reference category you want each group compared with, usually the largest or the most natural comparison group.
  4. Apply a subsample filter if needed.
  5. Click Run regression
    The output includes the coefficient table with the odds ratio toggle, the cut points, the model summary, a plot of the odds ratios, and a plain-language interpretation.
Check the level order before you run. The detected levels are shown with less-than signs between them. If they appear in an unexpected order, for instance because the categories are stored as text, recode the variable so that the codes follow the scale.

09Interpreting the result

The figures below are invented to show the steps, and they follow the results tables in AnalyZ Solutions, with a few columns left out to save space. Suppose 400 people rate a service as Low, Medium, or High satisfaction, in that order. The predictors are gender (reference: Male), age in decades, and use of the online service (reference: No).

Model summary
NLog-likelihoodLR chi2dfProb > chi2Pseudo R²AICLevels
400-427.460115.1330.00170.017864.923
Odds ratios
VariableOdds ratio95% CI lower95% CI upperp-valueSig
Gender: Female (ref: Male)1.6491.1402.3860.0079**
Age (per 10 years)1.1951.0421.3710.0108*
Uses the online service (ref: No)1.4210.9742.0750.0685ns

Reading it step by step

  1. Check the order of the outcome levels
    The levels should appear in the order Low, then Medium, then High. Here they hold 160, 112, and 128 respondents. An odds ratio above 1 means higher values of the predictor go with a higher level of satisfaction.
  2. Read the categorical predictor
    The odds ratio for women compared with men is 1.649, with an interval of 1.140 to 2.386 and a p-value of 0.0079. Women have about 65% higher odds of being in a higher satisfaction category. Because of the proportional odds assumption, this single ratio applies at every step of the scale.
  3. Read the numeric predictor
    The ratio for age is 1.195 per 10 years, significant at the 5% level. Each extra decade of age goes with about 20% higher odds of being in a higher category.
  4. Read the non-significant result
    Use of the online service has a ratio of 1.421, but the p-value is 0.0685 and the interval, 0.974 to 2.075, includes 1. The data lean towards higher satisfaction among users, but the evidence does not reach the 5% level. Do not report it as a confirmed effect.

In plain words

Women and older respondents tended to report higher satisfaction, and both differences are significant at the 5% level or better. Users of the online service also leaned towards higher satisfaction, but the evidence was too weak to be sure. The cut points that the model estimates describe the scale and are not findings. Check informally that key effects are similar at each step of the scale before relying on a single odds ratio.

10Common mistakes

Using it for unordered categories. The model assumes the order is meaningful.

Ignoring the coding direction. Read every odds ratio against the way the scale is coded.

Reading an odds ratio as a change in probability. It describes the odds of being above a cut point. The change in each category's probability depends on the starting point.

Assuming proportional odds without a check. If key effects differ across the scale, a single odds ratio can mislead.

Reporting the cut points as findings. They describe the scale, not the effects.

Frequently Asked Questions
How is ordinal regression different from multinomial regression?
Multinomial regression ignores the order of the categories and fits a separate set of coefficients for each one. Ordinal regression uses the order and fits one set of coefficients for all of them, which is simpler and more precise when the proportional odds assumption holds.
What do I do if the proportional odds check fails?
Report the odds ratios from the separate splits, merge categories so that fewer cut points are involved, or switch to multinomial regression and accept the loss of the ordering. AnalyZ Solutions fits only the proportional odds model.
What is the proportional odds assumption in simple terms?
It says each predictor pushes people up or down the scale by the same amount no matter where on the scale you look. It is convenient because it gives one odds ratio per predictor, but it does not always hold.
How many categories can the outcome have?
The module accepts ordered outcomes with three to twenty categories. Very long scales with few respondents per level are better treated as numeric.
Should I treat a five-point Likert item as numeric or ordinal?
For a single item, ordinal regression is the more defensible choice. For an average of several items, which behaves like a numeric scale, linear regression is generally acceptable and easier to explain.
Can I collapse categories to simplify the model?
Yes, when it makes conceptual sense, such as merging strongly agree and agree. It reduces the number of sparse levels, but it also discards detail, so state that you did so.
How is an odds ratio interpreted here compared with logistic regression?
It has the same meaning but applies across the whole scale. It is the odds of being in a higher category rather than a lower one, for one group compared with another or for each one-unit increase in a numeric predictor.

Model an ordered outcome

Open Regression in AnalyZ Solutions. Free to sign up, free to analyze.

Get started
Related Guides