How to Review an Economic Impact Study Before Making a Decision

Table of Contents

• Why Economic Impact Studies Matter
• What an Economic Impact Study Measures
• Key Metrics to Review
• Checking Assumptions and Data
• Understanding Economic Models
• Warning Signs to Watch For
• Comparing Other Types of Analysis
• Simple Review Checklist
• Conclusion

Economic impact studies can shape major decisions about development, public funding, investments, incentives, and community projects. Before relying on a headline number, decision-makers should understand the methods behind it. Organizations seeking practical support with market and economic analysis may begin by exploring stratfordanalytics.com, then apply the same level of scrutiny to every forecast they receive.

A sound report does more than estimate jobs or spending. It explains what is being measured, where the data came from, what assumptions were used, and what could change the outcome. In simple terms, economic impact analysis estimates how a project, policy, business, or event may affect activity within a defined area.

Why Economic Impact Studies Matter

These studies can estimate changes in employment, wages, business activity, supply-chain spending, and tax revenue. They help boards, agencies, investors, and residents compare options. Still, a forecast is not a guarantee. Its usefulness depends on realistic assumptions, relevant data, transparent methods, and a clear explanation of uncertainty.

What an Economic Impact Study Measures

An impact study typically examines business activity, employment, labor income, output, value added, public revenue, and supplier activity. The crucial distinction is between total activity and a true net gain. A project may create substantial sales, but some spending may replace activity that would have occurred anyway or flow to firms outside the study area.

Reports should clearly state the geography, such as a city, county, region, or state, and the time period being measured. A claim that is reasonable for a statewide economy may be misleading when presented as a local benefit.

Key Metrics to Review

Know What Each Number Represents

• Direct effects: Initial project spending, hiring, payroll, or operations.
• Indirect effects: Supplier and business-to-business activity linked to direct spending.
• Induced effects: Household spending supported by employee income.
• Output: Total value of goods and services produced or sold.
• Value added: New economic value retained within the study area.
• Labor income: Wages, salaries, and related compensation.
• Employment: Jobs created, supported, retained, full-time, part-time, or seasonal.

Job totals deserve special attention. Construction jobs may last only months, while operating jobs may continue for years. Reports should separate job-years, temporary positions, part-time work, and permanent full-time roles rather than combining them into one large figure.

Checking Assumptions and Data

Start with the counterfactual, meaning what would likely happen without the project. Without that baseline, a study can mistakenly count existing or unavoidable activity as a new benefit. Also, ask whether the forecast assumes full occupancy, projected sales, expected visitor volume, or hiring targets that have not yet been achieved.

Review the data year, source notes, geographic fit, and treatment of missing information. Data should reflect the project’s location and industry whenever possible. For example, a proposed manufacturing facility may use national supplier patterns even though most materials will be purchased outside the region. That choice can overstate local indirect effects.

Readers can also compare estimates with completed projects of similar size, industry, and location. The input-output accounts maintained by the U.S. Bureau of Economic Analysis provide useful context for understanding how industries buy from and sell to one another.

Understanding Economic Models

Many studies use input-output models to trace how spending moves among businesses, workers, households, and industries. These models apply multipliers based on historical economic relationships. A multiplier is an estimate, not a promise that every dollar will repeatedly circulate locally.

Review whether the report explains regional purchase coefficients, imports, leakage, employment conversions, and scenario design. Strong methodology also shows how results change under lower spending, slower hiring, delayed construction, or reduced demand. Forecast ranges are usually more informative than a single, precise-looking estimate.

Warning Signs to Watch For

• Large job or output claims with little calculation detail.
• No stated study area, time frame, or comparison case.
• Gross spending is presented as a net economic benefit.
• Temporary and permanent jobs combined without labels.
• No discussion of displacement, imports, or local leakage.
• Multipliers are included without an explanation of their source.
• Older data used without adjustment or justification.
• No disclosure of who commissioned or funded the report.

A commissioned study is not automatically unreliable. However, transparent funding, visible assumptions, and clearly reported limitations make it easier for readers to judge whether the conclusions are balanced.

Comparing Other Types of Analysis

An economic impact study answers only one part of a decision. Other analyses may be needed:

• Cost-benefit analysis: Asks whether expected benefits exceed all costs, including public costs.
• Fiscal impact analysis: Examines whether tax revenue will cover the added public service and infrastructure demands.
• Feasibility study: Assesses whether a project can be viable financially and operationally.
• Market analysis: Evaluates customer demand, competition, pricing, and market conditions.

Questions to Ask the Analyst

1. Which assumptions have the greatest effect on the result?
2. What is the study’s most important limitation?
3. How were direct, indirect, and induced effects separated?
4. How were imports, displacement, and leakage treated?
5. What happens if spending or hiring reaches only 75 percent of the forecast?
6. Which figures are based on actual data rather than projections?
7. What should decision-makers avoid concluding from this report?

Simple Review Checklist

• ☐ The purpose, study area, and time frame are clear.
• ☐ Data sources and key assumptions are listed.
• ☐ The counterfactual is realistic and explained.
• ☐ Direct, indirect, and induced effects are separated.
• ☐ Temporary and permanent jobs are reported separately.
• ☐ Leakage, displacement, risks, and limitations are addressed.
• ☐ Alternative scenarios test less favorable outcomes.

Conclusion

A useful economic impact study should clarify a decision, not simply make a project appear larger. By reviewing the data, assumptions, model choices, job definitions, and alternative scenarios, readers can treat forecasts as valuable decision tools while avoiding the mistake of treating them as guarantees.