Empirical & Experiential Evidence Framework (3E Framework)
The 3E Framework is a decision-making model for organizational management that prioritizes operational data as the primary source of evidence, while integrating empirical research, industry benchmarks, and expert judgment. It involves within-source identification, assessment, and aggregation, followed by cross-source weighting, agglomeration, and incorporation to produce synthesized, evidence-based conclusions.
THE IDEA
Background
The 3E Framework (Empirical & Experiential Evidence Framework) adapts evidence-based practice to organizational management. It gives operational data priority because that data can be timely and specific to the decision. The framework acknowledges four sources of evidence: operational data, empirical research, industry benchmarks/norms, and expert judgment.
Key Concepts
- Operational Data: Granular, timely data (e.g., UPC scanner data) that provides decision-specific insights.
- Empirical Research: Generalizable findings from carefully designed studies, useful but not primary in management.
- Industry Benchmarks: Practice-derived generalizations (norms, standards) that provide points of comparison.
- Expert Judgment: Tacit knowledge from experienced practitioners, valuable but prone to bias.
Each source is imperfect individually: operational data is noisy, research is probabilistic, benchmarks are generic, and judgment is biased. However, when multiple sources converge (triangulation), confidence increases.
The 3E Process
The process is divided into within-source and cross-source steps:
Within-Source Steps
- Identification: Locate distinct sources of evidence.
- Assessment: Evaluate the quality and applicability of available data from each source.
- Aggregation: Combine type-specific evidence into a summary for each source.
Cross-Source Steps
- Weighting: Apply the framework’s proposed source hierarchy, with operational data highest and expert judgment lowest, after assessing the evidence.
- Agglomeration: Synthesize source-specific summaries into a unified conclusion.
- Incorporation: Integrate the evidentiary conclusion into the decision-making process.
Separating these steps makes it easier to examine why sources disagree and how each contributes to the conclusion.
Practical Obstacles
- Informational over-abundance from diverse sources.
- Need for a classification schema to organize evidence.
- Managing conflicting inputs from different sources.
The framework emphasizes that while operational data is dominant, all sources should be considered for triangulation.
When to use it
A marketing manager allocating budget across channels uses historical performance data (operational), published advertising elasticity studies (empirical), industry cost-per-click benchmarks, and agency recommendations (expert judgment).
A supply chain manager optimizing inventory levels uses real-time stockouts data, academic inventory theory, industry fill-rate benchmarks, and warehouse manager insights.
A product manager deciding on new features uses customer usage analytics, A/B test results, competitive feature benchmarking, and feedback from senior engineers.
FROM THEORY TO EVERYDAY LIFE
In practice
Retail Pricing Decision
A brand manager uses UPC scanner data (operational data) to assess price sensitivity, a published study on consumer behavior (empirical research), industry reports on competitor pricing (benchmarks), and a senior sales director's intuition (expert judgment). Applying the 3E process, the manager aggregates each source, weights operational data highest due to specificity, and reconciles conflicting signals (e.g., research suggests elastic demand, but operational data shows inelasticity) by favoring the operational evidence, leading to a price increase that lifts revenue.
Product Feature Prioritization
A product team compares usage logs and its own A/B tests with published research, competitor benchmarks and experienced engineers’ judgment. Under the 3E framework, the decision-specific operational evidence receives priority. The team checks whether the other sources support the same feature choice and investigates disagreements before deciding.
A MOMENT TO REFLECT
Put it to work.
How can you identify and access the four distinct sources of evidence in a typical decision you face in your organization?
When faced with conflicting evidence from different sources, what criteria can you use to weight them appropriately?
How could the 3E process help reduce the influence of cognitive biases in your team's decision-making?
Often confused with
CONTINUE THE CONVERSATION
Source texts
- Evidence-Based Decision-Making How to Leverage Available Data and Avoid Cognitive Biases (Andrew D. Banasiewicz)