Skip to main content
Tenant Protections Evolution

Why Tenant Protection Benchmarks Outlast Legislative Cycles

Tenant protections shift with each election cycle. A rent control ordinance passed in one administration may be weakened or repealed in the next. Eviction moratoriums expire. New disclosure rules replace old ones. Yet the core questions that drive tenant protection work—Are people able to stay in their homes? Is housing affordable? Are rental units safe and habitable?—do not change with a change in party leadership. This guide explains why qualitative and administrative benchmarks outlast legislative cycles, and how housing advocates, property managers, and local policymakers can choose and maintain durable metrics that survive political turnover. We focus on benchmarks that measure outcomes rather than policy inputs: eviction filing rates per rental unit, rent-to-income ratios, average time to repair code violations, and tenant satisfaction survey scores. These indicators reflect real conditions on the ground, regardless of which laws are in effect.

Tenant protections shift with each election cycle. A rent control ordinance passed in one administration may be weakened or repealed in the next. Eviction moratoriums expire. New disclosure rules replace old ones. Yet the core questions that drive tenant protection work—Are people able to stay in their homes? Is housing affordable? Are rental units safe and habitable?—do not change with a change in party leadership. This guide explains why qualitative and administrative benchmarks outlast legislative cycles, and how housing advocates, property managers, and local policymakers can choose and maintain durable metrics that survive political turnover.

We focus on benchmarks that measure outcomes rather than policy inputs: eviction filing rates per rental unit, rent-to-income ratios, average time to repair code violations, and tenant satisfaction survey scores. These indicators reflect real conditions on the ground, regardless of which laws are in effect. When a new city council majority repeals a just-cause eviction ordinance, the eviction filing rate still tells you whether tenants are being displaced. That continuity makes outcome-based benchmarks essential for long-term planning and advocacy.

Who Needs Durable Benchmarks and Why the Clock Is Ticking

Three groups most urgently need tenant protection benchmarks that survive legislative churn. First, local housing advocates who track conditions to push for stronger protections must be able to show baseline trends that predate any current law. If a new ordinance passes, advocates need pre-existing data to measure its effect. If a law is repealed, they need ongoing metrics to demonstrate the consequences. Second, property managers and landlords who operate across multiple jurisdictions face inconsistent reporting requirements; a common benchmark framework lets them compare portfolio performance without reconfiguring systems every time a city updates its code. Third, municipal policymakers and staff who design and evaluate tenant protection programs need indicators that are not tied to the lifespan of any single ordinance—otherwise, every transition in leadership erases the ability to measure long-term trends.

The Cost of Starting Over

When a city abandons its previous tenant protection metrics and adopts a new set after each election, it loses the ability to detect gradual changes. For example, a rent board that switches from tracking median rent increases to tracking only annual rent registration data may miss the accumulation of small above-inflation hikes that compound over five years. Starting over also wastes the institutional knowledge of how to collect, clean, and interpret data. Staff who developed expertise in one metric system may leave, and new hires must rebuild from scratch. The result is a fragmented record that makes it nearly impossible to answer basic questions like: Are evictions rising or falling over a decade?

What This Guide Delivers

By the end of this article, you will be able to identify which benchmarks are most resilient to legislative change, evaluate three common approaches to building a benchmark system, and implement a monitoring process that continues to produce useful data even when the political winds shift. We do not recommend a single “best” benchmark—the right choice depends on your resources, your audience, and the specific protections you care about. Instead, we provide decision criteria and trade-off analysis so you can make an informed choice that will serve you for years, not just until the next election.

Three Approaches to Building Tenant Protection Benchmarks

Organizations and governments typically adopt one of three benchmark frameworks: jurisdictional scorecards, tenant experience surveys, or administrative data dashboards. Each approach has a different relationship to legislative cycles. Below we describe each option, its typical lifespan, and the conditions under which it thrives.

Approach 1: Jurisdictional Scorecards

A jurisdictional scorecard aggregates multiple indicators—such as eviction rate, rent burden, and code violation density—into a single rating or grade for a city, county, or state. The scorecard is updated periodically (often annually) and published publicly. Examples include the National Low Income Housing Coalition’s “Out of Reach” report and various city-level housing stability indexes. Because scorecards rely on publicly available data (census estimates, court records, building inspection logs), they can be produced even when local laws change. The main risk is that the underlying data sources may themselves be affected by legislative shifts—for instance, if a state stops collecting eviction records or changes how they are reported.

Approach 2: Tenant Experience Surveys

Surveys directly ask tenants about their housing conditions, rent burden, interactions with landlords, and sense of security. Because surveys measure subjective experience, they are less dependent on administrative definitions that change with legislation. A tenant may report that they feel at risk of eviction even if local law does not define “just cause” in a way that covers their situation. Surveys also capture issues that administrative data miss, such as harassment or illegal lockouts. The downside is cost and response bias: surveys require funding, staff time, and careful sampling to avoid overrepresenting tenants who are easy to reach. Additionally, survey questions must remain consistent across years to allow trend comparison, which can be difficult if the survey team changes or if funders push for new questions.

Approach 3: Administrative Data Dashboards

A dashboard pulls data from city or county administrative systems—rent registration databases, eviction court filings, building inspection records, and code enforcement logs—and displays key metrics in near-real time. Because the data is generated by ongoing government processes, the dashboard can continue to function even if the political leadership changes, as long as the underlying data collection continues. However, administrative data is shaped by the rules in place: if a city stops requiring rent registration, the dashboard loses its rent data. Dashboards also require technical expertise to build and maintain, and they can be vulnerable to changes in data format or access policies.

Each approach has a characteristic lifespan. Scorecards and surveys can survive legislative cycles as long as their data sources remain available and their methodology stays consistent. Dashboards are more fragile because they depend on specific administrative processes that may be discontinued. In practice, many organizations combine two or three approaches: a dashboard for real-time monitoring, a survey for depth, and a scorecard for public communication.

How to Choose the Right Benchmark Framework

Selecting among these approaches requires weighing several criteria. We recommend evaluating each option against five dimensions: resilience to legislative change, data availability and cost, timeliness, relevance to tenant experience, and political acceptability. Below we explain each criterion and how it applies to the three approaches.

Resilience to Legislative Change

This is the most important criterion for our purpose. A benchmark that disappears when a law changes is not useful for long-term tracking. Scorecards that rely on census data are highly resilient because the census continues regardless of local policy. Surveys are resilient if the survey instrument remains stable. Dashboards are less resilient because they depend on administrative processes that can be defunded or restructured. However, a dashboard that uses data from multiple sources (e.g., court records plus building inspections) may survive the loss of one source.

Data Availability and Cost

Scorecards often use free public data, making them low-cost but limited to what is already collected. Surveys require funding for design, distribution, and analysis—a typical tenant survey of a mid-sized city can cost $30,000 to $80,000 per wave. Dashboards have high upfront development costs (often $50,000 to $150,000) but lower per-update costs if the data pipeline is automated. Organizations with limited budgets may start with a scorecard and add a survey every two to three years.

Timeliness

Dashboards can provide monthly or even weekly updates, which is valuable for detecting sudden changes (e.g., a spike in eviction filings after a moratorium ends). Scorecards are usually annual, which means they cannot capture rapid shifts. Surveys are typically biennial or triennial due to cost and respondent fatigue. For tracking the impact of a new law, a dashboard is ideal; for understanding long-term trends, a scorecard or survey suffices.

Relevance to Tenant Experience

Administrative data (eviction filings, code violations) captures only what is reported or enforced. Many tenant problems never reach an official record. Surveys capture the full range of tenant experience, including fear of retaliation, difficulty communicating with landlords, and disrepair that is not reported. Scorecards that include survey data are stronger on this criterion than those using only administrative data. If your goal is to understand how tenants actually fare, prioritize surveys or hybrid approaches.

Political Acceptability

In polarized environments, some benchmarks may be seen as partisan. Eviction filing rates can be controversial because they are influenced by both landlord behavior and tenant ability to pay. Rent burden is widely accepted as a neutral indicator. Surveys that ask about landlord responsiveness may be resisted by property owner groups. When choosing benchmarks, consider which metrics will be seen as credible by all stakeholders. A dashboard that shows both tenant and landlord perspectives (e.g., rent collection rates alongside eviction filings) may be more sustainable.

Trade-Offs at a Glance: A Structured Comparison

The table below summarizes the trade-offs among the three approaches across the five criteria. Use it as a quick reference when deciding which framework to adopt or how to combine them.

CriterionJurisdictional ScorecardTenant Experience SurveyAdmin Data Dashboard
Resilience to legislative changeHigh (uses persistent data sources)High (if survey instrument stable)Moderate (depends on admin processes)
Data availability and costLow cost, easy to startHigh cost per waveHigh upfront, moderate recurring
TimelinessAnnual or slowerBiennial or slowerMonthly or faster
Relevance to tenant experienceModerate (depends on indicators)High (directly measures experience)Low to moderate (only official records)
Political acceptabilityModerate (varies by indicator)Low to moderate (may be contested)Moderate (if balanced)

No single approach dominates. A scorecard is best for low-cost, resilient tracking. A survey is best for understanding tenant experience. A dashboard is best for real-time monitoring. Most organizations that sustain benchmarks across legislative cycles use a hybrid: a dashboard for early warning, a survey for depth every two years, and a scorecard for public reporting annually.

When to Avoid Each Approach

Do not rely solely on a dashboard if your local government is unstable—if the agency that collects data might be defunded, your dashboard will fail. Do not use only a survey if you need to detect rapid changes, such as the effect of a new eviction law in its first month. Do not use only a scorecard if your community has unique conditions (e.g., a large informal rental market) that are not captured by standard data sources. In those cases, a survey or custom dashboard is necessary.

Implementation Path: From Choice to Ongoing Monitoring

Once you have selected your benchmark framework, the next step is implementation. The process involves four phases: data collection, baseline establishment, regular reporting, and periodic review. Each phase must be designed to survive changes in personnel and policy.

Phase 1: Data Collection

For a scorecard, identify the publicly available datasets you will use (e.g., American Community Survey, court records, HUD data). Document the exact variables, time periods, and geographic boundaries. For a survey, develop a questionnaire that includes core questions that will not change (e.g., “How much rent do you pay each month?”) and a few rotating questions to address emerging issues. For a dashboard, build a data pipeline that extracts, cleans, and loads data from administrative systems. Use open-source tools and document every step so that a new staff member can take over.

Phase 2: Baseline Establishment

Before you can measure change, you need a baseline. Collect at least two years of historical data if possible. For scorecards, this may mean pulling five years of census data. For surveys, the first wave establishes the baseline; subsequent waves measure trends. For dashboards, backfill historical data from administrative records. The baseline period should be clearly defined and described in every report so that future readers understand the reference point.

Phase 3: Regular Reporting

Publish updates on a fixed schedule—quarterly for dashboards, annually for scorecards, biennially for surveys. Use a consistent format and include the same core metrics each time. Add context about any legislative changes that occurred during the reporting period, but do not change the metrics themselves. If a metric must be updated (e.g., because the census changes its definition of “rent burden”), run the old and new definitions in parallel for at least one cycle to show the effect.

Phase 4: Periodic Review

Every two to three years, review the benchmark framework. Are the data sources still available? Are the metrics still relevant? Have new tenant protection issues emerged that require new indicators? Involve stakeholders—tenants, landlords, policymakers—in the review. Make changes transparently, and always maintain a version history so that long-term trends can be reconstructed even after a methodology shift.

Risks of Choosing the Wrong Benchmark or Skipping Steps

Selecting a benchmark framework without considering legislative resilience can lead to wasted resources and misleading conclusions. Below are the most common risks and how to avoid them.

Risk 1: Metric Obsolescence

If you choose a benchmark that depends on a specific law (e.g., “number of rent increase notices filed under Ordinance 123”), the metric becomes meaningless if the ordinance is repealed. To avoid this, choose outcome-based metrics that are defined independently of any particular law. For example, instead of tracking “notices under Ordinance 123,” track “percentage of tenants who received a rent increase of 10% or more in the past year.” The latter can be measured through surveys or census data regardless of local law.

Risk 2: Data Source Discontinuation

Administrative data sources can disappear when budgets are cut or when agencies change their record-keeping practices. In 2020, several cities stopped publishing eviction data during the pandemic moratorium, leaving a gap in many dashboards. Mitigate this risk by using multiple data sources for each metric. If one source dries up, you have a backup. Also, establish data-sharing agreements with agencies that commit to providing data even during transitions.

Risk 3: Political Manipulation of Metrics

When benchmarks are used to evaluate policy, there is a risk that metrics will be redefined to make outcomes look better. For example, a city might change the definition of “affordable housing” from 30% of income to 40% of income, making the housing stock appear more affordable. To guard against this, use widely accepted definitions (e.g., HUD’s 30% threshold) and document any changes. Involve independent researchers or community groups in the benchmarking process to maintain credibility.

Risk 4: Ignoring Seasonal and Cyclical Patterns

Tenant protection metrics often vary by season—eviction filings are higher in summer, rent increases cluster at lease renewal dates. A benchmark that compares a single month to the same month last year can be misleading if the comparison period is affected by a legislative change. Always use rolling averages or year-over-year comparisons, and note seasonal patterns in your reports. If a new law takes effect in June, compare June of the current year to June of the previous year, not to the annual average.

Risk 5: Over-Reliance on a Single Metric

No single metric captures the full picture of tenant protection. Eviction rates can fall while rent burden rises. Code violation rates can improve while tenant satisfaction declines. Use a dashboard of at least five to seven metrics that cover different dimensions: affordability, stability, safety, and tenant voice. If one metric is disrupted by a legislative change, the others can still tell the story.

Mini-FAQ: Common Questions About Benchmark Longevity

This section addresses frequent concerns that arise when organizations try to maintain benchmarks across political transitions.

How often should we update our benchmarks?

Update frequency depends on the metric and the audience. Eviction filing rates can be updated monthly if court data is available. Rent burden from census data is only updated annually or every five years. For public reporting, annual updates are standard. For internal monitoring, quarterly may be sufficient. The key is consistency: choose a cadence and stick to it, even if no major policy changes occur. This builds a reliable time series.

What if a metric becomes impossible to collect?

If a data source disappears, document the gap and explain why the metric is missing. Do not fill the gap with estimated data unless you have a validated model. When possible, switch to a proxy metric that measures the same outcome using a different data source. For example, if eviction court records become unavailable, you might use tenant survey questions about “threat of eviction” as a proxy. Run the old and new metrics in parallel for at least one cycle to calibrate.

How do we ensure benchmarks are used by policymakers?

Policymakers are more likely to use benchmarks that are simple, timely, and relevant to current debates. Present metrics in a one-page summary with clear visualizations. Relate each metric to a specific policy lever (e.g., “eviction filing rate” relates to “just-cause eviction ordinance”). Build relationships with staff in relevant agencies so they understand the data. Offer to brief new officials after each election—this is when benchmarks are most vulnerable to being ignored.

Can benchmarks be used to compare different cities?

Yes, but with caution. Cities differ in demographics, housing stock, and legal context. A raw eviction rate comparison between a city with strong tenant protections and one without may reflect policy differences rather than underlying conditions. When comparing across jurisdictions, control for factors like median income, rental vacancy rate, and population density. Use standardized metrics (e.g., evictions per 100 rental households) and clearly state the limitations of cross-city comparisons.

What is the single most important benchmark to track?

If you can only track one metric, track the eviction filing rate per rental household. It captures housing stability, is influenced by many policies (rent control, just-cause eviction, legal aid funding), and is relatively easy to obtain from court records. However, it does not capture rent burden or housing quality, so it should be supplemented with at least one other metric as soon as resources allow.

Recommendation Recap: Building a Benchmark System That Lasts

Tenant protection benchmarks outlast legislative cycles when they are designed around outcomes, not policies. The most resilient benchmarks measure what tenants actually experience—eviction rates, rent burden, repair times—using data sources that persist regardless of who holds office. To build a system that survives political turnover, follow these five principles:

  1. Choose outcome-based metrics that are defined independently of any specific law. Avoid metrics that reference ordinance numbers or temporary programs.
  2. Use at least two data sources for each metric. If one source is disrupted, you have a fallback. Hybrid frameworks (scorecard + survey + dashboard) are most resilient.
  3. Document everything: data definitions, collection methods, processing steps, and any changes over time. This documentation ensures continuity when staff or leadership changes.
  4. Publish on a fixed schedule and maintain a version history. Even if no one reads the report immediately, the data will be valuable for future analysis.
  5. Review and adapt every two to three years, but keep core metrics stable. Add new indicators as needed, but never drop a core metric without running it in parallel for at least one cycle.

Start small. If you have no benchmark system today, pick one metric—eviction filing rate—and begin collecting it monthly. After six months, add a second metric, such as rent burden from census data. After a year, consider adding a tenant survey. The goal is not perfection on day one, but a consistent, documented process that can survive the next election, and the one after that. In a field where laws come and go, durable benchmarks are the foundation for real progress.

Share this article:

Comments (0)

No comments yet. Be the first to comment!