7 min readDan Mercer

    Why Open Rate Is a Vanity Metric (and What to Track Instead)

    Open rate is unreliable because Apple Mail Privacy Protection auto-loads tracking pixels and inflates the number, while the pixel itself can hurt deliverability. Track positive reply rate, meeting rate, and cost per meeting instead.

    Recap

    • Open rate is unreliable. Apple Mail Privacy Protection auto-loads the tracking pixel for every protected recipient, so opens get logged whether or not anyone read the email.
    • The tracking pixel that measures opens can also hurt deliverability, since it adds an external image request that spam filters dislike.
    • Track positive reply rate, meeting rate, and cost per meeting instead. Those tie to pipeline and money.
    • Positive reply rate is the best early read on whether your targeting and message are working.

    Open rate is a vanity metric because the number is inflated by software, not by readers. Apple Mail Privacy Protection pre-loads your tracking pixel through its own servers for every recipient who uses it, which logs an open whether the person read the email or never saw it. On top of that, the pixel you need to count opens can drag your deliverability down. So you are paying a real cost to collect a fake signal. Track replies, meetings, and cost per meeting instead.

    Why is open rate unreliable now?

    Because a large share of opens are machines, not people. Apple Mail Privacy Protection, rolled out in 2021 and on by default, fetches the tracking pixel ahead of time through Apple proxies. That fires the open event for protected users regardless of behavior. With a big slice of inboxes on Apple Mail, your reported open rate is a blend of real reads and automatic pre-fetches you cannot separate.

    It gets worse. Other providers and security scanners also pre-fetch images and follow links to check for threats. Those scans log opens and sometimes clicks too. So a high open rate can mean strong interest, or it can mean a corporate security gateway clicked everything in the message a half second after it arrived. You have no clean way to tell the two apart.

    How does the tracking pixel hurt deliverability?

    The pixel adds a tiny external image that the recipient client has to request from your tracking domain. That request is exactly the kind of thing spam filters weigh. A 1x1 image hosted on a domain the recipient has no relationship with is a classic spam fingerprint, and a fresh or low-reputation tracking domain makes it worse.

    Plain, text-style cold emails tend to land in the inbox more often than ones stuffed with tracking and HTML. For cold outreach, the trade is bad. You accept a measurable deliverability risk to collect a number you already cannot trust. Dropping the pixel often improves placement and costs you nothing real, because the open data was noise.

    What should I track instead?

    Track outcomes that move toward revenue: positive reply rate, meeting rate, and cost per meeting. These are hard to fake and they map to pipeline. A reply is a deliberate human action. A booked meeting is money in motion. Cost per meeting tells you whether the whole machine is worth running. Here is how the metrics stack up.

    MetricWhat it claims to measureHow reliableUse it for
    Open rateAttentionLow. Polluted by auto-opens and scannersRough deliverability alarm only
    Click rateInterestLow to medium. Security scanners click tooWeak supporting signal
    Positive reply rateReal interestHigh. A human chose to respond wellTargeting and message quality
    Meeting ratePipeline createdHigh. Hard to fakeWhether outreach produces opportunities
    Cost per meetingEfficiencyHigh. Ties effort to moneyWhether the program is worth scaling

    Why positive reply rate beats total reply rate?

    Because total reply rate counts the rejections, the angry notes, and the unsubscribe requests as wins. A flood of replies that all say stop emailing me is a warning, not a healthy campaign. Positive reply rate isolates the responses that show genuine interest, which is the signal you actually want to optimize against.

    This is also the fastest honest read you get. Meetings take days to book and weeks to show pattern. Positive replies show up the same day you send. Watch that rate by segment and by message, and you learn quickly which buyer thesis is real and which copy earns a response. It is the leading indicator that sits closest to the send.

    Which metrics are leading indicators of pipeline?

    Leading indicators are the ones that move before the money does, so you can correct course early. In order from earliest to latest: deliverability health (bounce and complaint rates), positive reply rate, meeting rate, then closed pipeline. Watch the early ones daily. They tell you about problems while you can still fix them.

    The trap with open and click rate is that they feel like leading indicators but they predict almost nothing about whether someone will reply or buy. They sit upstream in the funnel but they are too noisy to act on. A clean ordering looks like this.

    • Bounce and complaint rate. Your first alarm. Rising bounces or complaints mean a list or sending problem, and the 2024 Google and Yahoo bulk sender requirements made staying under the complaint threshold non negotiable.
    • Positive reply rate. The earliest signal that targeting and message fit are working.
    • Meeting rate. Confirms that interest converts to real conversations.
    • Cost per meeting. Confirms the program is efficient enough to scale.

    How do you instrument this without the pixel?

    You measure the things that leave a clean trail. Bounces and complaints come straight from the sending infrastructure. Replies are countable in the inbox, and a simple positive or negative tag on each makes positive reply rate trivial to compute. Meetings come from your calendar or CRM. None of these need a tracking pixel.

    The harder part is doing it consistently across every segment and message so the comparisons stay honest. This is where a system that owns the whole motion earns its place. LaunchSurface tracks replies, meetings, and cost per meeting per segment automatically, so the operator optimizes against outcomes rather than chasing an open rate that a proxy server inflated. Whatever you use, pick the metric that survives contact with reality.

    Frequently asked questions

    Is open rate completely useless?
    Not completely, but close for decision making. It can hint at gross deliverability problems if it crashes to near zero. As an absolute number or an A/B signal it is too polluted by auto-opens to trust.
    Why does Apple Mail Privacy Protection break open tracking?
    It pre-fetches the tracking pixel through Apple proxies whether or not the person opens the email. Every protected recipient registers as an open, so your rate climbs while telling you nothing about real attention.
    Should I just remove the tracking pixel?
    For cold outreach, usually yes. The pixel adds an external image request that spam filters notice, and the data it returns is mostly noise now. Plain text style emails tend to land better.
    What is a good positive reply rate for cold email?
    It varies by market and list quality, so chase your own trend rather than a benchmark. The point is to measure positive replies specifically, not total replies, since rejections and unsubscribes are replies too.
    How do I calculate cost per meeting?
    Add up everything you spend to run outbound in a period (tools, data, sending infrastructure, and any human time) and divide by the meetings booked that period. It is the number that ties outbound to money.

    Dan Mercer writes about outbound and go-to-market at LaunchSurface.

    MetricsCold emailDeliverability