Onpode
Cover art for When moving data costs more than moving compute — the economic boundary between cloud and edge

When moving data costs more than moving compute — the economic boundary between cloud and edge

August 3, 2026 · 10 min

Eliza Ward & Brian Reed

Cloud egress fees — AWS at $0.09/GB, Azure at $0.087, Google Cloud at $0.085 for the first 10 TB monthly — aren't cost recovery; they're a structural penalty on leaving. For latency-hard workloads like real-time industrial inference, physics mandates edge regardless. For everything else, that pricing distorts decisions that physics left open.

Centralized cloud computing and distributed/edge computing represent two architectural poles in a longstanding engineering tradeoff, each dominant in different workload contexts. Major centralized cloud platforms — AWS, Microsoft Azure, and Google Cloud — consolidate compute, storage, and networking into hyperscale regional data centers organized into availability zones.

0:009:50
Get the next episode on Technology

Follow it free — new episodes land in your feed.

Or make your own — any topic, in minutes

More Onpode episodes on Technology

About this episode

The question isn't really cloud versus edge — it's about where the two models hit their physical and financial limits, and what happens in the space between them. This episode works through a deceptively simple premise: sometimes moving data costs more than moving compute, and when that's true, the architecture isn't a choice anymore. The conversation opens with Amazon Go — not as a tech story, but as a physics argument. Sub-second response times across thousands of simultaneous interactions can't survive a round-trip to a regional data center. The speed of light is the constraint. From there, the episode traces how AWS's aggregation model — genuinely brilliant engineering that drove hardware utilization up by pooling workloads — produced an egress pricing structure that now acts as a lock-in mechanism: roughly nine cents per gigabyte at AWS, eight-point-seven at Azure, eight-point-five at Google Cloud. The harder argument is about the gray zone. For latency-constrained workloads — real-time inference, industrial IoT, autonomous systems — edge is mandatory regardless of price. But for everything else, the egress bill quietly distorts architectural decisions away from what the physics would actually suggest, steering architects toward centralized defaults even when a hybrid approach would be more rational. Add operational complexity — edge hardware that requires on-site expertise most teams don't have — and both walls hit at once. The episode doesn't resolve cleanly, which is probably the honest answer. The continuum between cloud and edge is real. The scaffolding to run both without picking one and living with the consequences mostly isn't, yet.

Frequently asked

When does edge computing make more sense than cloud computing?

Edge computing is physically mandatory — not just preferable — when round-trip latency to a cloud data center exceeds the decision window. A factory bearing-fault detection model with a 200-millisecond response requirement and a $40,000/hour shutdown cost cannot route to AWS and back in time. Real-time inference, IoT sensor processing, and autonomous systems fall into this category.

How much does AWS charge for data egress, and why does it matter?

AWS charges approximately $0.09 per gigabyte for data egress; Azure charges $0.087 and Google Cloud $0.085 for the first 10 terabytes monthly. These fees don't reflect actual data-transfer costs — they create a financial penalty on moving workloads out of centralized cloud, which distorts hybrid architecture decisions for workloads where edge would otherwise be beneficial.

Is cloud versus edge computing a strategic choice or a technical constraint?

For latency-constrained workloads — real-time AI inference, industrial automation, Amazon Go-style retail — edge computing is a hard physical constraint, not a choice. For batch processing, ML training, and long-term storage, centralized cloud is the rational default. The genuine debate lives in the middle: workloads that are partly latency-sensitive but not absolutely, where egress pricing distorts the decision.

What are the main barriers to adopting a hybrid cloud-edge architecture?

Hybrid cloud-edge architectures face two compounding barriers: egress pricing (AWS at $0.09/GB makes moving data out financially punishing) and operational complexity (edge hardware requires on-site staff that most enterprises lack). These two costs hit simultaneously — organizations often can't afford the edge hardware, and if they could, they can't staff it.

Does Amazon use edge computing in its own stores despite running AWS?

Amazon Go stores process thousands of simultaneous customer interactions with sub-second response times using edge computing — the same company that operates AWS, the dominant centralized cloud platform since 2006. The store's computer-vision system cannot route to an AWS data center and return fast enough; the speed of light makes local edge processing the only viable option.

Grounded in 12 sources
Modeling Tradeoffs between mobility, cost, and performance in Edge Computing · arxiv.org
Cloud Revolution: Tracing the Origins and Rise of Cloud Computing · arxiv.org
Navigating the Edge-Cloud Continuum: A State-of-Practice Survey · arxiv.org
Cloud and Edge Computing Architectures: A Survey · doi.org
Edge Computing and Cloud Computing for Internet of Things: A Review · pdfs.semanticscholar.org
Edge Computing | Accenture · accenture.com
Edge Computing History — CDN, MEC ETSI, Lambda@Edge, WASM PoPs | ADHDecode · adhdecode.com
Edge vs Cloud Computing — Latency, Egress, Data Residency, Control Planes | ADHDecode · adhdecode.com
The end of cloud-first: What compute everywhere actually looks like | CIO · cio.com
What is Edge Computing – Distributed architecture · cisco.com
Edge computing: Enabling exciting use cases - Ericsson · ericsson.com
Edge Computing in 2026: Use Cases, Technology, Edge IoT & Edge AI · flolive.net
Read transcript

Brian Reed: Eliza, I have to tell you — I walked through an Amazon Go store last week just to watch it work, and I stood there for probably two minutes trying to catch the lag. The moment where the system has to think. And there wasn't one. Which sounds like a product demo, but it's actually the entire episode.

Eliza Ward: Because that's not magic, it's a physics constraint. Thousands of simultaneous customer interactions, sub-second response times — that computation cannot travel to an AWS data center and come back fast enough. The speed of light is the issue.

Brian Reed: Which is — okay, this is the part that I keep turning over. AWS launches in 2006, essentially defines what enterprise computing looks like for the next decade-plus. Centralized. Everything in a big regional data center. Pay per hour, pay per gigabyte. That's the model. And then the same company builds grocery stores that prove the model has a ceiling.

Eliza Ward: Not a ceiling — a *scope*. AWS still handles AI model training at a scale edge can't touch. That's the same company making both bets simultaneously.

Brian Reed: So what we're actually trying to figure out today is — is cloud versus edge even a decision? Or is it a constraint that disguises itself as a strategic choice?

Eliza Ward: Yeah — and the plain version of this is actually pretty simple. Centralized cloud: imagine all your city's computing happens in one enormous facility. Incredibly efficient. Massive economies of scale. Edge computing puts smaller processing nodes close to wherever the action is. The tradeoff is latency versus cost and complexity.

Brian Reed: The part I want to stress-test is whether 'tradeoff' is even the right word. Because for Amazon Go, it's not a tradeoff — edge is the only option that works. That's not a choice.

Eliza Ward: That's the position, and I'm not sure it survives past the most latency-extreme cases. That's what we're actually here to figure out.

Brian Reed: But the 'scope' framing — I'm not sure that's doing the work you want it to. Because Akamai figured out the underlying principle in 1998. Yahoo's servers kept crashing, and Akamai's fix was: don't send the request all the way to the origin. Process closer to the user. That's it. That's edge computing. We didn't learn something new — the incentives just shifted.

Eliza Ward: Wait — CDNs are not edge computing. That's a category error.

Brian Reed: The principle is identical though. Move compute closer to where the data lives. Whether it's a cached webpage in 1998 or a bearing-fault inference model on a factory floor in 2024, the physics argument is the same one.

Eliza Ward: Caching static content is not running inference. One's serving a file. The other is— actually, no, let me hold that. The stronger point is the financial one. AWS egress runs about nine cents a gigabyte. Azure's at eight-point-seven. Google Cloud eight-point-five, for the first ten terabytes monthly. That's not infrastructure cost recovery. That is a structural penalty on ever moving your data out.

Brian Reed: Right — but who built the system that made that pricing sticky?

Eliza Ward: AWS. In 2006. Availability zones, managed services, pay-as-you-go — the aggregation model is genuinely brilliant engineering. Hardware utilization goes way up when you pool workloads. That's real. Batch processing, ML training, long-term storage — centralized cloud wins those cleanly. The egress pricing is what happens when the aggregation becomes the lock-in.

Brian Reed: So the thing that made cloud dominant is now the mechanism punishing hybrid architectures.

Eliza Ward: That's the flag I'm planting, yeah. And Microsoft Azure has Azure Arc, Google Cloud has its distributed offerings — they're all selling hybrid now. But the egress number doesn't change when you buy the hybrid pitch.

Brian Reed: So the continuum is real as a product category but the pricing structure is still built for centralized. I mean — that's not a solved problem. That's a contradiction they're selling as a solution.

Eliza Ward: And that contradiction is exactly where the manufacturing floor breaks it open. Because Tuesday morning, 9:47 AM, Ohio facility — vibration anomaly on a machine, bearing wear. Shutdown costs forty thousand dollars an hour. The decision window is two hundred milliseconds. That data cannot go to AWS and come back. That's not a preference. That's physics.

Brian Reed: And it's not just that one scenario — the part I don't get glossed over is that this is the entire class of AI inference. Training stays central, fine. But the moment you deploy a model to make real-time decisions, it has to live at the edge. Amazon Go, industrial robots — same pipeline, both architectures, simultaneously required.

Eliza Ward: Wait — that's one narrow class of workload, though.

Brian Reed: Is it? Utility field-area network gateways — meter data, processed locally — not because someone made an architectural preference, but because the network physically could not support cloud round-trips. That's not a niche. That's infrastructure.

Eliza Ward: Okay, I'll give you the latency constraint is real. But is the continuum actually operational? Or is it a research concept that Google Cloud and Azure are packaging as a product while the egress bill still punishes every hybrid decision?

Brian Reed: The tooling being immature doesn't make it structurally optional. The Ohio factory doesn't get to wait for better tooling. The bearing is wearing right now.

Eliza Ward: No, I know — and that's the distinction I'm actually trying to draw. Workload fit for real-time inference, IoT, autonomous systems — I'll concede that. That's a genuine hard constraint. But the egress pricing, the nine cents a gigabyte AWS charges — that's not cost reflection. That's a deliberate mechanism, and it distorts every other architectural decision away from what the physics actually demands. And that part gets worse when you see what's behind the pricing model.

Brian Reed: So — hang on. You're saying the constraint is real but the market around it is rigged?

Eliza Ward: I'm saying they're two separate forces that we keep treating as one. The physics forces the split. The pricing decides who can afford to act on it.

Brian Reed: And the IT director in Ohio — the one staring at a forty-thousand-dollar-an-hour shutdown — they're not debating the continuum. They're asking whether they can afford to run an edge server that nobody on staff knows how to maintain. The constraint is real. The solution is still out of reach for half the people who need it.

Eliza Ward: And that's the trap closing on itself — because AWS at nine cents a gigabyte, Azure at eight-point-seven, Google Cloud at eight-point-five — those numbers aren't reflecting what it costs to move data. They're reflecting what it costs you to leave.

Brian Reed: Okay but — even if those fees dropped to zero tomorrow, the Ohio factory still needs an edge server. The physics doesn't change.

Eliza Ward: No, that's — yeah, I'll give you that. For real-time inference, latency-constrained workloads, the split is mandatory regardless of what AWS charges. That's a genuine hard constraint. I'm conceding that.

Brian Reed: Okay. So where does the disagreement actually live?

Eliza Ward: In everything that's not the Ohio factory. Most enterprise workloads — batch processing, analytics, storage — centralized cloud is genuinely the rational default. Pay-as-you-go, no capital expenditure, managed services. Cloud-first makes sense there. But the egress pricing means that when an architect looks at a workload that's maybe sixty percent latency-sensitive, they don't build the theoretically correct hybrid. They stay centralized because moving data out is financially punishing. The pricing distorts decisions that physics left open.

Brian Reed: So your claim is — the cases where edge would help but isn't mandatory, that's where the nine cents kills it.

Eliza Ward: That's exactly it. And that's the gap that stays real.

Brian Reed: I think that's right — but I'd want to see the deployment data before calling it the primary distortion. Because operational complexity might be killing hybrid architectures before the egress bill even arrives.

Eliza Ward: Yeah, and I'm not sure we can separate those two things cleanly. The egress bill and the operational complexity — they compound. You can't afford the edge hardware, and if you could, you can't staff it. Both walls hit at the same time.

Brian Reed: Which is — I mean, that's kind of where we land, isn't it. The continuum exists. It's real as a concept, documented in the surveys, real in the hardware. But nobody's built the scaffolding to run both without an engineer just picking one and living with the bill afterward. Akamai proved the principle in 1998. We're still waiting for the tooling in 2025.

Eliza Ward: And until egress pricing disappears, every intelligent architectural choice gets taxed. That's not engineering. That's a business model.

Brian Reed: Uncomfortable place to stop.

Eliza Ward: Good uncomfortable. Thanks for pushing on the operational complexity piece — I kept wanting to make it cleaner than it is.

When moving data costs more than moving compute — the economic boundary between cloud and edge · Onpode