Peering with a big web farm (was Re: BBN Peering Issues)

Forgive me, but this raises an interesting engineering
and traffic-management issue.

Alex Rubenstein, turning John Curran's words around, suggested:

"The central problem is asymmetry of traffic between GTEI and the hosting
companies, Curran said. BBN/GTEI customers generally request webpages from
Exodus more than from other places."

which is an interesting point IN FAVOUR OF peering with a large
web hosting network at only one location.

If one can force all outgoing to-the-webhosted-site queries
through a single web cache, and the content is (or is made to be)
relatively undynamic, one has a huge caching potential.

With hot-potato routing towards a multiply-connected network,
the egress funnel which allows one to intercept all queries
disappears.

The "firehose" of replies back is mitigated not by a large
cache on the "large-audience" side of the peering, but by
clever distributed caching combined with redirecting browsers
from the "egress funnel intercpetor" to caches which are
closer to them.

Ideally one would only ever need one transfer per new piece
of content to satisfy one's entire customer base. Moreover,
depending on how static one required the content to be
(or conversely, how dynamic one allowed it to be), the actual
peering connection might even be intermittent.

How one would contract for this sort of peering, of course,
is a matter for com-priv, not for NANOG.

  Sean.

Alex Rubenstein, turning John Curran's words around, suggested:

> "The central problem is asymmetry of traffic between GTEI and the hosting
> companies, Curran said. BBN/GTEI customers generally request webpages from
> Exodus more than from other places."

which is an interesting point IN FAVOUR OF peering with a large
web hosting network at only one location.

If one can force all outgoing to-the-webhosted-site queries
through a single web cache, and the content is (or is made to be)
relatively undynamic, one has a huge caching potential.

Amen; I didn't even see that. But, that could work to BBN's favor!

-- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
                  Atheism is a non-prophet organization.
       I route, therefore I am.
       Alex Rubenstein, alex@nac.net, KC2BUO, ISP/C Charter Member
               Father of the Network and Head Bottle-Washer
     Net Access Corporation, 9 Mt. Pleasant Tpk., Denville, NJ 07834
Don't choose a spineless ISP! We have more backbone! http://www.nac.net
-- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --

If BBN wants to sell connectivity to a big web farm provider, how does
BBN's forcing all hits through a cache help BBN? The data all still
crosses BBN's backbone, and the the web farm provider won't need as big a
pipe. Maybe I'm missing something, but if BBN starts charging former
peers, I'd think caching at these edges would be a bad thing for BBN.