COVID-19 vs. our Networks

We do about 70-80Gbps at peak over the external
BGP links we have and I am not seeing a large
increase nor am I seeing it spread out over time.
We're an eyeball network plus some really large
customers.

Anyone else seeing something different? We're
now into the 3rd day, so I thought I'd see
something change by now.

scott

Our traffic is normally about 1/3 during the day of what it is at night (6pm-midnight).

Since Monday the only change I've seen is that traffic goes to about 1/2 peak around 10am and stays there until about 6pm.

So no capacity concerns....

We have been fielding a ridiculous amount of "my VPN doesn't work, it's your problem" support calls though =\

I feel for any corporate IT guy right now.

Some VPN issues reported at my organisation as well

Mygroup has some members who cant join, so everyone else goes out, make groups on other platforms, which I hope scale.

South Africa and a few other African countries put countries on
semi-lockdown from about Sunday.

We've seen a 15% increase in peak traffic on our network since the 17th.

Mark.

I was getting blasted earlier for suggesting streaming services and gaming DLCs could likely be slowed by government intervention. EU is currently working with Netflix to do just that. It’s currently a strong suggestion and even a plead but I maintain that we’re going to see this pushed harder in the coming weeks.

In a statement on Thursday, Breton said that given the unprecedented situation, streaming platforms, telecom operators and users “all have a joint responsibility to take steps to ensure the smooth functioning of the internet during the battle against the virus propagation.”

https://www.cnn.com/2020/03/19/tech/netflix-internet-overload-eu/index.html

Agreed... 720 or 1080 Netflix will work just as fine as 4K for the next month or two.

A few more Netflix cache boxes might be nice. We've got one only 1 hop
away and I think we're keeping it busy.

EU regulations with such things are vastly different than in the US.

I’ve said it over and over again, we have TSP and it could easily be used to enforce priority to emergency preparedness customers. It’s built into the language.

Yes, you have said that. I still believe you are incorrect.

TSP allows priority for turnup of new capacity , and priority restoration for capacity. There is nothing in the regulations that I can find that would allow TSP to be used to rectify general internet congestion issues.

Well that’s pretty desperate. If you have an OCA connected to your network to serve your customers, I’m not sure taking streams down from HD to SD actually moves the needle. Mark.

Well, the article claims "Drop stream quality from HD". That means 4K,
1080p and 720p.

If you have an OCA on your network, how does this encourage consumers to
use the "extra bandwidth" for anything else?

Are we assuming we know how consumers want to spend their time now?

Mark.

Restoration:

The repair or returning to service of one or more telecommunications services that have experienced a service outage or are unusable for any reason, including a damaged or impaired telecommunications facility. Such repair or returning to service may be done by patching, rerouting, substitution of component parts or pathways, and other means, as determined necessary by a service vendor.

https://www.cisa.gov/sites/default/files/publications/OEC%20TSP%20Operations%20Guide%20Final%2012062016_FINAL%20508C.pdf

My understanding, and what we did while I worked for a Tier I ISP, was that even for degraded circuits we had to do everything in our power to restore to full operations. If capacity is an issue and causes TSP coded DIA circuits to be unusable then that falls under the “any reason” clause of that line.

Command & Control, promoted by “policy makers” who “do not see the shift”. You can’t tell people what to do with their online experience. These policies worked in the pre-Internet-on-a-device-en-masse age. They don’t work in 2020. Mark.

Consumers follow what they perceive as value. They gave up on Command &
Control tendencies of old.

Mark.

I don’t agree with your reading of this that applies downstream congestion issues to your TSP codes circuit. But I will not continue to debate the point.

Noticing a few major ISPs not peering with other major networks at their local IXs, instead taking cross country trips. I am sure this isn't helping congestion right now and I have heard from some people it is really affecting their remote users. People in the same city with 80ms-100ms latencies. Some companies with restrictive policies should review their peering policies and start really utilizing IXs for some quick capacity.

Maybe afterwards regulators can look at peering policies and how it affects their nation.

If you’re going to bang that drum, the place you’re going to get the most buck-for-your-bang is using it to force better cooperation between ISPs.

It appears that baking cakes was not sufficient to get recalcitrant players to work together.

https://www.flickr.com/photos/mpetach/4031195041

Perhaps a global pandemic may be sufficient to have government begin to compel networks to interconnect at locations at which they share common peering infrastructure?

If you’re worried about congestion and performance, that would be the place to start pushing.

Matt
staying safely at home away from the flame-fest that may ensue from this. ^_^;

Interesting thought, Matt.

I’ve emailed both of my Senators to inform them of this issue and its potential impact on the resiliency of the internet (the most infamous culprit being an operator of root DNS servers, to name a specific example). I would encourage every NANOG member who cares about this issue to do the same.

It may be a shot in the dark, but it’s a start I guess…

-Matt

As long as NetFlix lowers their prices proportionately with their reduced level of service. For example, if NetFlix decides they will only provide "half-quality" service then they should only charge half price.