RE: IPv6 side of www.charter.com has been down since Friday, September 16 5:12 am Central

Takes our HE tunnel to get out. Were also Native with Cogent (Not that it
gets us anything..)

No dice.

[root@bench ~]# wget -6 www.charter.com

--2011-09-19 13:53:17-- http://www.charter.com/

Resolving www.charter.com... 2607:f428:3:1:80:80:80:1

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80...

Times Out

[root@bench ~]# traceroute6 www.charter.com

traceroute to www.charter.com (2607:f428:3:1:80:80:80:1), 30 hops max, 40
byte packets

1 (2606:2400:141::1) 1.169 ms 1.157 ms 1.145 ms

2 (2606:2400:222::d) 31.685 ms 36.812 ms 37.104 ms

3 (2606:2400:222::5) 37.387 ms 37.456 ms 37.477 ms

4 brevardwireless-1.tunnel.tserv7.ash1.ipv6.he.net (2001:470:1f0d:c5::1)
123.090 ms 123.371 ms 123.334 ms

5 v104.core1.ash1.he.net (2001:470:0:40::2) 122.542 ms 122.523 ms
122.516 ms

6 10gigabitethernet1-2.core1.atl1.he.net (2001:470:0:1b5::2) 142.508 ms
129.220 ms 131.762 ms

7 2001:470:0:115::2 (2001:470:0:115::2) 131.537 ms 131.696 ms 131.739
ms

8 bbr01sghlga-tge0-2-0-1.ga.sghl.charter.com (2001:506:100:326::1)
143.856 ms bbr01sghlga-tge0-0-0-0.ga.sghl.charter.com (2001:506:100:308::1)
140.164 ms 140.196 ms

9 bbr01blvlil-tge0-3-0-4.il.blvl.charter.com (2001:506:100:42::2)
151.880 ms 152.019 ms 151.955 ms

10 bbr01olvemo-tge0-1-0-6.mo.olve.charter.com (2001:506:100:8::1) 151.669
ms 151.681 ms 151.665 ms

11 bdr01tncomo-tge1-1.mo.tnco.charter.com (2001:506:100:23::2) 149.784 ms
149.851 ms 149.852 ms

12 2001:506:100:6c::2 (2001:506:100:6c::2) 147.953 ms 147.470 ms
147.479 ms

13 * * *

14 * * *

15 * * *

16 * * *

17 * * *

18 *

Nick Olsen

Network Operations
(855) FLSPEED x106

Hi!

Takes our HE tunnel to get out. Were also Native with Cogent (Not that it
gets us anything..)

No dice.

Native also no luck here (from .nl) :

[root@ipv6proxy ~]# traceroute6 www.charter.com
traceroute to www.charter.com (2607:f428:3:1:80:80:80:1), 30 hops max, 80 byte packets
  1 2a00:d00:ff:131::253 (2a00:d00:ff:131::253) 0.610 ms 0.708 ms 0.700 ms
  2 2a00:d00:1:4::2 (2a00:d00:1:4::2) 0.644 ms 0.637 ms 0.745 ms
  3 hurricane-electric.nikhef.nlsix.net (2001:7f8:13::a500:6939:1) 0.549 ms 0.547 ms 0.551 ms
  4 10gigabitethernet1-4.core1.lon1.he.net (2001:470:0:3f::1) 8.584 ms 8.587 ms 8.609 ms
  5 10gigabitethernet7-4.core1.nyc4.he.net (2001:470:0:3e::1) 76.459 ms 76.473 ms 76.453 ms
  6 10gigabitethernet8-3.core1.chi1.he.net (2001:470:0:1c6::2) 97.787 ms 96.714 ms 93.772 ms
  7 2001:470:0:114::2 (2001:470:0:114::2) 93.941 ms 93.924 ms 93.968 ms
  8 bbr02chcgil-tge0-1-0-1.il.chcg.charter.com (2001:506:100:31d::1) 104.974 ms bbr02chcgil-tge0-0-0-1.il.chcg.charter.com (2001:506:100:317::2) 99.650 ms bbr02chcgil-tge0-0-0-0.il.chcg.charter.com (2001:506:100:305::1) 99.767 ms
  9 bbr01olvemo-tge0-5-0-4.mo.olve.charter.com (2001:506:100:5c::2) 106.416 ms 101.397 ms 101.371 ms
10 * * *
11 2001:506:100:6c::2 (2001:506:100:6c::2) 101.667 ms 101.553 ms 101.598 ms
12 * * *
13 * * *
14 * * *
15 * * *
16 *^C
[root@ipv6proxy ~]# ping6 www.charter.com
PING www.charter.com(2607:f428:3:1:80:80:80:1) 56 data bytes
^C
--- www.charter.com ping statistics ---
4 packets transmitted, 0 received, 100% packet loss, time 3700ms

[root@ipv6proxy ~]# wget -6 www.charter.com
--2011-09-19 20:47:13-- http://www.charter.com/
Resolving www.charter.com... 2607:f428:3:1:80:80:80:1
Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80...

Bye,
Raymond.

wget throws a timeout from here too, from the internet2 side.

% traceroute6 -A www.charter.com
traceroute to www.charter.com (2607:f428:3:1:80:80:80:1), 30 hops max, 80 byte packets
1 isb-6509-1.vl103.cns.ipv6.vt.edu (2001:468:c80:2103::1) [AS1312] 0.523 ms 0.727 ms 0.715 ms
2 isb-6509-2.po51.cns.ipv6.vt.edu (2001:468:c80:f220::1) [AS1312] 0.413 ms 0.629 ms 0.616 ms
3 isb-7606-2.te3-3.cns.ipv6.vt.edu (2001:468:c80:f222::2) [AS1312] 0.560 ms 0.537 ms 0.769 ms
4 matp-lvl3-7609-1.vl10.cns.ipv6.vt.edu (2001:468:cfe:1002::1) [AS40220] 8.542 ms 8.524 ms 8.494 ms
5 xe-3-0-0.277.asbn0.tr-cps.internet2.edu (2001:468:f000:2234::1) [*] 9.164 ms 9.134 ms 9.096 ms
6 2001:1860:110:f03::1 (2001:1860:110:f03::1) [AS101] 27.520 ms 27.521 ms 27.429 ms
7 2001:468:f000:1110::2 (2001:468:f000:1110::2) [*] 27.776 ms 27.665 ms 27.465 ms
8 bbr02chcgil-tge0-0-0-0.il.chcg.charter.com (2001:506:100:305::1) [*] 29.087 ms 29.001 ms bbr02chcgil-tge0-0-0-1.il.chcg.charter.com (2001:506:100:317::2) [*] 28.855 ms
9 * * *

And that's all she wrote... Nice RTTs till it hits a brick wall near Chicago..

Anybody seeing anything *else* impacted by this? How many IPv6 customers does
Charter have?

Strange, a curl request works for me through one of our he.net tunnels
but not the other (sorry, won't post the address space on the list).

Takes our HE tunnel to get out. Were also Native with Cogent (Not that it
gets us anything..)

No dice.

[root@bench ~]# wget -6 www.charter.com

--2011-09-19 13:53:17-- http://www.charter.com/

Resolving www.charter.com... 2607:f428:3:1:80:80:80:1

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80...

Times Out

[root@bench ~]# traceroute6 www.charter.com

traceroute to www.charter.com (2607:f428:3:1:80:80:80:1), 30 hops max, 40
byte packets

1 (2606:2400:141::1) 1.169 ms 1.157 ms 1.145 ms

2 (2606:2400:222::d) 31.685 ms 36.812 ms 37.104 ms

3 (2606:2400:222::5) 37.387 ms 37.456 ms 37.477 ms

4 brevardwireless-1.tunnel.tserv7.ash1.ipv6.he.net (2001:470:1f0d:c5::1)
123.090 ms 123.371 ms 123.334 ms

5 v104.core1.ash1.he.net (2001:470:0:40::2) 122.542 ms 122.523 ms
122.516 ms

6 10gigabitethernet1-2.core1.atl1.he.net (2001:470:0:1b5::2) 142.508 ms
129.220 ms 131.762 ms

7 2001:470:0:115::2 (2001:470:0:115::2) 131.537 ms 131.696 ms 131.739
ms

8 bbr01sghlga-tge0-2-0-1.ga.sghl.charter.com (2001:506:100:326::1)
143.856 ms bbr01sghlga-tge0-0-0-0.ga.sghl.charter.com (2001:506:100:308::1)
140.164 ms 140.196 ms

9 bbr01blvlil-tge0-3-0-4.il.blvl.charter.com (2001:506:100:42::2)
151.880 ms 152.019 ms 151.955 ms

10 bbr01olvemo-tge0-1-0-6.mo.olve.charter.com (2001:506:100:8::1) 151.669
ms 151.681 ms 151.665 ms

11 bdr01tncomo-tge1-1.mo.tnco.charter.com (2001:506:100:23::2) 149.784 ms
149.851 ms 149.852 ms

12 2001:506:100:6c::2 (2001:506:100:6c::2) 147.953 ms 147.470 ms
147.479 ms

13 * * *

14 * * *

15 * * *

16 * * *

17 * * *

18 *

Nick Olsen

Network Operations
(855) FLSPEED x106

----------------------------------------

From: "Frank Bulk" <frnkblk@iname.com>

Sent: Monday, September 19, 2011 1:38 PM

To: "PC" <paul4004@gmail.com>

Subject: RE: IPv6 side of www.charter.com has been down since Friday,
September 16 5:12 am Central

I've been told by someone else offline that it's fine for them, too. Last

hop according to tcptraceroute6 is Qwest. Anyone else going to

www.charter.com (IPv6) through Qwest?

nagios:/home/fbulk# tcptraceroute6 www.charter.com

traceroute to www.charter.com (2607:f428:3:1:80:80:80:1) from

2607:fe28:0:1000::5, port 80, from port 43838, 30 hops max, 60 bytes
packets

1 2607:fe28:0:1003::2 (2607:fe28:0:1003::2) 1.075 ms 1.258 ms 1.857 ms

2 router-core.mtcnet.net (2607:fe28:0:1000::1) 1.625 ms 2.271 ms 1.331

ms

3 sxct.sxcy.mtcnet.net (2607:fe28:11:1002::197) 2.581 ms 1.568 ms
1.215

ms

4 v6-siouxcenter.sxcy.137.netins.net (2001:5f8:7f06::5) 3.347 ms 3.007
ms

2.640 ms

5 v6-ins-db1-te-13-2-219.desm.netins.net (2001:5f8:1:1::1) 7.441 ms
7.121

ms 6.798 ms

6 v6-ins-dc1-et-8-2.desm.netins.net (2001:5f8::1:1) 8.682 ms 8.294 ms

7.910 ms

7 2001:428:3801:210:0:1:0:1 (2001:428:3801:210:0:1:0:1) 20.790 ms
20.447

ms 20.133 ms

8 * * *

9 * * *

10 * * *

11 * * *

12 * * *

13 * * *

14 * * *

15 * * *

16 * * *

17 * * *

18 * * *

19 * * *

20 * * *

21 * * *

22 * * *

23 * * *

24 * * *

25 * * *

26 * * *

27 * * *

28 * * *

29 * * *

30 * * *

nagios:/home/fbulk#

Frank

From: PC [mailto:paul4004@gmail.com]

Sent: Monday, September 19, 2011 12:13 PM

To: frnkblk@iname.com

Cc: nanog@nanog.org

Subject: Re: IPv6 side of www.charter.com has been down since Friday,

September 16 5:12 am Central

Works fine here.

# wget -6 www.charter.com

--2011-09-19 10:24:37-- http://www.charter.com/

Resolving www.charter.com... 2607:f428:3:1:80:80:80:1

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... connected.

HTTP request sent, awaiting response... 200 OK

Length: unspecified [text/html]

Saving to: `index.html'

[ <=>

] 112,940 288K/s in 0.4s

2011-09-19 10:24:43 (288 KB/s) - `index.html' saved [112940]

traceroute to www.charter.com (2607:f428:3:1:80:80:80:1), 30 hops max, 80

byte packets

1 2607:f2f8:xxxx::1 (2607:f2f8:xxxx::1) 18.721 ms 18.699 ms 18.689 ms

2 2001:504:13::1a (2001:504:13::1a) 1.256 ms 1.672 ms 1.428 ms

3 10gigabitethernet1-2.core1.den1.he.net (2001:470:0:15d::1) 26.498 ms

26.486 ms 26.466 ms

4 10gigabitethernet1-1.core1.chi1.he.net (2001:470:0:1af::1) 49.986 ms

49.529 ms 49.521 ms

5 2001:470:0:114::2 (2001:470:0:114::2) 50.105 ms 49.632 ms 49.626 ms

6 bbr02chcgil-tge0-1-0-0.il.chcg.charter.com (2001:506:100:313::1)
55.805

ms 54.254 ms bbr02chcgil-tge0-0-0-0.il.chcg.charter.com

(2001:506:100:305::1) 55.880 ms

7 bbr01olvemo-tge0-4-0-4.mo.olve.charter.com (2001:506:100:55::1) 69.465

ms 63.351 ms 63.314 ms

8 bdr01tncomo-tge1-1.mo.tnco.charter.com (2001:506:100:23::2) 60.018 ms

59.597 ms 59.586 ms

9 2001:506:100:6c::2 (2001:506:100:6c::2) 60.251 ms 60.245 ms 60.236
ms

10 * * *

11 * * *

12 * * *

13 * * *

14 * * *

The IPv6 side of www.charter.com has been down since Friday, September 16

5:12 am Central. Emails to their NOC have gone unanswered. If anyone on

list can nudge their ops group that would be appreciated.

Frank

nagios:/home/fbulk# wget -6 www.charter.com

--2011-09-19 08:23:58-- http://www.charter.com/

Resolving www.charter.com... 2607:f428:3:1:80:80:80:1

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:24:20-- (try: 2) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:24:43-- (try: 3) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:25:07-- (try: 4) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:25:32-- (try: 5) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:25:58-- (try: 6) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:26:25-- (try: 7) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:26:53-- (try: 8) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:27:22-- (try: 9) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:27:52-- (try:10) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:28:23-- (try:11) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:28:54-- (try:12) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:29:25-- (try:13) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:29:56-- (try:14) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:30:27-- (try:15) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:30:58-- (try:16) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:31:29-- (try:17) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:32:00-- (try:18) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:32:31-- (try:19) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Retrying.

--2011-09-19 08:33:02-- (try:20) http://www.charter.com/

Connecting to www.charter.com|2607:f428:3:1:80:80:80:1|:80... failed:

Connection timed out.

Giving up.

nagios:/home/fbulk#

This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they are
addressed. If you have received this email in error please notify the
system manager. This message contains confidential information and is
intended only for the individual named. If you are not the named
addressee you should not disseminate, distribute or copy this e-mail.
Please notify the sender immediately by e-mail if you have received this
e-mail by mistake and delete this e-mail from your system. If you are
not the intended recipient you are notified that disclosing, copying,
distributing or taking any action in reliance on the contents of this
information is strictly prohibited.

Several offlist contacts have shared working and non-working results, so
it's a mixed bag.

Frank