11/22/16: Reports of phones not working and unable to log into Service Web.

Question

question

derek2241 asked Nov 22, '16 mike commented Nov 28, '16

11/22/16: Reports of phones not working and unable to log into Service Web.

Phones all went down in office at 8:30 am EST. It's been 20 minutes outage is being reported currently through the number at ring central.

Again ring central should be reaching out to us when outages like this happen not the other way around, and 20 minutes is too long of a time not to have an announcement from RingCentral. Within 5 minutes seems much more reasonable.

They have discovered that a DataCenter at RingCentral is having the issue.
This is only affecting mostly the Eastern area they are not sure exactly who the clients are quite yet.

TraceRoute to service.ringcentral.com is failing.

topic-default

1 |1000

Attachments: Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

Answer 1 · 2016-11-22T14:03:09Z

derek2241 answered Nov 22, '16

Couldn't log on with normal account as service.ringcentral.com is down which means you cannot log on to ring central community which is probably why no one else has posted this yet.

1 |1000

Attachments: Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

Answer 2 · 2016-11-22T14:25:03Z

Jesse Evitts answered Nov 22, '16

We're experiencing the same thing here. All desktop phones are down, and cannot login to site.

1 |1000

Attachments: Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

Answer 3 · 2016-11-28T13:52:31Z

derek2241 answered Nov 28, '16 mike commented Nov 27, '17

Is there an update as to what changes are made so this hopefully doesn't happen again?

root@obsd-build# traceroute -I sip.ringcentral.com

traceroute to sip.ringcentral.com (199.255.120.146), 64 hops max, 60 byte packets

1 vlan400.pub-sw-1.clmxmixih00.ctstelecom.com (64.136.224.6) 1.124 ms 0.779 ms 0.807 ms

2 GigE-0-0-0-0.clmxmixih00-C9006-01.clmxmixih00.ctstelcom.com (64.136.224.57) 0.957 ms 0.638 ms 0.607 ms

3 Bundle-Ether-602.clmxmixih00-c9010-01.core.ctstelecom.com (67.219.192.246) 1.893 ms 0.911 ms 0.788 ms

4 Bundle-Ether-602.clmxmixih00-c9006-02.core.ctstelecom.com (67.219.192.181) 0.781 ms 0.783 ms 0.838 ms

5 ord01-eqix.ringcentral.com (206.223.119.97) 4.518 ms 4.499 ms 4.482 ms

6 * * *

7 * * *

#sh ip bgp 199.255.120.146

Tue Nov 22 10:14:10.761 EST

BGP routing table entry for 199.255.120.0/22

Versions:

Process bRIB/RIB SendTblVer

Speaker 7256085 7256085

Last Modified: Nov 22 02:10:17.964 for 08:03:52

Paths: (6 available, best #3)

Advertised to update-groups (with more than one peer):

0.9 0.10

Advertised to peers (in unique update groups):

67.219.192.17 67.219.192.15 206.223.119.187

Path #1: Received by speaker 0

Not advertised to any peer

6461 7018 40627

64.125.173.37 from 64.125.173.37 (64.125.0.208)

Origin IGP, metric 45, localpref 100, valid, external, group-best

Received Path ID 0, Local Path ID 0, version 0

Community: 6461:5997

Origin-AS validity: not-found

Path #2: Received by speaker 0

Not advertised to any peer

6461 7018 40627, (received-only)

64.125.173.37 from 64.125.173.37 (64.125.0.208)

Origin IGP, metric 0, localpref 100, valid, external

Received Path ID 0, Local Path ID 0, version 0

Community: 6461:5997

Origin-AS validity: not-found

Path #3: Received by speaker 0

Advertised to update-groups (with more than one peer):

0.9 0.10

Advertised to peers (in unique update groups):

67.219.192.17 67.219.192.15 206.223.119.187

40627

206.223.119.97 from 206.223.119.251 (206.223.119.251)

Origin IGP, metric 30, localpref 100, valid, external, best, group-best

Received Path ID 0, Local Path ID 1, version 7256085

Community: 24115:40627

Origin-AS validity: not-found

Path #4: Received by speaker 0

Not advertised to any peer

40627, (received-only)

206.223.119.97 from 206.223.119.251 (206.223.119.251)

Origin IGP, localpref 100, valid, external

Received Path ID 0, Local Path ID 0, version 0

Community: 24115:40627

Origin-AS validity: not-found

Path #5: Received by speaker 0

Not advertised to any peer

40627

206.223.119.97 from 206.223.119.252 (206.223.119.252)

Origin IGP, metric 30, localpref 100, valid, external

Received Path ID 0, Local Path ID 0, version 0

Community: 24115:40627

Origin-AS validity: not-found

Path #6: Received by speaker 0

Not advertised to any peer

40627, (received-only)

206.223.119.97 from 206.223.119.252 (206.223.119.252)

Origin IGP, localpref 100, valid, external

Received Path ID 0, Local Path ID 0, version 0

Community: 24115:40627

Origin-AS validity: not-found

1

1 |1000

Attachments: Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

mike commented · Nov 28, 2016 at 03:24 PM

Sorry we can't give specifics at to "what's been done" to prevent this in the future, as these sorts of interruptions can be caused by many things. When you run a tracerout as you've done, and it fails before it reaches our servers, this indicates a problem somewhere on the internet, not necessarily with RingCentral. Our engineers work closely with the the ISPs when things like this occur but often times the fix is provided by one of the ISPs not RingCentral.

One thing that you can do in the even of an outage is open a support case and request a copy of the RFO (reason for outage) report and include the incedent number in your request. In this case that number would be " INC-18317".

0 ·

Answer 4 · 2020-07-28T14:02:52Z

mike answered Jul 28, '20

If your phones are down (and you also unable to log into the service web), then please run a tracerout . See instructions on this page.

How do I run a "tracert" (traceroute) report?

If you are unable to open a case in order to submit the tracert report, then please take a screenshot and post it here in this thread.

If you are able to open a case please copy and past the following information to the body and/or title of the case notes. Parent Ticket 05204508, INC-18317

Thanks!
Mike

1 |1000

Attachments: Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

Answer 5 · 2020-07-28T14:02:53Z

mike answered Jul 28, '20

9:02am MST - Update: We have just bee notified that this issue has been resolved.

1 |1000

Attachments: Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

question