Devices and Links with Errors

        Feb 27 21:41:22 1650 nodes,   5 down, 8540 links, 1987 down, 118 critical,  13 alarm,  21 warning, 23627762 pk/s, 3904033 K by/s

Device                           Stat    SysUpTime    Avail  Loss    RTT  Probe  Address
                                       (Down Since)
Lytton 5 NE-NE, Bruns            DOWN 02/27 12:50 PM    0.0 100.0      0  Ping   10.36.62.99
Drobo                            DOWN 02/27 12:51 PM    0.0 100.0      0  Ping   192.168.1.200
Nimble Controller1               ACK  02/27 12:51 PM    0.0 100.0      0  Ping   192.168.1.201
Plesk Hosting                    ALRM                 100.0   0.0      0  Prob   207.32.48.1
Monitor DNS                      ALRM                 100.0   0.0      2  DNS    207.32.53.25
Hosting HTTP                     ALRM                 100.0   0.0     48  HTTP   207.32.48.1
Newell-ptp-Alta-Vertical.devices WARN 100+23:35:21     99.7   5.1    536  SNMP   10.24.0.84
Newell-ptp-Alta-Vertical.devices WARN 100+23:35:21     99.7   5.1    536  SNMP   10.24.0.84
Alta-PtP-Newell-Vertical.devices WARN 315+21:04:20     99.3   5.4    578  SNMP   10.24.0.86
Aurelia-ptp-Alta.devices.ncn.net ALRM 192+20:20:31    100.0   5.7    782  SNMP   10.24.0.125
Varina to Newell                 WARN  75+14:33:41     99.9   1.8     50  Ubiq   10.24.0.181
Garner to Britt                  WARN 213+20:13:08    100.0   1.8     49  Ubiq   10.24.8.135
Garner to Britt                  WARN 213+20:13:08    100.0   1.8     49  Ubiq   10.24.8.135
GimoreCity-PtP-Pioneer.devices.n WARN   9+09:24:40    100.0   0.0    631  SNMP   10.24.40.53
Pioneer-PtP-GilmoreCity.devices. WARN   9+09:24:49    100.0   1.0    776  SNMP   10.24.40.54
Livermore to LuVerne Master      WARN  63+21:49:16    100.0   0.1    771  SNMP   10.24.40.154
LuVerne - Livermore Slave        WARN  73+06:39:25    100.0   0.1    789  SNMP   10.24.40.155
10.24.40.182                     WARN  95+11:31:13    100.0   0.0    793  SNMP   10.24.40.182
Palmer-PtP-Manson-High-Vertical. WARN 267+12:46:36    100.0   0.0    506  SNMP   10.24.56.11
Manson-PtP-Palmer-Low-Vertical.d WARN 188+17:45:30    100.0   0.0    557  SNMP   10.24.56.13
Manson-PtP-Palmer-Low-Vertical.d WARN 188+17:45:30    100.0   0.0    557  SNMP   10.24.56.13
Manson-PtP-Palmer-Low-Horizontal WARN 188+17:45:29    100.0   0.0    521  SNMP   10.24.56.14
Manson-PtP-Palmer-Low-Horizontal WARN 188+17:45:29    100.0   0.0    521  SNMP   10.24.56.14
Lohrville Slave - Low            WARN  72+21:04:48    100.0   0.1    765  SNMP   10.24.56.21
Lohrville to Rockwell City Slave WARN  72+21:05:06    100.0   0.0    774  SNMP   10.24.56.21
Lake City Slave - Low            WARN   9+08:04:45    100.0   1.7    654  SNMP   10.24.56.23
Pomeroy-PtP-Fonda-Vertical.devic WARN 106+09:25:26    100.0   0.1    502  SNMP   10.24.56.37
Pomeroy-PtP-Fonda-Vertical.devic WARN 106+09:25:26    100.0   0.1    502  SNMP   10.24.56.37
Laurens-PtP-Marathon-Vertical.de WARN  66+08:28:38    100.0   0.2    507  SNMP   10.36.0.1
Laurens UPS                      WARN                 100.0   0.0    584  Trip   10.36.2.252
Cherokee 3 UPS                   ALRM   1+07:16:41     99.9   3.3     73  Trip   10.36.5.235
Britt UPS                        WARN                 100.0   2.3    577  Trip   10.36.13.252
Eburg Fiber Drain                CRIT 150+17:09:08    100.0   0.2    394  SNMP   10.36.27.10
Harrison UPS                     ALRM 261+04:55:57    100.0   0.0     75  Trip   10.36.27.59
Cylinder UPS                     ALRM  16+11:39:50    100.0   0.0     65  Trip   10.36.28.252
Gilmore City UPS                 ALRM   9+09:24:34    100.0   0.1     65  Trip   10.36.43.252
Humboldt 915                     ALRM   3+05:25:31    100.0   0.0      5  Wire   10.36.45.242
Humboldt 908.4                   ALRM   2+21:39:49    100.0   0.3      5  Wire   10.36.45.243
Humboldt 921.6                   ALRM   3+05:59:51    100.0   0.1      5  Wire   10.36.45.244
Manson 918.4                     ALRM 188+17:45:34    100.0   0.0      2  Wire   10.36.58.239
Manson 911.6                     ALRM 188+17:45:39    100.0   0.1      2  Wire   10.36.58.240
Nemaha UPS                       ALRM 185+06:56:42    100.0   0.1     66  Trip   10.36.63.252
Varina UPS                       ALRM 315+08:41:20     99.9   2.3     67  Trip   10.36.67.250
Luverne Tower UPS                ALRM  72+09:46:09    100.0   0.1     64  Trip   10.36.82.244
debbier-printer                  ACK  02/27 12:51 PM    0.0 100.0      0  SNMP   10.42.4.10
Whittemore Mikrotik              WARN 195+01:48:30    100.0   0.8     51  SNMP   165.140.233.55
Wesley                           WARN   9+23:30:51    100.0   0.0      1  SNMP   192.168.1.13
Jack                             WARN  10+05:23:17    100.0   0.0      1  SNMP   192.168.1.19
HV SAN LAN                       CRIT 361+09:16:20    100.0   0.0     25  SNMP   192.168.1.30
Havelock CO PDU#1                ALRM                 100.0  66.7      0  SNMP   192.168.1.190
Havelock CO PDU#2                ALRM                 100.0  66.7      0  SNMP   192.168.1.191
Mars                             ALRM  15+06:35:18    100.0   0.0      0  SNMP   192.168.1.232
Havelock                         ALRM  70+09:37:25    100.0   0.0      0  SNMP   192.168.1.251
Pro Coop Wallingford             ALRM                 100.0  75.0      0  SNMP   208.126.173.157
SafetyNet                        ALRM                 100.0   0.0      0  Map    127.0.0.1
Wireless-Rolfe                   ALRM                 100.0   0.0      0  Map    127.0.0.1
Wireless-Albert City             WARN                  96.3   0.0      0  Map    127.0.0.1
Wireless-UPS                     ALRM                  98.0   0.0      0  Map    127.0.0.1
Wireless-Algona                  CRIT                 100.0   0.0      0  Map    127.0.0.1
Pocahontas Fiber Network         ALRM                 100.0   0.0      0  Map    127.0.0.1
NW LAN                           ALRM                 100.0   0.0      0  Map    127.0.0.1
Wireless-Palmer.1                WARN                 100.0   0.0      0  Map    127.0.0.1
NW Servers                       CRIT                 100.0   0.0      0  Map    127.0.0.1
Core devices                     CRIT                 100.0   0.0      0  Map    127.0.0.1
eSIP eMobile                     ACK  02/27 12:52 PM    0.0 100.0      0  HTTP   165.140.232.83

Link                             Prt Stat               TPkt    TBytes TErr TDis    RPkt    RBytes RErr RDis  Util  Segment
Alta-PtP-Newell-Horizonal.device2050 up               125116 182327030    0    0  125118 182327518    0  256* 14.6% TenGigE1/2
Algona Edge UBNT                  13 alarm             63100  85718853    0 5423*  24484   5258093    0    0  68.6%*13
algona-dist.sw                    16 up                34691  46623303    0  170*  13398   3657938    0    0  37.3% 16
Algona EdgeSwitch                 13 warning           70213  95210992    0 2800*  27191   5850340    0    0  76.2%*13
Algona EdgeSwitch                 16 up                35831  48416314    0  108*  13975   3708522    0    0  38.7% 16
Rolfe-ptp-Rutland-Vertical.devic1537 alarm            121118 167022717    0    0   41828   8994137    0    1* 91.4%*Radio1
Rolfe-ptp-Rutland-Vertical.devic2049 up                41849   8841234    0    0  121254 167233363    0   35* 13.4% TenGigE1/1
Rutland-ptp-Rolfe-Vertical.devic1537 alarm             41805   8838404    0    0  121131 167046836    0    1* 91.4%*Radio1
Rutland-ptp-Rolfe-Vertical.devic2049 up               121359 167387606    0    0   41915   8843904    0   37* 13.4% TenGigE1/1
Rutland-ptp-Rolfe-Vertical.devic2049 up               121359 167387606    0    0   41915   8843904    0   37* 13.4% TenGigE1/1
Rolfe-PtP-Bradgate-11ghz.devices2050 up                    2       204    0    0  125078  15009474    0  315*  1.2% TenGigE1/2
Bradgate-PtP-Rolfe-11ghz.devices2050 up               125026  15003004    0    0  125031  15003731    0  309*  1.2% TenGigE1/2
Laurens-client.sw.ncn.net          5 up                 3524   4923791    0    0    1404    206642    0   13*  3.9% 5
alberticity-client.sw              1 up                12639   2625117    0    0   39731  54909099    0    3* 43.9%*1
algona-mdu-weaver                  8 up                 1655    213625    0    0    3989   5523055    0  801*  4.4% 8
algona-client.sw                  15 up                 3184   3840416    0    0    1615    637892    0   17*  3.1% 15
early-client.sw                    1 up                 5688   1542432    0    0   19030  27008009    0    3* 21.6% 1
emmetsburg-brownlee.sw            21 up                 2572    378795    0    0    8566  11787515    0    5*  9.4% 21
cylinder-client.sw                 6 up                  936   1228099    0    0     353     79728    0   11*  1.0% 6
rolfe-client.sw                   18 up                 1817   2528408    0    0     528     53181    0   13* 12.2% 18
mallard-client.sw                 26 up                 8574   1088485    0    0   16185  21945571    0   82* 17.6% 26
manson-client.sw                   1 up                15786   3324671    0    0   50467  69099062    0    3* 55.3%*1
pomeroy-client.sw                  1 up                 6329   1095151    0    0   20223  27769386    0    3* 22.2% 1
pomeroy-client.sw                  8 up                 2755   3907034    0    0     744     84131    0   21*  3.1% 8
lytton-client.sw                   2 up                 7195   1887914    0    0   24897  34320968    0    3* 27.5% 2
lytton-client.sw                  17 up                 3095   4411148    0    0     756     76815    0   11*  3.5% 17
pocahontas-client.sw               5 up                 4969   6934173    0    0    2018    402415    0   19*  5.6% 5
rockwellcity-client.sw             1 up                12067   2349237    0    0   35767  49048527    0    3* 39.2% 1
hv-bathroom                       50 up                 2819   2642624    0    0    1477   1244515    0    2*  0.2% 50
hv-ne-closet                      46 up                  986   1389990    0    0     164     11848    0    6*  1.1% 46
hv-warehouse                      10 up                  217    274270    0    0      40      3501    0    6*  0.2% 10
hv-sysadmin                       26 up                   14      3770    0    0      43      7423    0    1*  0.0% 26
WB CO AP (N)                       2 up                    5       561    0    0      26      2505    0    1*  0.0% 2
Plover AP                          2 up                    0        64    0    0      18      1691    0    1*  0.0% 2
Ayrshire 3560                   5001 critical         168853 185048705    0 8872* 169342 185774898    0    0  49.5%*5001
Ayrshire 3560                   5001 warning          168853 185048705    0 8872* 169342 185774898    0    0  49.5%*5001
HV SAN LAN                        52 up                 3504  15130082    0    0    2490  11954055    3*   0   1.2% 52
HV SAN LAN                        57 critical           3912    954591    0    0    7917   7290230  115*   0   0.6% Data
Havelock                        4105 alarm              3298   2879104    0    0    2047    768528   27*   0   0.2% 4105
Bode Mikrotik                     17 down                  0         0    0    0       0         0    0    0   0.0% 17
Rolfe Fiber Drain                 17 down                  0         0    0    0       0         0    0    0   0.0% 17
Algona Edge UBNT                  13 alarm             63100  85718853    0 5423*  24484   5258093    0    0  68.6%*13
algona-dist.sw                    13 up                67996  92563167    0 4364   26321   5753138    0    0  74.1%*13
Algona EdgeSwitch                 13 warning           70213  95210992    0 2800*  27191   5850340    0    0  76.2%*13
wesley-dist.sw                     1 up                26702   5759837    0    0   68746  93414018    0    0  74.7%*1
wesley-dist.sw                    24 up                37463  51015985    0    0   15238   3930016    0    0  40.8%*24
Wesley Netonix                     1 alarm             25869   5788832    0    0   68619  92949488    0    0  74.4%*1
Wesley Netonix                     2 critical          31626  42515105    0    0   11951   2100833    0    0  94.5%*2
Rolfe-ptp-Rutland-Vertical.devic1537 alarm            121118 167022717    0    0   41828   8994137    0    1* 91.4%*Radio1
Rolfe-ptp-Rutland-horizontal.dev1537 up               124898 182069353    0    0  124901 182069607    0    0  52.0%*Radio1
Rutland-ptp-Rolfe-Vertical.devic1537 alarm             41805   8838404    0    0  121131 167046836    0    1* 91.4%*Radio1
Rutland-ptp-Rolfe-Horizontal.dev1537 up               124970 182174780    0    0  124973 182174940    0    0  52.1%*Radio1
humboldt.sw                        1 up                 6200   1898933    0    0   18164  24245623    0    0  53.1%*1
humboldt.sw                        6 critical           6649   8569352    0    0    2213    916814    0    0 105.5%*6
humboldt.sw                        7 critical           7518  10190232    0    0    2789    835377    0    0 125.4%*7
humboldt.sw                        8 up                 4038   5530717    0    0    1207    152969    0    0  68.1%*8
palmer-dist.sw                     1 up                93669  21027012    0    0  272755 369706194    0    0 394.4%*1
palmer-dist.sw                     3 up               130473 179417052    0    0   44371   8907327    0    0 287.1%*3
manson-ptp-rockwellcity.devices.1537 up                81340 112051267    0    0   28082   5467285    0    0  61.3%*1537
RC backhaul slave               1537 up                28695   5479160    0    0   83248 114721030    0    0  62.8%*1537
Laurens Mikrotik                   2 critical          64005  87674459    0    0   17822   3498408    0    0  93.5%*PTP Marathon
alberticity-client.sw              1 up                12639   2625117    0    0   39731  54909099    0    3* 43.9%*1
alberticity-client.sw              6 up                 4370   5656660    0    0     977    295644    0    0  69.6%*6
alberticity-client.sw              7 up                 3452   4724312    0    0    1148    138802    0    0  58.2%*7
newell-client.sw                  25 up                13335   2928517    0    0   40078  54616902    0    0  43.7%*25
alta-client.sw                     3 up                 3946   5736306    0    0    1361    151905    0    0  70.6%*3
wesley-client.sw                   1 critical          14544   3684574    0    0   37667  51195485    0    0 112.2%*1
wesley-client.sw                   1 critical          14544   3684574    0    0   37667  51195485    0    0 112.2%*1
algona-client.sw                   2 up                 3627   5011050    0    0    1513    172835    0    0  55.3%*2
Mallard NE                         4 up                 1416    299666    0    0    4086   5424721    0    0  43.4%*4
manson-client.sw                   1 up                15786   3324671    0    0   50467  69099062    0    3* 55.3%*1
fonda-client.sw                    1 up                 8966   2133514    0    0   27657  38291955    0    3  83.9%*Uplink to ER
fonda-client.sw                    6 up                 2751   4032402    0    0     975     96635    0    0  49.6%*5ghz SW
varina-client.sw                   1 up                 1105    130684    0    0    3733   5110460    0    0  64.5%*1
livermore-client.sw                1 up                 6142   1224666    0    0   21388  29507188    0    0  64.7%*1
Ayrshire 3560                   5001 critical         168853 185048705    0 8872* 169342 185774898    0    0  49.5%*5001
Ayrshire 3560                   5001 warning          168853 185048705    0 8872* 169342 185774898    0    0  49.5%*5001
Manson Mikrotik                   15 critical          82051 113164320    0    0   28453   5426460    0    0  90.5%*PTP Rockwell City
Manson Mikrotik                   16 alarm             44188   8688112    0    0  131116 180333778    0    0  51.5%*PTP Palmer
Manson CRS317                     12 up                47813  65211863    0    0   14875   3260860    0    0  52.2%*12
Manson CRS317                     12 up                47813  65211863    0    0   14875   3260860    0    0  52.2%*12
Pomeroy Mikrotik                  16 warning           48538  13199722    0    0  137998 183268438    0    0  48.9%*PTP Palmer
newell.rtr                        12 up                43741  59724358    0    0   15492   3395232    0    0  47.8%*12
albertcity.rtr                    15 up                40268  55594403    0    0   12880   2722432    0    0  44.5%*15
Albert City CRS317                15 up                36704  50396564    0    0   11704   2573226    0    0  40.3%*Albert City CRS317: NA
Wesley Router                      3 up                15033   3895230    0    0   36994  50450161    0    0  40.4%*eth0 Uplink
Wesley Router                      4 up                37054  50304682    0    0   14996   3951904    0    0  40.2%*eth1 Customers
Wesley Router                      3 up                15038   3773329    0    0   37445  50907430    0    0  40.7%*3