Devices and Links with Errors

        Feb 27 20:16:59 1650 nodes,   5 down, 8540 links, 1987 down, 119 critical,  11 alarm,  26 warning, 23878797 pk/s, 4127504 K by/s

Device                           Stat    SysUpTime    Avail  Loss    RTT  Probe  Address
                                       (Down Since)
Tyler Weisenstein                WARN                 100.0   2.1     40  Ping   10.36.11.35
Algona 3NW, Thilges              WARN                 100.0   0.0    115  Ping   10.36.12.144
Lytton 5 NE-NE, Bruns            DOWN 02/27 12:50 PM    0.0 100.0      0  Ping   10.36.62.99
Drobo                            DOWN 02/27 12:51 PM    0.0 100.0      0  Ping   192.168.1.200
Nimble Controller1               ACK  02/27 12:51 PM    0.0 100.0      0  Ping   192.168.1.201
Plesk Hosting                    ALRM                 100.0   0.0      0  Prob   207.32.48.1
Monitor DNS                      ALRM                 100.0   0.0      2  DNS    207.32.53.25
Hosting HTTP                     ALRM                 100.0   0.0     47  HTTP   207.32.48.1
newell-ptp-albertcity-vertical.d WARN 100+22:11:12     99.3   6.7    535  SNMP   10.24.0.72
Aurelia-ptp-Alta.devices.ncn.net ALRM 192+18:56:30    100.0   6.7    781  SNMP   10.24.0.125
Varina to Newell                 WARN  75+13:08:58     99.8   2.1     36  Ubiq   10.24.0.181
Garner to Britt                  WARN 213+18:48:49    100.0   1.3     60  Ubiq   10.24.8.135
Garner to Britt                  WARN 213+18:48:49    100.0   1.3     60  Ubiq   10.24.8.135
GimoreCity-PtP-Pioneer.devices.n WARN   9+08:00:07    100.0   0.0    636  SNMP   10.24.40.53
Pioneer-PtP-GilmoreCity.devices. WARN   9+08:00:19    100.0   0.7    788  SNMP   10.24.40.54
Humboldt Netonix                 CRIT 106+02:01:29    100.0   0.1    154  SNMP   10.24.40.75
Livermore to LuVerne Master      WARN  63+20:25:16    100.0   0.1    779  SNMP   10.24.40.154
LuVerne - Livermore Slave        WARN  73+05:14:55    100.0   0.1    793  SNMP   10.24.40.155
10.24.40.182                     WARN  95+10:06:40    100.0   0.0    788  SNMP   10.24.40.182
Palmer-PtP-Manson-High-Vertical. WARN 267+11:22:06    100.0   0.0    519  SNMP   10.24.56.11
Palmer-PtP-Manson-High-Horizonta WARN 267+11:22:44    100.0   0.0    503  SNMP   10.24.56.12
Manson-PtP-Palmer-Low-Vertical.d WARN 188+16:21:29    100.0   0.0    550  SNMP   10.24.56.13
Manson-PtP-Palmer-Low-Vertical.d WARN 188+16:21:29    100.0   0.0    551  SNMP   10.24.56.13
Lohrville Slave - Low            WARN  72+19:40:47    100.0   0.1    775  SNMP   10.24.56.21
Lohrville to Rockwell City Slave WARN  72+19:40:35    100.0   0.0    776  SNMP   10.24.56.21
Lake City Slave - Low            WARN   9+06:40:44    100.0   2.0    624  SNMP   10.24.56.23
Pomeroy-PtP-Palmer-Vertical.devi WARN   1+09:02:15    100.0   0.0    521  SNMP   10.24.56.35
Pomeroy-PtP-Palmer-Vertical.devi WARN   1+09:02:15    100.0   0.0    520  SNMP   10.24.56.35
Fonda-PtP-Pomeroy-Vertical.devic WARN  16+09:16:50    100.0   0.0    535  SNMP   10.24.56.39
lytton-ptp-fonda.devices.ncn.net WARN  14+01:11:31    100.0   0.1    501  SNMP   10.24.56.59
Laurens-PtP-Marathon-Horizontal. WARN  66+07:04:31    100.0   0.0    515  SNMP   10.36.0.2
Marathon-PtP-SiouxRapidsWT-Verti WARN  16+04:45:40    100.0   0.1    520  SNMP   10.36.0.12
SiouxRapidsWT-PtP-LinnGrove-11gh WARN 218+20:56:23    100.0   0.0    517  SNMP   10.36.0.22
Laurens UPS                      WARN                 100.0   0.0    577  Trip   10.36.2.252
Cherokee 3 UPS                   ALRM   1+05:51:29     99.8   3.9     73  Trip   10.36.5.235
Britt UPS                        WARN                 100.0   1.7    570  Trip   10.36.13.252
Eburg Fiber Drain                CRIT 150+15:45:08    100.0   0.2    342  SNMP   10.36.27.10
Harrison UPS                     ALRM 261+03:31:47    100.0   0.0     70  Trip   10.36.27.59
Emmetsburg-PtP-Brownlee-11ghz.de WARN 202+13:05:04    100.0   0.1    532  SNMP   10.36.27.113
Cylinder UPS                     ALRM  16+10:15:39    100.0   0.0     65  Trip   10.36.28.252
Gilmore City UPS                 ALRM   9+08:00:22    100.0   0.0     65  Trip   10.36.43.252
Humboldt 915                     ALRM   3+04:00:41    100.0   0.0      5  Wire   10.36.45.242
Humboldt 908.4                   ALRM   2+20:15:37    100.0   0.2      4  Wire   10.36.45.243
Humboldt 921.6                   ALRM   3+04:35:29    100.0   0.1      5  Wire   10.36.45.244
Manson 918.4                     ALRM 188+16:21:29    100.0   0.0      2  Wire   10.36.58.239
Manson 911.6                     ALRM 188+16:21:05    100.0   0.2      2  Wire   10.36.58.240
Fonda 5NE, Dirks                 WARN  86+05:12:16    100.0   0.0    146  SNMP   10.36.60.31
Nemaha UPS                       ALRM 185+05:32:32    100.0   0.1     66  Trip   10.36.63.252
Varina UPS                       ALRM 315+07:17:10     99.8   2.7     67  Trip   10.36.67.250
Luverne Tower UPS                ALRM  72+08:20:59    100.0   0.1     62  Trip   10.36.82.244
debbier-printer                  ACK  02/27 12:51 PM    0.0 100.0      0  SNMP   10.42.4.10
Whittemore Mikrotik              WARN 195+00:23:59    100.0   0.6     59  SNMP   165.140.233.55
Wesley                           WARN   9+22:06:09    100.0   0.0      1  SNMP   192.168.1.13
Jack                             WARN  10+03:58:55    100.0   0.0      0  SNMP   192.168.1.19
HV SAN LAN                       ALRM 361+07:52:11    100.0   0.0     36  SNMP   192.168.1.30
Havelock CO PDU#1                ALRM                 100.0  66.7      0  SNMP   192.168.1.190
Havelock CO PDU#2                ALRM                 100.0  66.7      0  SNMP   192.168.1.191
Mars                             ALRM  15+05:10:44    100.0   0.0      0  SNMP   192.168.1.232
Newell Mikrotik                  WARN 100+22:10:59     99.9   0.5     56  SNMP   207.32.53.91
Rolfe Fiber Drain                WARN   5+18:30:08    100.0   0.1     63  SNMP   207.32.53.220
Pro Coop Wallingford             ALRM                 100.0  75.0      0  SNMP   208.126.173.157
SafetyNet                        ALRM                 100.0   0.0      0  Map    127.0.0.1
Wireless-Rolfe                   CRIT                 100.0   0.0      0  Map    127.0.0.1
Wireless-UPS                     ALRM                  97.6   0.0      0  Map    127.0.0.1
Wireless-Algona                  CRIT                 100.0   0.0      0  Map    127.0.0.1
Pocahontas Fiber Network         ALRM                 100.0   0.0      0  Map    127.0.0.1
Wireless-Palmer.1                WARN                 100.0   0.0      0  Map    127.0.0.1
NW Servers                       ALRM                 100.0   0.0      0  Map    127.0.0.1
Core devices                     WARN                 100.0   0.0      0  Map    127.0.0.1
eSIP eMobile                     ACK  02/27 12:52 PM    0.0 100.0      0  HTTP   165.140.232.83

Link                             Prt Stat               TPkt    TBytes TErr TDis    RPkt    RBytes RErr RDis  Util  Segment
Alta-PtP-Newell-Horizonal.device2050 up               124990 182141802    0    0  124992 182142164    0  237* 14.6% TenGigE1/2
Algona Edge UBNT                  13 critical          71174  97241660    0 3310*  25871   5658328    0    0  77.8%*13
algona-dist.sw                    16 up                38644  52810378    0  276*  14307   3111694    0    0  42.3%*16
Algona EdgeSwitch                 13 warning           69665  95173684    0 2766*  25977   5345948    0    0  76.1%*13
Algona EdgeSwitch                 16 up                37894  51648411    0  200*  14005   3137007    0    0  41.3%*16
Rolfe-ptp-Rutland-Vertical.devic1537 critical         128475 178075781    0    0   42733   7941126    0    1* 97.5%*Radio1
Rolfe-ptp-Rutland-Vertical.devic2049 up                42679   7788902    0    0  128403 177980708    0   35* 14.2% TenGigE1/1
Rutland-ptp-Rolfe-Vertical.devic1537 critical          42684   7790471    0    0  128363 177922160    0    1* 97.4%*Radio1
Rutland-ptp-Rolfe-Vertical.devic2049 up               128082 177525018    0    0   42577   7773733    0   37* 14.2% TenGigE1/1
Rutland-ptp-Rolfe-Vertical.devic2049 up               128082 177525018    0    0   42577   7773733    0   37* 14.2% TenGigE1/1
Rolfe-PtP-Bradgate-11ghz.devices2050 up                    2       202    0    0  124955  14994449    0  319*  1.2% TenGigE1/2
Bradgate-PtP-Rolfe-11ghz.devices2050 up               125004  15000390    0    0  125010  15001208    0  320*  1.2% TenGigE1/2
Laurens-client.sw.ncn.net          5 up                 2192   3022402    0    0     667     96439    0   11*  2.4% 5
alberticity-client.sw              1 up                12382   2773930    0    0   37897  52127344    0    3* 41.7%*1
alta-client.sw                    25 alarm             18859   2800782    0    0   27682  38308991    0 10359* 30.7% 25
algona-mdu-weaver                  8 up                 1458    134512    0    0    4206   5994872    0 4206*  4.8% 8
algona-client.sw                  15 up                 3693   5048516    0    0    1034    155152    0   13*  4.0% 15
early-client.sw                    1 up                 4247    690564    0    0   17424  24186246    0    3* 19.4% 1
emmetsburg-brownlee.sw            21 up                 2175    327014    0    0    7397   9950270    0    5*  8.0% 21
Brownlee-Dist.sw.ncn.net - 10gig   1 up                 3692    525362    0    0   10881  14786696    0    2*  1.2% 1
cylinder-client.sw                 6 up                  363    410985    0    0     215     47265    0   17*  0.3% 6
rolfe-client.sw                   18 up                  623    895786    0    0     270     24063    0   15*  4.3% 18
mallard-client.sw                 26 up                 9420    978590    0    0   15916  22329539    0   88* 17.9% 26
manson-client.sw                   1 up                17708   2874318    0    0   58842  81059708    0    3* 64.9%*1
pomeroy-client.sw                  1 up                 6408    949791    0    0   20192  27434663    0    3* 22.0% 1
pomeroy-client.sw                  8 up                  982   1262120    0    0     219     37828    0   21*  1.0% 8
lytton-client.sw                   2 up                 7518   1135684    0    0   25330  34748084    0    3* 27.8% 2
lytton-client.sw                  17 up                 3026   4176296    0    0     710     86593    0   13*  3.3% 17
pocahontas-client.sw               5 up                 4080   5338182    0    0    1426    365316    0   19*  4.3% 5
rockwellcity-client.sw             1 up                 9807   2008306    0    0   31821  43015845    0    3* 34.4% 1
hv-bathroom                       50 up                 2701   2543790    0    0    1462   1253239    0    2*  0.2% 50
hv-ne-closet                      46 up                  947   1387030    0    0     146     10592    0    6*  1.1% 46
hv-warehouse                      10 up                  222    277278    0    0      38      3539    0    6*  0.2% 10
hv-sysadmin                       26 up                    8      2046    0    0      37      7173    0    1*  0.0% 26
WB CO AP (N)                       2 up                    0        15    0    0      24      2642    0    1*  0.0% 2
Plover AP                          2 up                    0        75    0    0      19      1979    0    1*  0.0% 2
Ayrshire 3560                   5001 warning          122464 141602683    0 3867* 122855 142239941    0    0  37.9% 5001
Ayrshire 3560                   5001 up               122464 141602683    0 3867* 122855 142239941    0    0  37.9% 5001
HV SAN LAN                        52 up                 3396  15130352    0    0    2306  11902891    6*   0   1.2% 52
HV SAN LAN                        57 warning            3467    687692    0    0    3422    843281   16*   0   0.1% Data
Havelock                        4104 up                 1897    748056    0    0    3159   2808833    1*   0   0.2% 4104
Havelock                        4105 up                 3329   3039336    0    0    2158   1019016    5*   0   0.2% 4105
Bode Mikrotik                     17 down                  0         0    0    0       0         0    0    0   0.0% 17
Rolfe Fiber Drain                 17 down                  0         0    0    0       0         0    0    0   0.0% 17
Algona Edge UBNT                  13 critical          71174  97241660    0 3310*  25871   5658328    0    0  77.8%*13
algona-dist.sw                    13 warning           70892  96756358    0 3310   25726   5675413    0    0  77.4%*13
algona-dist.sw                    16 up                38644  52810378    0  276*  14307   3111694    0    0  42.3%*16
Algona EdgeSwitch                 13 warning           69665  95173684    0 2766*  25977   5345948    0    0  76.1%*13
Algona EdgeSwitch                 16 up                37894  51648411    0  200*  14005   3137007    0    0  41.3%*16
wesley-dist.sw                     1 warning           25391   5372219    0    0   68994  94224372    0    0  75.4%*1
wesley-dist.sw                    24 up                38147  51932189    0    0   12498   3339420    0    0  41.6%*24
Wesley Netonix                     1 critical          26076   5642011    0    0   70653  96269421    0    0  77.0%*1
Wesley Netonix                     2 critical          29123  39782918    0    0   12299   2166694    0    0  88.4%*2
Rolfe-ptp-Rutland-Vertical.devic1537 critical         128475 178075781    0    0   42733   7941126    0    1* 97.5%*Radio1
Rolfe-ptp-Rutland-horizontal.dev1537 up               125074 182326498    0    0  125077 182326658    0    0  52.1%*Radio1
Rutland-ptp-Rolfe-Vertical.devic1537 critical          42684   7790471    0    0  128363 177922160    0    1* 97.4%*Radio1
Rutland-ptp-Rolfe-Horizontal.dev1537 up               124973 182178276    0    0  124975 182178389    0    0  52.1%*Radio1
humboldt.sw                        6 alarm              5037   6969631    0    0    1560    234907    0    0  85.8%*6
humboldt.sw                        7 alarm              5045   7156965    0    0    1669    188184    0    0  88.1%*7
humboldt.sw                        8 up                 2924   3690317    0    0     505    138419    0    0  45.4%*8
palmer-dist.sw                     1 up                92545  18179856    0    0  281536 378655260    0    0 403.9%*1
palmer-dist.sw                     3 up               135660 185830559    0    0   44246   7737792    0    0 297.3%*3
manson-ptp-rockwellcity.devices.1537 up                75809 103277659    0    0   25046   4955449    0    0  56.5%*1537
RC backhaul slave               1537 up                25149   4939473    0    0   74682 101888248    0    0  55.8%*1537
Laurens Mikrotik                   2 critical          71619  96303899    0    0   23208   7887318    0    0 102.7%*PTP Marathon
alberticity-client.sw              1 up                12382   2773930    0    0   37897  52127344    0    3* 41.7%*1
alberticity-client.sw              6 up                 2712   3655969    0    0     891    210637    0    0  45.0%*6
alberticity-client.sw              7 up                 2853   4061709    0    0     928    169046    0    0  50.0%*7
newell-client.sw                  25 up                14207   2465898    0    0   41338  55587747    0    0  44.5%*25
aurelia-client.sw                  1 up                 3341   1128261    0    0    9758  12993251    0    0  42.4%*1
alta-client.sw                     3 up                 3606   4885676    0    0    1058    159721    0    0  60.1%*3
wesley-client.sw                   1 critical          12705   3345762    0    0   38387  52120300    0   39 114.2%*1
wesley-client.sw                   1 critical          12705   3345762    0    0   38387  52120300    0   39 114.2%*1
algona-client.sw                   2 up                 3800   5441915    0    0    1441    128765    0    0  59.4%*2
algona-client.sw                  24 up                14249   3081391    0    0   38457  52563300    0  187  42.1%*24
Mallard NE                         4 up                 1479    255812    0    0    4879   6621350    0    0  53.0%*4
mallard-client.sw                  4 up                 4873   6638563    0    0    1503    263672    0    0  53.1%*4
manson-client.sw                   1 up                17708   2874318    0    0   58842  81059708    0    3* 64.9%*1
fonda-client.sw                    1 up                 9423   2443392    0    0   28756  39741908    0    3  87.1%*Uplink to ER
fonda-client.sw                    4 up                 3455   4762120    0    0    1308    154036    0    0  58.6%*5ghz NE
varina-client.sw                   1 up                  920    112397    0    0    3883   5593902    0    0  70.2%*1
varina-client.sw                   6 up                 2247   3310185    0    0     284     49087    0    0  41.3%*6
livermore-client.sw                1 warning            9124   1882282    0    0   27527  37753562    0    0  82.8%*1
livermore-client.sw                7 up                 5568   7853757    0    0    1429    173876    0    0  64.2%*7
Manson Mikrotik                   15 critical          75564 102778330    0    0   24518   4601432    0    0  82.2%*PTP Rockwell City
Manson Mikrotik                   16 alarm             42306   7389338    0    0  134023 183090777    0    0  52.3%*PTP Palmer
Manson CRS317                     12 up                55995  77145677    0    0   17604   2766080    0    0  61.7%*12
Manson CRS317                     12 up                55995  77145677    0    0   17604   2766080    0    0  61.7%*12
Pomeroy Mikrotik                  16 alarm             47951  10207028    0    0  146267 193044540    0    0  51.5%*PTP Palmer
newell.rtr                        12 up                40363  54373966    0    0   14115   2336874    0    0  43.5%*12
Albert City CRS317                15 up                37987  52203084    0    0   12260   2724697    0    0  41.8%*Albert City CRS317: NA
Algona Edgerouter                  4 up                37621  51119401    0    0   13920   3110424    0    0  40.9%*4 Customers
Algona Router                      3 up                13762   3037807    0    0   37708  51312550    0    0  41.1%*eth0 Backhauls
Algona Router                      4 up                37709  51145176    0    0   13764   3093845    0    0  40.9%*eth1 Customers
Wesley Router                      3 up                13164   3341367    0    0   40349  55027080    0    0  44.0%*eth0 Uplink
Wesley Router                      4 up                40420  54882849    0    0   13141   3392530    0    0  43.9%*eth1 Customers
Wesley Router                      3 up                13137   3366121    0    0   40876  55667655    0    0  44.5%*3