Devices and Links with Errors

        Feb 26 21:08:08 1650 nodes,   6 down, 8540 links, 1984 down, 119 critical,  18 alarm,  24 warning, 24237265 pk/s, 220354 K by/s

Device                           Stat    SysUpTime    Avail  Loss    RTT  Probe  Address
                                       (Down Since)
Brownlee-PtP-Emmetsburg-80ghz.de WARN 162+06:30:19    100.0   0.5    593  SNMP   10.36.27.114
Brownlee-PtP-Emmetsburg-11ghz.de WARN 162+06:30:27    100.0   0.7    525  SNMP   10.36.27.115
Humboldt 5SW, Godfrey            ALRM                 100.0   0.0    214  Ping   10.36.45.3
Lytton 5 NE-NE, Bruns            DOWN 02/26 02:26 PM    0.0 100.0      0  Ping   10.36.62.99
Bradgate Cambium SW - Ricklefs   WARN                 100.0   0.0    134  Ping   10.36.220.6
wb-rr                            DOWN 02/26 09:07 PM   71.3  32.9      1  Ping   100.127.0.201
Drobo                            DOWN 02/26 02:26 PM    0.0 100.0      0  Ping   192.168.1.200
Nimble Controller1               ACK  02/26 02:26 PM    0.0 100.0      0  Ping   192.168.1.201
Plesk Hosting                    ALRM                 100.0   0.0      0  Prob   207.32.48.1
Monitor IPv6                     WARN                 100.0  31.1      1  Ping   2602:fe87:1:2::68
netINS DNS server                ALRM                 100.0   0.0      9  DNS    167.142.225.5
Monitor DNS                      ALRM                 100.0   0.0      8  DNS    207.32.53.25
Hosting HTTP                     ALRM                 100.0   0.0     50  HTTP   207.32.48.1
Aurelia-ptp-Alta.devices.ncn.net ALRM 191+19:47:21    100.0   0.1    524  SNMP   10.24.0.125
Varina to Newell                 WARN  74+14:00:21    100.0   0.0     34  Ubiq   10.24.0.181
Garner to Britt                  WARN 212+19:39:57    100.0   2.5     76  Ubiq   10.24.8.135
Garner to Britt                  WARN 212+19:39:57    100.0   2.5     76  Ubiq   10.24.8.135
Rutland-PtP-Livermore-Vertical.d WARN  57+12:26:22    100.0   0.0    505  SNMP   10.24.40.40
GimoreCity-PtP-Pioneer.devices.n WARN   8+08:51:25    100.0   0.0    701  SNMP   10.24.40.53
Pioneer-PtP-GilmoreCity.devices. WARN   8+08:51:08    100.0   0.0    792  SNMP   10.24.40.54
Humboldt Netonix                 CRIT 105+02:52:48    100.0   0.3    244  SNMP   10.24.40.75
Livermore to LuVerne Master      WARN  62+21:16:08    100.0   0.2    848  SNMP   10.24.40.154
10.24.40.182                     WARN  94+10:57:59    100.0   0.0    795  SNMP   10.24.40.182
Palmer-PtP-Manson-High-Vertical. WARN 266+12:13:26    100.0   0.0    674  SNMP   10.24.56.11
Palmer-PtP-Manson-High-Horizonta WARN 266+12:14:02    100.0   0.0    537  SNMP   10.24.56.12
Manson-PtP-Palmer-Low-Vertical.d WARN 187+17:12:18    100.0   0.0    524  SNMP   10.24.56.13
Manson-PtP-Palmer-Low-Vertical.d WARN 187+17:12:18    100.0   0.0    524  SNMP   10.24.56.13
Lohrville to Rockwell City Slave WARN  71+20:31:56    100.0   0.1    849  SNMP   10.24.56.21
Lohrville Slave - Low            WARN  71+20:31:37    100.0   0.2    555  SNMP   10.24.56.21
Lake City Slave - Low            WARN   8+07:31:35    100.0   1.8    622  SNMP   10.24.56.23
Palmer-PtP-Pomeroy-Horiztonal.de WARN   0+10:04:36    100.0   0.0    526  SNMP   10.24.56.34
Pomeroy-PtP-Palmer-Vertical.devi WARN   0+09:53:07    100.0   0.2    505  SNMP   10.24.56.35
Pomeroy-PtP-Palmer-Vertical.devi WARN   0+09:53:07    100.0   0.2    505  SNMP   10.24.56.35
Fonda-PtP-Pomeroy-Horizontal.dev WARN  15+08:28:43    100.0   0.2    522  SNMP   10.24.56.40
Laurens UPS                      WARN                 100.0   0.0    584  Trip   10.36.2.252
Cherokee 3 UPS                   ALRM   0+06:43:08    100.0   0.0     74  Trip   10.36.5.235
algona-mdu-weaver                ALRM 260+06:00:40    100.0   0.1    438  SNMP   10.36.12.235
Britt UPS                        WARN                 100.0   2.3    577  Trip   10.36.13.252
Eburg Fiber Drain                CRIT 149+16:35:58    100.0   0.7    311  SNMP   10.36.27.10
Harrison UPS                     ALRM 260+04:22:19    100.0   1.2     69  Trip   10.36.27.59
Cylinder UPS                     ALRM  15+11:06:42    100.0   0.0     65  Trip   10.36.28.252
Gilmore City UPS                 ALRM   8+08:51:33    100.0   0.1     65  Trip   10.36.43.252
Humboldt 915                     ALRM   2+04:52:39    100.0   0.2      5  Wire   10.36.45.242
Humboldt 908.4                   ALRM   1+21:07:27     99.9   2.9      6  Wire   10.36.45.243
Humboldt 921.6                   ALRM   2+05:27:04    100.0   0.1      5  Wire   10.36.45.244
Manson 918.4                     ALRM 187+17:12:18    100.0   0.1      3  Wire   10.36.58.239
Manson 911.6                     ALRM 187+17:12:17    100.0   0.1      2  Wire   10.36.58.240
Nemaha UPS                       ALRM 184+06:23:33    100.0   0.0     66  Trip   10.36.63.252
Varina UPS                       ALRM 314+08:08:31    100.0   0.0     64  Trip   10.36.67.250
ottosen-client.sw                ALRM 356+16:00:27    100.0   0.3    528  SNMP   10.36.81.253
Luverne Tower UPS                ALRM  71+09:12:00    100.0   0.1     63  Trip   10.36.82.244
Whittemore-ptp-Cylinder.devices. ALRM 122+21:07:39    100.0   0.0   1120  SNMP   10.36.88.2
debbier-printer                  ACK  02/26 02:26 PM    0.0 100.0      0  SNMP   10.42.4.10
Wesley                           WARN   8+22:57:00    100.0   0.0      1  SNMP   192.168.1.13
Jack                             WARN   9+04:50:52    100.0   0.0      0  SNMP   192.168.1.19
HV SAN LAN                       CRIT 360+08:42:29    100.0   0.0     25  SNMP   192.168.1.30
Havelock CO PDU#1                ALRM                 100.0  66.7      0  SNMP   192.168.1.190
Havelock CO PDU#2                ALRM                 100.0  66.7      0  SNMP   192.168.1.191
Mars                             ALRM  14+06:01:29    100.0   0.0      0  SNMP   192.168.1.232
SpringValley - ER                CRIT  59+11:50:03    100.0   0.0   1407  SNMP   206.72.48.97
Ottosen Edge UBNT                CRIT 356+16:09:23    100.0   0.5   1068  SNMP   207.32.53.215
Pro Coop Wallingford             ALRM                 100.0  75.0      0  SNMP   208.126.173.157
Wireless-Algona                  CRIT                 100.0   0.0      0  Map    127.0.0.1
Wireless-Rolfe                   ALRM                 100.0   0.0      0  Map    127.0.0.1
Core devices                     CRIT                 100.0   0.0      0  Map    127.0.0.1
SafetyNet                        ALRM                 100.0   0.0      0  Map    127.0.0.1
NICP                             ALRM                 100.0   0.0      0  Map    127.0.0.1
NICP                             ALRM                 100.0   0.0      0  Map    127.0.0.1
NW Servers                       CRIT                  99.8   0.0      0  Map    127.0.0.1
Wireless-UPS                     ALRM                 100.0   0.0      0  Map    127.0.0.1
Pocahontas Fiber Network         ALRM                 100.0   0.0      0  Map    127.0.0.1
Wireless-Palmer.1                WARN                 100.0   0.0      0  Map    127.0.0.1
eSIP eMobile                     ACK  02/26 02:27 PM    0.0 100.0      0  HTTP   165.140.232.83

Link                             Prt Stat               TPkt    TBytes TErr TDis    RPkt    RBytes RErr RDis  Util  Segment
Alta-PtP-Newell-Horizonal.device2050 up               124329 181193482    0    0  124331 181193742    0  214* 14.5% TenGigE1/2
Algona Edge UBNT                  13 critical          74899 100343116    0 33754*  29682   7475900    0    0  80.3%*13
Algona EdgeSwitch                 13 alarm             78141 104258550    0 48630*  31065   7515810    0    0  83.4%*13
Rolfe-ptp-Rutland-Vertical.devic1537 alarm            126961 172265608    0    0   43855  10553297    0    1* 94.3%*Radio1
Rolfe-ptp-Rutland-Vertical.devic2049 up                43869  10410738    0    0  127178 172606349    0   35* 13.8% TenGigE1/1
Rutland-ptp-Rolfe-Vertical.devic1537 alarm             43849  10407062    0    0  126940 172237021    0    1* 94.3%*Radio1
Rutland-ptp-Rolfe-Vertical.devic2049 up               127351 172846475    0    0   43920  10424560    0   37* 13.8% TenGigE1/1
Rutland-ptp-Rolfe-Vertical.devic2049 up               127351 172846475    0    0   43920  10424560    0   37* 13.8% TenGigE1/1
Rolfe-PtP-Bradgate-11ghz.devices2050 up                    2       195    0    0  125077  15009288    0  300*  1.2% TenGigE1/2
Bradgate-PtP-Rolfe-11ghz.devices2050 up               124997  14999567    0    0  125003  15000330    0  300*  1.2% TenGigE1/2
Laurens-client.sw.ncn.net          5 up                 2973   4185347    0    0    1189    147591    0   13*  3.4% 5
alberticity-client.sw              1 up                13379   2521423    0    0   34921  45758574    0    3* 36.6% 1
algona-mdu-weaver                  8 alarm              2911    280518    0    0    6011   8145316    0 33568*  6.5% 8
algona-client.sw                  15 up                 3619   4787637    0    0     920    281397    0   15*  3.8% 15
irvington-client.sw                1 up                 2052    393552    0    0    4818   6382693    0  372*  5.1% 1
early-client.sw                    1 up                 3351    783338    0    0    9609  13131701    0    7* 10.5% 1
emmetsburg-brownlee.sw            21 up                 2005    572294    0    0    6874   8593830    0    5*  6.9% 21
cylinder-client.sw                 6 up                 2010   2730285    0    0     807    101867    0   13*  2.2% 6
rolfe-client.sw                   18 up                  671    884722    0    0     167     35577    0   17*  4.3% 18
mallard-client.sw                 26 up                 8107   1060793    0    0   15600  21208647    0   81* 17.0% 26
manson-client.sw                   1 up                20636   5154926    0    0   62288  84221006    0    3* 67.4%*1
pomeroy-client.sw                  1 up                 7614   1434306    0    0   28825  39523673    0    3* 31.6% 1
pomeroy-client.sw                  8 up                 1906   2319102    0    0     343     70221    0   19*  1.9% 8
lytton-client.sw                   2 up                 8128   1569351    0    0   28437  39592347    0    3* 31.7% 2
lytton-client.sw                  17 up                 3231   4575736    0    0    1031    151292    0   13*  3.7% 17
pocahontas-client.sw               5 up                 4841   6790207    0    0    1819    249276    0   19*  5.4% 5
rockwellcity-client.sw             1 up                10561   2835192    0    0   31278  42135579    0    3* 33.7% 1
hv-bathroom                       50 up                 2745   2504509    0    0    1468   1238441    0    2*  0.2% 50
hv-ne-closet                      46 up                  944   1329217    0   23*    144     11996    0    6*  1.1% 46
hv-warehouse                      10 up                  510    718460    0    0      40      3413    0    6*  0.6% 10
hv-sysadmin                       26 up                   12      2599    0    0      53     13739    0    1*  0.0% 26
WB CO AP (N)                       2 up                    0        75    0    0      25      2523    0    1*  0.0% 2
Plover AP                          2 up                    0        72    0    0      23      2026    0    1*  0.0% 2
Ayrshire 3560                   5001 critical         132660 151641658    0 13008* 133202 152439455    0    0  40.7%*5001
Ayrshire 3560                   5001 alarm            132660 151641658    0 13008* 133202 152439455    0    0  40.7%*5001
HV SAN LAN                        52 up                 3297  19844593    0    0    2017   6558511    3*   0   1.6% 52
HV SAN LAN                        57 critical           2164    544672    0    0    2101    917762  154*   0   0.1% Data
Bode Mikrotik                     17 down                  0         0    0    0       0         0    0    0   0.0% 17
Rolfe Fiber Drain                 17 down                  0         0    0    0       0         0    0    0   0.0% 17
algona-dist.sw                    13 warning           76559 102321291    0 49660   30822   7580720    0    0  81.9%*13
algona-dist.sw                    16 up                40498  55031720    0    0   13985   2161271    0    0  44.0%*16
Algona Edge UBNT                  13 critical          74899 100343116    0 33754*  29682   7475900    0    0  80.3%*13
Algona EdgeSwitch                 13 alarm             78141 104258550    0 48630*  31065   7515810    0    0  83.4%*13
Algona EdgeSwitch                 16 up                39933  54414855    0    0   13812   2141964    0    0  43.5%*16
wesley-dist.sw                     1 alarm             33208   8101871    0    0   82488 110201167    0    0  88.2%*1
wesley-dist.sw                    24 up                44501  59305183    0    0   17229   4827716    0    0  47.4%*24
Wesley Netonix                     1 critical          33208   8101871    0    0   82488 110201167    0    0  88.2%*1
Wesley Netonix                     2 critical          30662  41107886    0    0   13024   2552489    0    0  91.4%*2
Rolfe-ptp-Rutland-Vertical.devic1537 alarm            126961 172265608    0    0   43855  10553297    0    1* 94.3%*Radio1
Rolfe-ptp-Rutland-horizontal.dev1537 up               124849 181997646    0    0  124851 181997758    0    0  52.0%*Radio1
Rutland-ptp-Rolfe-Vertical.devic1537 alarm             43849  10407062    0    0  126940 172237021    0    1* 94.3%*Radio1
Rutland-ptp-Rolfe-Horizontal.dev1537 up               124828 181966778    0    0  124830 181966890    0    0  52.0%*Radio1
humboldt.sw                        1 up                 8098   1361953    0    0   20832  28640152    0    0  62.8%*1
humboldt.sw                        6 critical           8976  12213610    0    0    3987    857529    0    0 150.3%*6
humboldt.sw                        7 critical           6777   9376885    0    0    2417    318630    0    0 115.4%*7
humboldt.sw                        8 alarm              5046   6996962    0    0    1679    182736    0    0  86.1%*8
palmer-dist.sw                     1 up                97045  20131237    0    0  295023 398443231    0    0 425.0%*1
palmer-dist.sw                     3 up               135615 184577258    0    0   46082  10229468    0    0 295.3%*3
manson-ptp-rockwellcity.devices.1537 up                70322  96342459    0    0   24950   5291991    0    0  52.7%*1537
RC backhaul slave               1537 up                24917   5252368    0    0   70240  96224893    0    0  52.7%*1537
Laurens Mikrotik                   2 critical          57360  75784274    0    0   16872   4474598    0    0  80.8%*PTP Marathon
newell-client.sw                  25 up                14352   2541955    0    0   41987  56963163    0    0  45.6%*25
alta-client.sw                     3 up                 4880   6812025    0    0    1529    361593    0    0  83.8%*3
wesley-client.sw                   1 critical          18837   5304298    0    0   48903  65074631    0    0 142.6%*1
wesley-client.sw                   1 critical          18837   5304298    0    0   48903  65074631    0    0 142.6%*1
algona-client.sw                   2 alarm              5764   7741949    0    0    2755    282229    0    0  85.6%*2
algona-client.sw                   9 up                 4917   6898591    0    0    1432    183872    0    0  55.2%*9
algona-client.sw                  24 up                14812   2286884    0    0   43138  58618811    0 1314  46.9%*24
Mallard NE                         4 up                 1265    134839    0    0    4738   6717316    0    0  53.7%*4
mallard-client.sw                  4 up                 4697   6707700    0    0    1179    133105    0    0  53.7%*4
manson-client.sw                   1 up                20636   5154926    0    0   62288  84221006    0    3* 67.4%*1
fonda-client.sw                    1 up                11613   2304696    0    0   39225  53667149    0    3 117.6%*Uplink to ER
fonda-client.sw                    2 up                 3742   5053363    0    0    1092    151420    0    0  40.4%*5ghz NW
fonda-client.sw                    4 up                 3804   4962339    0    0    1019    208763    0    0  61.1%*5ghz NE
varina-client.sw                   1 up                  795    100953    0    0    2490   3493316    0    0  44.2%*1
livermore-client.sw                1 up                 6117   1208564    0    0   20516  27498772    0    0  60.3%*1
Ayrshire 3560                   5001 critical         132660 151641658    0 13008* 133202 152439455    0    0  40.7%*5001
Ayrshire 3560                   5001 alarm            132660 151641658    0 13008* 133202 152439455    0    0  40.7%*5001
Manson CRS317                     12 up                62370  84318988    0    0   20724   5194781    0    0  67.5%*12
Manson Mikrotik                   15 alarm             67295  92410829    0    0   23872   4827697    0    0  73.9%*PTP Rockwell City
Manson Mikrotik                   16 warning           43214   9455023    0    0  127769 174145209    0    0  49.8%*PTP Palmer
Manson CRS317                     12 up                62370  84318988    0    0   20724   5194781    0    0  67.5%*12
Pomeroy Mikrotik                  16 alarm             50272   9583002    0    0  157173 210777175    0    0  56.2%*PTP Palmer
newell.rtr                        12 up                43665  59169083    0    0   14852   2689098    0    0  47.3%*12
Algona Router                      3 up                14754   2230043    0    0   42690  58181448    0    0  46.6%*eth0 Backhauls
Algona Router                      4 up                42699  58008913    0    0   14758   2289827    0    0  46.4%*eth1 Customers
Algona Edgerouter                  4 up                43270  58581516    0    0   14781   2311491    0    0  46.9%*4 Customers
Wesley Router                      3 up                18226   5331667    0    0   47680  63649333    0    0  50.9%*3
Wesley Router                      3 up                18208   5326342    0    0   47633  63585769    0    0  50.9%*eth0 Uplink
Wesley Router                      4 up                47694  63394073    0    0   18169   5395013    0    0  50.7%*eth1 Customers