Devices and Links with Errors

        Feb 26 21:08:29 1650 nodes,   6 down, 8540 links, 1984 down, 122 critical,   9 alarm,  26 warning, 24326695 pk/s, 364141 K by/s

Device                           Stat    SysUpTime    Avail  Loss    RTT  Probe  Address
                                       (Down Since)
Brownlee-PtP-Emmetsburg-11ghz.de WARN 162+06:30:27    100.0   0.7    525  SNMP   10.36.27.115
Humboldt 5SW, Godfrey            ALRM                 100.0   0.0    214  Ping   10.36.45.3
Lytton 5 NE-NE, Bruns            DOWN 02/26 02:26 PM    0.0 100.0      0  Ping   10.36.62.99
Bradgate Cambium SW - Ricklefs   WARN                 100.0   0.0    134  Ping   10.36.220.6
wb-rr                            DOWN 02/26 09:07 PM   71.2  32.9      1  Ping   100.127.0.201
Drobo                            DOWN 02/26 02:26 PM    0.0 100.0      0  Ping   192.168.1.200
Nimble Controller1               ACK  02/26 02:26 PM    0.0 100.0      0  Ping   192.168.1.201
Plesk Hosting                    ALRM                 100.0   0.0      0  Prob   207.32.48.1
Monitor IPv6                     WARN                 100.0  31.0      1  Ping   2602:fe87:1:2::68
netINS DNS server                ALRM                 100.0   0.0     11  DNS    167.142.225.5
Monitor DNS                      ALRM                 100.0   0.0      6  DNS    207.32.53.25
Hosting HTTP                     ALRM                 100.0   0.0     50  HTTP   207.32.48.1
Aurelia-ptp-Alta.devices.ncn.net CRIT 191+19:47:50    100.0   0.1    844  SNMP   10.24.0.125
Varina to Newell                 WARN  74+14:00:51    100.0   0.0     40  Ubiq   10.24.0.181
Garner to Britt                  WARN 212+19:39:57    100.0   2.5     76  Ubiq   10.24.8.135
Garner to Britt                  WARN 212+19:39:57    100.0   2.5     76  Ubiq   10.24.8.135
Rutland-PtP-Livermore-Vertical.d WARN  57+12:26:22    100.0   0.0    505  SNMP   10.24.40.40
GimoreCity-PtP-Pioneer.devices.n WARN   8+08:51:25    100.0   0.0    701  SNMP   10.24.40.53
Pioneer-PtP-GilmoreCity.devices. WARN   8+08:51:38    100.0   0.0    786  SNMP   10.24.40.54
Humboldt Netonix                 CRIT 105+02:53:18    100.0   0.3    174  SNMP   10.24.40.75
Livermore to LuVerne Master      WARN  62+21:16:38    100.0   0.2    778  SNMP   10.24.40.154
LuVerne - Livermore Slave        WARN  72+06:06:13    100.0   0.0    792  SNMP   10.24.40.155
10.24.40.182                     WARN  94+10:58:29    100.0   0.0    797  SNMP   10.24.40.182
Manson-PtP-Palmer-Low-Vertical.d WARN 187+17:12:48    100.0   0.0    515  SNMP   10.24.56.13
Manson-PtP-Palmer-Low-Vertical.d WARN 187+17:12:48    100.0   0.0    515  SNMP   10.24.56.13
Lohrville to Rockwell City Slave WARN  71+20:31:56    100.0   0.1    849  SNMP   10.24.56.21
Lohrville Slave - Low            WARN  71+20:32:07    100.0   0.2    769  SNMP   10.24.56.21
Lake City Slave - Low            WARN   8+07:32:05    100.0   1.8    618  SNMP   10.24.56.23
Palmer-PtP-Pomeroy-Horiztonal.de WARN   0+10:05:06    100.0   0.0    516  SNMP   10.24.56.34
Fonda-PtP-Pomeroy-Horizontal.dev WARN  15+08:28:43    100.0   0.2    522  SNMP   10.24.56.40
Laurens UPS                      WARN                 100.0   0.0    584  Trip   10.36.2.252
Cherokee 3 UPS                   ALRM   0+06:43:08    100.0   0.0     74  Trip   10.36.5.235
algona-mdu-weaver                CRIT 260+06:01:10    100.0   0.1    536  SNMP   10.36.12.235
Britt UPS                        WARN                 100.0   2.3    577  Trip   10.36.13.252
Eburg Fiber Drain                CRIT 149+16:36:28    100.0   0.7    283  SNMP   10.36.27.10
Harrison UPS                     ALRM 260+04:23:19    100.0   1.2     65  Trip   10.36.27.59
Cylinder UPS                     ALRM  15+11:06:42    100.0   0.0     65  Trip   10.36.28.252
Gilmore City UPS                 ALRM   8+08:51:33    100.0   0.1     65  Trip   10.36.43.252
Humboldt 915                     ALRM   2+04:52:39    100.0   0.2      5  Wire   10.36.45.242
Humboldt 908.4                   ALRM   1+21:07:57     99.9   2.9      4  Wire   10.36.45.243
Humboldt 921.6                   ALRM   2+05:27:04    100.0   0.1      5  Wire   10.36.45.244
Manson 918.4                     ALRM 187+17:12:48    100.0   0.1      2  Wire   10.36.58.239
Manson 911.6                     ALRM 187+17:12:47    100.0   0.1      4  Wire   10.36.58.240
Nemaha UPS                       ALRM 184+06:23:33    100.0   0.0     66  Trip   10.36.63.252
Varina UPS                       ALRM 314+08:08:31    100.0   0.0     64  Trip   10.36.67.250
Ottosen 5GHz NW                  ALRM 356+16:14:21    100.0   1.0   1062  SNMP   10.36.81.246
ottosen-client.sw                WARN 356+16:01:02    100.0   0.3    679  SNMP   10.36.81.253
Luverne Tower UPS                ALRM  71+09:13:00    100.0   0.1     62  Trip   10.36.82.244
Whittemore-ptp-Cylinder.devices. ALRM 122+21:07:39    100.0   0.0   1120  SNMP   10.36.88.2
debbier-printer                  ACK  02/26 02:26 PM    0.0 100.0      0  SNMP   10.42.4.10
Wesley                           WARN   8+22:58:02    100.0   0.0      1  SNMP   192.168.1.13
Jack                             WARN   9+04:50:52    100.0   0.0      0  SNMP   192.168.1.19
HV SAN LAN                       CRIT 360+08:43:29    100.0   0.0     25  SNMP   192.168.1.30
Havelock CO PDU#1                ALRM                 100.0  66.7      0  SNMP   192.168.1.190
Havelock CO PDU#2                ALRM                 100.0  66.7      0  SNMP   192.168.1.191
Mars                             ALRM  14+06:02:30    100.0   0.0      0  SNMP   192.168.1.232
Albert City Mikrotik             WARN  21+05:34:21    100.0   0.1     51  SNMP   207.32.53.92
Varina ER5                       WARN 314+07:45:44    100.0   0.1    571  SNMP   207.32.53.93
Varina ER5                       WARN 314+07:45:44    100.0   0.1    571  SNMP   207.32.53.93
Ottosen Edge UBNT                CRIT 356+16:09:53    100.0   0.5    438  SNMP   207.32.53.215
Rolfe Fiber Drain                WARN   4+19:21:42    100.0   0.1     63  SNMP   207.32.53.220
Pro Coop Wallingford             ALRM                 100.0  75.0      0  SNMP   208.126.173.157
Wireless-Algona                  CRIT                 100.0   0.0      0  Map    127.0.0.1
Wireless-Rolfe                   CRIT                 100.0   0.0      0  Map    127.0.0.1
Core devices                     ALRM                 100.0   0.0      0  Map    127.0.0.1
SafetyNet                        ALRM                 100.0   0.0      0  Map    127.0.0.1
NICP                             ALRM                 100.0   0.0      0  Map    127.0.0.1
NICP                             ALRM                 100.0   0.0      0  Map    127.0.0.1
NW Servers                       CRIT                  99.8   0.0      0  Map    127.0.0.1
Wireless-Albert City             WARN                 100.0   0.0      0  Map    127.0.0.1
Wireless-UPS                     ALRM                 100.0   0.0      0  Map    127.0.0.1
Pocahontas Fiber Network         ALRM                 100.0   0.0      0  Map    127.0.0.1
Wireless-Palmer.1                WARN                 100.0   0.0      0  Map    127.0.0.1
eSIP eMobile                     ACK  02/26 02:27 PM    0.0 100.0      0  HTTP   165.140.232.83

Link                             Prt Stat               TPkt    TBytes TErr TDis    RPkt    RBytes RErr RDis  Util  Segment
Alta-PtP-Newell-Horizonal.device2050 up               125878 183450518    0    0  125879 183450950    0  220* 14.7% TenGigE1/2
algona-dist.sw                    16 up                38899  52413220    0  630*  13235   2137821    0    0  41.9%*16
Algona Edge UBNT                  13 critical          77300 103388709    0 40954*  30006   7980540    0    0  82.7%*13
Algona EdgeSwitch                 13 alarm             78801 105693346    0 41224*  31210   8055761    0    0  84.6%*13
Algona EdgeSwitch                 16 up                40491  54805331    0  458*  13825   2147892    0    0  43.8%*16
Rolfe-ptp-Rutland-Vertical.devic1537 critical         130141 176895864    0    0   45801  11778345    0    1* 96.8%*Radio1
Rolfe-ptp-Rutland-Vertical.devic2049 up                45790  11631817    0    0  130045 176760915    0   37* 14.1% TenGigE1/1
Rutland-ptp-Rolfe-Vertical.devic1537 critical          45859  11626436    0    0  130307 177122870    0    1* 96.9%*Radio1
Rutland-ptp-Rolfe-Vertical.devic2049 up               130155 176914123    0    0   45832  11643695    0   35* 14.2% TenGigE1/1
Rutland-ptp-Rolfe-Vertical.devic2049 up               130155 176914123    0    0   45832  11643695    0   35* 14.2% TenGigE1/1
Rolfe-PtP-Bradgate-11ghz.devices2050 up                    2       195    0    0  125077  15009288    0  300*  1.2% TenGigE1/2
Bradgate-PtP-Rolfe-11ghz.devices2050 up               124997  14999567    0    0  125003  15000330    0  300*  1.2% TenGigE1/2
Laurens-client.sw.ncn.net          5 up                 2594   3683267    0    0    1019    119883    0   15*  3.0% 5
alberticity-client.sw              1 up                14133   2947634    0    0   35717  46659128    0    3* 37.3% 1
alta-client.sw                    25 up                 8140   2208919    0    0   22878  30724299    0  673* 24.6% 25
wesley-client.sw                   3 up                 4579   6226060    0    0    1823   1143347    0    7*  5.0% 3
wesley-client.sw                   4 up                 4313   5851693    0    0    1003    279306    0   21*  4.7% 4
wesley-client.sw                   5 up                 2333   2792634    0    0    1194    699693    0    5*  2.2% 5
wesley-client.sw                   6 up                 6294   8284626    0    0    1669    330234    0    5*  6.6% 6
wesley-client.sw                   7 up                 2053   2643405    0    0     961    594301    0   33*  2.1% 7
wesley-client.sw                  18 up                 2391   2701848    0    0    1184    644128    0   17*  2.2% 18
algona-mdu-weaver                  8 alarm              2701    295574    0    0    6065   7889272    0 37196*  6.3% 8
algona-client.sw                  13 up                 8241  11401982    0    0    3295    506782    0    3*  9.1% 13
algona-client.sw                  15 up                 3211   4220117    0    0     949    366256    0   11*  3.4% 15
early-client.sw                    1 up                 3351    783338    0    0    9609  13131701    0    7* 10.5% 1
emmetsburg-brownlee.sw            21 up                 2111    715402    0    0    8087   9955657    0  220*  8.0% 21
cylinder-client.sw                 6 up                 2110   2923567    0    0     686    101679    0   15*  2.3% 6
rolfe-client.sw                   18 up                  606    782552    0    0     248     47371    0   12*  3.9% 18
mallard-client.sw                 26 up                 7808   1014690    0    0   14720  20063794    0   82* 16.1% 26
manson-client.sw                   1 up                20636   5154926    0    0   62288  84221006    0    3* 67.4%*1
pomeroy-client.sw                  1 up                 7614   1434306    0    0   28825  39523673    0    3* 31.6% 1
pomeroy-client.sw                  8 up                 1906   2319102    0    0     343     70221    0   19*  1.9% 8
lytton-client.sw                   2 up                 7429   1609159    0    0   25079  34681375    0    3* 27.8% 2
lytton-client.sw                  17 up                 2725   3930819    0    0     905    116951    0   11*  3.1% 17
pocahontas-client.sw               5 up                 5075   7108449    0    0    1959    251593    0   19*  5.7% 5
rockwellcity-client.sw             1 up                10561   2835192    0    0   31278  42135579    0    3* 33.7% 1
hv-bathroom                       50 up                 2745   2504509    0    0    1468   1238441    0    2*  0.2% 50
hv-ne-closet                      46 up                  944   1329217    0   23*    144     11996    0    6*  1.1% 46
hv-warehouse                      10 up                  493    706825    0    0      34      2947    0    6*  0.6% 10
hv-sysadmin                       26 up                   11      2632    0    0      49     10351    0    1*  0.0% 26
WB CO AP (N)                       2 up                    0        75    0    0      25      2523    0    1*  0.0% 2
Plover AP                          2 up                    0        18    0    0      17      1740    0    1*  0.0% 2
Ayrshire 3560                   5001 warning          132313 150163151    0 4855* 132736 150826575    0    0  40.2%*5001
Ayrshire 3560                   5001 up               132313 150163151    0 4855* 132736 150826575    0    0  40.2%*5001
HV SAN LAN                        57 critical           1825    475630    0    0    1601    269451   70*   0   0.0% Data
Bode Mikrotik                     17 down                  0         0    0    0       0         0    0    0   0.0% 17
Rolfe Fiber Drain                 17 down                  0         0    0    0       0         0    0    0   0.0% 17
algona-dist.sw                    13 warning           79128 105970624    0 41894   31039   8190008    0    0  84.8%*13
algona-dist.sw                    16 up                38899  52413220    0  630*  13235   2137821    0    0  41.9%*16
Algona Edge UBNT                  13 critical          77300 103388709    0 40954*  30006   7980540    0    0  82.7%*13
Algona EdgeSwitch                 13 alarm             78801 105693346    0 41224*  31210   8055761    0    0  84.6%*13
Algona EdgeSwitch                 16 up                40491  54805331    0  458*  13825   2147892    0    0  43.8%*16
wesley-dist.sw                     1 warning           28316   7402316    0    0   71954  96364451    0    0  77.1%*1
wesley-dist.sw                    24 up                49035  65396137    0    0   18115   5340118    0    0  52.3%*24
Wesley Netonix                     1 critical          30775   8045149    0    0   78202 104732943    0    0  83.8%*1
Wesley Netonix                     2 critical          32956  44438335    0    0   14269   3070288    0    0  98.8%*2
Rolfe-ptp-Rutland-Vertical.devic1537 critical         130141 176895864    0    0   45801  11778345    0    1* 96.8%*Radio1
Rolfe-ptp-Rutland-horizontal.dev1537 up               125062 182309059    0    0  125065 182309267    0    0  52.1%*Radio1
Rutland-ptp-Rolfe-Vertical.devic1537 critical          45859  11626436    0    0  130307 177122870    0    1* 96.9%*Radio1
Rutland-ptp-Rolfe-Horizontal.dev1537 up               125116 182387581    0    0  125119 182387741    0    0  52.1%*Radio1
humboldt.sw                        1 up                 7284   1443552    0    0   17924  24716876    0    0  54.2%*1
humboldt.sw                        6 critical           7883  10807039    0    0    3761    868875    0    0 133.0%*6
humboldt.sw                        7 critical           5964   8196667    0    0    2017    387850    0    0 100.9%*7
humboldt.sw                        8 up                 4024   5637396    0    0    1478    182416    0    0  69.4%*8
palmer-dist.sw                     1 up                95106  21308198    0    0  284433 382892145    0    0 408.4%*1
palmer-dist.sw                     3 up               119781 162533564    0    0   41813   9996021    0    0 260.1%*3
manson-ptp-rockwellcity.devices.1537 up                66879  91236505    0    0   23645   5377037    0    0  49.9%*1537
RC backhaul slave               1537 up                23701   5366232    0    0   67028  91447121    0    0  50.0%*1537
Laurens Mikrotik                   2 critical          57360  75784274    0    0   16872   4474598    0    0  80.8%*PTP Marathon
newell-client.sw                  25 up                14352   2541955    0    0   41987  56963163    0    0  45.6%*25
alta-client.sw                     3 up                 4559   6363633    0    0    1334    155427    0    0  78.3%*3
wesley-client.sw                   1 critical          17906   5273345    0    0   48588  64738461    0  243 141.9%*1
wesley-client.sw                   1 critical          17906   5273345    0    0   48588  64738461    0  243 141.9%*1
algona-client.sw                   2 warning            5778   7426629    0    0    2512    253177    0    0  81.9%*2
algona-client.sw                   9 up                 5271   7300640    0    0    1521    183371    0    0  58.4%*9
algona-client.sw                  24 up                13199   2132607    0    0   38887  52353166    0 4453  41.9%*24
Mallard NE                         4 up                 1265    134839    0    0    4738   6717316    0    0  53.7%*4
mallard-client.sw                  4 up                 4661   6548851    0    0    1315    151463    0    0  52.4%*4
manson-client.sw                   1 up                20636   5154926    0    0   62288  84221006    0    3* 67.4%*1
fonda-client.sw                    1 up                11613   2304696    0    0   39225  53667149    0    3 117.6%*Uplink to ER
fonda-client.sw                    2 up                 3742   5053363    0    0    1092    151420    0    0  40.4%*5ghz NW
fonda-client.sw                    4 up                 3804   4962339    0    0    1019    208763    0    0  61.1%*5ghz NE
varina-client.sw                   1 up                  795    100953    0    0    2490   3493316    0    0  44.2%*1
livermore-client.sw                1 up                 5979   1140190    0    0   19803  26632039    0    0  58.4%*1
Ayrshire 3560                   5001 warning          132313 150163151    0 4855* 132736 150826575    0    0  40.2%*5001
Ayrshire 3560                   5001 up               132313 150163151    0 4855* 132736 150826575    0    0  40.2%*5001
Manson CRS317                     12 up                62370  84318988    0    0   20724   5194781    0    0  67.5%*12
Manson Mikrotik                   15 alarm             65741  89630451    0    0   23082   5129865    0    0  71.7%*PTP Rockwell City
Manson Mikrotik                   16 warning           43338  10210364    0    0  124256 168724049    0    0  48.2%*PTP Palmer
Manson CRS317                     12 up                62370  84318988    0    0   20724   5194781    0    0  67.5%*12
Pomeroy Mikrotik                  16 alarm             49005  10089114    0    0  153695 206226939    0    0  55.0%*PTP Palmer
fonda.rtr                         12 up                39097  53324286    0    0   12208   2471521    0    0  42.7%*SFP12 - Client Switch
newell.rtr                        12 up                43665  59169083    0    0   14852   2689098    0    0  47.3%*12
Newell Mikrotik                   16 warning           42458  11166829    0    0  127947 170466503    0    0  47.4%*Albert City PTP
Algona Router                      3 up                13580   2059214    0    0   39807  53819581    0    0  43.1%*eth0 Backhauls
Algona Router                      4 up                39820  53660735    0    0   13590   2114875    0    0  42.9%*eth1 Customers
Algona Edgerouter                  4 up                38367  51554305    0    0   13172   2090448    0    0  41.2%*4 Customers
Wesley Router                      3 up                17762   5118051    0    0   49124  65667332    0    0  52.5%*3
Wesley Router                      3 up                17739   5111233    0    0   49058  65579863    0    0  52.5%*eth0 Uplink
Wesley Router                      4 up                49116  65383769    0    0   17699   5177572    0    0  52.3%*eth1 Customers