Devices and Links with Errors

        Feb 28 20:12:50 1650 nodes,   7 down, 8540 links, 1988 down, 120 critical,  11 alarm,  25 warning, 23584845 pk/s, 3841660 K by/s

Device                           Stat    SysUpTime    Avail  Loss    RTT  Probe  Address
                                       (Down Since)
Alta 5N, Turnquist               WARN                  99.7   0.9    181  Ping   10.36.7.24
Lytton 5 NE-NE, Bruns            DOWN 02/27 12:50 PM    0.0 100.0      0  Ping   10.36.62.99
Whittemore 5N, Olmstead          DOWN 02/28 03:16 PM   84.3   1.1     60  Ping   10.36.89.14
Alta Cambium SE - Foell          WARN                  99.8   2.9    142  Ping   10.36.204.11
Bode Cambium E Sampson           WARN                 100.0   0.1    136  Ping   10.36.213.2
wb-rr                            DOWN 02/28 08:10 PM   90.5   6.4      1  Ping   100.127.0.201
Drobo                            DOWN 02/27 12:51 PM    0.0 100.0      0  Ping   192.168.1.200
Nimble Controller1               ACK  02/27 12:51 PM    0.0 100.0      0  Ping   192.168.1.201
Plesk Hosting                    ALRM                 100.0   0.0      0  Prob   207.32.48.1
netINS DNS server                ALRM                 100.0   0.1     13  DNS    167.142.225.5
Monitor DNS                      ALRM                 100.0   0.0      7  DNS    207.32.53.25
Hosting HTTP                     ALRM                 100.0   0.0     50  HTTP   207.32.48.1
Aurelia-ptp-Alta.devices.ncn.net ALRM 193+18:52:16    100.0   1.8    765  SNMP   10.24.0.125
Alta-PtP-Aurelia.devices.ncn.net WARN 246+08:15:21     99.9   1.7    977  SNMP   10.24.0.126
Varina to Newell                 WARN  76+13:04:52    100.0   0.5     38  Ubiq   10.24.0.181
Garner to Britt                  WARN 214+18:44:29    100.0   1.1     66  Ubiq   10.24.8.135
Garner to Britt                  WARN 214+18:44:29    100.0   1.1     66  Ubiq   10.24.8.135
Rutland-PtP-Livermore-Vertical.d WARN  59+11:30:49    100.0   0.0    532  SNMP   10.24.40.40
GimoreCity-PtP-Pioneer.devices.n WARN  10+07:55:50    100.0   0.0    598  SNMP   10.24.40.53
Pioneer-PtP-GilmoreCity.devices. WARN  10+07:56:02    100.0   0.3    771  SNMP   10.24.40.54
Livermore to LuVerne Master      WARN  64+20:21:00    100.0   0.1    776  SNMP   10.24.40.154
LuVerne - Livermore Slave        WARN  74+05:10:38    100.0   0.1    798  SNMP   10.24.40.155
10.24.40.182                     WARN  96+10:02:53    100.0   0.0    788  SNMP   10.24.40.182
Lohrville Slave - Low            WARN  73+19:36:30    100.0   0.0    779  SNMP   10.24.56.21
Lohrville to Rockwell City Slave WARN  73+19:36:19    100.0   0.1    774  SNMP   10.24.56.21
Lake City Slave - Low            WARN  10+06:36:27    100.0   1.0    648  SNMP   10.24.56.23
Marathon-PtP-Laurens-Horizontal. WARN  17+04:41:23    100.0   0.0    514  SNMP   10.36.0.11
Laurens UPS                      WARN                 100.0   0.0    583  Trip   10.36.2.252
Cherokee 3 UPS                   ALRM   2+05:47:58    100.0   1.1     72  Trip   10.36.5.235
Britt UPS                        WARN                 100.0   1.4    583  Trip   10.36.13.252
Harrison UPS                     ALRM 262+03:27:51    100.0   0.0     68  Trip   10.36.27.59
Cylinder UPS                     ALRM  17+10:11:41    100.0   0.0     68  Trip   10.36.28.252
Gilmore City UPS                 ALRM  10+07:56:15    100.0   0.0     64  Trip   10.36.43.252
Humboldt 915                     ALRM   4+03:56:03    100.0   0.0      6  Wire   10.36.45.242
Humboldt 908.4                   ALRM   3+20:10:41    100.0   0.5      4  Wire   10.36.45.243
Humboldt 921.6                   ALRM   4+04:30:49    100.0   0.0      5  Wire   10.36.45.244
Manson 918.4                     ALRM 189+16:17:11    100.0   0.1      2  Wire   10.36.58.239
Manson 911.6                     ALRM 189+16:17:11    100.0   0.1      2  Wire   10.36.58.240
Nemaha UPS                       ALRM 186+05:28:45    100.0   0.1     65  Trip   10.36.63.252
Varina UPS                       ALRM 316+07:13:03    100.0   0.7     69  Trip   10.36.67.250
Luverne Tower UPS                ALRM  73+08:17:00    100.0   0.1     62  Trip   10.36.82.244
debbier-printer                  ACK  02/27 12:51 PM    0.0 100.0      0  SNMP   10.42.4.10
Whittemore Mikrotik              WARN 196+00:20:03    100.0   0.7     69  SNMP   165.140.233.55
Wesley                           WARN  10+22:01:34    100.0   0.1      1  SNMP   192.168.1.13
Jack                             WARN  11+03:55:10    100.0   0.0      0  SNMP   192.168.1.19
HV SAN LAN                       CRIT 362+07:47:35    100.0   0.0     33  SNMP   192.168.1.30
Havelock CO PDU#1                ALRM                 100.0  66.7      0  SNMP   192.168.1.190
Havelock CO PDU#2                ALRM                 100.0  66.7      0  SNMP   192.168.1.191
Mars                             ALRM  16+05:06:11    100.0   0.1      0  SNMP   192.168.1.232
Havelock                         WARN  71+08:08:41    100.0   0.0      0  SNMP   192.168.1.251
Ottosen Edge UBNT                ALRM 358+15:14:11    100.0   0.4    110  SNMP   207.32.53.215
Pro Coop Wallingford             ALRM                 100.0  75.0      0  SNMP   208.126.173.157
NICP                             ALRM                 100.0   0.0      0  Map    127.0.0.1
SafetyNet                        ALRM                 100.0   0.0      0  Map    127.0.0.1
NICP                             ALRM                 100.0   0.0      0  Map    127.0.0.1
Wireless-Rolfe                   ALRM                 100.0   0.0      0  Map    127.0.0.1
Wireless-UPS                     ALRM                  99.4   0.0      0  Map    127.0.0.1
Wireless-Algona                  CRIT                 100.0   0.0      0  Map    127.0.0.1
Pocahontas Fiber Network         ALRM                 100.0   0.0      0  Map    127.0.0.1
NW LAN                           WARN                 100.0   0.0      0  Map    127.0.0.1
Wireless-Palmer.1                WARN                 100.0   0.0      0  Map    127.0.0.1
NW Servers                       CRIT                 100.0   0.0      0  Map    127.0.0.1
Core devices                     CRIT                 100.0   0.0      0  Map    127.0.0.1
eSIP eMobile                     ACK  02/27 12:52 PM    0.0 100.0      0  HTTP   165.140.232.83

Link                             Prt Stat               TPkt    TBytes TErr TDis    RPkt    RBytes RErr RDis  Util  Segment
Alta-PtP-Newell-Horizonal.device2050 up               124966 182112670    0    0  124968 182112988    0  241* 14.6% TenGigE1/2
Algona Edge UBNT                  13 critical          70786  96688805    0 8136*  35912   5339451    0    0  77.4%*13
algona-dist.sw                    16 up                32473  44549555    0  288*  10265   1952319    0    0  35.6% 16
Algona EdgeSwitch                 13 warning           71464  97674857    0 8388*  36127   5376549    0    0  78.1%*13
Algona EdgeSwitch                 16 up                35748  49206029    0  288*  10340   1746254    0    0  39.4% 16
Rolfe-ptp-Rutland-Vertical.devic1537 alarm            120661 165121014    0    0   42209   9914728    0    1* 90.4%*Radio1
Rolfe-ptp-Rutland-Vertical.devic2049 up                42270   9795249    0    0  121018 165591437    0   35* 13.3% TenGigE1/1
Rutland-ptp-Rolfe-Vertical.devic1537 alarm             42220   9812795    0    0  121078 165639609    0    1* 90.6%*Radio1
Rutland-ptp-Rolfe-Vertical.devic2049 up               120719 165098387    0    0   42044   9784503    0   35* 13.2% TenGigE1/1
Rutland-ptp-Rolfe-Vertical.devic2049 up               120719 165098387    0    0   42044   9784503    0   35* 13.2% TenGigE1/1
Rolfe-PtP-Bradgate-11ghz.devices2050 up                    4       512    0    0  125009  15001092    0  299*  1.2% TenGigE1/2
Bradgate-PtP-Rolfe-11ghz.devices2050 up               124922  14990692    0    0  124927  14991275    0  300*  1.2% TenGigE1/2
Laurens-client.sw.ncn.net          5 up                 3556   4879458    0    0     999    150872    0   15*  3.9% 5
alberticity-client.sw              1 up                11462   2662249    0    0   34648  46957118    0    3* 37.6% 1
algona-mdu-weaver                  8 up                  745    102388    0    0    2217   3124646    0 1678*  2.5% 8
algona-client.sw                  15 up                 5178   7220094    0    0    1326    208429    0   13*  5.8% 15
irvington-client.sw                1 up                 2908    463233    0    0    4756   5145585    0  332*  4.1% 1
early-client.sw                    1 up                 3141    712812    0    0   10660  14768891    0    3* 11.8% 1
emmetsburg-brownlee.sw            21 up                 3105    944633    0    0    8096  10401054    0    5*  8.3% 21
cylinder-client.sw                 6 up                 1318   1717717    0    0     406     75481    0   15*  1.4% 6
rolfe-client.sw                   18 up                 1330   1679431    0    0     135     30406    0   13*  8.1% 18
mallard-client.sw                 26 up                12206   1258144    0    0   17123  23986461    0  100* 19.2% 26
manson-client.sw                   1 up                18623   4211900    0    0   51736  71363753    0    3* 57.1%*1
pomeroy-client.sw                  1 up                 6303   2139574    0    0   18691  25152222    0    7* 20.1% 1
pomeroy-client.sw                  8 up                  120    159843    0    0      45      7372    0   19*  0.1% 8
lytton-client.sw                   2 up                 8013   1992737    0    0   23757  32931575    0    3* 26.4% 2
lytton-client.sw                  17 up                 1095   1297379    0    0     267     90227    0   15*  1.0% 17
pocahontas-client.sw               5 up                 5382   7429927    0    0    1955    342060    0   19*  5.9% 5
rockwellcity-client.sw             1 up                 7617   1294575    0    0   27382  37270498    0    3* 29.8% 1
hv-bathroom                       50 up                 2776   2672008    0    0    1347   1101444    0    2*  0.2% 50
hv-ne-closet                      46 up                 1009   1459369    0   72*    140     10642    0    6*  1.2% 46
hv-warehouse                      10 up                  199    275298    0    0      21      1791    0    6*  0.2% 10
hv-sysadmin                       26 up                    7      1826    0    0      52      8016    0    1*  0.0% 26
WB CO AP (N)                       2 up                    0        72    0    0      15      1586    0    1*  0.0% 2
Plover AP                          2 up                    0        72    0    0      21      2040    0    1*  0.0% 2
Ayrshire 3560                   5001 critical         126082 144443611    0 12340* 126764 145451290    0    0  38.8% 5001
Ayrshire 3560                   5001 alarm            126082 144443611    0 12340* 126764 145451290    0    0  38.8% 5001
HV SAN LAN                        52 up                 4008  19037695    0    0    2670  13602467    5*   0   1.5% 52
HV SAN LAN                        57 critical           3579    951806    0    0    3059    476001  168*   0   0.1% Data
Havelock                        4104 up                 1974    520710    0    0    3846   3977671    5*   0   0.3% 4104
Havelock                        4105 up                 4011   4191727    0    0    2177    760265    5*   0   0.3% 4105
Lake City ER5                      4 up                11384   1794184    0    0   29306  40794583    0    1* 32.6% Backhauls
Bode Mikrotik                     17 down                  0         0    0    0       0         0    0    0   0.0% 17
Rolfe Fiber Drain                 17 down                  0         0    0    0       0         0    0    0   0.0% 17
Algona Edge UBNT                  13 critical          70786  96688805    0 8136*  35912   5339451    0    0  77.4%*13
algona-dist.sw                    13 warning           70824  97283410    0 2934   36596   5617310    0    0  77.8%*13
Algona EdgeSwitch                 13 warning           71464  97674857    0 8388*  36127   5376549    0    0  78.1%*13
wesley-dist.sw                     1 warning           36627   5538365    0    0   71275  97693454    0    0  78.2%*1
wesley-dist.sw                    24 up                41182  56276674    0    0   24374   3750949    0    0  45.0%*24
Wesley Netonix                     1 critical          36639   5540188    0    0   71299  97725611    0    0  78.2%*1
Wesley Netonix                     2 critical          30043  41345850    0    0   12219   1782920    0    0  91.9%*2
Rolfe-ptp-Rutland-Vertical.devic1537 alarm            120661 165121014    0    0   42209   9914728    0    1* 90.4%*Radio1
Rolfe-ptp-Rutland-horizontal.dev1537 up               125128 182404886    0    0  125131 182405047    0    0  52.1%*Radio1
Rutland-ptp-Rolfe-Vertical.devic1537 alarm             42220   9812795    0    0  121078 165639609    0    1* 90.6%*Radio1
Rutland-ptp-Rolfe-Horizontal.dev1537 up               125058 182302367    0    0  125060 182302479    0    0  52.1%*Radio1
humboldt.sw                        1 up                 5336    724385    0    0   16330  22332706    0    0  49.0%*1
humboldt.sw                        6 critical           6251   8778323    0    0    1923    194794    0    0 108.0%*6
humboldt.sw                        7 critical           6364   8434809    0    0    2305    327934    0    0 103.8%*7
humboldt.sw                        8 up                 3614   4977358    0    0    1057    195079    0    0  61.3%*8
palmer-dist.sw                     1 up                87103  15604754    0    0  264287 358589106    0    0 382.5%*1
palmer-dist.sw                     3 up               121009 166254106    0    0   41422   7638929    0    0 266.0%*3
manson-ptp-rockwellcity.devices.1537 up                72638  99684674    0    0   23251   3783444    0    0  54.6%*1537
RC backhaul slave               1537 up                22981   3838043    0    0   70951  97166726    0    0  53.2%*1537
Laurens Mikrotik                   2 critical          61429  82996640    0    0   15524   3334722    0    0  88.5%*PTP Marathon
alberticity-client.sw              6 up                 3587   4696677    0    0     867    168849    0    0  57.8%*6
alberticity-client.sw              7 up                 3545   4890261    0    0     945    142591    0    0  60.2%*7
aurelia-client.sw                  1 up                 3213    878911    0    0    9904  13572076    0    0  44.3%*1
alta-client.sw                     3 up                 3953   5570672    0    0    1361    132735    0    0  68.6%*3
wesley-client.sw                   1 critical          23096   3482620    0    0   39938  54167677    0    0 118.7%*1
wesley-client.sw                   1 critical          23096   3482620    0    0   39938  54167677    0    0 118.7%*1
Rutland Router                    12 up                41141  55990807    0    0   13819   4522870    0    0  44.8%*12
Mallard NE                         4 up                 1798    315475    0    0    5933   8163096    0    0  65.3%*4
mallard-client.sw                  4 up                 5928   8179043    0    0    1809    322984    0    0  65.4%*4
manson-client.sw                   1 up                18623   4211900    0    0   51736  71363753    0    3* 57.1%*1
fonda-client.sw                    1 up                10140   1804760    0    0   34112  46720350    0    3 102.4%*Uplink to ER
fonda-client.sw                    4 up                 3942   5436505    0    0    1231    140885    0    0  66.9%*5ghz NE
varina-client.sw                   1 up                 1064    217342    0    0    2665   3713318    0    0  48.4%*1
livermore-client.sw                1 warning            9540   1520352    0    0   26127  35992950    0    0  78.9%*1
livermore-client.sw                5 up                 3769   5158757    0    0    1700    169055    0    0  42.6%*5
Manson Mikrotik                   15 critical          72242  99076069    0    0   23298   3741597    0    0  79.3%*PTP Rockwell City
Manson Mikrotik                   16 warning           41016   7299340    0    0  123462 169680176    0    0  48.5%*PTP Palmer
Manson CRS317                     12 up                53004  73329046    0    0   19432   4204290    0    0  58.7%*12
Manson CRS317                     12 up                53004  73329046    0    0   19432   4204290    0    0  58.7%*12
Pomeroy Mikrotik                  16 alarm             51392   9326824    0    0  157403 211699391    0    0  56.5%*PTP Palmer
newell.rtr                        12 up                39883  52677449    0    0   13386   3337045    0    0  42.1%*12
Wesley Router                      3 up                23246   3418047    0    0   39946  54127180    0    0  43.3%*eth0 Uplink
Wesley Router                      4 up                39990  53948447    0    0   23207   3506807    0    0  43.2%*eth1 Customers
Wesley Router                      3 up                24154   3693027    0    0   40211  55118846    0    0  44.1%*3