Devices and Links with Errors

        Sep 14 15:30:28 1850 nodes,  14 down, 9386 links, 2341 down, 118 critical,  15 alarm,  22 warning, 26786233 pk/s, 3477381 K by/s

Device                           Stat    SysUpTime    Avail  Loss    RTT  Probe  Address
                                       (Down Since)
Livermore-PtP-Rutland-Horizontal WARN   4+03:12:46    100.0   0.2    584  SNMP   10.24.40.43
Albert City NW, Dahlstrom        DOWN 09/05 09:42 AM   51.5   0.2    195  Ping   10.36.3.103
Kevin & Maria Arndorfer          WARN                  99.6   0.2    101  Ping   10.36.10.23
Algona 3NW, Thilges              WARN                  99.6   0.2    146  Ping   10.36.12.144
Cylinder S, Mundus               WARN                 100.0   0.1    165  Ping   10.36.28.154
Rutland 5SE, Fridolfson          DOWN 08/28 12:13 PM   10.1   0.1     21  Ping   10.36.42.12
Plover B EdgeMARC                ACK  08/26 02:08 PM    0.0 100.0      0  Ping   10.161.0.14
Nimble Controller1               ACK  08/26 02:08 PM    0.0 100.0      0  Ping   192.168.1.201
Nimble Controller2               DOWN 09/04 03:11 PM   47.5   0.1      0  Ping   192.168.1.202
Spirit Lake Tower                WARN                  99.9   0.6     80  Ping   192.168.158.25
Bill Berg- Pub                   DOWN 09/05 02:52 PM   52.6   0.2     22  Ping   206.72.40.27
Plesk Hosting                    ALRM                  99.9   0.0      0  Prob   207.32.48.1
ProCoop Laurens Oil              WARN                 100.0   0.1    151  Ping   207.32.51.194
netINS DNS server                ALRM                  99.9   0.3      8  DNS    167.142.225.5
Monitor DNS                      ALRM                 100.0   0.1      7  DNS    207.32.53.25
Hosting HTTP                     ALRM                 100.0   0.0     67  HTTP   207.32.48.1
Newell-ptp-Alta-Vertical.devices WARN  36+13:29:42    100.0   0.1    528  SNMP   10.24.0.84
Newell-ptp-Alta-Vertical.devices WARN  36+13:29:42    100.0   0.1    528  SNMP   10.24.0.84
Aurelia-ptp-Alta.devices.ncn.net CRIT  26+13:09:06    100.0   0.2    747  SNMP   10.24.0.125
Alta-PtP-Aurelia.devices.ncn.net WARN  79+02:32:19    100.0   0.2    800  SNMP   10.24.0.126
Varina to Newell                 WARN 149+01:10:07    100.0   0.1     37  Ubiq   10.24.0.181
Garner to Britt                  WARN  47+13:00:53     99.6   0.9     61  Ubiq   10.24.8.135
Garner to Britt                  WARN  47+13:00:53     99.6   0.9     61  Ubiq   10.24.8.135
Bode Netonix                     CRIT 191+09:34:28    100.0   0.5    187  SNMP   10.24.40.7
Livermore Netonix                DOWN 09/10 11:35 AM   78.1   0.2      6  SNMP   10.24.40.9
GimoreCity-PtP-Pioneer.devices.n WARN 191+09:38:45    100.0   0.0    756  SNMP   10.24.40.53
Pioneer-PtP-GilmoreCity.devices. WARN  28+20:40:12    100.0   0.1    828  SNMP   10.24.40.54
Humboldt Netonix                 CRIT 436+22:42:51    100.0   0.1    245  SNMP   10.24.40.75
Bradgate-PtP-Rolfe-11ghz.devices WARN  90+05:45:57    100.0   0.0    831  SNMP   10.24.40.103
Rolfe Master to Bradgate         WARN 149+12:02:44    100.0   0.0    780  SNMP   10.24.40.112
Livermore to LuVerne Master      WARN   4+03:14:05     99.7   0.2    599  SNMP   10.24.40.154
10.24.40.182                     WARN 191+09:35:15    100.0   0.5    865  SNMP   10.24.40.182
Lohrville Slave - Low            WARN  91+02:16:20    100.0   0.1    782  SNMP   10.24.56.21
Rockwell City Master - High      WARN  86+02:32:46    100.0   0.1    774  SNMP   10.24.56.22
lytton-ptp-fonda.devices.ncn.net WARN  27+22:29:36     99.9   0.4    555  SNMP   10.24.56.59
Fonda Edge UBNT                  DOWN 09/09 02:13 PM   73.5   0.2      6  SNMP   10.24.56.60
LinnGrove-ptp-SiouxRapidsWT-11gh WARN  32+02:07:27    100.0   0.0    505  SNMP   10.36.0.40
Laurens UPS                      WARN                 100.0   0.0    580  Trip   10.36.2.252
Britt UPS                        WARN                  99.6   1.0    579  Trip   10.36.13.252
Bill Berg-Priv                   DOWN 09/05 02:52 PM   52.6   0.3     38  SNMP   10.36.26.159
Eburg Fiber Drain                CRIT 481+12:28:43    100.0   0.2    538  SNMP   10.36.27.10
Harrison UPS                     ALRM  94+21:14:00    100.0   0.3     69  Trip   10.36.27.59
Cylinder UPS                     ALRM 236+07:14:24    100.0   0.0     66  Trip   10.36.28.252
Eburg Hospital UPS               ALRM 124+00:52:05    100.0   0.0     64  Trip   10.36.29.252
Humboldt 915                     ALRM   2+16:24:04    100.0   0.1      5  Wire   10.36.45.242
Humboldt 908.4                   ALRM   2+09:31:41    100.0   1.4      5  Wire   10.36.45.243
Humboldt 921.6                   ALRM   2+16:53:47    100.0   0.1      5  Wire   10.36.45.244
Mallard UPS                      DOWN 09/13 04:20 PM   94.9   0.3   4403  Trip   10.36.50.246
Manson 918.4                     ALRM  22+10:34:16    100.0   0.1      3  Wire   10.36.58.239
Manson 911.6                     ALRM  22+10:34:11    100.0   0.1      2  Wire   10.36.58.240
Nemaha UPS                       ALRM  18+23:16:27     99.8   0.2     65  Trip   10.36.63.252
Varina UPS                       ALRM 149+01:18:40    100.0   0.1     65  Trip   10.36.67.250
Luverne Netonix                  CRIT  31+07:31:05     99.7   0.2    244  SNMP   10.36.82.253
10.36.106.245                    ALRM  31+19:13:09    100.0   3.2     85  SNMP   10.36.106.245
SysAdmin East Wall               WARN  44+10:13:08    100.0   0.1    567  SNMP   10.42.17.42
West Bend B EdgeMARC             ALRM                 100.0  75.0      0  SNMP   10.161.0.4
Plover A EdgeMARC                ACK  08/26 02:08 PM    0.0 100.0      0  SNMP   10.161.0.13
NWBackup                         ALRM                 100.0  66.7      0  SNMP   192.168.1.3
Nimble Management                DOWN 09/04 03:10 PM   47.5   0.0      0  SNMP   192.168.1.6
Kane - Connectwise               WARN  17+23:43:30    100.0   0.0      0  SNMP   192.168.1.8
Wesley                           WARN 166+18:46:18     99.9   0.1      2  SNMP   192.168.1.13
Jack                             WARN   4+08:30:44    100.0   0.0      1  SNMP   192.168.1.19
Big Bertha                       WARN  83+05:10:10    100.0   0.0      1  SNMP   192.168.1.45
Havelock CO PDU#1                ALRM                 100.0  66.7      0  SNMP   192.168.1.190
Havelock CO PDU#2                ALRM                 100.0  66.7      0  SNMP   192.168.1.191
Mars                             ALRM 409+06:05:26    100.0   0.1      0  SNMP   192.168.1.232
Pro Coop Wallingford             ALRM                  99.4  75.0      0  SNMP   208.126.173.157
NICP                             ALRM                  99.1   0.0      0  Map    127.0.0.1
Wireless-Palmer.1                WARN                  84.4   0.0      0  Map    127.0.0.1
NW LAN                           WARN                  99.8   0.0      0  Map    127.0.0.1
Wireless-Rolfe                   ALRM                  89.3   0.0      0  Map    127.0.0.1
NICP                             ALRM                  99.1   0.0      0  Map    127.0.0.1
Pocahontas Fiber Network         ALRM                 100.0   0.0      0  Map    127.0.0.1
Core devices                     ALRM                  67.5   0.0      0  Map    127.0.0.1
SafetyNet                        ALRM                 100.0   0.0      0  Map    127.0.0.1
Wireless-UPS                     DOWN 09/13 04:20 PM   93.9   0.0      0  Map    127.0.0.1
ProCoop                          WARN                  87.6   0.0      0  Map    127.0.0.1
NW Servers                       DOWN 09/04 03:10 PM   47.3   0.0      0  Map    127.0.0.1
Wireless-Algona                  CRIT                  99.6   0.0      0  Map    127.0.0.1
Wireless-Albert City             WARN                  99.9   0.0      0  Map    127.0.0.1
Telco                            ALRM                  99.8   0.0      0  Map    127.0.0.1

Link                             Prt Stat               TPkt    TBytes TErr TDis    RPkt    RBytes RErr RDis  Util  Segment
Alta-PtP-Newell-Horizonal.device2050 up               125070 182255496    0    0  125071 176551819    0  239* 14.6% TenGigE1/2
algona-dist.sw                    16 up                29745  40256132    0 1422*   9520   1456866    0    0  32.2% 16
Algona EdgeSwitch                 13 warning           65992  90717532    0 5418*  23273   4099237    0    0  72.6%*13
Algona EdgeSwitch                 16 up                25612  34402729    0  246*   9197   1654868    0    0  27.5% 16
Algona Edge UBNT                  13 alarm             64795  89065179    0 4222*  22925   4036144    0    0  71.3%*13
rolfe-dist.sw.ncn.net             16 up                16686  23052579    0  145*   6250   1754203    0    0  18.4% 16
Rolfe-ptp-Rutland-Vertical.devic1537 warning          108555 148125718    0    0   38036   9319433    0    1* 81.1%*Radio1
Rolfe-ptp-Rutland-Vertical.devic2049 up                37996   9150429    0    0  108434 147921074    0  339* 11.8% TenGigE1/1
Rutland-ptp-Rolfe-Vertical.devic1537 alarm             37539   9066991    0    0  107148 146153398    0    1* 85.3%*Radio1
Rutland-ptp-Rolfe-Vertical.devic2049 up               107230 146295439    0    0   37599   9080434    0   35* 11.7% TenGigE1/1
Rutland-ptp-Rolfe-Vertical.devic2049 up               107230 146295439    0    0   37599   9080434    0   35* 11.7% TenGigE1/1
Rolfe-PtP-Bradgate-11ghz.devices2050 up               123643 180237283    0    0  123650 180238072    0  243* 14.4% TenGigE1/2
Bradgate-PtP-Rolfe-11ghz.devices2050 up               124291 181181948    0    0  124299 181182781    0  259* 14.5% TenGigE1/2
RC backhaul slave               2049 up                54934  75174386    0  347*  16408   3750031    0    0  60.1%*2049
Laurens-client.sw.ncn.net          5 up                 1235   1696126    0    0     366     68812    0   15*  1.4% 5
alberticity-client.sw              1 up                 9606   1561424    0    0   32706  45237556    0    3* 36.2% 1
newell-client.sw                   2 up                 3024   3980866    0    0    1355    688315    0    5*  3.2% 2
newell-client.sw                  25 up                16114   4217477    0    0   51652  69942036    0 4829* 56.0%*25
algona-mdu-weaver                  8 up                  483     56123    0    0    1213   1705779    0  722*  1.4% 8
algona-client.sw                  15 up                 2289   3070025    0    0     850    127282    0   11*  2.5% 15
irvington-client.sw                1 up                  927    220393    0    0    3660   4809478    0  791*  3.9% 1
early-client.sw                    1 up                 4054    672481    0    0   12226  16490063    0    3* 13.2% 1
Harrison Water Tower 10gig switc   5 up                 6561   8984579    0    0    1694    340810    0    2*  0.7% 5
emmetsburg-brownlee.sw            21 up                 3963    434642    0    0   11620  16509479    0    5* 13.2% 21
Brownlee-Dist.sw.ncn.net - 10gig   5 up                 1722   2114605    0    0     450     69703    0    2*  0.2% 5
Brownlee-Dist.sw.ncn.net - 10gig  16 up                12741  18096929    0    0    4393    524524    0    2* 14.5% 16
cylinder-client.sw                 6 up                 2407   3228622    0    0     748    128680    0   13*  2.6% 6
rolfe-client.sw                   18 up                 1799   2500240    0    0     260     25510    0   15* 11.9% 18
manson-client.sw                   1 up                16201   3340532    0    0   48980  66653095    0    3* 53.3%*1
manson-client.sw                   7 up                 1275   1777528    0    0     339     33704    0   60*  1.4% 7
pomeroy-client.sw                  1 up                 7379   1513359    0    0   19425  24503352    0    3* 19.6% 1
pomeroy-client.sw                  8 up                 2599   3564853    0    0     755    128866    0   19*  2.9% 8
lytton-client.sw                   2 critical          10251   1906779    0    0   27847  37401904    0 100137* 29.9% 2
lytton-client.sw                  17 up                 3460   4968942    0    0    1254    121942    0   13*  4.0% 17
pocahontas-client.sw               5 up                 4107   5456936    0    0    2061    891388    0   19*  4.4% 5
N Tower 16 Switch                  1 up                 2917    504264    0    0    8472  11480113    0    2*  0.9% 1
hv-bathroom                       50 up                 1981   1054279    0    0    1457   1143360    0    2*  0.1% 50
hv-sysadmin                       26 up                   11      2735    0    0     282     67721    0    1*  0.0% 26
WB CO AP (N)                       2 up                    0        90    0    0      17      1530    0    1*  0.0% 2
Plover AP                          2 up                    0        73    0    0      20      2042    0    1*  0.0% 2
Ayrshire 3560                   5001 up               104694 122113588    0 2482* 104757 122163522    0    0  32.6% 5001
Ayrshire 3560                   5001 up               104694 122113588    0 2482* 104757 122163522    0    0  32.6% 5001
Saturn                            78 down                  0         0    0    0       0         0    0    0   0.0% 172.23.0.0/16
Havelock                        4104 up                 1636    555135    0    0    2615   2113343    4*   0   0.2% 4104
algona-dist.sw                    13 warning           69616  95588884    0 2468   24573   4010145    0    0  76.5%*13
Algona EdgeSwitch                 13 warning           65992  90717532    0 5418*  23273   4099237    0    0  72.6%*13
Algona Edge UBNT                  13 alarm             64795  89065179    0 4222*  22925   4036144    0    0  71.3%*13
Wesley Netonix                     1 critical          24224   3972745    0    0   68720  94317665    0    0  75.5%*1
Wesley Netonix                     2 critical          27169  37191710    0    0   10543   1824310    0    0  82.7%*2
wesley-dist.sw                     1 warning           24255   3977952    0    0   68810  94441279    0    0  75.6%*1
wesley-dist.sw                    24 up                41655  57268250    0    0   13713   2154141    0    0  45.8%*24
Bode Netonix                       1 critical          10379   1866652    0    0   26469  36659956    0    0  81.5%*Rutland BH
Rolfe-ptp-Rutland-Vertical.devic1537 warning          108555 148125718    0    0   38036   9319433    0    1* 81.1%*Radio1
Rolfe-ptp-Rutland-horizontal.dev1537 up               125103 182368575    0    0  125106  85226487    0    0  52.1%*Radio1
Rutland-ptp-Rolfe-Vertical.devic1537 alarm             37539   9066991    0    0  107148 146153398    0    1* 85.3%*Radio1
Rutland-ptp-Rolfe-Horizontal.dev1537 up               125032  85177513    0    0  125034 182264283    0    0  52.1%*Radio1
humboldt.sw                        6 alarm              5538   7694968    0    0    1814    405308    0    0  94.7%*6
humboldt.sw                        7 up                 4150   5524143    0    0    1414    436930    0    0  68.0%*7
humboldt.sw                        8 up                 3150   4129593    0    0     549    165686    0    0  50.8%*8
palmer-dist.sw                     1 up                81900  17412692    0    0  248688 335900632    0    0 358.3%*1
palmer-dist.sw                     3 up               106350 144523349    0    0   33042   7034476    0    0 231.2%*3
manson-ptp-rockwellcity.devices.1537 up                56995  78138067    0    0   17973   4085307    0    0  42.8%*1537
RC backhaul slave               1537 up                16366   3733189    0    0   54910  75132758    0    0  41.1%*1537
RC backhaul slave               2049 up                54934  75174386    0  347*  16408   3750031    0    0  60.1%*2049
rockwellcity-dist.sw              13 up                17968   4089079    0    0   57337  78612194    0    0  62.9%*13
rockwellcity-dist.sw              13 up                17903   4074239    0    0   57128  78326897    0    0  62.7%*13
Laurens Mikrotik                   2 alarm             44621  61119781    0    0   16257   2939225    0    0  65.2%*PTP Marathon
alberticity-client.sw              6 alarm              5131   7190464    0    0    1691    271029    0    0  88.5%*6
Newell NW-W                        4 up                 1416    315993    0    0    3885   5168118    0    0  41.3%*4
newell-client.sw                   1 up                 3879   5132840    0    0    1398    295635    0    0  41.1%*1
newell-client.sw                  25 up                16114   4217477    0    0   51652  69942036    0 4829* 56.0%*25
aurelia-client.sw                  1 up                 4831    785820    0    0   12159  16656672    0    0  54.4%*1
wesley-client.sw                   1 critical          13725   2292253    0    0   41731  57347344    0    0 125.7%*1
wesley-client.sw                   1 critical          13725   2292253    0    0   41731  57347344    0    0 125.7%*1
manson-client.sw                   1 up                16201   3340532    0    0   48980  66653095    0    3* 53.3%*1
fonda-client.sw                    1 up                11199   2614738    0    0   34319  46188021    0    3 101.2%*Uplink to ER
fonda-client.sw                    4 up                 4501   6484696    0    0    1339    162314    0    0  79.8%*5ghz NE
lytton-client.sw                  22 critical           9095  11899351    0    0    4373   1062945    0    0  95.2%*22
livermore-client.sw                1 warning            8412   1894055    0    0   25602  34659963    0    0  76.0%*1
livermore-client.sw                5 up                 5144   6849929    0    0    2022    677511    0    0  60.2%*5
Manson Mikrotik                   15 alarm             58121  79667969    0    0   18281   4141654    0    0  63.7%*PTP Rockwell City
Manson Mikrotik                   16 warning           34687   7452948    0    0  107890 147237023    0    0  42.1%*PTP Palmer
Manson CRS317                     12 up                48231  65616270    0    0   15906   3285625    0    0  52.5%*12
Manson CRS317                     12 up                48231  65616270    0    0   15906   3285625    0    0  52.5%*12
Pomeroy Mikrotik                  16 alarm             48791  10343287    0    0  143036 192135340    0    0  51.2%*PTP Palmer
albertcity.rtr                    15 up                37770  52022779    0    0   11845   1867575    0    0  41.6%*15
Wesley Router                      3 up                13584   2342715    0    0   41255  56750914    0    0  45.4%*3
Wesley Router                      3 up                13573   2061366    0    0   41420  56914088    0    0  45.5%*eth0 Uplink
Wesley Router                      4 up                41431  56731162    0    0   13569   2115254    0    0  45.4%*eth1 Customers