Server Hardware monitoring done right - Thomas

Server Hardware monitoring done right - Thomas
Hardware-Monitoring
bei Thomas-Krenn
Georg Schönberger, Thomas-Krenn.AG
20150707
2
Nach diesem Vortrag
überwachen Sie sicherer
und umfangreicher
3
CAMera
4
CATinspection
5
Icinga und NETWAYS
6
Agenda
_ Plugins bei Thomas-Krenn
_
IPMI
_
SMART
_
RAID
_ VMWare
_ TKmon
_ Fragen und Antworten
7
Plugins bei Thomas-Krenn
_ Open Source
_ http://git.thomas-krenn.com/
8
9
IPMI Sensor Monitoring
10
11
12
Intelligent Platform Management
Interface
13
Funktionen




Monitoring
(Temp., Lüfter, ...)
Recovery Control
(on/off/reset)
Logging
(System Event Log)
Inventory
(FRU information)
14
Aufbau
LAN
Connector
Zugriff mit
Benutzername
Serial
Connector
& Passwort
Remote Mmgt. Card
(KVM over IP, ...)
Auxillary
IPMB Connector
PCI mgmt. bus
Network
(LAN)
Controller
LAN
interface
Serial
Port
Sharing
Serial/Modem
interface
BMC
Serial
Controller
Chassis
mgmt.
(Satellite
Controller)
NVS Storage
SDR
SEL
FRU
FRU
Sensors & Controls
Fan sensor
Temp. sensor
Power control
Reset control
…
private mgmt. busses
FRU
M/B
Serial
Controller
ICMB
bridge
IPMB
Baseboard
Management
Controller
(BMC)
Zugriff lokal mit
root Rechten
ICMB
System
interface
FRU
Temp. s.
Memory
board
Temp.
sensor
…
Chassis board
FRU
Redundant Power
board
Processor
board
System bus
Motherboard
15
IPMI Sensor Klassen
Discrete (True/False)
Threshold (Schwellwerte)
Mehrere Zustände möglich:
● bis zu 15 Status möglich
● jeder Status = 1 Bit
● mehrere aktive Statusbits möglich
Zustand abhängig von:
● Vergleich analoger Messwert mit
den Schwellwerten (Thresholds)
Liefert:
● allgemeine Zustände
● Sensor-spezifische Zustände
Liefert:
● analogen Messwert
● diskreten Status
Ähnliche Klasse OEM
● Bedeutung der Zustände werden
vom OEM definiert
16
IPMI Sensor Klassen
Discrete
[root@test ~]# ipmitool sdr get "PS2 Status"
Sensor ID : PS2 Status (0x71)
Entity ID : 10.2 (Power Supply)
Sensor Type (Discrete): Power Supply
States Asserted : Power Supply
[Presence detected]
[Power Supply AC lost]
Assertion Events : Power Supply
[Presence detected]
[Power Supply AC lost]
Assertions Enabled : Power Supply
[Presence detected]
[Failure detected]
[Predictive failure]
[Power Supply AC lost]
[...]
Deassertions Enabled : Power Supply
[...]
Threshold
[root@test ~]# ipmitool sdr get "Fan 1"
Sensor ID : Fan 1 (0x50)
Entity ID : 29.1 (Fan Device)
Sensor Type (Analog) : Fan
Sensor Reading : 5719 (+/­ 0) RPM
Status : ok
Nominal Reading : 6708.000
Normal Minimum : 2451.000
Normal Maximum : 10965.000
Lower critical : 1720.000
Lower non­critical : 1978.000
Positive Hysteresis : 86.000
Negative Hysteresis : 86.000
Minimum sensor range : Unspecified
Maximum sensor range : Unspecified
Event Message Control : Per­threshold
Readable Thresholds : lcr lnc Settable Thresholds : lcr lnc Threshold Read Mask : lcr lnc Assertion Events : Assertions Enabled : lnc­ lcr­ Deassertions Enabled : lnc­ lcr­ 17
IPMI Sensoren
OK
$ sudo ipmi­sensors ­­output­sensor­state ­­interpret­oem­data
Password: ID | Name | Type | State | Reading | Units | Event
4 | System Temp | Temperature | Nominal | 27.00 | C | 'OK'
71 | Peripheral Temp | Temperature | Nominal | 35.00 | C | 'OK'
138 | CPU Temp | OEM Reserved | Nominal | N/A | N/A | 'Low'
205 | FAN 1 | Fan | Nominal | 1800.00 | RPM | 'OK'
…
942 | VBAT | Voltage | Nominal | 3.15 | V | 'OK'
1009 | VSB | Voltage | Nominal | 3.34 | V | 'OK'
1076 | AVCC | Voltage | Nominal | 3.38 | V | 'OK'
1143 | Chassis Intru | Physical Security | Critical | N/A | N/A | 'Gen...'
Critical
18
Plugin konfigurieren
19
ipmi­sensor
IPMI LAN Channel
check_ipmi_sensor
ipmi­sensor
IPMI LAN Channel
check_ipmi_sensor
ipmi­sensor
NRPE
NRPE
ipmi­sensor
check_ipmi_sensor
20
IPMI Plugin Konfiguration
_ IPMI Sensor Monitoring Plugin
_ Packages - Vorraussetzungen
_
freeipmi-tools, libipc-run-perl
_
check_ipmi_sensor
_
Per git oder per Package
_
Thomas Krenn Ubuntu Repository
_
Section optional, nagios-plugins-thomas-krenn
21
IPMI Plugin Konfiguration
_ Blueprint
_
Icinga Server (LAN Channel)
_
apt-get install freeipmi-tools libipc-run-perl
_
git clone http://git.thomas-krenn.com/check_ipmi_sensor_v3.git
_
vi /etc/nagios-plugins/config/check_ipmi.cfg
_
vi /etc/icinga/objects/ipmi_host.cfg
_
/etc/init.d/icinga reload
22
check_ipmi_sensor
$ ./check_ipmi_sensor ­H 192.168.255.5 ­f ipmi.cfg ­vv
IPMI Status: OK | 'System Temp'=27.00 'Peripheral Temp'=35.00 'FAN 1'=1800.00 'Vcore'=0.98 '3.3VCC'=3.36 '12V'=11.93 'VDIMM'=1.53 '5VCC'=5.09 '­12V'=­12.09 'VBAT'=3.15 'VSB'=3.34 'AVCC'=3.38
System Temp = 27.00 (Status: Nominal)
Peripheral Temp = 35.00 (Status: Nominal)
CPU Temp = 'Low' (Status: Nominal)
FAN 1 = 1800.00 (Status: Nominal)
Vcore = 0.98 (Status: Nominal)
3.3VCC = 3.36 (Status: Nominal)
12V = 11.93 (Status: Nominal)
VDIMM = 1.53 (Status: Nominal)
5VCC = 5.09 (Status: Nominal)
­12V = ­12.09 (Status: Nominal)
VBAT = 3.15 (Status: Nominal)
VSB = 3.34 (Status: Nominal)
AVCC = 3.38 (Status: Nominal)
Chassis Intru = 'OK' (Status: Nominal)
23
Stolpersteine
24
Stolpersteine
_ „Unsaubere“ Firmware Implementierungen
_
Anstatt N/A, liefert Sensor Wert 0
_
Keine sinnvollen Thresholds
→ Sensoren ausnehmen
# echo 'System Temp | Temperature' > sensor.exclude
# /usr/lib/nagios/plugins/check_ipmi_sensor ­H 10.1.102.130 ­f ./ipmi.cfg ­xx ./sensor.exclude
_ System Event Log
_
Seit Version v3.7
_
clear oder Sensoren ausnehmen → -sx
# ipmi­sel ­h 10.1.102.130 ­­config­file ./ipmi.cfg ­­clear
25
Goodies
_ Serial Number
# /usr/lib/nagios/plugins/check_ipmi_sensor ­H 10.1.102.130 ­f ipmi.cfg ­­fru
IPMI Status: OK (9000096781) | 'System Temp'=27.00;­5.00:31.00;­7.00:32.00 'Peripheral Temp'=29.00;­5.00:80.00;­7.00:85.00[...]
_ Grenzwerte
_
Seit freeipmi 1.2.1, --output-sensor-thresholds
26
Monitor your RAM!
(it's ECC, isn't it?)
27
IPMI SEL (System Event Log)
$ ipmi­sel
ID | Date | Time | Name | State | Event
1 | Feb­03­2012 | 10:31:58 | CPU0 DIMM0 | Warning | Correctable memory error
2 | Feb­13­2012 | 22:28:58 | CPU0 DIMM0 | Warning | Correctable memory error
3 | Feb­14­2012 | 00:29:03 | CPU0 DIMM0 | Warning | Correctable memory error
4 | Feb­14­2012 | 01:29:06 | CPU0 DIMM0 | Warning | Correctable memory error
...
Unterstützung ab
check_ipmi_sensor v3.7
29
IPMI SEL (System Event Log)
$ ipmi­sel
ID | Date | Time | Name | State | Event
1 | Feb­03­2012 | 10:31:58 | CPU0 DIMM0 | Warning | Correctable memory error
2 | Feb­13­2012 | 22:28:58 | CPU0 DIMM0 | Warning | Correctable memory error
3 | Feb­14­2012 | 00:29:03 | CPU0 DIMM0 | Warning | Correctable memory error
4 | Feb­14­2012 | 01:29:06 | CPU0 DIMM0 | Warning | Correctable memory error
...
OS unabhängig
30
Sicherheit – Monitoring User
S. a. IPMI Sicherheit – Best Practices
31
ADMIN
ADMIN
34
Be smart,
use SMART ;-)
35
SelfMonitoring,
Analysis &
Reporting
Technology
36
Stolpersteine
_ „Unsaubere“ Firmware Implementierungen
_
Anstatt N/A, liefert Sensor Wert 0
_
Keine sinnvollen Thresholds
→ Sensoren ausnehmen
# echo 'System Temp | Temperature' > sensor.exclude
# /usr/lib/nagios/plugins/check_ipmi_sensor ­H 10.1.102.130 ­f ./ipmi.cfg ­xx ./sensor.exclude
_ System Event Log
_
Seit Version v3.7
_
clear oder Sensoren ausnehmen → -sx
# ipmi­sel ­h 10.1.102.130 ­­config­file ./ipmi.cfg ­­clear
37
Standardisiert
NICHT standardisiert
Datenformat
Kommandos
Errorlogs
Tests
Attribute
Dokumentation
vom Hersteller
erforderlich
(zum Teil nicht
öffentlich, außer
Intel/Samsung)
38
Intel DC S3700
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE RAW_VALUE
5 Reallocated_Sector_Ct 0x0032 100 100 000 Old_age 0
9 Power_On_Hours 0x0032 100 100 000 Old_age 19864
12 Power_Cycle_Count 0x0032 100 100 000 Old_age 35
170 Available_Reservd_Space 0x0033 100 100 010 Pre­fail 0
171 Program_Fail_Count 0x0032 100 100 000 Old_age 0
172 Erase_Fail_Count 0x0032 100 100 000 Old_age 0
174 Unsafe_Shutdown_Count 0x0032 100 100 000 Old_age 31
175 Power_Loss_Cap_Test 0x0033 100 100 010 Pre­fail 498613813844
183 SATA_Downshift_Count 0x0032 100 100 000 Old_age 0
184 End­to­End_Error 0x0033 100 100 090 Pre­fail 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age 0
190 Temperature_Case 0x0022 086 083 000 Old_age 14 (Min/Max 13/17)
192 Unsafe_Shutdown_Count 0x0032 100 100 000 Old_age 31
194 Temperature_Internal 0x0022 100 100 000 Old_age 14
197 Current_Pending_Sector 0x0032 100 100 000 Old_age 0
199 CRC_Error_Count 0x003e 100 100 000 Old_age 0
225 Host_Writes_32MiB 0x0032 100 100 000 Old_age 868923
226 Workld_Media_Wear_Indic 0x0032 100 100 000 Old_age 65535
227 Workld_Host_Reads_Perc 0x0032 100 100 000 Old_age 4294967295
228 Workload_Minutes 0x0032 100 100 000 Old_age 65535
232 Available_Reservd_Space 0x0033 100 100 010 Pre­fail 0
233 Media_Wearout_Indicator 0x0032 100 100 000 Old_age 0
234 Thermal_Throttle 0x0032 100 100 000 Old_age 0
241 Host_Writes_32MiB 0x0032 100 100 000 Old_age 868923
242 Host_Reads_32MiB 0x0032 100 100 000 Old_age 2829731
39
check_smart_attributes
_ Device
_ JSON Datenbank
_ smartctl
$ /usr/lib/nagios/plugins/check_smart_attributes \
> ­d /dev/sda \
> ­dbj /etc/nagios­plugins/config/check_smartdb.json
OK (sda) |sda_Media_Wearout_Indicator=098;16;6 sda_Host_Writes_32MiB=575272 sda_Host_Reads_32MiB=723527
40
# vi /etc/nagios­plugins/config/check_smartdb.json
...
"Intel DC S3700" : {
"Device" : ["Intel DC S3700 Series SSDs","INTEL SSDSC2BA100G3",
"ID#" : {
"5" : "RAW_VALUE", # Re­allocated Sector Count
...
"194" : "RAW_VALUE", # Temperature ­ Device Internal Te
...
"232" : "VALUE", # Available Reserved Space
"233" : "VALUE", # Media Wearout Indicator
"234" : "VALUE", # Thermal Throttle Status
"241" : "RAW_VALUE", # Total LBAs Written (32MiB)
"242" : "RAW_VALUE", # Total LBAs Read (32MiB)
"1024" : "VALUE" # ATA error count (custom)
},
"Threshs" : {
"5" : ["20","40"],
...
"232" : ["16:","11:"],
"233" : ["16:","6:"],
"1024" : ["0","10"]
},
"Perfs" : ["194","233","241","242"]
},
...
41
/etc/nagios­plugins/config/check_smartdb.json
...
42
/etc/nagios­plugins/config/check_smartdb.json
Git(t) sei
Dank ;-)
43
Plugin konfigurieren
44
check_smart_attributes
smartctl
NRPE command
NRPE
45
SMART Plugin Konfiguration
_ SMART Attributes Monitoring Plugin
_ Packages - Vorraussetzungen
_
smartmontools, libfile-which-perl
_
check_smart_attributes
_
Per git oder per Package
_
Thomas Krenn Ubuntu Repository
_
Section optional, nagios-plugins-thomas-krenn
46
SMART Plugin Konfiguration
_ Blueprint
_
_
Target Host
_
apt-get install smartmontools libfile-which-perl
_
git clone http://git.thomas-krenn.com/check_smart_attributes.git
_
vi /etc/nagios/nrpe.d/smart.cfg
_
vi /etc/sudoers.d/check_smart_attributes
_
/etc/init.d/nagios-nrpe-server restart
Icinga Server
_
vi /etc/nagios-plugins/config/check_smart.cfg
_
vi /etc/icinga/objects/raid_host.cfg
_
/etc/init.d/icinga reload
47
Und mit RAID Controllern?
...
[­d|­­device <path to device being checked>]
Specify the device being monitored. If multiple devices should be checked provide the '­d' option multiple times.
E.g. '­d /dev/sda ­d /dev/sdb'
For devices behind LSI RAID controllers specify 'megaraid' and then the device number, e.g. '­d megaraid6'. Use storcli to find out the corresponding device numbers.
For devices behind Adaptec RAID controllers specify '/dev/sg<X>' where <X> is the number for your device. Use e.g. sg_scan to find the device.
You must also use '­O sat' or '­O scsi' according to the device interface. This are extra options only necessary for '/dev/sg<X>' devices.
...
# /usr/lib/nagios/plugins/check_smart_attributes ­dbj /etc/nagios­
plugins/config/check_smartdb.json ­d megaraid7,/dev/sda
# /usr/lib/nagios/plugins/check_smart_attributes ­dbj /etc/nagios­
plugins/config/check_smartdb.json ­d /dev/sg2 ­d /dev/sg3 ­d /dev/sg4 ­O sat 48
Und mit RAID Controllern?
49
RAID Monitoring
50
Avago MegaRAID (LSI)
52
# storcli
Storage Command Line Tool Ver 1.15.12 Apr 23, 2015
(c)Copyright 2015, AVAGO Corporation, All Rights Reserved.
help ­ lists all the commands with their usage. E.g. storcli help
<command> help ­ gives details about a particular command. E.g. storcli add help
List of commands:
Commands Description
­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­­
add Adds/creates a new element to controller like VD,Spare..etc
delete Deletes an element like VD,Spare
show Displays information about an element
set Set a particular value to a property get Get a particular value to a property compare Compares particular value to a property
start Start background operation
stop Stop background operation
pause Pause background operation
resume Resume background operation
download Downloads file to given device
expand expands size of given drive
insert inserts new drive for missing
transform downgrades the controller
53
check_lsi_raid
$ sudo /usr/lib/nagios/plugins/check_lsi_raid ­vv
Warning (LD Warn) [c0/v0_Consist = Warning (No)]|CV_Temperature=22;70;85 ROC_Temperature=57;80;90 c0/e252/s0_Drive_Temperature=21;40;45 c0/e252/s1_Drive_Temperature=21;40;45
Used storcli commands:
­ /usr/bin/sudo /usr/sbin/storcli64 /c0 /cv show status
­ /usr/bin/sudo /usr/sbin/storcli64 adpallinfo a0
­ /usr/bin/sudo /usr/sbin/storcli64 /c0/vall show all
­ /usr/bin/sudo /usr/sbin/storcli64 /c0/vall show init
­ /usr/bin/sudo /usr/sbin/storcli64 /c0/eall/sall show all
­ /usr/bin/sudo /usr/sbin/storcli64 /c0/eall/sall show initialization
­ /usr/bin/sudo /usr/sbin/storcli64 /c0/eall/sall show rebuild
Warning sensors:
­ c0/v0_Consist (No)
54
Warum adpallinfo a0?
„storcli /c0 show all …
blocks the whole raid card
i/o for … upto ~4 seconds“
55
Warum adpallinfo a0?
„storcli /0 show all …
blocks the whole raid card
i/o for … upto ~4 seconds“
56
Adaptec by PMC
57
$ sudo arcconf | UCLI | Adaptec by PMC uniform command line interface
| UCLI | Version 1.6 (B21062)
| UCLI | (C) Adaptec by PMC 2003­2014
| UCLI | All Rights Reserved
ATAPASSWORD | setting password on a physical drive
COPYBACK | toggles controller copy back mode
CREATE | creates a logical device
CONSISTENCYCHECK | toggles the controller background consistency check mode
DELETE | deletes one or more logical devices
ERRORTUNABLE | sets error tunable profiles on the controller
EXPANDERLIST | Lists the Expanders Connected to the Controller
EXPANDERUPGRADE | updates expander firmware
FAILOVER | toggles the controller automatic failover mode
GETCONFIG | prints controller information
GETLOGS | gets controller log information
GETPERFORM | gets the parameters for a performance mode
GETSMARTSTATS | gets the SMART statistics
GETSTATUS | displays the status of running tasks
GETVERSION | prints version information for all controllers
IDENTIFY | blinks LEDS on device(s) connected to a controller
IMAGEUPDATE | update physical device firmware
KEY | installs a Feature Key onto a controller
MODIFY | performs RAID Level Migration or Online Capacity Expansion
PHYERRORLOG | displays PHY error logs for controller or device or an | expander PHY
PRESERVECACHE | changes the cache preservation settings on the controller
RESCAN | checks for new or removed drives
RESETSTATISTICSCOUNTERS | resets the controller statistics counters
ROMUPDATE | updates controller firmware
SAVESUPPORTARCHIVE | saves the support archive SETALARM | controls the controller alarm, if present
...
58
check_adaptec_raid
$ sudo /usr/lib/nagios/plugins/check_adaptec_raid --version
check_adaptec_raid: Nagios/Icinga plugin to check Adaptec Raid Controller
status
Version: 2.1
arcconf version:
| UCLI | Version 1.4 (B20859)
$ sudo /usr/lib/nagios/plugins/check_adaptec_raid -vv
Critical (ZMM Crit) [ZMM_State = Critical (Preparing)][ZMM_SCap_Status =
Warning (Preparing)]|CTR_Temperature=52;80;90 ZMM_Health=100
ZMM_Temperature=28;60;75 ZMM_Voltage_Present=4942
Used arcconf commands:
- /sbin/arcconf GETCONFIG 1 AD
- /sbin/arcconf GETCONFIG 1 AD
- /sbin/arcconf GETCONFIG 1 LD
- /sbin/arcconf GETCONFIG 1 PD
Critical sensors:
- ZMM_State (Preparing)
Warning sensors:
- ZMM_SCap_Status (Preparing)
59
check_adaptec_raid
# /usr/lib/nagios/plugins/check_adaptec_raid ­vvv | grep ­A 2 information
CTR information:
­ Adaptec ASR8405:
­ Serial No=4B3613XXXXX
­­
LD information:
­ ld0:
­ Block Size of member drives=512 Bytes
­­
PD information:
­ pd0:
­ Block Size=512 Bytes
­­
ZMM information:
­ ZMM_Charge_Level=100
­ ZMM_Health=100
60
Plugin konfigurieren
61
check_lsi_raid
storcli
NRPE command
NRPE
check_adaptec_raid
arcconf
NRPE command
NRPE
62
RAID Plugins Konfiguration
_ LSI RAID Monitoring Plugin
_ Adaptec RAID Monitoring Plugin
_ Unter Windows
_
_
Adaptec RAID Monitoring Plugin unter Windows Server 2012 ei
nrichten
LSI RAID Monitoring Plugin unter Windows Server 2012 einrich
ten
_ Vorraussetzungen
_
storcli, arcconf
_
libfile-which-perl
63
RAID Plugin Konfiguration
_ Blueprint LSI
_
_
Target Host
_
apt-get install storcli libfile-which-perl
_
git clone http://git.thomas-krenn.com/check_lsi_raid.git
_
vi /etc/nagios/nrpe.d/raid.cfg
_
vi /etc/sudoers.d/check_ipmi_sensor
_
/etc/init.d/nagios-nrpe-server restart
Icinga Server
_
vi /etc/icinga/objects/raid_host.cfg
_
/etc/init.d/icinga reload
64
VMware Monitoring
65
VMware – Health Status
66
VMware? → Plugin
check_esxi_hardware.py
check_vmware_esx.pl
Hardware
VMware allgemein
python-pywbem
VMware Perl SDK
Claudio Kuenzler et.al.
Martin Fürstenau
Infos:
67
check_esxi_hardware.py
68
check_esxi_hardware.py
#!/usr/bin/python
# ­*­ coding: UTF­8 ­*­
#
# Script for checking global health of host running VMware ESX/ESXi
#
# Licence : GNU General Public Licence (GPL) http://www.gnu.org/
# This program is free software; you can redistribute it and/or
# modify it under the terms of the GNU General Public License
# as published by the Free Software Foundation; either version 2
# of the License, or (at your option) any later version.
[...]
#
# Pre­req : pywbem
#
# Copyright (c) 2008 David Ligeret
# Copyright (c) 2009 Joshua Daniel Franklin
# Copyright (c) 2010 Branden Schneider
# Copyright (c) 2010­2015 Claudio Kuenzler
# Copyright (c) 2010 Samir Ibradzic
# Copyright (c) 2010 Aaron Rogers
# Copyright (c) 2011 Ludovic Hutin
# Copyright (c) 2011 Carsten Schoene
# Copyright (c) 2011­2012 Phil Randal
# Copyright (c) 2011 Fredrik Aslund
# Copyright (c) 2011 Bertrand Jomin
# Copyright (c) 2011 Ian Chard
# Copyright (c) 2012 Craig Hart
# Copyright (c) 2013 Carl R. Friend
# Copyright (c) 2015 Andreas Gottwald
69
VMware und RAID Controller
_ CIM Provider
_
VMware ESXi Hardware mit Nagios oder Icinga überwachen
_
Für Megaraid Controller im Health Status ersichtlich
_
Für Adaptec
_
Früher remote arcconf
_
Adaptec RAID Controller in VMware überwachen
_
Aktuell kein CIM Provider, der sich direkt in den Health Status
integrieren würde
70
TKmon
71
TKmon – Call Home
_ TKmon
_
Inkl. Hands-On Video
_ Call-Home-Service
_ Nicht TKmon spezifisch, auch „nur“ mit
Icinga/Nagios verwendbar
_
GPG verschlüsselt
_
Open Source
_ Automatische Benachrichtigung bei HardwareFehlern
72
TKmon
_ Kategorie:TKmon
73
So, was nun?
74
Relax ...
_ Alle Plugins unter git.thomas-krenn.com
_
gschoenberger@thomas-krenn.com
_ Alle Plugins erfüllen die Nagios Plugin Developer
Guidelines (-h für Hilfe)
_ Zu allen Plugins gibt es einen Wiki-Artikel
_
Verbesserungsvorschläge per Wiki-Feedback
_ Auf der Mailing Liste erreichen Sie uns!
_
Feature Requests
_
Bug Reports
75
Relax, start ...
Serverliste
erstellen
IPMI
sicher
konfigurieren
Relevante
Plugins
einrichten
76
Danke,
für die Webinar-Teilnahme
77
Was this manual useful for you? yes no
Thank you for your participation!

* Your assessment is very important for improving the work of artificial intelligence, which forms the content of this project

Download PDF

advertising