CON8133 - Engineered Systems Showcase Behind the Scenes of Managing the Engineered Systems Showcase Andrew Bulloch, Werner De Gruyter, Jim Viscusi Enterprise Manager Strategic Customer Programs September 29th, 2014 Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Program Agenda 1 Engineered Systems Portfolio 2 Enterprise Manager Architecture Overview 3 Setting up the Management Infrastructure 4 Modeling Business Requirements 5 Summary 6 Appendix Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Engineered Systems Portfolio Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Engineered Systems Optimized for Oracle Database Exadata Database Machine Big Data Appliance Database Appliance SuperCluster SuperCluster Big Memory Machine Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Database Backup Appliance How to Manage the Growing Engineered System Family? What are the challenges? • Common way to monitor hardware and software • Monitoring the components top-to-bottom (application to metal) • Proliferation of monitoring and diagnostics tools How to overcome these challenges? • EM is the central hub • EM has a modular and incrementally extensible architecture • EM delivers out of the box support for Engineered Systems Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Enterprise Manager Architecture Overview Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Total Cloud Control Administration and Maintenance Monitoring Expanded Cloud Stack Management Complete Cloud Lifecycle Management Agile, Automated Service Level Management | Optimized, Efficient Superior Enterprise-Grade Management | Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Scalable, Secure Enterprise Manager Infrastructure Overview Repository (OMR): EM Users: EMCLI Console / Reports • • Firewall Agent Connectors Management Server (OMS): • • • Agent Repository Database Management Server Heart Data storage, aggregation, rollup and purging • Brains Handles management data from Agents, and delegates administration tasks to the Agents Handles administration and real-time monitoring requests from UI Sends out notifications Agents (OMA): Internet Notifications Agent • • • • Nerve endings Receives and acts upon task requests from the OMS Gather management information Perform administration task Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Pluggable Architecture • Core framework (EM platform) provides the basic capabilities 2 • The framework can be extended with plug-ins and connectors (application updates) and new Agent software for additional monitoring and administration capabilities 3 • Operational information can be updated (runtime updates) to enhance the active configuration 4 • Administrators can also add infrastructure level pieces to the framework 1 2 2 Plug-ins Connectors Provisioning Bundles Compliance Content 3 Agent Software Monitoring Templates 3 3 VM Templates & Assemblies Diagnostic Checks 4 3 4 3 Middleware Profiles / Gold Images EDK 3 Database Profiles/ Gold Images Informational Updates 4 4 1 EM Platform Extensibility exchange: http://www.oracle.com/goto/EMExtensibility Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Engineered Systems Plug-ins ENGINEERED SYSTEM PLUG-INS REQUIRED Exadata X4-2 Exadata, Database, Virtualization, Cloud Framework, Cloud Self Service, Chargeback, Cloud Storage Management Exalytics Fusion Middleware SuperCluster T5-8 Exadata, Database , Cloud Framework, Cloud Self Service, Chargeback, Cloud Storage Management SuperCluster M6-32 Exadata, Database Exadata X4-8 Exadata, Database ZDLRA Exadata, Database, ZDLRA plug-in Virtual Compute Appliance Database, Virtualization Big Data Appliance Virtual Infrastructure, BDA Oracle Database Appliance Database, Virtualization, ODA plug-in Exalogic Fusion Middleware Default required plug-ins, required for DBaaS Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Exadata Plugin - Architecture Overview 1. EM Agent deployed on the Compute Node 2. Exadata Plug-in pushed to the Agent 3. 4. 5. Agent communicates with Storage Server and Infiniband Switch targets using ssh. Exadata Plug-in monitors the other DBM components OEM Agent collects data and uploads it to the Oracle Management Server (OMS) DATABASE SERVER 1 5 Oracle Enterprise Manager 12c Agent 2 Exadata Plug-in OMS 3 Exadata Storage Server 4 ssh Exadata Infiniband Switches and Network snmp Other DBM Devices PDU ILOM Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | KVM CISCO S/W Setting up the Management Infrastructure Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Hardware requirements (Medium Size) Repository (OMR) Management Server (OMS) Management Agent (OMA) Minimum req: 4 CPU 8 GB memory ± 250 Gb Repository Database 4 CPU 8 GB memory 16 Gb Disc Space 2 GB memory 3 Gb Disk space 16 Gb RAM, 8 vCPUs 16 Gb RAM, 8 vCPUs 16 Gb RAM, 8 vCPUs Focus on: CPU, IO Focus on: Network, Memory Focus on: Connectivity, CPU Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Software Requirements Repository (OMR) • Enterprise Edition database - Fine-grained access control - Partitioning • Version 10.2.0.5 or higher* – Recommend dedicated version 11.2.0.4 • Use physical standby only for Data Guard • Details on the new repository views can be found in the Extensibility Guide Management Server (OMS) • WebLogic Server 10.3.6 • Dedicated WLS server • Sun JDK 1.6.0_43 or higher • OUI will install WLS if not already installed Management Agent (OMA) • Agent version must be the same as the OMS or lower • JDK 1.6.0_43 or higher • Deployed from the OMS (agent push) or manual install (agent pull) • Plug-ins deployed when needed * One Agent per monitored machine *Check certification matrix in My Oracle Support Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Exadata Rapid Deployment Kits • Ideal for new customer deployments • Streamline install specific for engineered systems • focused on Exadata • Also for DBaaS (check with Kamal) • Install done according to best practices • Exakit Agent can also be used to deploy into existing EM environment • Setup and configuration of SSH keys • Auto deployment of the Exadata plugin 14628061: BASE BUG FOR UPLOADING EM AGENT KIT 12.1.0.4.0 17036016: BASE BUG FOR UPLOADING STANDALONE EM KIT 12.1.0.4.0 Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Database Appliance - Management Appliance Personality EM Solution-in-a-Box Node 1 EM OMS EM Repository ODA_BASE • Easy to deploy using Appliance Manager and EM Templates Node 2 EM OMS* EM Repository* ODA_BASE * Optional: HA Configuration only • HA or non-HA configuration • Can support other management tools in additional VMs – RMAN repository, ASR Manager, Grid Home Server, etc – Link to Tammy's Paper Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Making it Real: Discovering Engineered Systems • Plug-in has all the components bundled (Cell, PDU, Cisco Switch) Exadata Cell and the Infiniband components discovered out-of-the box • Option to discover new DB Machine or rediscover (Add DB Machine Members) Install Agent on Compute Node Launch Auto Discovery Assign Monitoring Agents Component Credentials Monitoring Properties Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Review Monitoring and Alerting - SNMP • Key component to monitoring - set up often missed • Documented in the Exadata Management Getting Started Guide • SNMP notification setup for Exadata Cells and InfiniBand Switches during discovery flow. • The SNMP string does not have to be public! • Setup requires root privileges • Port 162 needed for traffic between the hardware and the Agent • set up trap forwarding to the agent port (usually 3872) • Target failover setting forwarding to primary and backup agents Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Managing the EM Infrastructure Overview Repository Start Here! Monitor The Monitor: Setup -> Manage Cloud Control OMS Agent 421053.1 : EMDIAG Master Index White paper: Operational Considerations and Troubleshooting Oracle Enterprise Manager 12c Openworld Session: CON8225 - Under the Hood - Diagnosing and Troubleshooting Oracle Enterprise Manager Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | ASR setup and overview Customer Data Center Oracle Support Services FRU replaced by Field Engineer Oracle Field Engineer ! Comprehensive H/W Fault Coverage FRU dispatched by Support Engineer Fault occurs SR routed to Support Engineer Customer SR creation email notification to customer Fault telemetry securely ASR Manager transmitted to Oracle Product’s auto-diagnosis facility sends SNMP trap to ASR Manager ASR Service Service Request created Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | • • • • • • • • • • CPU Disk controllers Disks Flash Cards Flash modules Cards Memory System Board Power supplies Fans Oracle Platinum Services How it Works • Patented Remote Monitoring Solution with Single Gateway • Multiple levels of Encryption, Authorization, Access Controls, and Data Security • Advanced Event Filtering • Customer-accessible Monitoring Portal • Consistent Global Coverage through Platinum Service Centers of Excellence Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Modeling Business Requirements Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | How to Manage Evolving Business Requirements? What are the challenges? • Need to understand the usage of the existing infrastructure • Map evolving business requirements to resource and usage metrics • Project impact of increased utilization How to overcome these challenges? • Managing incidents and problems through alerts and notifications • Bring together hardware and software into a single operational view • Define metrics relevant to business operations Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Incident Management • Incoming: Alerts/thresholds • Outgoing: Notifications and incident rules • Integration with helpdesk/3rd party ticketing systems Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | System and Services What is a System? • Set of physical targets all helping perform the same business function • Overall availability can be defined based on 'key' components – Critical assets that are required for the continuity of the application • Defined associations between the components – Used for the topology view – Used for RCA (Root-Cause Analysis) What is a Service? • End-user representation of the business functions, typically based on a system • Ability to define KPI's (Key Performance Indicators), SLO's and SLA's (Service Level Objective/Agreement) – Monitor from an end-used perspective – Availability – Performance & Throughput Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Applications and Dashboards What is an Application? • Defines a business flow – Typically uses a set of systems and services • Promotes the SLA's (for availability, performance and throughput) from the underlying components What is a Dashboard? • Aggregated overview of a system, service or application • Overall availability can be defined based on 'key' components – Same data used for both Administration view and Management view – Report can be made public for access outside of Enterprise Manager • Summarizes the SLA for executive management reporting • Can be scheduled, or run on-demand Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | What do we get out-of-box? • The Exadata RACK is an engineered system – Has many components (aggregated information from all the components) – Storage cells form a 'grid' (aggregate information from the individual cells) – The Grid Infrastructure (CRS + ASM) provide a service to the databases (aggregate information from all cluster/CRS nodes) – RAC databases (aggregate information from all database instances) • Use the Systems And Services Model from Enterprise Manager – Model all applications running on the rack as services, using the Exadata RACK as the system they are depending on Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Service Lists • Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Example: The Enterprise Manager Application • Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Example: Service Dashboards Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Summary Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | What have we accomplished? • Understanding plug-in architecture • How the plug-in concept allow for addition of eng sys • Installing Enterprise Manager • Options for installing, kits to make it easier, ODA personality • Easy setup and configuration for Engineered Systems • Seeing the result • Complete view of the Engineered System (Application-to-Silicon) • Management of the entire software stack (database, middleware, BI, …) • Complemented with hardware telemetry and alerts • Bringing business value • Model services and applications to turn data into information for the business Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | The Engineered System Showcase… Come see this for yourself - Outside the Moscone North Keynote Hall Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Appendix Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | EM Resources Getting additional information About Enterprise Manager • Maximum Availability Architecture http://www.oracle.com/technology/deploy/availability/htdocs/maa.htm • Oracle website http://www.oracle.com/us/products/enterprise-manager/index.html • Documentation http://www.oracle.com/pls/em121/homepage • Best Practices: – Best Practices Blog https://blogs.oracle.com/EMMAA/ – MOS note for tweaks/tuning? ?? – Operational Considerations and Troubleshooting http://www.oracle.com/technetwork/database/availability/managing-em12c-1973055.pdf – White paper Sizing guidelines http://www.oracle.com/technetwork/oem/framework-infra/em12c-sizing-1590739.pdf Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | The TLA library… ADDM ADR ASH ASM ASR AWR CLI CPU CRS DBMS EM GC HTTP IO IT JDK JVM JVMD KPI MDA Automatic Database Diagnostic Monitor Automatic Diagnostic Repository Active Session History Automatic Storage Management Automatic Service Request Automatic Workload Repository Command-line Interface Central Processing Unit Cluster Ready Services Database Management System Enterprise Manager Grid Control Hypertext Transfer Protocol Input / Output Information Technology JAVA Development Kit JAVA Virtual Machine JVM Diagnostics Key Performance Indicator Middleware Diagnostic Advisor MTM OMA OMR OMS OOB OS OUI PBS PLSQL QA RAC RMAN SLA SNMP SLO SQL UI URL WLS Monitor The Monitor Oracle Management Agent Oracle Management Repository Oracle Management Server Out-of-Band Operating System Oracle Universal Installer Platform Background Services Procedural Language SQL Quality Assurance Real Application Cluster Recovery Manager Service Level Agreement Simple Network Management Protocol Service Level Objective Structured Query Language User Interface Uniform Resource Locator WebLogic Server Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Copyright © 2014, Oracle and/or its affiliates. All rights reserved. |
* Your assessment is very important for improving the work of artificial intelligence, which forms the content of this project
advertisement