Archiwizacja danych - przykłady Hierarchical Storage Management Hierarchiczne zarządzanie...

Archiwizacja danych - przykładyArchiwizacja danych - przykłady

Hierarchical Storage Management

Hierarchiczne zarządzanie zasobami

Ograniczenia BackupuOgraniczenia Backupu

Backup nie zabezpiecza ciągłości bezpieczeństwa danychNajszybciej zużywające się nośnikiTaśmy nie są interaktywnym nośnikiem Informacja rozłożona jest na wielu nośnikach (długi dostęp)

Co to jest HSM?Co to jest HSM?

Hierarchical Storage Management

System przechowywania danych, który automatycznie migruje je pomiędzy droższymi i tańszymi mediami. Koszt jednostkowy szybkich urządzeń pamięci masowej, jak np. dysków twardych jest dużo większy od wolniejszych jak napędy MO lub napędy taśmowe. Rozwiązanie ażeby wszystkie dane znajdowały się na szybkich i drogich urządzeniach nie jest do zaakceptowania przez wiele firm. HSM przechowuje dane na wolnych urządzeniach i stamtąd kopiuje je do szybkiej pamięci dyskowej, które pracuje jako cache.

Webopaedia

Konfiguracja bez HSMKonfiguracja bez HSM

http://www.hp.com/desktops/vectra/vei/





Konfiguracja z HSMKonfiguracja z HSM






SerwerX:

C:D:

I:J:

HSM w sieciHSM w sieci






Zasada pracy HSMZasada pracy HSM

PrimaryStorage

SecondaryStorage

HDDRAID

Biblioteka:- MO- CD- DVD

Dane

Cache

Dysk Logiczny (np. X:)

Rozwiązanie HSMRozwiązanie HSM

PrimaryStorage

SecondaryStorage

Biblioteka MO

Dane

Cache

Cache

SecondaryStorage

Biblioteka CD

HDDRAID

HDDRAID

Działanie cacheDziałanie cache

70 – 700kB/s (1napęd)Do 20MB/s

Serwer Cache CD/MO

SCSI

Cache pozwala użytkownikom szybciej przesłać dane

Aktywne pliki są dostępne z wydajnością RAID

SCSIsieć





Systemy zarządzania danymi Systemy zarządzania danymi (podsumowanie)(podsumowanie)

Tworzenie zapasowych kopii bezpieczeństwa (backup) strategie:

pełna przyrostowa różnicowa

schematy rotacji: „ojciec-syn” „dziadek-ojciec-syn” „wieże Hanoi”

Przykłady systemów: HP OpenView OmniBack II Legato Networker CA ARCserveIT Veritas Software

Archiwizacja danych (archive) Składowanie hierarchiczne (HSM)

dysk - cache dyskowy - biblioteka Przykłady systemów

UniTree Central File Manager HP OmniStore Legato Networker Veritas Software

Przykładowe cechy UniTree CFMPrzykładowe cechy UniTree CFM

Opracowany w Lawrence Livermore National Lab.Modele pracy

podstawowy: jedna instancja zarządza pamięcią cache, robotem i systemem plików, zasoby alokowane na jednej/kilku maszynach

rozszerzony: wirtualny system plików - użytkownik nie posiada dostępu do plików innego użytkownika.

Rozproszony system zasobów taśmowych - zasoby lokalne i zdalnePrzykładowe zastosowania: Centra Informatyczne -

ACK Cyfronet, TASK, PCSS, WCSS

Przykład zestawu oprogramowaniaPrzykład zestawu oprogramowania

VERITAS Software

Przegląd zastosowańPrzegląd zastosowań

Veritas SolutionsBacking up Windows 2000Backup ManagementStorage Area Networking (SAN)Disaster Recovery

VERITAS SoftwareVERITAS Software

The industry’s largest independent application storage management software vendor #1 company in $5.5 Billion storage

management software market ~$48 Billion market capitalization Analysts’ projections for 1999:

Revenue: >$600M Growth: >50% Actual : $700M Growth : 80% 2000 projection: $1.2B

Global company with ~ 3,000 employees A premier strategic partner to most major vendors Customer-focused with enterprise-class, worldwide service and support

VERITAS SoftwareVERITAS Software(A company already endorsed by the Analysts)(A company already endorsed by the Analysts)

Ab

ilit

y to

Exe

cute

Completeness of Vision

ChallengersChallengers LeadersLeaders

VisionariesVisionariesNiche PlayersNiche Players

EMC

CACommVault

StorageTekBeta

SterlingSyncsort

SCH

Innovation

IBMLegato

HP

“Enterprise Backup”Gartner Group, April ‘99

WspółpracaWspółpraca

System OEMs

Strategic Software

Disk Subsystems

Tape Subsystems

Hewlett PackardHewlett PackardServing HP Customers’ Enterprise Storage NeedsServing HP Customers’ Enterprise Storage Needs

VERITAS File System included in HP-UX (jfs)

VERITAS Volume Manager to be embeddedin HP-UX 11.X Available today as standalone product

HP resells VERITAS NetBackup, Storage Migrator for UNIX, and Storage Edition for Oracle

VERITAS Cluster Server for HP available

VERITAS Foundation Suite for HP en route

MicrosoftMicrosoftProviding Enterprise Storage for Windows NTProviding Enterprise Storage for Windows NT®® Server Server

VERITAS selected for four applets expected to ship in Windows 2000 NTBackup (Backup Exec; also in NT4, NT 3.5, Win98) Remote Storage Service HSM applet VERITAS Volume Manager (Logical Disk Manager) WinInstall LE component Disaster Recovery component

VERITAS enterprise solutions for Windows NT/2000 Backup Exec, NetBackup, Replication Exec, ClusterX

Backup Exec used internally by Microsoft ITG worldwide First to deliver Windows 2000 backup Only fully certified Windows 2000 solution VERITAS VM GUI selected by Microsoft Developer of Microsoft Tape Format

VERITAS Solutions VERITAS Solutions

FSFS WEB

Solaris

Windows 2000

FSFS WEB

Linux

FSFS WEB

Linux

FSFS WEB

HP-UX• Voice/data integration• Wireless• Video-on-demand

WEBData AnalysisEnterprise

ApplicationsClient/Server

Basic Accounting

• Voice/data integration• Wireless• Video-on-demand



Basic Accounting




Basic Accounting



ApplicationsClient/ServerBasic

Accounting


ApplicationsClient/ServerBasic

Accounting• Voice/data integration• Wireless• Video-on-demand

Data Availability Index (DAI)Data Availability Index (DAI)

Investment ($)

Availa

bili

ty

DAI

On-line Admin On-line Admin ••Backup Backup ••

BLIB Backup BLIB Backup ••

Basic Systems

MirrorsMirrors ••RAID-5RAID-5 ••

File Snap ShotsFile Snap Shots ••

Data Redundancy

VCSVCS ••SANSAN ••

Cluster FSCluster FS ••Cluster VMCluster VM ••

Clustering

FS Replication FS Replication ••VM Replication VM Replication ••

Disaster Recovery

A V

A

I

L

A

B

I L

I T

Y

Messaging

e-Commerce

VERITAS TechnologiesVERITAS Technologies

Professional Services


Education

Education

Support

Support

SAN ManagementSAN Management

BackupBackupFile &

VolumeMgmt

File &VolumeMgmt

ApplicationSolutions


Clustering&

Replication

Clustering&

Replication

VERITAS Foundation TechnologiesVERITAS Foundation Technologies



Education

Education

Support

Support


BackupBackup



Clustering&

Replication

Clustering&

Replication

File &VolumeMgmt

File &VolumeMgmt

/ops/usr

Logical Storage Pool

VERITAS Volume ManagerVERITAS Volume Manager

High-performance, high-availability tool for maximizing availability of on-line storage.

On-line data movement and relayout

RAID configurations: 0, 1, 0+1, 1+0, 5

Low-impact Oracle mirror resilvering

Dynamic multipathing forperformance and availability

Simple Java interface Broad device support

VERITAS File SystemVERITAS File System

High-performance, journaling file system for UNIX environments

Fast crash recoveryEasy manageability

Online grow, shrink, move, etc.Native throughput approximates rawRobust error isolation

No calls to panic

VERITAS Backup TechnologiesVERITAS Backup Technologies



Education

Education

Support

Support


BackupBackupFile &

VolumeMgmt

File &VolumeMgmt



Clustering&

Replication

Clustering&

Replication

CentralizedCentralizedMasterMasterServerServer

DistributedDistributedMediaMedia

ServersServers

Broad Client Broad Client SupportSupport

VERITAS NetBackupVERITAS NetBackup

One solution for heterogeneous environments and all major databases Oracle, Sybase, Exchange, SQL Server, SAP, DB2 UNIX, Windows NT/9x, NetApp, VMS, NetWare,

Linux, etc. Centralized administration

Simple, low-cost management for large enterprises Record-shattering performance Scalable to terabyte-size systems, thousands of

nodes Advanced functionality Bundled, resold, or OEMed by Sun, Bull, HP, NEC,

Red Hat, sgi

Industry-leading solution for Windows 2000, Windows NT, and Novell NetWare

Used by Microsoft ITG and Novell internally OEMed or bundled by Microsoft, Dell, Compaq, Quantum/ATL, NEC Ease of use, great disaster recovery, and powerful functionality with a low

entry price Supports Microsoft MTF, COM, RSM standards Agents/clients for Exchange, Databases, Notes, UNIX (including Linux),

SAP R/3, Windows 9x, Mac Integrated open file backup, virus scanning ExecView for single-console management

VERITAS VERITAS

Backup Exec NT NetBackup for UNIX Backup Exec NetWare

NetBackup for NT

Global Data Manager Global Data Manager Enterprise Backup ManagementEnterprise Backup Management

Management of geographically dispersed backup master servers

Protection of all Storage DomainsProtection of all Storage DomainsDesktop to Data CenterDesktop to Data Center

TeleBackupTeleBackup

BLIBBLIBBlock Level Incremental BackupBlock Level Incremental Backup

File Level Backup

New Data

Block Level Backup

New Data

Breakthrough technology that redefines database backup FAST - 10-100X faster than File Level backup

HIGH CAPACITY - Protects the largest multi-terabyte databases.

EFFICIENT - Backs up changed blocks only, min. disk I/O & server overhead.

SAFE - Non-disruptive. Tested and endorsed by Oracle.

EASY - Simple as file backup, only faster. Integrated with Oracle8 recovery manager.

INEXPENSIVE - Fraction the cost of alternatives. Use any disks and less of them.

VERITAS Storage Migrator VERITAS Storage Migrator (Hierarchical Storage Management)(Hierarchical Storage Management)

Automatic migration of stale data to secondarymedia, preserving access

Cuts out-of-space incidents, management effort Cuts backup times Transparent recall upon

reference Supports Solaris, NT,

HP, SGI, Auspex Embedded in Enigma

PARS Migrator Integrated with

VERITAS backup solutions

Optical disk, tape,

or vault

VERITAS Clustering and Replication VERITAS Clustering and Replication TechnologiesTechnologies



Education

Education

Support

Support


BackupBackupFile &

VolumeMgmt

File &VolumeMgmt



Clustering&

Replication

Clustering&

Replication

Clustering for High AvailabilityClustering for High Availability

CLUSTERING

Heartbeats and application agents monitor services for problems

Service and network addresses can be restarted in place or failed over to alternate server

Users see little or no disruption to application

Network

HeartbeatLinks

Multi-Ported Shared Disk

VERITAS Cluster ServerVERITAS Cluster Server

Application service oriented failover solution

Cost-effective scalability up to 32 nodes

Manage planned and unplanned downtime

Easy to install, configure and modify Simple Java interface

SAN-ready today High availability from the industry

leader For HP-UX or Solaris

VERITAS ClusterXVERITAS ClusterX

Single-point cluster management for Windows NT environments

Versions for Microsoft Cluster Service (MSCS) Windows Load Balancing Service (WLBS)

Architected to support other clustering technologies OEMed by Data General, Dell, Unisys

VERITAS Storage ReplicatorsVERITAS Storage ReplicatorsAn automated way to

keep the changing data states of

distributed nodes continuously synchronized(NT & UNIX)

ASYNCHRONOUS

SYNCHRONOUS

Zurich

Madrid

Stockholm

London

VERITAS SAN Management VERITAS SAN Management TechnologiesTechnologies



Education

Education

Support

Support


BackupBackupFile &

VolumeMgmt

File &VolumeMgmt



Clustering&

Replication

Clustering&

Replication

VERITAS SAN ExploitationVERITAS SAN Exploitation

VERITAS shipping SAN-aware products today Further SAN exploitation en route VERITAS built and demonstrated the world’s largest SAN (NY, September 98) Partnerships with key SAN vendors

FS

FS CorporateCorporateDataData

SANLAN

Some Key VERITAS SAN PartnershipsSome Key VERITAS SAN Partnerships

VERITAS Application SolutionsVERITAS Application Solutions



Education

Education

Support

Support


BackupBackupFile &

VolumeMgmt

File &VolumeMgmt



Clustering&

Replication

Clustering&

Replication

VERITAS EditionsVERITAS Editions

Application-optimized solutions For Oracle, Sybase, SAP, and File Servers File System and Volume Manager-based performance,

availability, and simplicity of management Special application-oriented performance accelerators Exploitation of large memory sizes Block-Level Incremental Backups (Oracle)

The ultimate in low-utilization, online backups High Availability options

ColdBackups

HotBackups

Block LevelIncremental Backups

CheckpointRecovery

AsynchronousReplication

LAN Clustering

WAN Clustering

Self-Healing

SynchronousReplication

Potential Savings ($)

VAI

99.9999

99.999

99.99

99.9

99.5

99.0

98.0

95.0

A V

A

I

L

A

B

I L

I T

Y

%

The VERITAS Information The VERITAS Information Availability IndexAvailability Index

Backing up Windows NT/2000Backing up Windows NT/2000

Windows 2000 Support Automatic protection of all Windows 2000 components both local and

remote (via Agent Accelerator) Encrypted Files Sparse Files Active directory

Special handling of: Mount Points and Links Remote Storage Services data Disk Quota data

Integration with Removable Storage Manager (RSM)

Windows 2000 SupportWindows 2000 Support

Mount Points and LinksMount Points and Links Backup

Backup mount points which direct a file or directory to a local disk or directory path Allows you to backup data that is linked to local files, but stored on another device

without having to actually select the device. Remote Storage Services (RSS)

Automatic protection of RSS database when system directory is selected for backup Automatically protect RSS reparse points without generating a recall of data from

secondary media Option to back up data migrated from primary storage to secondary storage without

recalling data to primary storage Data is backed up directly to backup media Provides complete backup of your entire system for disaster recovery purposes

Disk QuotaDisk Quota Disk Quota

Tracks and controls disk usage on a per user, per volume basis Disk Quota data is automatically backed up when the root directory of the volume is selected for backup Values can be restored to limits that were set before backup

Removable Storage Manager Formerly known as NT Media Services (NTMS) Being provided by HighGround Systems Allows different applications to share devices supported by RMS

Enhanced ADAMM User can use ADAMM to manage devices and media without having to use RSM User can have ADAMM work in conjunction with RSM to share devices and media with other applications

MS Cluster SupportMS Cluster Support Active/Passive server support

Server A is Active, Sever B is Passive Server A fails, Server B:

Automatically detects Backup Exec failure from A Automatically starts up its own Backup Exec Services Automatically restarts the job that fails Automatically takes over the rest of the jobs that A had

A B

A B

A B

A B

MS Cluster SupportMS Cluster Support Supported in 3 different

configurations

Backup Device on both servers A and B

Backup Device shared between servers A and B via dedicated SCSI bus

Backup Device shared between servers A and B via the Shared Storage Option

Backup Server ManagementBackup Server Management

• Network Storage Executive

NSE 8.0 Key FeaturesNSE 8.0 Key Features

Data-centric orientation (not backup server centric) Centralized administration of backup, restore and device operations An intuitive user interface based on the Microsoft Management Console

(MMC) Policy-based management offers a more scalable way to manage and

automate backup Backup server pooling permits load balancing across Backup Exec servers

with greater fault tolerance Microsoft SQL Server 7.0 database integration provides a central database that

stores all job, device, media and configuration information SSO and GDM integration

Policy-based Job ManagementPolicy-based Job Management

Each task defines the details of a specific job Backup method Device & media Schedule Advanced settings

Backup policies define how & when data will be backed up

Task list identifies the different types of jobs within a policy

Backup Server PoolingBackup Server Pooling Group backup servers using drive

pools

Load balancing Jobs dispatch to first available

backup server Simplifies capacity planning

Fault tolerance Offline backup server will not

prevent job execution

Target policies and jobs to drive pools

Centralized History & LoggingCentralized History & Logging Results from all jobs are

rolled up to the Master database

Job history details are available for viewing or reporting

Problem files (skipped or in use) are also stored in the database

History pruning controls depth of history and size of the database

Alerting & NotificationAlerting & Notification

Flexible variety of notification methods Email

Exchange Lotus Notes SMTP

SNMP Alpha-numeric pager Event Log

Circuit Breaker stops alert overload

Consolidated ReportingConsolidated Reporting Over 20 new reports using Crystal Reports 7.0 All data stored in an ODBC-compliant database

Create custom reports if desired Automate operations based on database states

Spot trends Predict growth Optimize

performance Manage media pools Track service levels

Offsite Media TrackingOffsite Media Tracking

Reports direct operators to move proper media

Media discovered online will be moved automatically

Restore jobs will inform the user where the media is currently located

Create multiple offsite vaults to store media

Track media location onsite and offsite

Centralized RestoreCentralized Restore

Centralized catalog repository enables fast restore from any backup server Not necessary to restore data using the original backup server Dedicate restore tasks to a specific machine

This capability is impossible without a centralized catalog repository

Catalog partializing and pruning control catalog growth

NSE BenefitsNSE Benefits

Reduce Total Cost of Ownership by consolidating the administration of backup & restore tasks

Easily scales with you as your network grows Pool storage resources for more efficient resource utilization & greater

fault tolerance Manage by exception with NSE’s rich variety of reporting and alerting

capabilities Integrate with other Windows management tools by taking advantage of

NSE’s Microsoft component-based design (MMC & SQL) Trust the leaders in NT storage management for the highest level of NT

compatibility

Storage area networkingStorage area networkingSANSAN

IssuesIssues

Backups impact business productivity Backups take too long

LAN bandwidth insufficient Data grows exponentially (50-100% per year)

Certain applications have little or no backup window and require greater availability Widely dispersed backup systems are too costly for IT to maintain and

manage effectively Each backup system requires care & feeding Difficult to automate

Traditional Approaches to BackupTraditional Approaches to Backup

Backup to locally attached tape devices High performance Does not require network bandwidth

Backup over the network Consolidated device hardware Centralized device and media management

Hard Drive

Hard Drive

Hard Drive

Server

LAN

Tape Device

Backup to Locally Attached DevicesBackup to Locally Attached DevicesEach Server has its own backup device

Data Flow Data Flow Data Flow

SCSI

Problems with this ApproachProblems with this Approach

Hardware and media required for every server on the networkCost of a library on every server is prohibitiveConsiderable manual effort required to maintain many individual

systems

LAN

Hard Drive

Hard Drive

LAN

Hard Drive

Backup Over NetworkBackup Over Network

Tape Library

Data Flow

Problems with this ApproachProblems with this Approach

Significant network bandwidth is requiredNetwork performance is seriously degradedNetwork users are severely affectedDoes not meet the needs of “7 x 24” operationsModern tape drive performance far exceeds network

performanceThe network becomes the bottleneck

The Ultimate SolutionThe Ultimate Solution

Achieve speeds of local backupDon’t utilize network bandwidthConsolidate device hardwareCentralize device and media management

The Storage Area Network (SAN)The Storage Area Network (SAN)

Replaces the conventional SCSI busConnects storage devices to a separate network on the “back

end” of the serverStorage devices may be simultaneously connected to many

servers at onceUsually implemented using Fibre Channel technologyCurrent SAN topologies use a “Fibre Channel-Arbitrated Loop”

(FC-AL)

LAN LAN

Shared Storage Option ArchitectureShared Storage Option Architecture

Data Flow

FC-to-SCSI Bridge

Fibre Channel

Hub

Tape Libraries

Storagedevices

Backup Exec Shared Storage Backup Exec Shared Storage OptionOption

Allows multiple Backup Exec servers to share backup devices directly attached across a “storage area network” or SAN Consolidates storage to fewer centralized tape devices with greater capacity backup Performance comparable to local speeds Backup traffic removed from the main network

Support for Windows NT and Novell NetWare Currently NT & NetWare servers must reside on separate loops

Disaster RecoveryDisaster Recovery

What Happens IF .......

Your Server

The Recovery ProblemThe Recovery Problem

Without automated solution one has to Collect and install system configuration files Manually re-partition and format H/D Manually re-install profiles and drivers Manually re-install Backup program Identify last Backup Tape Re-catalog the backup tape The above is all prone to Human Error

How IDR works ?How IDR works ?

Three Phases of Implementation Initial preparation of Disaster Disks

On Installation of IDR creates four disksThree are modified Windows NT setup disksThe fourth is the IDR disk that contains

• Restore Engine for Backup Exec• And server specific configuration Information

Automatic update of IDR information via regular backup IDR is integrated into Backup Exec all information about full / Incremental backup is

stored and any new server configuration changes is recorded.This ensures that current information will be available on a Recovery

Recover after a Disaster

Recovery phaseRecovery phase

First replace faulty HD or ServerBoot with IDR disks and NT CDDisk partition sizing configuration and profile information is

all restored with IDRAll applications and data is restored automatically off the

most current backup tape Can restore remote servers

Archiwizacja danych - przykłady Hierarchical Storage Management Hierarchiczne zarządzanie...

Documents

Transcript of Archiwizacja danych - przykłady Hierarchical Storage Management Hierarchiczne zarządzanie...