DataDomain

Aus Zovis Wikili
Wechseln zu: Navigation, Suche

DataDomain

Infos

Pre-Comp = Data written before compression             
Post-Comp = Storage used after compression             
Global-Comp Factor = Pre-Comp / (Size after de-dupe)   
Local-Comp Factor = (Size after de-dupe) / Post-Comp   
Total-Comp Factor = Pre-Comp / Post-Comp               
Reduction % = ((Pre-Comp - Post-Comp) / Pre-Comp) * 100


FAQ

Wichtigster Befehl!

system show droid

Web GUI funktioniert nicht

Meldung im WebGUI:

  • Service not available*
adminaccess disable http
adminaccess disable https
.
adminaccess enable http
adminaccess enable https

noch ca 2-5min warten bis es wieder funktioniert.

System Stats auslesen

This command displays a quick look at real-time statistics for key system areas, including: CPU, NFS and CIFS protocols, network traffic, disk read and write rates and replication statistics. This is a good way to measure raw throughput on the storage system

system show stats int 2

The next command to show Data Domain Boost statistics in real time.

ddboost show stats int 2

File Transfer ab DD

Um ein File ab einer DD zu kopieren gehe wie folgt vor:

  • logge dich mit dem CLI auf der DataDomain ein
system  show serialno
priv set se
se ls -slh /ddvar/core/
SE@hddeh3## se ls -slh /ddvar/core/
total 15G
4.0K -rw-r--r--  1 root admin 3.7K May  2 03:13 ddfs-kernel-20160502-03.10.out
4.0K -rw-r--r--  1 root admin 3.5K May  4 03:38 ddfs-kernel-20160504-03.38.out
4.0K -rw-r--r--  1 root admin 3.7K May  5 03:17 ddfs-kernel-20160505-03.14.out
4.0K -rw-r--r--  1 root admin 3.5K Jul  6 03:10 ddfs-kernel-20160706-03.10.out
4.0K -rw-r--r--  1 root admin 3.5K Jul 19 00:48 ddfs-kernel-20160719-00.48.out
 15G -rw-r--r--  1 root admin  15G Jul 19 01:29 ddfs.core.4214.1468882157.gz
548K -rw-r--r--  1 root admin 541K Apr 27 03:16 ddfs.mini.10007-20160427-03.16.26.log
544K -rw-r--r--  1 root admin 540K Apr 29 03:22 ddfs.mini.22194-20160429-03.22.23.log
500K -rw-r--r--  1 root admin 495K May  4 03:39 ddfs.mini.25270-20160504-03.38.55.log
612K -rw-r--r--  1 root admin 605K Jul  6 03:10 ddfs.mini.29666-20160706-03.10.29.log
500K -rw-r--r--  1 root admin 493K Jul 19 00:49 ddfs.mini.4214-20160719-00.48.55.log
532K -rw-r--r--  1 root admin 526K May  2 03:11 ddfs.mini.5287-20160502-03.10.45.log
480K -rw-r--r--  1 root admin 475K May  5 03:15 ddfs.mini.8298-20160505-03.14.54.log
   0 -rw-r--r--  1 root admin    0 May  2 03:18 invoke_savecore.log
SE@hddeh3##
  • logge dich auf dem Targetlinuxserver ein
scp sysadmin@[DataDomain]://[PFAD/DATEI]
z.B.:
scp sysadmin@hddeh3://ddvar/core/ddfs.core.4214.1468882157.gz .
  • Falls nötig, kann nun vom Targetserver die Datei via WinSCP weg kopiert werden


fail in to a "limited session" mode

Error sieht etwa so aus

neuenschwank@hnix1a:~> ssh sysadmin@hddca2
Data Domain OS
Password:
X11 forwarding request failed on channel 0
Last login: Sat Feb 6 14:05:47 CET 2016 from 172.21.42.217 on gui

**
** NOTICE: You are logged in. However not all services are initialized.
** Some commands may fail. Re-login later for full functionality.
** Do you wish to continue with limited session functionality? (yes|no) [no]: yes


Welcome to Data Domain OS 5.7.0.4-513368
----------------------------------------
(limited session) #
(limited session) #
(limited session) #
(limited session) #
(limited session) # disk show state
**** Error retrieving information (**** Error communicating with management service.).
(limited session) #

The error communicating with management service alert is caused by the SMS service being in a hung state. It typically appears to happen randomly after DD OS upgrades. The resolution is to manually restart this service. Please could you try and run the following commands over a cli session?

#system show serialno
#priv set se
#se sms restart

(This will restart SMS)

Filesystem commands and the Management Service should now work without issue.


Hostname ändern

net set hostname

Dazu müssen nachher noch zwei Sachen geändert werden.

  • In der DDMC muss das alte Zertifikat geändert werden.
adminaccess trust show 
adminaccess trust del host hddxx1.pnet.ch 
adminaccess trust add host hddxx2.pnet.ch 
  • Die Replikationen (falls vorhanden) müssen auf den neuen Hostname geändert werden.Auf dem Source Host und auf dem Destination Host ausführen:
replication show config all
replication disable mtree://hddxx1.pnet.ch/data/col1/zf2_sql_bak 
replication modify mtree://hddxx1.pnet.ch/data/col1/zf2_er2_img_repli destination-host hddxx2.pnet.ch 
replication enable mtree://hddxx2.pnet.ch/data/col1/zf2_er2_img_repli


Compression type

DDOS currenty supports four different compression types with varying levels of compression CPU load.

type        expected-comp  CPU-load
----------  -------------  --------    
none        1x             0x
lz(default) 2x             1x
gzfast      2.5x           2x
gz          3x             5x

For example, the gz compression algorithm gives about 3x local compression but uses about 5x more CPU to run the compression part of the code than lz.

Note that the expected compression figures can vary greatly based on the data type. For some data types, gz may only be 10% better than lz while for other data types, it is 2x or more better than lz.In general, files with lots of similar strings of data tend to compression better with gz than lz. Examples of such data sets are:

  • Database files.
  • Log files.

Consequences of using gz:

Since the stronger compression algorithms use more CPU, they can have significant performance consequences:

Use the following commands to change the compression type:

# filesys disable
# filesys option set local-compression-type {none | lz | gzfast | gz}
# filesys enable

Warning: Prior to changing the local compression type, the file system must be shut down. It can then be restarted immediately after the compression option has been set. This is necessary due to Bug 66582.Once the compression type is changed, all new writes will use the new compression type and any data already written will be converted to the new compression type during cleaning. As a result, the first clean after changing the compression type may take a much longer time to run.

181558 : Identifying Data Types That Cause Poor Compression

https://support.emc.com/kb/181558

MissingDiskPath - Error: EVT-MPATH-00005

The workaround is to do disk port disable and disk port enable to reset HBA.# If the drive is reporting "hardware access error" or 'failed" state, identify the active path the drive is on. At the Data Domain system prompt type

disk multipath status

Example Output:

      Disk Multipath Status
---------------------
Port Hops   Status    Disk                 
----   ----    -------   ---------------------
2a     1      Active       2.1 - 2.3, 2.5 - 2.16
       1      Failed       2.4*********** - Status shows a "failed" path     
       3      Standby   3.1 - 3.16           
       2      Active      4.1 - 4.8            
       2      Standby   4.9 - 4.16           

3b     3      Active       2.4*********** - Too many hops to access the disk
       3      Standby    2.1 - 2.3, 2.5 - 2.16
       1      Active       3.1 - 3.16           
       2      Active       4.9 - 4.16           
       2      Standby    4.1 - 4.8            
----   ----   -------   ---------------------
  1. Disable the filesystem. Issue the command:
filesys disable
  1. Go to SE Mode.# Disable the path with the failed drive. Issue the command:
disk port disable 

In the example above, path 2a should be disabled by running the command disk port disable 2a# Force I/O to the standby path. Run the command:

enclosure test topology  duration 

In the example above, the syntax would be enclosure test topology 3b duration 1# Verify the secondary path is now active. Run the command:

disk multipath status
  1. Unfail the disk drive by running the command:
disk unfail 
  1. Enable the failed path. Run the command:
disk port enable 

In the example above, the syntax would be disk port enable 2a# Verify the failed path is now active. Run the command:

disk multipath status
  1. Return to step 4 and run the workaround on the other path if it is failed or not active# Verify the connection path alert cleared.# Exit SE Mode. Run the command:
priv set admin
  1. Re-enable the filesystem:
filesys enable

Optional workaround:
Note: This option will require a system outage.
Reboot the system. A reboot will cause the system to recognize the drive paths when the RAID array is reassembled.

Fix: This issue will be fixed in future DD OS releases.

REFERENCE:
25.11.2013 https://community.emc.com/docs/DOC-30491
Document ID:86162

---

User verknüpfen mit Mtree

ddboost storage-unit modify [MTREE] user [LOCAL_USERNAME]

ddboost storage-unit modify hk4_pz_ora_bak user nbuost

OS Upgrade

  • Release Notes lesen!
  • OS RPM downloaden und auf DD kopieren
  • Reboot vor dem upgrade (recomendet)
    system reboot
  • disk show state
  • filesys status
  • cifs show active
  • nfs show active
  • alerts show current
  • Wenn alles i.O. -> Update
    system upgrade 5.x.x.x-xxxxx.rpm
  • filesys status ... warten bis "The filesystem is enabled and running."
  • disk show state
  • alerts show current

Voila


---


Alte Files auf der DataDomain suchen

Switch to SE mode;

   system show serialno
   priv set se -> press enter
   [serialno] -> press enter
   -> shell-escape Prozedur
   find /data/col1 -type f -mtime +35 -exec ls -l {} \; > /ddr/var/older_35days.txt


Dedup Raten für Files aus Mtree holen

Switch to SE mode;

   system show serialno
   priv set se -> press enter
   [serialno] -> press enter
   mtree list -> press enter
   mtree show compression !-> press enter
   se sfs_dump /data/col1/.... --columns


Reset

#system headswap
The system responds:

This command returns the system back to its prior operational
conditions. The system will be rebooted before resuming normal
operations.
Are you sure? (yes|no|?) [no]:
yes
ok, proceeding.
Please enter sysadmin password to confirm 'system headswap':
This command may take several minutes to complete; please wait.
Restoring the system configuration . . .
Success
deployment chassis replacement..........[start]
Reassemble external shelf...............[OK]
Save external storage UUID to Head ......[OK]
Save head serial to external storage ....[OK]
Mount management volume...................[OK]
deployment chassis replacement............[done]
...

This command might take 30 minutes or longer to complete, depending on the
number of shelves and the amount of data on the shelves. The system should reboot automatically.


Berechtigungen auf CIF Shares ändern

Berechtigung für ein bestimmten User

The best way to proceed with granting access to the folder for that particular user is to do the following;

Switch to SE mode;

  • system show serialno
  • priv set se -> press enter
  • [serialno] -> press enter
  • cifs troubshooting list-users -> Will give you the user's uid and gid
  • se chown -R uid:gid /ndmplb/[subfolder] -> This will give folder ownership to the user and all subfolders within it.

Berechtigung für alle

Wen das nicht geholfen hatte, kann noch folgendes durchgeführt werden:

!!! Aber nur als letzte Möglichkeit verwenden !!!

Denn es erstellt Full Control Rights for everyone!

Switch to SE mode;

  • system show serialno
  • priv set se -> press enter
  • [serialno] -> press enter
  • se chmod -R 777 /ndmplb/[subfolder]

Beispiel für den Ordner sap-pi7dev'

se chmod -R 777 /ndmplb/sap-pi7dev


Besitzer eines Ordners wechseln

Wichtig! Der neue User darf nicht root sein und muss in der user show list vorhanden sein

Switch to SE mode;

  • system show serialno
  • priv set se -> press enter
  • [serialno] -> press enter
  • User ID(Uid) anzeigen mit user show list
  • se chown -v -R [Uid] /ndmplb/...

Beispiel:

se chown -v -R 543 /ndmplb/server/atlas01


Fixing CIFS ACLs On a DataDomain


DataDomain hintertür "schell-escape" (root shell ähnlich)

ALERT!ALERT!ALERT! Achtung ALERT!ALERT!ALERT!

*************************************************************************
****                            WARNING                              ****
*************************************************************************
****   Unlocking 'shell-escape' may compromise your data integrity   ****
****                and void your support contract.                  ****
*************************************************************************

wenn Du wirklich weisst was tu tust....dann hier der Weg dazu:

  • uname
  • fi st
  • df
  • CTRL-C drei mal
  • shell-escape

oder (DDMC)

SE@vddmc1## filesys status
SE@vddmc1## filesys show space
     CTRL-C drei mal
SE@vddmc1##
SE@vddmc1##
SE@vddmc1##
SE@vddmc1## shell-escape
*************************************************************************
****                            WARNING                              ****
*************************************************************************
****   Unlocking 'shell-escape' may compromise your data integrity   ****
****                and void your support contract.                  ****
*************************************************************************
!!!! vddmc1 YOUR DATA IS IN DANGER !!!! #

Meldung "filesys Verify Status Data verification is suspended"

Was bedeutet die Meldung "filesys Verify Status Data verification is suspended"?

-> während die autosupport eMails erzeugt werden, schaltet die DD die Datenüberprüfung (Verify) aus. Dies ist ein normaler Vorgang. Am Ende diesen Prozesses wird das Verify automatisch wieder eingeschaltet. Dieses automatische Einschalten kann man beschleunigen, wenn man den Befehl #filesys verify resume eingibt

Meldungen: Alert 80% Space

Meldungen: Alert 80% Space disablen
  • system show serialno
  • priv set se -> press enter
  • [serialno] -> press enter

Sind die "Extra Allerts" aktiv? Sollte auf "false" sein.

  • SE@hddeh1# reg show config.ems.space.extra_alerts
  • config.ems.space.extra_alerts = false

Wenn "true", mache folgendes.

reg set config.ems.space.extra_alerts = false

Falls dies nicht funktioniert, lösche den Reg Eintrag:

SE@hddeh1## reg show dynamic.ems
dynamic.ems.alert.113.EVT-SPACE-00003.2 = Space usage in Data Collection has exceeded 80% threshold. EVT-OBJ::FilesysType=2 EVT-INFO::SpaceUsage(%)=83 ACTION::0 TIMESTAMP::1396248608
dynamic.ems.email_history.EVT-FILESYS-00012 = 1390405177
dynamic.ems.email_history.EVT-UPGRADE-00003 = 1390404811
dynamic.ems.last_alert_id = 113

SE@hddeh1## reg removekey dynamic.ems.alert.113.EVT-SPACE-00003.2
Removed key "dynamic.ems.alert.113.EVT-SPACE-00003.2" from the registry.

SE@hddeh1## reg show dynamic.ems
dynamic.ems.email_history.EVT-FILESYS-00012 = 1390405177
dynamic.ems.email_history.EVT-UPGRADE-00003 = 1390404811
dynamic.ems.last_alert_id = 113


IPMI (ilo) - Remote Control

SSH Console

Die zweite Möglichkeit auf die Konsole zu kommen ist folgende:

  • Auf eine benachbarte DD "normal" via ssh einlogen.
  • dann "ipmi remote console ipmi-target user user"
sysadmin@hddmu4# ipmi remote console ipmi-target hddec4i user admin
Please enter user password:
[SOL Session operational.  Use @? for help]
sysadmin
Password:
hddec4.pnet.ch login: sysadmin
Password:
Last login: Mon Sep 22 08:19:59 CEST 2014
Welcome to Data Domain OS 5.4.0.8-404909
----------------------------------------
sysadmin@hddec4# 
  • mit " @. " schliesst man die Session wieder


SSH Power ON / OFF

sysadmin@hddmu4#
sysadmin@hddmu4# ipmi remote power off ipmi-target hddur1i user admin
Please enter user password:

The 'ipmi remote power off' command turns off the power without shutting down the system gracefully and file access will be interrupted.

        Are you sure? (yes|no|?) [no]: yes

ok, proceeding.


Remote target hddur1i has been powered OFF.

sysadmin@hddmu4#
sysadmin@hddmu4#
sysadmin@hddmu4#
sysadmin@hddmu4#
sysadmin@hddmu4# ipmi remote power on ipmi-target hddur1i user admin
Please enter user password:

Remote target hddur1i has been powered ON.
Please use serial-over-lan or serial console to view boot status.

sysadmin@hddmu4#
sysadmin@hddmu4#


Via ipmitool

ipmitool ist eine Software die auf "jedem" Linux Rechner installiert werden kann. Mit ipmi standartisierten Commands können so ziemlich alle Befehle ausgeführt werden die ein ipmi Board kennt.

- Installation (SUSE SLES11)

hnbe52:~ # zypper in ipmitool
Loading repository data...
Reading installed packages...
Resolving package dependencies...

Problem: conflicting requests
 Solution 1: do not forbid installation of ipmitool-1.8.12-0.21.1.x86_64[SLES11SP3_Youpatch]
 Solution 2: do not ask to install a solvable providing ipmitool.x86_64 = 1.8.12-0.21.1

Choose from above solutions by number or cancel [1/2/c] (c): 

dann [1] eingeben

auf ipmi adresse verbinden

ipmitool -I lanplus -H [IP oder DNSNAME] -U [USER] shell

dann müsste folgender Promt erscheinen ipmitool>

Um den Server ein- oder auszuschalten:

ipmitool> power off

oder

ipmitool> power on

Optionen anzeigen:

ipmitool> help

oder für spezifische (zB power)

ipmitool> power
chassis power Commands: status, on, off, cycle, reset, diag, soft
ipmitool>


User Keys auslesen / einfügen

  • auslesen
 adminaccess show ssh-keys
User "ddrep" :
 1 ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAupZmZ0q6TMWUZc6Al02aI4/McdmqdTNvBBIDNVuwQ5mPwP1uc//buTiyJx+6ul/56VHfrucOUd251Tj+XCuuVb5hX4zVHhLrAPNzgD2HXxA6JEJx3S0AYVyigCqCV/7adiT4X728ivx2lccdWzU2fsa6NehEyycAl60B2Mii2bO0lB
  • einfügenadminaccess add ssh-keys [user]
sysadmin@hddos1# adminaccess add ssh-keys user ddrep
Enter the key and then press Control-D, or press Control-C to cancel.

[hier den Key einfügen]

Datengrösse aus Mtree auslesen

system show serialno
priv set se
mtree list
se sfs_dump /data/col1/hddzf1_MSSQL --columns

[Output]

oder für die letzten 7 Tage

mtree show compression /data/col1/hddzf1_MSSQL


Ports

Hier die Liste der Ports die eine DD benutzen kann:

Active Directory Join für CIFS

Voraussetzung
  • Als erstes muss die DD den DomainController auf dem TCP und UDP Port 389sehen. Mit Telnet kann man schon mal den TCP Port kontrollieren.

z.B.:

SE@hddpoc##
SE@hddpoc## se telnet d00013.pnet.ch 389
Trying 138.191.82.26...
Connected to d00013.pnet.ch.
Escape character is '^]'.
Connection closed by foreign host.
SE@hddpoc##
  • Der DC muss natürlich ein DC der Domäne sein in die Du joinen willst!
  • Route muss stimmen! Dass heisst, falls die DD in einem anderen VLAN steht als der DC, brauchst Du an der DD ein VLAN dass Zugang zum DC hat oder Du lässt dir Firewall Roules einrichten. Um über ein anderes VLAN IF zu connecten musst Du auf der DD eine Route einrichten damit diese die Anfrage über das richtige IF raus geht.**

Join

DD join.PNG DD join2.PNG