Active IQ Unified Manager Discussions

Upgrade DFM firmware

SATISH_PAMARTHI1983
5,550 Views

Hi,

In our environment, we're using DFM 3.7.1 which is too older.

May i know what is the latest version to upgrade the DFM.

Also, can we upgrade to the latest version or need to go step by step with other versions.

Please let me know the upgrade procedure.

Many Thanks,

Satish

1 ACCEPTED SOLUTION

adaikkap
5,550 Views

Hi Satish,

               Thanks for the details. Let me give you some overview on how you should do this upgrade.

You are currently running version 3.7.1 which is close to 5 years old.

After that we have made the following version,

  • 3.8
  • 4.0
  • 5.0
  • 5.1
  • 5.2

The current release is 5.2RC1 which is soon going to become GA. I am writing this in the assumption that you will upgrade to the latest version 5.2RC1.

The current upgrade plan would be to go like this

3.7.1 > 4.0.2D12 > 5.2RC1

Upgrade from 3.7.1 to 5.2RC1 is directly supported and seamless. But you should know and consider the following.

  1. Version 3.7.1 was running with sybase version 9.0.2.3396
  2. In version 4.0 there are 2 major changes
    • Sybase version 10.0.1.3831. Also in 4.0 there is
    • Major change in the way Performance Adviser data was written/stored

So since you are upgrading, all these PA flat files needs to be rewritten in the new format which would take considerable amount of time depending upon the amount of PA data you have.( We have seen PA flats files upgrade taking up to 26 hours when the data was close to 250GB). The rule of thumb is that its takes approximately 1 hour for each GB of PA data. Also it needs atleast 40% free space of the perf dir current size, inorder to do this upgrade with out any issue.

  1. In 5.0 there is introduction of edition of dfm called express and standard.
  2. In 5.1 there is a split of mode in the dfm called cluster-mode and 7-mode.
  3. In 5.2 there is purge of dfm database for the following type of data which may again take considerable amount of time
    1. Deletion of mark-deleted objects and its history
    2. Purge of data protection job progress events older than the value specified in dfbm options list jobpurgeolderthan value. By default the value is 90days.
    3. Purge of events older than the value specified in dfm options list eventpurgeinterval. By default the value is 180days

Also before upgrading pls find a 64bit server with supported OS by referring the IMT.

The current memory footprint is not sufficient, you would atleast need 8GB of memory and my recommendation would be 16GB.

Some of your existing monitoring intervals are too frequent than the default ones.

Pls reset them back to default. List below are the same.

ccTimestamp          8 hours     4 hours        13 Jun 08:03

cfTimestamp          1 minute    5 minutes    13 Jun 16:03 Normal 13 Jun 16:02

diskTimestamp        1.25 hours  4 hours      13 Jun 15:36 Normal 13 Jun 14:48

ifTimestamp          1 minute    15 minutes   13 Jun 16:03 Normal 13 Jun 16:02

licenseTimestamp     8 hours     4 hours      13 Jun 13:31 Normal 13 Jun 08:03

qtreeTimestamp       30 minutes  8 hours        13 Jun 15:33

userQuotaTimestamp   15 minutes  1 day        13 Jun 16:03 Normal 13 Jun 15:48

statusTimestamp      1 minute    10 minutes   13 Jun 16:03 Normal 13 Jun 16:02

sysInfoTimestamp     30 minutes  1 hour       13 Jun 15:57 Normal 13 Jun 15:33

svTimestamp          30 minutes  30 minutes     13 Jun 15:33

svMonTimestamp       8 hours     8 hours        13 Jun 08:03

xmlQtreeTimestamp    30 minutes  8 hours      13 Jun 16:03 Normal 13 Jun 15:33

vFilerTimestamp      1 minute    1 hour       13 Jun 16:03 Normal 13 Jun 16:02

Pls take a backup using the cli dfm backup create before you upgrade and keep it safe.

I would also recommend you to do a dry to know exactly how much time the entire upgrade would take before you go for the live one.

  1. Stand up a new 64bit server, install 4.0.2D12
  2. Stop all service and start only sql service
  3. Restore the backup taken from 3.7.1 using dfm backup restore cli. Time the entire upgrade process.
    • This is where the PA flat files will be rewritten in the new format
  4. Create another backup in 4.0.2D12 after completion of step 3
  5. Now Download 5.1 and upgrade on the same server, here you will make the following choices,
    1. Edition as Standard
    2. Mode as 7-Mode
  6. After completion of step 5 install the dfmpurge https://communities.netapp.com/videos/3134 tool and run it in report mode to estimate how much time the upgrade to 5.2 will take as in 5.2 upgrade the following is involved ( its recommended to reduce the value of jobspurge and events purge before upgrade to 5.2 as maximum stale data is cleaned and db is de-fragmented)
    1. Database validation, if its an upgrade,(not in case of restore as database backups are by default verified and validated. )  it takes close to 10mins for every GB of the database size.
    2. Purge of Mark-Delete objects
    3. Purge of DataProtection Job history
    4. Purge of all events older than eventpurge interval.

Based on the dry run estimated plan a downtime and upgrade as per the plan of 3.7.1 to 4.0.2D12 to 5.2RC1.

Regards

adai

View solution in original post

5 REPLIES 5

adaikkap
5,550 Views

Hi Satish,

     Whats is the current Operating system on which you are running DFM 3.7.1 ? If possible can you post the output of dfm diag from your server ?

Based on this I can give you more precise and customized upgrade procedure.

Regards

adai

SATISH_PAMARTHI1983
5,550 Views

Hi Arumugam,

Below is the output:

Management Station

Version                    3.7.1.6014 (3.7.1)

Serial Number              1-50-131024

Administrator Name         <admin>

Host Name                  <hostname>

Host IP Address            <IP Addr>

Host Full Name             <hostname fullname>

Node Limit                 250 (currently managing 22)

Operating System           Microsoft Windows 2003 Service Pack 2 (Build 3790) x86 based 

CPU Count                  2

System Memory              2047 MB (load: 71%)

Installation Directory     C:/Program Files/NetApp/DataFabric/DFM

                           9.40 GB free (15.7%)

Perf Data Directory        C:/Program Files/NetApp/DataFabric/DFM/perfdata

Data Export Directory      C:/Program Files/NetApp/DataFabric/DFM/dataExport

Database Backup Directory  d:\NetApp\DataFabric\DFM\backup

Reports Archival Directory C:\Program Files\NetApp\DataFabric\DFM\reports

Database Directory         d:/NetApp/DataFabric/DFM/data

                           21.3 GB free (70.9%)

Database Log Directory     d:/NetApp/DataFabric/DFM/data

                           21.3 GB free (70.9%)

Licensed Features          Operations Manager: installed

Installed Plugins          Storage System Config 6.5.1 (6.5.1) - storage systems and vFilers

                           Storage System Config 6.5.2 (6.5.2) - storage systems and vFilers

                           Storage System Config 6.5.3 (6.5.3) - storage systems and vFilers

                           Storage System Config 6.5.4 (6.5.4) - storage systems and vFilers

                           Storage System Config 6.5.5 (6.5.5) - storage systems and vFilers

                           Storage System Config 6.5.6 (6.5.6) - storage systems and vFilers

                           Storage System Config 6.5.7 (6.5.7) - storage systems and vFilers

                           Storage System Config 7.0 (7.0.0.1) - storage systems and vFilers

                           Storage System Config 7.0.1 (7.0.1.1) - storage systems and vFilers

                           Storage System Config 7.0.2 (7.0.2) - storage systems and vFilers

                           Storage System Config 7.0.3 (7.0.3) - storage systems and vFilers

                           Storage System Config 7.0.4 (7.0.4) - storage systems and vFilers

                           Storage System Config 7.0.5 (7.0.5) - storage systems and vFilers

                           Storage System Config 7.0.6 (7.0.6) - storage systems and vFilers

                           Storage System Config 7.1 (7.1.0.1) - storage systems and vFilers

                           Storage System Config 7.1.1 (7.1.1.1) - storage systems and vFilers

                           Storage System Config 7.1.2 (7.1.2.1) - storage systems and vFilers

                           Storage System Config 7.2 (7.2) - storage systems and vFilers

                           Storage System Config 7.2.1 (7.2.1.1) - storage systems and vFilers

                           Storage System Config 7.2.2 (7.2.2) - storage systems and vFilers

                           Storage System Config 7.2.3 (7.2.3) - storage systems and vFilers

                           Storage System Config 7.2.4 (7.2.4) - storage systems and vFilers

                           NetCache Config 5.3.1 (5.3.1R4) - NetCache appliances

                           NetCache Config 5.4 (5.4R3) - NetCache appliances

                           NetCache Config 5.5 (5.5R6) - NetCache appliances

                           NetCache Config 5.6 (5.6R1) - NetCache appliances

                           NetCache Config 5.6.1 (5.6.1) - NetCache appliances

                           NetCache Config 5.6.2 (5.6.2R1) - NetCache appliances

                           NetCache Config 6.0 (6.0) - NetCache appliances

                           NetCache Config 6.0.1 (6.0.1) - NetCache appliances

                           NetCache Config 6.0.2 (6.0.2) - NetCache appliances

                           NetCache Config 6.0.3 (6.0.3) - NetCache appliances

                           NetCache Config 6.0.4 (6.0.4) - NetCache appliances

                           NetCache Config 6.0.5 (6.0.5) - NetCache appliances

                           NetCache Config 6.1 (6.1RC2) - NetCache appliances

                           NetCache Config 6.1.1 (6.1.1RC1) - NetCache appliances

Global Status

Status Key               Last Updated Status Value

autosupport.installTime  02 Jun  2008 2008-06-02 16:06:28.170000

autosupport.lastStatusSendTime 02 Jun  2008 1370796810

autoThrottleMultiplier   03 Apr  2009 100

generationId             15 Jul  2009 663

generationId.alonso      02 Jun  2008 88

generationId.baldi       15 Jul  2009 51

generationId.frederick   15 Jul  2009 64

generationId.freya-reloaded 02 Jun  2008 104

generationId.gayatri     02 Jun  2008 21

generationId.hel         15 Jul  2009 18

generationId.janneau     02 Jun  2008 77

generationId.kahlua      02 Jun  2008 16

history.rollup.aggrHistoryMonth 13 Jun 15:36 Timeslot 13 Jun 16:00: 47 records in 0 seconds (100000 rps)

history.rollup.aggrHistoryQuarter 13 Jun 15:36 Timeslot 14 Jun 08:00: 47 records in 0 seconds (100000 rps)

history.rollup.aggrHistoryWeek 13 Jun 15:36 Timeslot 13 Jun 16:00: 47 records in 0.016 seconds (2937 rps)

history.rollup.aggrHistoryYear 13 Jun 15:36 Timeslot 16 Jun 08:00: 47 records in 0 seconds (100000 rps)

history.rollup.cpuHistoryMonth 13 Jun 15:53 Timeslot 13 Jun 16:00: 71 records in 0 seconds (100000 rps)

history.rollup.cpuHistoryQuarter 13 Jun 15:53 Timeslot 14 Jun 08:00: 71 records in 0 seconds (100000 rps)

history.rollup.cpuHistoryWeek 13 Jun 15:53 Timeslot 13 Jun 16:00: 71 records in 0 seconds (100000 rps)

history.rollup.cpuHistoryYear 13 Jun 15:53 Timeslot 16 Jun 08:00: 71 records in 0 seconds (100000 rps)

history.rollup.dfHistoryMonth 13 Jun 15:36 Timeslot 13 Jun 16:00: 434 records in 0.094 seconds (4617 rps)

history.rollup.dfHistoryQuarter 13 Jun 15:36 Timeslot 14 Jun 08:00: 434 records in 0.015 seconds (28933 rps)

history.rollup.dfHistoryWeek 13 Jun 15:36 Timeslot 13 Jun 16:00: 434 records in 0.016 seconds (27125 rps)

history.rollup.dfHistoryYear 13 Jun 15:36 Timeslot 16 Jun 08:00: 434 records in 0.016 seconds (27125 rps)

history.rollup.fcswHistoryMonth 13 Jun 15:53 Timeslot 13 Jun 16:00: 0 records in 0 seconds (100000 rps)

history.rollup.fcswHistoryQuarter 13 Jun 15:53 Timeslot 14 Jun 08:00: 0 records in 0 seconds (100000 rps)

history.rollup.fcswHistoryWeek 13 Jun 15:53 Timeslot 13 Jun 16:00: 0 records in 0 seconds (100000 rps)

history.rollup.fcswHistoryYear 13 Jun 15:53 Timeslot 16 Jun 08:00: 0 records in 0 seconds (100000 rps)

history.rollup.historyMonth 13 Jun 15:41 Timeslot 13 Jun 16:00: 316 records in 0.063 seconds (5016 rps)

history.rollup.historyQuarter 13 Jun 15:41 Timeslot 14 Jun 08:00: 316 records in 0.062 seconds (5097 rps)

history.rollup.historyWeek 13 Jun 15:41 Timeslot 13 Jun 16:00: 316 records in 0.063 seconds (5016 rps)

history.rollup.historyYear 13 Jun 15:41 Timeslot 16 Jun 08:00: 317 records in 0.062 seconds (5113 rps)

history.rollup.ifHistoryMonth 13 Jun 15:53 Timeslot 13 Jun 16:00: 189 records in 0 seconds (100000 rps)

history.rollup.ifHistoryQuarter 13 Jun 15:53 Timeslot 14 Jun 08:00: 189 records in 0 seconds (100000 rps)

history.rollup.ifHistoryWeek 13 Jun 15:53 Timeslot 13 Jun 16:00: 189 records in 0 seconds (100000 rps)

history.rollup.ifHistoryYear 13 Jun 15:53 Timeslot 16 Jun 08:00: 189 records in 0 seconds (100000 rps)

history.rollup.initiatorHistoryMonth 13 Jun 15:53 Timeslot 13 Jun 16:00: 0 records in 0 seconds (100000 rps)

history.rollup.initiatorHistoryQuarter 13 Jun 15:53 Timeslot 14 Jun 08:00: 0 records in 0 seconds (100000 rps)

history.rollup.initiatorHistoryWeek 13 Jun 15:53 Timeslot 13 Jun 16:00: 0 records in 0 seconds (100000 rps)

history.rollup.initiatorHistoryYear 13 Jun 15:53 Timeslot 16 Jun 08:00: 0 records in 0 seconds (100000 rps)

history.rollup.lunHistoryMonth 13 Jun 15:36 Timeslot 13 Jun 16:00: 25 records in 0 seconds (100000 rps)

history.rollup.lunHistoryQuarter 13 Jun 15:36 Timeslot 14 Jun 08:00: 25 records in 0 seconds (100000 rps)

history.rollup.lunHistoryWeek 13 Jun 15:36 Timeslot 13 Jun 16:00: 25 records in 0 seconds (100000 rps)

history.rollup.lunHistoryYear 13 Jun 15:36 Timeslot 16 Jun 08:00: 25 records in 0 seconds (100000 rps)

history.rollup.perfThreshViolationHistoryMonth 13 Jun 15:53 Timeslot 13 Jun 16:00: 5 records in 0 seconds (100000 rps)

history.rollup.perfThreshViolationHistoryQuarter 13 Jun 15:53 Timeslot 14 Jun 08:00: 5 records in 0 seconds (100000 rps)

history.rollup.perfThreshViolationHistoryWeek 13 Jun 15:53 Timeslot 13 Jun 16:00: 5 records in 0 seconds (100000 rps)

history.rollup.perfThreshViolationHistoryYear 13 Jun 15:53 Timeslot 16 Jun 08:00: 5 records in 0.016 seconds (312 rps)

history.rollup.qtreeHistoryMonth 13 Jun 15:36 Timeslot 13 Jun 16:00: 207 records in 0.016 seconds (12937 rps)

history.rollup.qtreeHistoryQuarter 13 Jun 15:36 Timeslot 14 Jun 08:00: 207 records in 0.015 seconds (13800 rps)

history.rollup.qtreeHistoryWeek 13 Jun 15:36 Timeslot 13 Jun 16:00: 207 records in 0.031 seconds (6677 rps)

history.rollup.qtreeHistoryYear 13 Jun 15:36 Timeslot 16 Jun 08:00: 207 records in 0.047 seconds (4404 rps)

history.rollup.quotaHistoryMonth 13 Jun 15:53 Timeslot 13 Jun 16:00: 6936 records in 0.468 seconds (14821 rps)

history.rollup.quotaHistoryQuarter 13 Jun 15:53 Timeslot 14 Jun 08:00: 6936 records in 1.78 seconds (3894 rps)

history.rollup.quotaHistoryWeek 13 Jun 15:53 Timeslot 13 Jun 16:00: 6936 records in 0.766 seconds (9055 rps)

history.rollup.quotaHistoryYear 13 Jun 15:53 Timeslot 16 Jun 08:00: 6941 records in 0.281 seconds (24701 rps)

history.rollup.snapmirrorHistoryMonth 13 Jun 15:36 Timeslot 13 Jun 16:00: 0 records in 0 seconds (100000 rps)

history.rollup.snapmirrorHistoryQuarter 13 Jun 15:36 Timeslot 14 Jun 08:00: 0 records in 0 seconds (100000 rps)

history.rollup.snapmirrorHistoryWeek 13 Jun 15:36 Timeslot 13 Jun 16:00: 0 records in 0 seconds (100000 rps)

history.rollup.snapmirrorHistoryYear 13 Jun 15:36 Timeslot 16 Jun 08:00: 0 records in 0 seconds (100000 rps)

history.rollup.vfilerHistoryMonth 13 Jun 15:53 Timeslot 13 Jun 16:00: 49 records in 0 seconds (100000 rps)

history.rollup.vfilerHistoryQuarter 13 Jun 15:53 Timeslot 14 Jun 08:00: 49 records in 0 seconds (100000 rps)

history.rollup.vfilerHistoryWeek 13 Jun 15:53 Timeslot 13 Jun 16:00: 49 records in 0 seconds (100000 rps)

history.rollup.vfilerHistoryYear 13 Jun 15:53 Timeslot 16 Jun 08:00: 49 records in 0 seconds (100000 rps)

history.rollup.volHistoryMonth 13 Jun 15:36 Timeslot 13 Jun 16:00: 162 records in 0 seconds (100000 rps)

history.rollup.volHistoryQuarter 13 Jun 15:36 Timeslot 14 Jun 08:00: 162 records in 0 seconds (100000 rps)

history.rollup.volHistoryWeek 13 Jun 15:36 Timeslot 13 Jun 16:00: 162 records in 0.015 seconds (10800 rps)

history.rollup.volHistoryYear 13 Jun 15:36 Timeslot 16 Jun 08:00: 163 records in 0 seconds (100000 rps)

history.stats.aggrHistory 13 Jun 10:47 2.67 seconds

history.stats.cpuHistory 13 Jun 06:40 0.188 seconds

history.stats.dfHistory  13 Jun 07:42 1.41 seconds

history.stats.fcswHistory 13 Jun 04:37 0 seconds

history.stats.history    12 Jun 23:30 5.13 seconds

history.stats.ifHistory  13 Jun 03:36 0.531 seconds

history.stats.initiatorHistory 13 Jun 05:39 0 seconds

history.stats.lunHistory 13 Jun 02:34 0.125 seconds

history.stats.perfThreshViolationHistory 13 Jun 09:46 0.016 seconds

history.stats.qtreeHistory 13 Jun 12:49 12.9 seconds

history.stats.quotaHistory 13 Jun 00:34 139 seconds

history.stats.snapmirrorHistory 13 Jun 01:34 0 seconds

history.stats.vfilerHistory 13 Jun 11:48 3.09 seconds

history.stats.volHistory 13 Jun 08:43 1.02 seconds

licensesMigrated         15 Jul  2009 1

monitor.dbck.checkObjFlags 13 Jun 14:14 succeeded=258 failed=0 elapsed=0s

monitor.dbck.consolidateHistory 13 Jun 15:58 succeeded=15528 failed=0 elapsed=73s

monitor.dbck.deleteDupQuotaUsers 13 Jun 15:53 succeeded=5631 failed=0 elapsed=0s

monitor.dbck.mgmtStationName 13 Jun 16:00 succeeded=1516 failed=0 elapsed=0s

monitor.dbck.preCacheGroups 13 Jun 16:00 succeeded=5638 failed=0 elapsed=0s

monitor.dbck.rebuildHistoryStatistics 13 Jun 15:54 succeeded=1517 failed=0 elapsed=0s

monitor.dbck.removeOrphans 13 Jun 15:40 succeeded=1517 failed=0 elapsed=0s

monitor.dbck.verifyDbcache 13 Jun 16:01 succeeded=1516 failed=0 elapsed=0s

monitor.discover.network 13 Jun 16:03 172.16.30.0

objectMap.verifier.current 13 Jun 16:01 51

perf.threshviolation.update 13 Jun 15:54 

postTransformLogicSuccess 15 Jul  2009 1

postupgrade.dp_policies.create_samples 02 Jun  2008 no

Global Options

Option Name              Option Value

agentHostCIFSAccount     

agentHostLogin           guest

agentHostPort            

agentHostTransport       http

agentMonInterval         00:02:00

aggrFullThreshold        90

aggrFullThresholdInterval 00:00:00

aggrNearlyFullThreshold  90

aggrNearlyOvercommittedThreshold 200

aggrOvercommittedThreshold 250

aggrSnapshotFullThreshold 90

aggrSnapshotNearlyFullThreshold 90

alertFrom                NetApp Operations Manager

apacheUserName           

auditLogEnabled          Yes

auditLogForever          No

authUsePam               no

autosupportAdminContact  <mail id>

autosupportContent       complete

autosupportDestinationEmail autosupport@netapp.com

autosupportDestinationURL support.netapp.com/asupprod/post/1.0/postAsup

autosupportEnabled       Yes

autosupportMonInterval   00:02:00

autosupportProtocol      https

autosupportRetryCount    4

autosupportRetryDelay    00:15:00

backupDirMonInterval     08:00:00

backupRetentionCount     5

cacheAdminPort           3132

cacheAdminUser           admin

cacheClearLocalConfig    no

cacheMonInterval         00:05:00

cacheSecureAdminPort     3443

cacheUseDfmHostname      no

ccMonInterval            08:00:00

cfMonInterval            00:01:00

chargebackDayOfMonth     1

chargebackIncrement      Daily

chargebackRate           

cmsAclEnable             No

cmsDir                   

cpuBusyThresholdInterval 00:15:00

cpuMonInterval           00:05:00

cpuTooBusyThreshold      80

credCacheTTL             00:20:00

currencyFormat           $ #,###.##

currentEventsCacheSize   

databaseBackupDbengWaitTime 600

databaseBackupDir        d:\NetApp\DataFabric\DFM\backup

dataExportDir            

defReportLinesPerPage    20

dfmDataExportEnabled     No

dfMonInterval            00:30:00

discoverAgents           Yes

discoverAppInitEnabled   Yes

discoverAutoSnmp         Yes

discoverCacheAdminPort   3132

discoverEnabled          Yes

discoverHosts            Yes

discoverHttpEnabled      Yes

discoverInterval         00:15:00

discoverNetworks         No

discoverSAN              Yes

discoverTimeout          00:00:10

discoverVfilers          Yes

diskMonInterval          01:15:00

dsConformanceMonInterval 01:00:00

dsDRMonInterval          00:15:00

dsProtectionMonInterval  00:15:00

envMonInterval           00:05:00

eventsPurgeInterval      00:00:00

favoriteMaxReports       25

fcMonInterval            00:05:00

filerConfigSaveLocalChanges yes

fsMonInterval            00:15:00

groupTreeShowStatus      Enabled

growthRateSensitivity    2

guiRefreshInterval       00:05:00

hbaportTooBusyThreshold  90

hostAdminTransport       http

hostEnclosureDiscoveryEvents Disabled

hostLoginProtocol        rsh

hostPingMethod           echo

hostRBACMonInterval      1:00:00:00

httpEnabled              No

httpPort                 8080

httpsEnabled             Yes

httpsPort                8443

ifMonInterval            00:01:00

ldapBaseDN               

ldapBindDN               

ldapBindPass             

ldapEnabled              No

ldapGid                  

ldapMember               uniqueMember

ldapUgid                 CN

ldapUid                  UID

ldapVersion              3

licenseExpireWarningThreshold 5

licenseMonInterval       08:00:00

localHostName            

lunMonInterval           00:30:00

maxReportLinesPerPage    1000

monMinFreeBytes          10000.0

monMinFreePercent        10.0

monSNMPRetries           4

monSNMPTimeout           10

ncfileDir                

ndmpDataUseAllInterfaces 0

ndmpMonInterval          00:30:00

networkDiscoveryLimit    15

nodesRemainingWarningThreshold 1

opsMonInterval           00:10:00

ownerEmailFieldName      ownerEmail

perfAdvisorDisabledCounterGroups noCGs

perfAdvisorEnabled       Yes

perfAdvisorMaxMonitorThreads 32

perfAdvisorPollInterval  00:05:00

perfAdvisorShowAllViews  No

perfAdvisorShowDiagCounters No

perfAdvisorTransport     httpOnly

perfAdvThreshViolationMonInterval 00:00:15:00

perfArchiveDir           C:/Program Files/NetApp/DataFabric/DFM/perfdata

perfDataExportEnabled    No

pingMonInterval          00:01:00

pingMonRetryDelay        30

pingMonTimeout           5

pluginsDir               

pmQSMBackupPreferred     Yes

profileTTL               45:00:00:00

qtreeFullThreshold       91

qtreeFullThresholdInterval 00:00:00

qtreeGrowthEventMinChangePct 1

qtreeMonInterval         00:30:00

qtreeNearlyFullThreshold 90

recentMaxReports         25

reportsArchiveDir        

respoolFullThreshold     90

respoolNearlyFullThreshold 80

respoolSpaceMonInterval  1:00:00

SANHostMonInterval       00:05:00

SANHostMonSnapshotLUNs   Yes

scriptDir                

scriptPath               

serverHTTPEnabled        No

serverHTTPPort           8088

serverHTTPSEnabled       Yes

serverHTTPSPort          8488

shareMonInterval         01:00:00

SMTPServerBackup         

SMTPServerName           <SMTP server Name>

SMTPServerPort           25

snapmirrorMonInterval    00:30:00

snapshotDiscoveryEventsEnabled No

snapshotMonInterval      00:30:00

snapvaultMonInterval     00:30:00

snmpTrapListenerEnabled  Yes

snmpTrapListenerPort     162

snmpTrapRcvdMaxPerWindow 250

snmpTrapRcvdWindowSize   00:05:00

softwareDir              

srmLargestDirs           100

srmLargestFiles          20

srmLeastRecentlyAccessedFiles 20

srmLeastRecentlyModifiedFiles 20

srmMonInterval           00:10:00

srmRecentlyModifiedFiles 20

statusMonInterval        00:01:00

sysInfoMonInterval       00:30:00

useHostsEquiv            No

userEmailDefaultDomain   

userEnableAlerts         No

userFullThreshold        90

userNearlyFullThreshold  90

userQuotaMonInterval     00:15:00

vFilerMonInterval        00:01:00

vFilerRootVolumeSizeMb   50

volFullThreshold         90

volFullThresholdInterval 00:00:00

volGrowthEventMinChangePct 1

volNearlyFullThreshold   90

volNearlyNoFirstSnapThreshold 85

volNearlyOvercommittedThreshold 200

volNoFirstSnapThreshold  90

volOvercommittedThreshold 250

volReserveDepletedThreshold 90

volReserveNearlyDepletedThreshold 90

volSnapshotCountThreshold 250

volSnapshotFullThreshold 90

volSnapshotTooOldThreshold 364:00:00:00

Object Counts

Object Type                    Count

Administrator                  27

Aggregate                      47

Disk                           668

DP Policy                      20

DP Schedule                    18

DP Throttle                    2

Host                           71

Initiator Group                13

Interface                      370

Lun Path                       25

Mgmt Station                   1

Network                        4

OSSV Hosts                     0

Primary Storage Systems        0

Qtree                          343

QuotaUser                      8758

Resource Group                 56

Role                           27

schedule                       1

Secondary Storage Systems      0

SnapMirror Rels                0

SnapVault Rels                 0

UserQuota                      6936

vFilers                        49

Volume                         173

Zapi Hosts                     23

Monitoring Timestamps

Timestamp Name       Interval     Default      Last Updated Error if older than ...

cacheTimestamp       5 minutes   5 minutes      13 Jun 15:58

ccTimestamp          8 hours     4 hours        13 Jun 08:03

cfTimestamp          1 minute    5 minutes    13 Jun 16:03 Normal 13 Jun 16:02

cpuTimestamp         5 minutes   5 minutes    13 Jun 16:03 Normal 13 Jun 15:58

dfTimestamp          30 minutes  30 minutes   13 Jun 16:03 Normal 13 Jun 15:33

diskTimestamp        1.25 hours  4 hours      13 Jun 15:36 Normal 13 Jun 14:48

envTimestamp         5 minutes   5 minutes    13 Jun 16:03 Normal 13 Jun 15:58

fcTimestamp          5 minutes   5 minutes    13 Jun 16:03 Normal 13 Jun 15:58

fsTimestamp          15 minutes  15 minutes   13 Jun 16:03 Normal 13 Jun 15:48

hostPingTimestamp    1 minute    1 minute     13 Jun 16:03 Normal 13 Jun 16:02

ifTimestamp          1 minute    15 minutes   13 Jun 16:03 Normal 13 Jun 16:02

licenseTimestamp     8 hours     4 hours      13 Jun 13:31 Normal 13 Jun 08:03

lunTimestamp         30 minutes  30 minutes   13 Jun 16:03 Normal 13 Jun 15:33

opsTimestamp         10 minutes  10 minutes   13 Jun 16:03 Normal 13 Jun 15:53

qtreeTimestamp       30 minutes  8 hours        13 Jun 15:33

rbacTimestamp        1 day       1 day        13 Jun 12:24 Normal 12 Jun 16:03

userQuotaTimestamp   15 minutes  1 day        13 Jun 16:03 Normal 13 Jun 15:48

sanhostTimestamp     5 minutes   5 minutes      13 Jun 15:58

snapmirrorTimestamp  30 minutes  30 minutes     13 Jun 15:33

snapshotTimestamp    30 minutes  30 minutes   13 Jun 16:00 Normal 13 Jun 15:33

statusTimestamp      1 minute    10 minutes   13 Jun 16:03 Normal 13 Jun 16:02

sysInfoTimestamp     30 minutes  1 hour       13 Jun 15:57 Normal 13 Jun 15:33

svTimestamp          30 minutes  30 minutes     13 Jun 15:33

svMonTimestamp       8 hours     8 hours        13 Jun 08:03

xmlQtreeTimestamp    30 minutes  8 hours      13 Jun 16:03 Normal 13 Jun 15:33

vFilerTimestamp      1 minute    1 hour       13 Jun 16:03 Normal 13 Jun 16:02

Database

monitordb.db               1.25 GB

dbFileVersion              9

ConnCount                  29 connections

MaxCacheSize               1047552 KBytes

CurrentCacheSize           1046072 KBytes

PeakCacheSize              1046072 KBytes

PageSize                   8192 Bytes

Logs

discovery      264 KB 13 Jun 16:03

DFMMonitor     210 KB 13 Jun 16:03

DFMEvent       312 KB 13 Jun 14:44

DFMServer      574 KB 13 Jun 10:29

DFMScheduler   128 KB 10 Jun 00:53

DFMWatchDog    36.2 KB 13 Jun 15:52

dfm            676 KB 13 Jun 11:05

sybase         5.67 MB 13 Jun 15:42

pingmon        111 KB 07 Jun 19:23

audit          558 KB 13 Jun 16:03

vfmon          23.6 KB 07 Jun 19:19

Services

sql        Normal Started

http       Normal Started

eventd     Normal Started

monitor    Normal Started

scheduler  Normal Started

server     Normal Started

watchdog   Normal Started

Time Since Confirmed Alive

Eventd     5 seconds

Monitor    16 seconds

Scheduler  22 seconds

Server     25 seconds

Watchdog   5 seconds

Events

Sev.      Event                      Triggered    Ack'ed by     Deleted Condition

Data Set Protection Status

Protection State           Count

Protected                  0

Unprotected                0

Event Counts

Table                      Count

Events                     485965

Current Events             59845

Abnormal Events            1474

Event Type Counts

Event Type                 Count

snapshot.discovered        208465

snapshot.deleted           105085

volume.growthrate          24303

userquota.kbytes           22590

perf:B2C_DELIVERY_VA_NFS_LATENCY_OVER_THRESHOLD 22441

aggregate.snapshot         20000

userquota.kbytes.soft.limit 12715

userquota.files.soft.limit 12715

userquota.files            12715

qtree.growthrate           10001

Version                    3.7.1.6014 (3.7.1)

adaikkap
5,551 Views

Hi Satish,

               Thanks for the details. Let me give you some overview on how you should do this upgrade.

You are currently running version 3.7.1 which is close to 5 years old.

After that we have made the following version,

  • 3.8
  • 4.0
  • 5.0
  • 5.1
  • 5.2

The current release is 5.2RC1 which is soon going to become GA. I am writing this in the assumption that you will upgrade to the latest version 5.2RC1.

The current upgrade plan would be to go like this

3.7.1 > 4.0.2D12 > 5.2RC1

Upgrade from 3.7.1 to 5.2RC1 is directly supported and seamless. But you should know and consider the following.

  1. Version 3.7.1 was running with sybase version 9.0.2.3396
  2. In version 4.0 there are 2 major changes
    • Sybase version 10.0.1.3831. Also in 4.0 there is
    • Major change in the way Performance Adviser data was written/stored

So since you are upgrading, all these PA flat files needs to be rewritten in the new format which would take considerable amount of time depending upon the amount of PA data you have.( We have seen PA flats files upgrade taking up to 26 hours when the data was close to 250GB). The rule of thumb is that its takes approximately 1 hour for each GB of PA data. Also it needs atleast 40% free space of the perf dir current size, inorder to do this upgrade with out any issue.

  1. In 5.0 there is introduction of edition of dfm called express and standard.
  2. In 5.1 there is a split of mode in the dfm called cluster-mode and 7-mode.
  3. In 5.2 there is purge of dfm database for the following type of data which may again take considerable amount of time
    1. Deletion of mark-deleted objects and its history
    2. Purge of data protection job progress events older than the value specified in dfbm options list jobpurgeolderthan value. By default the value is 90days.
    3. Purge of events older than the value specified in dfm options list eventpurgeinterval. By default the value is 180days

Also before upgrading pls find a 64bit server with supported OS by referring the IMT.

The current memory footprint is not sufficient, you would atleast need 8GB of memory and my recommendation would be 16GB.

Some of your existing monitoring intervals are too frequent than the default ones.

Pls reset them back to default. List below are the same.

ccTimestamp          8 hours     4 hours        13 Jun 08:03

cfTimestamp          1 minute    5 minutes    13 Jun 16:03 Normal 13 Jun 16:02

diskTimestamp        1.25 hours  4 hours      13 Jun 15:36 Normal 13 Jun 14:48

ifTimestamp          1 minute    15 minutes   13 Jun 16:03 Normal 13 Jun 16:02

licenseTimestamp     8 hours     4 hours      13 Jun 13:31 Normal 13 Jun 08:03

qtreeTimestamp       30 minutes  8 hours        13 Jun 15:33

userQuotaTimestamp   15 minutes  1 day        13 Jun 16:03 Normal 13 Jun 15:48

statusTimestamp      1 minute    10 minutes   13 Jun 16:03 Normal 13 Jun 16:02

sysInfoTimestamp     30 minutes  1 hour       13 Jun 15:57 Normal 13 Jun 15:33

svTimestamp          30 minutes  30 minutes     13 Jun 15:33

svMonTimestamp       8 hours     8 hours        13 Jun 08:03

xmlQtreeTimestamp    30 minutes  8 hours      13 Jun 16:03 Normal 13 Jun 15:33

vFilerTimestamp      1 minute    1 hour       13 Jun 16:03 Normal 13 Jun 16:02

Pls take a backup using the cli dfm backup create before you upgrade and keep it safe.

I would also recommend you to do a dry to know exactly how much time the entire upgrade would take before you go for the live one.

  1. Stand up a new 64bit server, install 4.0.2D12
  2. Stop all service and start only sql service
  3. Restore the backup taken from 3.7.1 using dfm backup restore cli. Time the entire upgrade process.
    • This is where the PA flat files will be rewritten in the new format
  4. Create another backup in 4.0.2D12 after completion of step 3
  5. Now Download 5.1 and upgrade on the same server, here you will make the following choices,
    1. Edition as Standard
    2. Mode as 7-Mode
  6. After completion of step 5 install the dfmpurge https://communities.netapp.com/videos/3134 tool and run it in report mode to estimate how much time the upgrade to 5.2 will take as in 5.2 upgrade the following is involved ( its recommended to reduce the value of jobspurge and events purge before upgrade to 5.2 as maximum stale data is cleaned and db is de-fragmented)
    1. Database validation, if its an upgrade,(not in case of restore as database backups are by default verified and validated. )  it takes close to 10mins for every GB of the database size.
    2. Purge of Mark-Delete objects
    3. Purge of DataProtection Job history
    4. Purge of all events older than eventpurge interval.

Based on the dry run estimated plan a downtime and upgrade as per the plan of 3.7.1 to 4.0.2D12 to 5.2RC1.

Regards

adai

SATISH_PAMARTHI1983
5,550 Views

it's a clean and perfect explanation Adai..

I don't think even the GSC could provide such a clear explanation...

Many Thanks...

Appreciated...

adaikkap
5,550 Views

Happy, that it was helpful. In a way I have actually done professional consulting for you

Regards

adai

Public