Since I am getting requests from people who enjoyed my last NCIE-SAN study guide, I figured I would make a new one for the latest and greatest NCDA NS0-157. WORK IN PROGRESS
Click to continue reading “Netapp 8.3 NCDA NS0-157 Study Guide”
Archive | Certifications
RSS feed for this section
1.1.3 Gather power information such as circuit availability, wiring in place, etc…
Topologies[/caption]
Comparison (from Wikipedia)
My NS0-504 Study Notes – 4 SCALABLE SAN IMPLEMENTATION TESTING AND TROUBLESHOOTING
SCALABLE SAN IMPLEMENTATION TESTING AND TROUBLESHOOTING
Please click here to goto the main NS0-504 Study Notes blog post to see all sections and additional information
4.1 Be able to create an acceptance test plan.
4.2 Test host to storage connectivity
- Possible failures in connectivity?
- Improper zoning
- NPIV not enabled on switches
4.3 Test LUN availability during failover scenarios (multipathing).
4.4 Test controller failover scenarios (multipath HA).
My NS0-504 Study Notes – 2 SCALABLE SAN IMPLEMENTATION PLAN CREATION
Please click here to goto the main NS0-504 Study Notes blog post to see all sections and additional information
2. SCALABLE SAN IMPLEMENTATION PLAN CREATION
2.1 Verify and plan for dual power feeds for all components.
- DUAL is the key word
- Dual Feeds
- Dual PDUs
- Dual Power Supplies
- Controllers and shelves all have dual power supplies. Power should be plugged into A and B circuits. Each leg of power should be able to handle the load of the entire environment (N+N)
- Refer to Site Requirements Guide for more information, and power/temp specs.
- Verify that Controllers/Shelves were ordered with the proper plug style for your nation/voltage/outlet. (For example NEMA L5-20 vs IEC c13-c14. See common cable types here. )
2.2 Be able to create cabinet diagrams or be able to read and interpret a cabinet diagram. Diagrams should include the cabinet’s storage systems and switches with all connections shown.
- Core info
- Rack Location
- Cabinet U positions of servers
- Switch Placement
- Utilize Visio or NetApp Synergy to mock of the layout and available space.
- If they show exact ports to exact switches, keep an eye on what may be trunked, that FC isnt plugged into the wrong ports, etc.
2.3 Create a connectivity diagram. Be able to read and interpret a connectivity diagram.
- Fibre Channel
- Port names/Locations
- Initiator vs Target port setting
- FC vs UTA
- FC Switch port connectivity
- WWPN
- Port Locations
- Host name, Zone name, Aliases
- Port names/Locations
- IP
- Switch name / port
- VLANs
- Trunks / LACP
- VIF names
- See section 3 for more detailed information
2.4 Plan storage controller configuration.
- Important details
- Cluster naming, automatic node names vs manually “renamed”
- SVMs youll need, protocols they will use
- DNS Server, default domains
- Protocols needed?
- Multipathing software installed?
- Snapdrive and Host Utilities installed (FC or iSCSI)?
- Verify paths
- HBAnywhere (Emulex) or SANsurfer (Qlogic) for FC installed?
- What’s the customers RPO (Recovery Point Objective)?
- It is the maximum tolerable period in which data might be lost from an IT service due to a major incident. The RPO gives systems designers a limit to work to. (Wikipedia)
- What’s the customers RTO (Recovery Time Objective)?
- The targeted duration of time and a service level within which a business process must be restored after a disaster (or disruption) in order to avoid unacceptable consequences associated with a break in business continuity. (Wikipedia)
- Expected Space Reservations needed?
- What’s the expected rate of change? Plan for the needed space withing the volumes for this X the number of snapshots
2.7 Plan Ethernet switch configuration.
- Remember- at least 2 different types of switches
- Management
- Flat lights out management switch config. Single vlan. (See section 3 for example)
- Cluster Interconnect
- These have specific configurations based on the number of cluster nodes. (See section 3 for example)
- Data (management may be on these normal switches)
- VLANs needed? Any routing?
- iSCSI
- NFS
- Management / iLO?
- User desktops
- Servers (Web/App/DB tiers)
- MTU?
- Jumbo: 9000 MTU? (needed for FCoE)
- Normal: 1500 MTU?
- QoS?
- VLANs needed? Any routing?
- Management
2.8 Plan zoning configuration.
- Do you have 2 fabrics? 2 FC switches?
- Are these fabrics split or ISL trunked together?
- Multiple ports from each Host, to 2 or more FC switch?
- Verify 4+ paths from each host to the controllers
- Multipathing software:
- Linux- DM_MP device-mapper-multipath
- Solaris – MPxIO
- Windows – Built in MPIO (Microsoft Multipath I/O Role)
- Gather all IQNs, which iGroups will they belong to?
- Add multiple IP addresses, one for each LIF to the discovery and static bindings
- Enable MCS (Multiple Connections per Session)
- iSCSI boot from SAN needed? (May influence dynamic vs static persistence in iSCSI discovery, and also host LUN IDs used)
- Use VLANs to ISOLATE Traffic!
- CHAP or IPSEC needed?
My NS0-504 Study Notes – 1 SCALABLE SAN SOLUTION ASSESSMENT
Please click here to goto the main NS0-504 Study Notes blog post to see all sections and additional information
1. SCALABLESAN SOLUTION ASSESSMENT
1.1 Ensure that all prerequisites for the installation of NetApp system and switches (if needed) are met and that the required information to configure NetApp systems is collected.
Site Information
List the networks used for Cluster Management IP, Node Management IP, and Service Processor IP.
| 1. Networks | |||
| Subnet | Netmask | Gateway | Purpose |
| 2. DNS | |
| DNS Domain Names | |
| Name Server IP Addresses | |
Cluster Information
| 1. Licenses | ||||
| SO Number | ||||
| Serial Number | Cluster S/N | Model | Protocol Name | License Key |
| 2. Cluster | ||
| Cluster Administrator’s (username “admin”) Password | ||
| Cluster Name | Cluster Mgmt Port | Cluster Mgmt IP |
| 3. Node(s) | |||
| Location | |||
| Node Name | Node Mgmt Port | Node Mgmt IP | |
| I. Post Cluster Setup Wizard |
node rename -node OLDNAME -newname NEWNAME |
| II. Service Processor Configuration | ||||
system node service-processor network modify -address-type IPv4/IPv6 -node NODENAME -enable true/false -dhcp v4/none -ip-address X.X.X.X -netmask X.X.X.X -gateway X.X.X.X |
||||
| Node Name | Address Type (IPv4/IPv6) | Enable (true/false) | DHCP (v4/none) | IP Address |
1.1.1 Collect NetApp storage system configuration information.
Putting Various Netapp Information here:
- Maximum number of nodes in a SAN cluster in CDOT 8.1 is 4, in CDOT 8.1.2 it went up to 6, and in CDOT 8.2 it went up to 8.
1.1.2 Collect Switch configuration information.
1.1.3 Gather power information such as circuit availability, wiring in place, etc…
1.1.4 Collect Host configuration information.
1.1.5 Collect Application configuration and requirements.
- Application Names / Software Version
- OS / Version
- IOPs needed heavy / avg.
1.1.6 Collect potential DEDUPE information.
- TR-3966 Dedupe and Compression in cDot
- Netapp 7-Mode and Cluster Mode dedupe/compression command comparison (A rosetta stone)
1.1.7 Collect backup and retention information.
- Hourly?
- Daily?
- Weekly?
- Nightly?
- Monthly?
- Years kept?
- Distance requirements?
1.2 List a detailed inventory of SAN components including:
1.2.1 NetApp storage system configuration details
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 |
## Set it up to show all fields and all information ha-cdot::> set -showallfields true ha-cdot::> set -privilege diagnostic Warning: These diagnostic commands are for use by NetApp personnel only. Do you want to continue? {y|n}: y ha-cdot::> system show -fields node,assettag,health,location,nvramid,model,systemid,serialnumber,vendor node location model serialnumber assettag nvramid systemid vendor health ---------- -------- ------- ------------ -------- ---------- ---------- ------ ------ ha-cdot-01 Lab FAS3270 700000691996 - 1574031045 1574031045 NetApp true ha-cdot-02 Lab FAS3270 700000691984 - 1574031151 1574031151 NetApp true ha-cdot::*> cluster identity show uuid name serialnumber location contact rdb-uuid ------------------------------------ ------- ------------ -------- ------- ------------------------------------ a5784a0f-48af-11e4-8b15-123478563412 ha-cdot 1-80-000099 Lab "" a5786ff0-48af-11e4-8b15-123478563412 ## Old fashioned sysconfig commands ha-cdot::*> system node run -node ha-cdot-01 -command sysconfig NetApp Release 8.2.2 Cluster-Mode: Fri Aug 22 01:46:52 PDT 2014 System ID: 1574031045 (ha-cdot-01); partner ID: 1574031151 (ha-cdot-02) System Serial Number: 700000691996 (ha-cdot-01) System Rev: F3 System Storage Configuration: Multi-Path HA System ACP Connectivity: NA Backplane Part Number: 111-00587 Backplane Rev: C1 Backplane Serial Number: 5002771225 slot 0: System Board Model Name: FAS3270 Processors: 4 Processor type: Intel(R) Xeon(R) CPU E5240 @ 3.00GHz Memory Size: 20480 MB Memory Attributes: Bank Interleaving Hoisting Rank Interleaving Chipkill ECC Controller: A Service Processor Status: Online IOXM Status: present Power: Good CPLD version: Agent version: N/A Serial Number: 5003559973 Part Number: 111-00647 Version: B0 slot 0: Dual 10G Ethernet Controller T320E-SFP/KR c0a MAC Address: 00:a0:98:16:da:72 (auto-10g_twinax-fd-up) c0b MAC Address: 00:a0:98:16:da:73 (auto-10g_twinax-fd-up) slot 0: Internal BGE 10/100 Ethernet Controller e0M MAC Address: 00:a0:98:16:da:74 (auto-100tx-fd-up) e0P MAC Address: 00:a0:98:16:da:75 (auto-100tx-fd-up) slot 0: Dual 10/100/1000 Ethernet Controller G20 e0a MAC Address: 00:a0:98:16:da:70 (auto-1000t-fd-up) e0b MAC Address: 00:a0:98:16:da:71 (auto-1000t-fd-up) slot 0: SAS Host Adapter 0a 48 Disks: 40682.6GB 2 shelves with IOM3 slot 0: SAS Host Adapter 0b slot 0: FC Host Adapter 0c slot 0: FC Host Adapter 0d slot 0: Intel USB EHCI Adapter u0a (0xdfc01400) boot0 Micron Technology 0x655, class 0/0, rev 2.00/11.10, addr 2 1936MB 512B/sect (4BF0022700119766) slot 1: Dual 10G Ethernet Controller T320E-SFP+ e1a MAC Address: 00:07:43:07:78:4e (auto-10g_twinax-fd-up) e1b MAC Address: 00:07:43:07:78:4f (auto-10g_twinax-fd-up) slot 2: Dual 10G Ethernet Controller T320E-SFP+ e2a MAC Address: 00:07:43:07:8e:94 (auto-10g_twinax-fd-up) e2b MAC Address: 00:07:43:07:8e:95 (auto-10g_twinax-fd-up) slot 3: Flash Cache (512 GB) State: Enabled slot 4: SAS Host Adapter 4a 48 Disks: 40682.6GB 2 shelves with IOM3 slot 4: SAS Host Adapter 4b slot 4: SAS Host Adapter 4c slot 4: SAS Host Adapter 4d ha-cdot::*> date Node Date Time zone --------- ------------------------ ------------------------- ha-cdot-01 Sat Oct 04 02:56:28 2014 Etc/UTC ha-cdot-02 Sat Oct 04 02:56:28 2014 Etc/UTC 2 entries were displayed. ## SPACE ha-cdot::*> df vserver volume aggregate fs-type filesys-name total-space total-hybrid-cache-size used-space percent-used-space available-space reserved-space inodes-used percent-inodes-used inodes-free total-saved percent-total-saved dedupe-saved percent-dedupe-saved compression-saved percent-compression-saved vbn-zero-saved percent-vbn-zero-saved mounted-on ---------- ------ --------- ------- ------------ ----------- ----------------------- ---------- ------------------ --------------- -------------- ----------- ------------------- ----------- ----------- ------------------- ------------ -------------------- ----------------- ------------------------- -------------- ---------------------- ---------- ha-cdot-01 vol0 "" active /vol/vol0/ 703550980 - 3726868 1% 699824112 1168 11766 0% 21974192 0 0% 0 0% 0 0% 0 0% --- ha-cdot-01 vol0 "" snapshot /vol/vol0/.snapshot 37028996 - 491464 1% 36537532 0 0 0% 0 0 0% 0 0% 0 0% 0 0% --- ha-cdot-02 vol0 "" active /vol/vol0/ 703550980 - 3892628 1% 699658352 32 11805 0% 21974153 0 0% 0 0% 0 0% 0 0% --- ha-cdot-02 vol0 "" snapshot /vol/vol0/.snapshot 37028996 - 406460 1% 36622536 0 0 0% 0 0 0% 0 0% 0 0% 0 0% --- 4 entries were ## LIFS a-cdot::*> network interface show vserver lif role data-protocol home-node home-port curr-node curr-port status-oper status-extended numeric-id is-home address netmask netmask-length auto routing-group status-admin failover-policy firewall-policy auto-revert sticky dns-zone listen-for-dns-query allow-lb-migrate lb-weight failover-group wwpn address-family comment ------- ------------ ------------ ------------- ---------- --------- ---------- --------- ----------- --------------- ---------- ------- ------------ ------------- -------------- ---- -------------- ------------ --------------- --------------- ----------- ------ -------- -------------------- ---------------- --------- -------------- ---- -------------- ------- ha-cdot cluster_mgmt cluster-mgmt none ha-cdot-01 a1a-1921 ha-cdot-01 a1a-1921 up - 1025 true 10.192.1.130 255.255.255.0 24 - c10.192.1.0/24 up nextavail mgmt true false none false false load vlan1921-fg - ipv4 - ha-cdot-01 clus1 cluster none ha-cdot-01 e1a ha-cdot-01 e1a up - 1024 true 169.254.156.24 255.255.0.0 16 - c169.254.0.0/16 up nextavail cluster true false none false false load system-defined - ipv4 - ha-cdot-01 clus2 cluster none ha-cdot-01 e2a ha-cdot-01 e2a up - 1023 true 169.254.251.4 255.255.0.0 16 - c169.254.0.0/16 up nextavail cluster true false none false false load system-defined - ipv4 - ha-cdot-01 mgmt1 node-mgmt none ha-cdot-01 e0b ha-cdot-01 e0b up - 1026 true 10.192.1.131 255.255.255.0 24 - n10.192.1.0/24 up nextavail mgmt true false none false false load system-defined - ipv4 - ha-cdot-02 clus1 cluster none ha-cdot-02 e1a ha-cdot-02 e1a up - 1013 true 169.254.136.101 255.255.0.0 16 - c169.254.0.0/16 up nextavail cluster true false none false false load system-defined - ipv4 - ha-cdot-02 clus2 cluster none ha-cdot-02 e2a ha-cdot-02 e2a up - 1014 true 169.254.37.40 255.255.0.0 16 - c169.254.0.0/16 up nextavail cluster true false none false false load system-defined - ipv4 - ha-cdot-02 mgmt1 node-mgmt none ha-cdot-02 e0b ha-cdot-02 e0b up - 1027 true 10.192.1.132 255.255.255.0 24 - n10.192.1.0/24 up nextavail mgmt true false none false false load system-defined - ipv4 - 7 entries were displayed. ## PORTS ha-cdot::*> network port show node port role link mtu autonegotiate-admin autonegotiate-oper duplex-admin duplex-oper speed-admin speed-oper flowcontrol-admin flowcontrol-oper mac up-admin autorevert-delay type ifgrp-node ifgrp-port ifgrp-distr-func ifgrp-mode vlan-node vlan-port vlan-tag remote-device-id ---------- ---- ---- ---- ---- ------------------- ------------------ ------------ ----------- ----------- ---------- ----------------- ---------------- ----------------- -------- ---------------- -------- ---------- ---------- ---------------- -------------- --------- --------- -------- ---------------- ha-cdot-01 a1a data up 1500 true - auto full auto 10000 full - 02:a0:98:16:da:70 true - if-group - - ip multimode_lacp - - - - ha-cdot-01 a1a-1921 data up 1500 true - auto full auto 10000 full - 02:a0:98:16:da:70 true - vlan - - - - ha-cdot-01 ---- truncated for brevity (I have hundreds of vlans) --- ha-cdot-02 e0M node-mgmt up 1500 true true full full auto 100 full full 00:a0:98:16:e4:4c true - physical - - - - - - - PA-SW-2960-2.wayne.hastorage.com ha-cdot-02 e0a data up 1500 true true full full auto 1000 full none 00:a0:98:16:e4:48 true - physical - - - - - - - PA-SW-2960-2.wayne.hastorage.com ha-cdot-02 e0b data up 1500 true true full full auto 1000 full none 00:a0:98:16:e4:49 true - physical - - - - - - - PA-SW-2960-2.wayne.hastorage.com ha-cdot-02 e1a cluster up 9000 true true full full auto 10000 full full 00:07:43:08:16:9b true 10 physical - - - - - - - ha-cdot-01 ha-cdot-02 e1b data up 1500 true true full full auto 10000 full full 02:a0:98:16:e4:48 true - physical ha-cdot-02 a2a - - - - - PA-SW-5548-2(SSI17290695) ha-cdot-02 e2a cluster up 9000 true true full full auto 10000 full full 00:07:43:07:87:ab true 10 physical - - - - - - - ha-cdot-01 ha-cdot-02 e2b data up 1500 true true full full auto 10000 full full 02:a0:98:16:e4:48 true - physical ha-cdot-02 a2a - - - - - PA-SW-5548-1(SSI17350070) ## VLANS ha-cdot::*> network port vlan show node vlan-name port vlan-id mac ---------- --------- ---- ------- ----------------- ha-cdot-01 a1a-1921 a1a 1921 02:a0:98:16:da:70 ha-cdot-01 a1a-1930 a1a 1930 02:a0:98:16:da:70 ha-cdot::*> security ssh show vserver key-exchange-algorithms ciphers ------- ------------------------------------------------------------------------------------------------------------------------------ -------------------------------------------------------------------------- ha-cdot diffie-hellman-group-exchange-sha256,diffie-hellman-group-exchange-sha1,diffie-hellman-group14-sha1,diffie-hellman-group1-sha1 aes256-ctr,aes192-ctr,aes128-ctr,aes256-cbc,aes192-cbc,aes128-cbc,3des-cbc ha-cdot::*> security ssl show vserver ca serial common-name server-enabled client-enabled ------- ------------ -------- ------------ -------------- -------------- ha-cdot ha-cdot.cert 542AC0CA ha-cdot.cert true false ha-cdot-01 ha-cdot-01.cert 542AC0C9 ha-cdot-01.cert true false ha-cdot-02 ha-cdot-02.cert 542AC458 ha-cdot-02.cert true false 3 entries were displayed. ha-cdot::*> storage aggregate show aggregate chksumstyle diskcount mirror nodes disklist mirror-disklist free-space-realloc ha-policy ignore-inconsistent percent-snapshot-space raid-block-checksum raid-lost-write raid-zoned-checksum thorough-scrub hybrid-enabled availsize block-type chksumenabled chksumstatus dr-home-id dr-home-name has-mroot has-partner-mroot home-id home-name hybrid-cache-size-total hybrid inconsistent is-home maxraidsize cache-raid-group-size owner-id owner-name percent-used plexes raidgroups raid-lost-write-state raidstatus raidtype resyncsnaptime root sis-metadata-space-used size state type max-write-alloc-blocks usedsize uuid volcount voltype volume-style --------- ----------- --------- ------ ---------- ----------------------------------------------------------- --------------- ------------------ --------- ------------------- ---------------------- ------------------- --------------- ------------------- -------------- -------------- ----------- ---------- ------------- ------------ ---------- ------------ --------- ----------------- ---------- ---------- ----------------------- ------ ------------ ------- ----------- --------------------- ---------- ---------- ------------ ------------ -------------------------- --------------------- ----------------- -------- -------------- ---- ----------------------- ------------ ------ ---- ---------------------- ------------ ------------------------------------ -------- ------- ------------ aggr0 block 3 false ha-cdot-01 ha-cdot-01:4a.80.18,ha-cdot-01:4a.80.19,ha-cdot-01:4a.80.20 - off cfo off - on on - off false 37266436096 64-bit true active - - true false 1574031045 ha-cdot-01 0 false false true 14 - 1574031045 ha-cdot-01 95% /aggr0/plex0 "/aggr0/plex0/rg0 (block)" on "raid_dp, normal" raid_dp 60 true 0 799834619904 online aggr 0 762568183808 1c41d629-b720-4d3f-bc0c-75392cd96a0d 1 flex flex aggr0_ha_cdot_02_0 block 3 false ha-cdot-02 ha-cdot-02:4a.80.0,ha-cdot-02:0a.81.0,ha-cdot-02:4a.80.1 - off cfo off - on on - off false 37265833984 64-bit true active - - true false 1574031151 ha-cdot-02 0 false false true 14 - 1574031151 ha-cdot-02 95% /aggr0_ha_cdot_02_0/plex0 "/aggr0_ha_cdot_02_0/plex0/rg0 (block)" on "raid_dp, normal" raid_dp 60 true 0 799834619904 online aggr 0 762568785920 7e3b5707-7a19-4748-9019-30a916c68dca 1 flex flex 2 entries were displayed. ha-cdot::*> storage disk show disk owner owner-id state is-foreign uid aggregate array-name average-latency bay bps capacity-sectors carrier-id checksum-compatibility container-type copy-destination copy-percent disk-io-kbps-total disk-iops-total diskpathnames effective-rpm dr-home dr-home-id errors firmware-revision grown-defect-list-count home home-id host-adapter initiator initiator-iops initiator-io-kbps initiator-lun-in-use-count initiator-side-switch-port is-dynamically-qualified is-multidisk-carrier lun lun-iops lun-io-kbps lun-path-use-state media-scrub-count media-scrub-last-done model nodelist outage-reason path-error-count path-iops path-io-kbps path-link-errors path-lun-in-use-count path-quality physical-size-mb physical-size physical-size-512b plex port-speed position power-on-hours prefailed preferred-target-port primary-port raid-group reconstruction-percent replacing reserver-id rpm secondary-name secondary-port sectors-read sectors-written serial-number shelf shm-time-interval target-iops target-io-kbps target-lun-in-use-count target-port-access-state target-side-switch-port target-wwpn tpgn type usable-size-mb usable-size vendor zeroed zeroing-percent ------------------- ---------- ---------- ------- ---------- ----------------------------------------------------------------------------------------- ------------------ ---------- --------------- --- --- ---------------- ---------- ---------------------- -------------- ---------------- ------------ ------------------ --------------- ------------------------------------------------------------------------------- ------------- ------- ---------- ------ ----------------- ----------------------- ---------- ---------- ------------ ----------- -------------- ----------------- -------------------------- -------------------------- ------------------------ -------------------- ------- -------- ----------- ------------------ ----------------- --------------------- ---------------- ------------------------------------------- ------------- ---------------- --------- ------------ ---------------- --------------------- ------------ ---------------- ------------- ------------------ ----- ---------- -------- -------------- --------- ----------------------- ------------ ---------- ---------------------- --------- ----------- ---- ------------------- -------------- ------------ --------------- --------------- ----- ----------------- ----------- -------------- ----------------------- ------------------------ ----------------------- ------------------------------------------------------------------- ----------- ---- -------------- ------------ ------ ------ --------------- ha-cdot-01:4a.80.18 ha-cdot-01 1574031045 present - 500605BA:0001C510:00000000:00000000:00000000:00000000:00000000:00000000:00000000:00000000 aggr0 N/A 8 18 512 1953525168 - block aggregate - - 52 0 ha-cdot-01:4a.80.18,ha-cdot-01:0a.80.18,ha-cdot-02:4a.80.18,ha-cdot-02:0a.80.18 10000 - - - NA09 0 ha-cdot-01 1574031045 4a 4a,0a,4a,0a 4,2,5,0 161,4,103,49 0,0,0,0 N/A,N/A,N/A,N/A false false 0,0,0,0 0,0,1,0 52,0,3,0 INU,RDY,INU,RDY - - X302_WMARS01TSSM ha-cdot-01,ha-cdot-01,ha-cdot-02,ha-cdot-02 - 0 0,0,0,0 0,0,0,0 0,0,0,0 0,0,0,0 0,0,0,0 847884 889071009792 1736466816 plex0 -,-,-,- dparity 392800 false false,false,false,false B rg0 - false 1574031045 7200 ha-cdot-01:0a.80.18 A 1551942 27915979 WD-WMATV3278764 80 272121 0,0,0,0 0,0,0,0 0,0,0,0 AO,AO,AO,AO N/A,N/A,N/A,N/A 500605ba0001c512,500605ba0001c511,500605ba0001c511,500605ba0001c512 34,3,3,34 BSAS 847555 888726618112 NETAPP false - ha-cdot-01:4a.80.19 ha-cdot-01 1574031045 present - 500605BA:0001CE88:00000000:00000000:00000000:00000000:00000000:00000000:00000000:00000000 aggr0 N/A 10 19 512 1953525168 - block aggregate - - 53 0 ha-cdot-01:4a.80.19,ha-cdot-01:0a.80.19,ha-cdot-02:4a.80.19,ha-cdot-02:0a.80.19 10000 - - - NA09 0 ha-cdot-01 1574031045 4a 4a,0a,4a,0a 4,2,5,0 161,4,103,49 0,0,0,0 N/A,N/A,N/A,N/A false false 0,0,0,0 0,0,1,0 53,0,3,0 INU,RDY,INU,RDY - - X302_WMARS01TSSM ha-cdot-01,ha-cdot-01,ha-cdot-02,ha-cdot-02 - 0 0,0,0,0 0,0,0,0 0,0,0,0 0,0,0,0 0,0,0,0 847884 889071009792 1736466816 plex0 -,-,-,- parity 392900 false false,false,false,false B rg0 - false 1574031045 7200 ha-cdot-01:0a.80.19 A 1433128 28586979 WD-WMATV3287803 80 272121 0,0,0,0 0,0,0,0 0,0,0,0 AO,AO,AO,AO N/A,N/A,N/A,N/A 500605ba0001ce8a,500605ba0001ce89,500605ba0001ce89,500605ba0001ce8a 19,87,87,19 BSAS 847555 888726618112 NETAPP false - ha-cdot::*> storage failover show node node-name partner-name nvramid partner-nvramid enabled mode possible reason reason-enum interconnect-up interconnect-links interconnect-type state-description partner-state time-until-takeover partner-reason partner-reason-enum killpackets partner-aggregates current-index current-entry maximum-index pmbox-status bmbox-status local-mbx-node-status partner-mbx-node-status local-takeover-info partner-takeover-info local-headswap-state partner-headswap-state fast-timeout slow-timeout mailbox-timeout connect-timeout operator-timeout firmware-timeout dumpcore-timeout booting-timeout transit-timer transit-timeout firmware-received firmware-received-cycles booting-received transit-time pnormal ptransition bnormal btransition logs-unsynced auto-giveback check-partner detection-time onfailure onpanic onshort-uptime short-uptime attempts attempts-time propagate read-interval write-interval onreboot delay-seconds hwassist hwassist-partner-ip hwassist-partner-port hwassist-health-check-interval hwassist-retry-count hwassist-status time-until-autogiveback local-mailbox-disks partner-mailbox-disks local-firmware-state local-firmware-progress partner-firmware-state partner-firmware-progress local-missing-disks partner-missing-disks reboot-timeout time-since-takeover auto-giveback-after-panic is-giveback-requested auto-giveback-last-veto-check is-auto-giveback-attempts-exceeded was-auto-giveback-done is-cifs-auto-giveback-stopping bypass-takeover-optimization aggregate-migration-timeout auto-giveback-override-vetoes is-mirror-enabled is-mirror-consistency-required is-degraded reserve-policy total-system-uptime current-time fm-takeover-state fm-giveback-state takeover-reason ---------- ---------- ------------ ---------- --------------- ------- ---- -------- ------ ----------- --------------- --------------------------------------------------------- ----------------- ------------------------- ------------- ------------------- -------------- ------------------- ----------- ------------------ ------------- ------------- ------------- ------------ ----------------- --------------------- ----------------------- ----------------------------------------------- ----------------------------------------------- -------------------- ---------------------- ------------ ------------ --------------- --------------- ---------------- ---------------- ---------------- --------------- ------------- --------------- ----------------- ------------------------ ---------------- ------------ ------- ----------- ------- ----------- ------------- ------------- ------------- -------------- --------- ------- -------------- ------------ -------- ------------- --------- ------------- -------------- -------- ------------- -------- ------------------- --------------------- ------------------------------ -------------------- --------------- ----------------------- -------------------- --------------------- -------------------- ----------------------- ---------------------- ------------------------- ------------------- --------------------- -------------- ------------------- ------------------------- --------------------- ----------------------------- ---------------------------------- ---------------------- ------------------------------ ---------------------------- --------------------------- ----------------------------- ----------------- ------------------------------ ----------- --------------------- ------------------- ------------ ----------------- ----------------- --------------- ha-cdot-01 ha-cdot-01 ha-cdot-02 1574031045 1574031151 true ha true - - true "RDMA Interconnect is up (Link 0 up (active), Link 1 up)" "Chelsio T3" "Connected to ha-cdot-02" Up - - - true false - - 173 - mbx_status_backup TAKEOVER_ENABLED TAKEOVER_ENABLED "0x3000 <TAKEOVER_ON_REBOOT,TAKEOVER_ON_PANIC>" "0x3000 <TAKEOVER_ON_REBOOT,TAKEOVER_ON_PANIC>" HEADSWAP_NONE HEADSWAP_NONE 1000 2500 10000 5000 600000 15000 60000 300000 true 600000 217569534 653081516881893 0 1379230 624 0 29328 0 1 true true 15 true true true 60 2 60 true 5 5 true 600 true 10.192.1.132 4444 180 2 active - "4a.80.18, 4a.80.19" "4a.80.0, 0a.81.0" SF_UP 216191 SF_UP 217342 None None 1000 - true false 0 false true false false 120 false true true false ALWAYS_AFTER_TAKEOVER 217570199 1412391945 FT_NONE FT_NONE - ha-cdot-02 ha-cdot-02 ha-cdot-01 1574031151 1574031045 true ha true - - true "RDMA Interconnect is up (Link 0 up (active), Link 1 up)" "Chelsio T3" "Connected to ha-cdot-01" Up - - - true false - - 173 - mbx_status_backup TAKEOVER_ENABLED TAKEOVER_ENABLED "0x3000 <TAKEOVER_ON_REBOOT,TAKEOVER_ON_PANIC>" "0x3000 <TAKEOVER_ON_REBOOT,TAKEOVER_ON_PANIC>" HEADSWAP_NONE HEADSWAP_NONE 1000 2500 10000 5000 600000 15000 60000 300000 true 600000 216251386 649403240497281 0 66784 1785 0 200 0 0 true true 15 true true true 60 2 60 true 5 5 true 600 true 10.192.1.131 4444 180 2 active - "4a.80.0, 0a.81.0" "4a.80.18, 4a.80.19" SF_UP 217342 SF_UP 216191 None None 1000 - true false 0 false true false false 120 false true true false ALWAYS_AFTER_TAKEOVER 216251661 1412391945 FT_NONE FT_NONE - 2 entries were displayed. ha-cdot::*> system health status show status ------ ok ha-cdot::*> system health subsystem show subsystem health init-state outstanding-alert-count suppressed-alert-count ----------- ------ ----------- ----------------------- ---------------------- SAS-connect ok initialized 0 0 Switch-Health ok initialized 0 0 CIFS-NDO ok initialized 0 0 3 entries were displayed. ha-cdot::*> system health system-connectivity shelf show node uuid monitor id status num-paths connected-nodes num-nodes ---------- ----------------------- -------------- -- ------ --------- --------------------- --------- ha-cdot-01 50:05:0c:c1:02:00:1e:3b system-connect 80 ok 4 ha-cdot-02,ha-cdot-01 2 ha-cdot-01 50:05:0c:c1:02:01:3c:a1 system-connect 81 ok 4 ha-cdot-02,ha-cdot-01 2 2 entries were displayed. ha-cdot::*> system license show serial-number package owner expiration description type legacy customer-id ------------- ------- ------- ---------- ---------------------- ------- ------ ----------- 1-80-000099 Base ha-cdot - "Cluster Base License" license no none ha-cdot::*> system license status show package method expiration description ------- ------- ---------- ---------------------- Base license - "Cluster Base License" NFS none - "NFS License" CIFS none - "CIFS License" iSCSI none - "iSCSI License" FCP none - "FCP License" CDMI none - "CDMI License" SnapRestore none - "SnapRestore License" SnapMirror none - "SnapMirror License" FlexClone none - "FlexClone License" SnapVault none - "SnapVault License" SnapLock none - "SnapLock Compliance License" SnapManagerSuite none - "SnapManagerSuite License" SnapProtectApps none - "SnapProtectApp License" V_StorageAttach none - "Virtual Attached Storage License" SnapLock_Enterprise none - "SnapLock Enterprise License" Insight_Balance none - "OnCommand Balance" 16 entries were displayed. ha-cdot::*> system node autosupport show node foo state mail-hosts from to noteto partner-address support transport url put-url proxy-url support-address hostname-subj nht perf retry-interval retry-count reminder throttle payload-format periodic-tx-window last-subject last-time max-http-size max-smtp-size remove-private-data validate-digital-certificate local-collection ondemand-state ondemand-remotediag-state ondemand-server-url ondemand-polling-interval ---------- --- ------ ---------- ---------- -- ------ --------------- ------- --------- --------------------------------------------- ------------------------------ --------- ---------------------- ------------- ---- ---- -------------- ----------- -------- -------- -------------- ------------------ ------------------------------------- -------------------- ------------- ------------- ------------------- ---------------------------- ---------------- -------------- ------------------------- ------------------------------------------- ------------------------- ha-cdot-01 - enable mailhost Postmaster - - - disable https support.netapp.com/asupprod/post/1.0/postAsup support.netapp.com/put/AsupPut "" autosupport@netapp.com false true true 4m 15 true true 7z 1h "CHASSIS POWER SUPPLY DEGRADED: PS 2" "10/4/2014 01:40:31" 10485760 5242880 false true true enable enable https://support.netapp.com/aods/asupmessage 60 ha-cdot-02 - enable mailhost Postmaster - - - disable https support.netapp.com/asupprod/post/1.0/postAsup support.netapp.com/put/AsupPut "" autosupport@netapp.com false true true 4m 15 true true 7z 1h MANAGEMENT_LOG "10/4/2014 00:32:43" 10485760 5242880 false true true enable enable https://support.netapp.com/aods/asupmessage 60 2 entries were displayed. ha-cdot::*> system node image show node image isdefault iscurrent kernel-path rootfs-path version installdate ---------- ------ --------- --------- ------------------------------------ ---------------------------------------- ------- -------------------- ha-cdot-01 image1 true false /cfcard/x86_64/freebsd/image1/kernel /cfcard/x86_64/freebsd/image1/rootfs.img 8.2.2 "10/1/2014 02:48:38" ha-cdot-01 image2 false true /cfcard/X86_64/freebsd/image2/kernel /cfcard/x86_64/freebsd/image2/rootfs.img 8.2.2 "10/1/2014 02:48:12" ha-cdot-02 image1 true true /cfcard/X86_64/freebsd/image1/kernel /cfcard/x86_64/freebsd/image1/rootfs.img 8.2.2 "10/1/2014 14:30:08" ha-cdot-02 image2 false false /cfcard/x86_64/freebsd/image2/kernel /cfcard/x86_64/freebsd/image2/rootfs.img 8.2.1 "6/16/2014 20:05:12" 4 entries were displayed. ha-cdot::*> system node service-processor image show node image type status is-current version autoupdate last-update-status ---------- ------- ---- --------- ---------- ------- ---------- ------------------ ha-cdot-01 primary SP installed true 1.4.1 true passed ha-cdot-01 backup SP installed false 1.4P1 true passed ha-cdot-02 primary SP installed true 1.4.1 true passed ha-cdot-02 backup SP installed false 1.4P1 true passed 4 entries were displayed. ha-cdot::*> system node service-processor image update-progress show node start-time percent-done end-time in-progress ---------- ---------- ------------ -------- ----------- ha-cdot-01 - 0 - no ha-cdot-02 - 0 - no 2 entries were displayed. ha-cdot::*> system node service-processor network show node address-type enable type status link-status dhcp ip-address mac netmask prefix-length router-ip link-local-ip gateway time-last-updated ---------- ------------ ------ ---- ------ ----------- ---- ------------ ----------------- ------------- ------------- --------- ------------- ------------ ------------------------------ ha-cdot-01 IPv4 true SP online up none 10.192.1.133 00:a0:98:16:da:76 255.255.255.0 - - - 10.192.1.254 "Sat Oct 4 03:08:07 UTC 2014" ha-cdot-01 IPv6 false SP online disabled none - 00:a0:98:16:da:76 - - - - - "Sat Oct 4 03:08:07 UTC 2014" ha-cdot-02 IPv4 true SP online up none 10.192.1.134 00:a0:98:16:e4:4e 255.255.255.0 - - - 10.192.1.254 "Sat Oct 4 03:08:07 UTC 2014" ha-cdot-02 IPv6 false SP online disabled none - 00:a0:98:16:e4:4e - - - - - "Sat Oct 4 03:08:07 UTC 2014" 4 entries were displayed. ha-cdot::*> system node service-processor show node type status ip-configured address mac fw-version part-num serial-num ipmi-ver dev-rev autoupdate-enabled ---------- ---- ------ ------------- ------------ ----------------- ---------- ---------------- ---------------- -------- ---------------- ------------------ ha-cdot-01 SP online true 10.192.1.133 00:a0:98:16:da:76 1.4.1 "Not Applicable" "Not Applicable" 2.0 "Not Applicable" true ha-cdot-02 SP online true 10.192.1.134 00:a0:98:16:e4:4e 1.4.1 "Not Applicable" "Not Applicable" 2.0 "Not Applicable" true 2 entries were displayed. ha-cdot::*> system node show node owner location model serialnumber assettag uptime nvramid systemid vendor health eligibility epsilon ---------- ----- -------- ------- ------------ -------- -------------- ---------- ---------- ------ ------ ----------- ------- ha-cdot-01 "" Lab FAS3270 700000691996 - "2 days 12:29" 1574031045 1574031045 NetApp true true false ha-cdot-02 "" Lab FAS3270 700000691984 - "2 days 12:09" 1574031151 1574031151 NetApp true true false 2 entries were displayed. ha-cdot::*> ha-cdot::*> system services firewall show node enabled logging ---------- ------- ------- ha-cdot-01 true false ha-cdot-02 true false 2 entries were displayed. ha-cdot::*> system services ndmp show node enable clear-text user-id common-sessions ---------- ------ ---------- ------- --------------- ha-cdot-01 false true root - ha-cdot-02 false true root - 2 entries were displayed. ha-cdot::*> system services web show external http-port https-port tlsv1-enabled sslv3-enabled sslv2-enabled ssl-fips-enabled status -------- --------- ---------- ------------- ------------- ------------- ---------------- ------ true 80 443 true true false false online ha-cdot::*> system snmp show contact location authtrap init hostname traphosts printhost access community ------- -------- -------- ---- -------- --------- --------- ------ --------- "" Lab 0 1 - - - - - ha-cdot::*> version NetApp Release 8.2.2 Cluster-Mode: Fri Aug 22 06:04:17 PDT 2014 ha-cdot::*> volume show vserver volume aggregate size name-ordinal dsid msid state type volume-style is-cluster-volume is-constituent policy user group security-style unix-permissions junction-path junction-path-source junction-active junction-parent vsroot comment available filesystem-size total used percent-used space-nearly-full-threshold-percent space-full-threshold-percent max-autosize autosize-increment min-autosize autosize-grow-threshold-percent autosize-shrink-threshold-percent autosize-mode autosize files files-used maxdir-size space-guarantee space-guarantee-enabled min-readahead atime-update snapdir-access percent-snapshot-space snapshot-space-used snapshot-policy create-time language clone-volume flexcache-cache-policy flexcache-fill-policy flexcache-min-reserve fc-delegs-enabled node uuid nvfail in-nvfailed-state force-nvfail-on-dr filesys-size-fixed extent-enabled overwrite-reserve fractional-reserve index-dir-enabled load-sharing-source move-target physical-replica max-write-alloc-blocks snapshot-clone-dependency create-ucode convert-ucode space-mgmt-try-first read-realloc is-inconsistent is-quiesced-on-disk is-quiesced-in-memory transition-state transition-behavior is-copied-for-transition is-transitioned is-sis-volume is-sis-logging-enabled sis-space-saved sis-space-saved-percent dedupe-space-saved dedupe-space-saved-percent dedupe-space-shared compression-space-saved compression-space-saved-percent vbn-zero-space-saved vbn-zero-space-saved-percent instance-uuid provenance-uuid block-type flexcache-connection-status vm-align-sector vm-align-suffix is-moving hybrid-cache-eligibility hybrid-cache-write-caching-ineligibility-reason is-managed-by-service storage-service enable-object-store enable-snapdiff unreachable-attr-action constituent-role max-namespace-constituent-size max-data-constituent-size percent-reserve-constituent is-reserve-constituent directory-bitwidth ols-aggr-list ols-constituent-size ols-constituent-count object-write-sync-period qos-policy-group external-cache is-volume-in-cutover snapshot-count ---------- ------ --------- ------------ ------------ ---- ---- ------ ---- ------------ ----------------- -------------- ------ ---- ----- -------------- ---------------- ------------- -------------------- --------------- --------------- ------ ------- ------------ --------------- ------------ ---------- ------------ ----------------------------------- ---------------------------- ------------ ------------------ ------------ ------------------------------- --------------------------------- ------------- -------- -------- ---------- ----------- --------------- ----------------------- ------------- ------------ -------------- ---------------------- ------------------- --------------- -------------------------- -------- ------------ ---------------------- --------------------- --------------------- ----------------- ---------- ------------------------------------ ------ ----------------- ------------------ ------------------ -------------- ----------------- ------------------ ----------------- ------------------- ----------- ---------------- ---------------------- ------------------------- ------------ ------------- -------------------- ------------ --------------- ------------------- --------------------- ---------------- ------------------- ------------------------ --------------- ------------- ---------------------- --------------- ----------------------- ------------------ -------------------------- ------------------- ----------------------- ------------------------------- -------------------- ---------------------------- ------------------------------------ ------------------------------------ ---------- --------------------------- --------------- --------------- --------- ------------------------ ----------------------------------------------- --------------------- --------------- ------------------- --------------- ----------------------- ---------------- ------------------------------ ------------------------- --------------------------- ---------------------- ------------------ ------------- -------------------- --------------------- ------------------------ ---------------- -------------- -------------------- -------------- ha-cdot-01 vol0 aggr0 758353895424 base - - online RW flex false false - - - - ------------ - - - - - - 716618637312 758353895424 720436203520 3817566208 5% 95% 98% 910024671232 37917691904 758353895424 95% 50% off false 21985958 11768 194615296 volume true false true true 5% 1% - "Mon Sep 29 21:37:37 2014" - - - - - false ha-cdot-01 9ff7908f-7611-4ea6-b533-1033717f562c on false - false off 1196032 100% - - false false 0 off false false volume_grow off false false false none none false false false false 0 0% 0 0% 0 0 0% - - d34ec9f1-063f-4ad5-9a5b-ce050f9192a0 d34ec9f1-063f-4ad5-9a5b-ce050f9192a0 64-bit - - - - read-write - - - - - - - - - - - - - - - - - - - 8 ha-cdot-02 vol0 aggr0_ha_cdot_02_0 758353895424 base - - online RW flex false false - - - - ------------ - - - - - - 716449230848 758353895424 720436203520 3986972672 5% 95% 98% 910024671232 37917691904 758353895424 95% 50% off false 21985958 11807 194615296 volume true false true true 5% 1% - "Mon Sep 29 21:42:18 2014" - - - - - false ha-cdot-02 571681d4-3218-44f1-b4fb-c3b8e46a1365 on false - false off 32768 100% - - false false 0 off false false volume_grow off false false false none none false false false false 0 0% 0 0% 0 0 0% - - 89a71a7e-3f77-41ff-98e6-170293218088 89a71a7e-3f77-41ff-98e6-170293218088 64-bit - - - - read-write - - - - - - - - - - - - - - - - - - - 8 2 entries were displayed. Press to page down, for next line, or 'q' to quit... ha-cdot::*> vserver show vserver type uuid rootvolume aggregate ns-switch nm-switch nisdomain rootvolume-security-style ldap-client language snapshot-policy comment quota-policy aggr-list max-volumes admin-state allowed-protocols disallowed-protocols protocol-services-use-data-lifs is-repository qos-policy-group ------- ----- ------------------------------------ ---------- --------- --------- --------- --------- ------------------------- ----------- -------- --------------- ----------------------------- ------------ --------- ----------- ----------- ----------------- -------------------- ------------------------------- ------------- ---------------- ha-cdot admin ae096c6e-48af-11e4-8b15-123478563412 - - - - - - - en_US none "The administrative vserver." - - - - - - true false - ha-cdot-01 node 624f3993-4805-11e4-87f6-93201976365b - - - - - - - C - "" - - - - - - true false - ha-cdot-02 node 257f7193-4805-11e4-a681-47041f9b2cba - - - - - - - C - "" - - - - - - true false - 3 entries were displayed. ############### ADD LATER - Other helpful info gathering commands ################### vserver cifs show vserver fcp initiator show vserver fcp interface show vserver fcp nodename vserver fcp portname show vserver fcp show vserver fcp status vserver fcp wwpn-alias show vserver iscsi show vserver iscsi stats vserver iscsi status vserver nfs show vserver options vserver peer show volume efficiency show lun show reallocate show system capability clusterset show system capability show snapmirror get-volume-status snapmirror list-destinations snapmirror policy show snapmirror set-options snapmirror show snapmirror snapshot-owner show statistics show statistics start statistics stop |
- FC Supported OSes: ( netapp.com )
- Windows®, VMware, Solaris™, Oracle® Enterprise Linux®, Red Hat Linux, SUSE Linux, AIX, HP/UX, NetWare, and OpenVMS
- Verify Host Utility Kit installation
- HUK sets Timeouts
- HUK lets the SAN see basic OS side data (filesystem paths, etc)
- Verify SnapDrive Installation
- Allowed easy access to basic SAN functionality from the mounting OS. (Create snaps, mount volumes, create volumes)
- Read through “Setting up FCP on Clustered Ontap“
- Read through, information on OUI’s to identify Netapp (usually start with 5)
- 5_:__:__:__ (format of xA:AB:BC:C where A:A is 00, B:B is a:0, C:C is 9:8)
- x0:0a:09:8
- You need NPIV capable switches! (SAN Configuration Guide Page 16)
- portshow (brocade), switchshow (brocade, F_Port and VF_Port show NPIV),
- show npv status (cisco nx-os)
- Use WebTools gui, or “supportshow” command on CLI in a brocade
- Use “sh run” on a Cisco MDS
- “sh run” on most switches
- “sh cdp neighbor” to see what other devices are connected
1.2.5 Current zoning configuration
- On the NetApp: fcp adapter show
- On Netapp: system node run -node {nodename|local} fcp topology
- Brocade FOS common commands:
- zoneshow
- “Zone Info” in the WebTools GUI
- cfgshow
- Displays the ‘zoneset’
- portCfgShow
- Shows port configuration
- portshow
- Shows port status, including NPIV information
- portloginshow
- Displays port login status of devices attached to the specified port
- cfgActvShow
- Displays ACTIVE Zone configuration
- zoneshow
- Cisco MDS 9k command quick reference
- show zoneset active
- Displays the active zone set for each VSAN, including which devices have logged in and are communicating
- show zone
- Displays zone mappings
- show zone vsan X
- Displays zone mapping ONLY for vsan X
- show fcalias
- Displays alias mappings
-
show flogi database
-
Displays the devices that have logged into the fabric. Retrieve pWWNs for aliases and zoning from this database
-
-
show fcns database
-
Displays device name server registration information per VSAN
-
- show zoneset active
1.2.6 Current iSCSI implementation details
1.2.7 CHAP settings
1.2.8 IPSEC configuration details
1.2.9 Snapshot configuration details
1.2.10 Current data layout (aggregates, raid groups, volumes)
1.2.11 Consider listing out system names, IP addresses, current zoning configuration, OS
versions, OS patch levels, driver versions and firmware versions
1.3 Ensure that the solution design and the hardware provisioned do not fall short of the customer’s requirements and expectations.
1.3.1 Validate requirements with the customer. Consider the following:
1.3.1.1 Sizing needs
- Total Capacity, expected growth
- Bandwidth throughput
- Per end host and application
- Per SAN for all hosts
- Per SAN for backups
- For replication
- IOPs requirements
- Perform simple IOPs calculations per existing application and per existing san
- Look at daytime, backup time, and nightly processing IOPs differences
- Future needs
1.3.1.2 Connectivity needs
1.3.1.3 Zoning types
- single initiator zoning
1.3.1.4 Expected level of functionality
1.3.1.5 Performance requirements
1.3.1.6 Solution requirements being provided by a thirdparty
My NS0-504 Study Notes – 3 SCALABLE SAN IMPLEMENTATION AND CONFIGURATION TASKS
Please click here to goto the main NS0-504 Study Notes blog post to see all sections and additional information
3 SCALABLE SAN IMPLEMENTATION AND CONFIGURATION TASKS
3.1 Prepare site for installation.
3.1.1 Be able to review implementation flowchart with customer and assign task areas.
3.1.2 Verify site infrastructure including: dual power, floor space, floor loading plan, HVAC.
Sample cDot Site Survey Questions (not including networking) (from an cDot old Survey to Quote document)
Cabinets:
Questions to help get the equipment racked and powered properly.
- Does the customer plan on using NetApp Cabinets?
- If Yes, what PDUs does the customer want in the cabinets?
- What country will these racks be installed in?
- Will redundant power be able to be configured?
- If No, what is the height in RackU of the customer’s cabinets?
- Will customer provide redundant power for the equipment?
- If Yes, what PDUs does the customer want in the cabinets?
- Does the customer want NetApp to supply PDU-to-Head/Shelf power cords?
- If so, what length?
- If not, country-specific power cords will be included.
- Does the customer want NetApp Universal Rail kits?
- If so, 2 post or 4 post?
Cables:
Questions to help gauge cable lengths to connect cluster elements together.
- How does the customer plan on running cables between racks?
- Down, under the floor and back up?
- Up, through ladder racks/trays and back down?
- Through cabinet sides (not recommended)?
- What cable length(s) will be required?
- How will cabinets be set up on the datacentre floor?
- All adjacent with no gaps or other equipment in between?
- Separated by an aisle or other equipment?
- If not all adjacent, please build diagram of cabinet layout to facilitate cable length calculation with PS
Questions to help gauge SFPs and cable lengths to connect cluster to host/client side networks.
Clusters with NAS, iSCSI & FCoE protocols:
- What kind and quantity of Ethernet ports does the customer require?
- o 10GigE with optical SFP+
- o 10Gig CNA with optical SFP+
- o 10GigE bare cage
- o 10Gig CNA bare cage
- o 1GigE with optical SFP
- o 1GigE with RJ45 connector
- Does the customer want NetApp to supply cables for any of the above?
- If so, what length(s)?
- For bare cage 10GigE & 10GigE CNA, does the customer want copper 10Gig cables?
- If so, what length(s)?
Clusters with FC protocol:
- What kind and quantity of FC ports does the customer require?
- o 8Gbps with optical SFP
- o 4Gbps with optical SFP
- o 8Gbps bare cage
- o 4Gbps bare cage
- Does the customer want NetApp to supply cables for any of the above?
- If so, what length(s)?
- Read the Netapp Site Requirement guide
- Review the BTU and Ton conversion of the heat output of the controllers and disk shelves.
- Know the NEMA vs IEC power cables and voltage
- C13 – C14
- NEMA L5-15/L5-20
- C19-C20
3.1.3 Validate equipment move path to installation location.
- This sounds stupid, but I have seen racks fall over, or bust plastic wheels.
- Walk it!
3.1.4 Validate logistics plan for staging and installation of equipment.
- Will this be built in a lab room? Built in production rack? Etc.
3.1.5 Verify Ethernet cabling plan and availability of cable supports.
Valid 1gb Administration Switches
- Cisco 2960
- Netapp 1601 (may not have existed at time of test creation)
Valid 10gb Cluster Interconnect Switches
- Cisco 5010 – 12 or 18 node clusters
- Cisco 5020 – Up to 32 nodes (not like thats possible, realistically 24 nodes)
- Cisco 5548UP
- Cisco 5596UP – Up to 40 nodes
- Cisco CN1610 (rebranded Broadcom BCM53716-16FE or larger port count)
Sample cabling plan:
- Netapp CN1610 Cabling.
Overview Cabling Diagram
Sample Cabling Guide of a Flexpod – For illustration only. Dont use on modern production.
3.1.6 Verify fiber cabling plan and availability of cable supports.
3.2 Following the rack diagram, install systems and FC switches.
Example Rack Diagram
3.3 Storage System Configuration Tasks.
3.3.1 Data ONTAP 8.1.1 Cluster-Mode Setup Tasks
3.3.2 Storage Provisioning and Vserver Setup Tasks
- vserver create
- protocol configuration
- volume create
- Adding to namespace
- lun create
- NFS: Export policy creation
- Other tasks
- Lif Migrate
- ARL Aggregate Relocate
- DataMotion for Volumes
3.3.3 FC, FCoE, and iSCSI Connectivity Tasks
- We are almost always deploying a “switched fabric” with a core-edge topology with FC.
- Core-edge topology: In this design, storage is always put in the core, and hosts are always attached at the edge. This design is effective because SAN traffic flows are typically not peer to peer but instead many to one (hosts to storage). (Definition from Cisco MDS documentation)
- Edge-core-edge topology: This common design (storage edge to core to host edge) is used when a core-edge design provides insufficient scalability and an additional edge tier is needed to handle the large number of devices. (Definition from Cisco MDS documentation)
Topologies[/caption]
FC Cable comparison (because they always have annoying distance questions, not like we couldnt just google this when we need to)
Comparison (from Wikipedia)
| Category | Minimum modal bandwidth 850 nm / 1310 nm |
100 Mb Ethernet 100BASE-FX | 1 Gb (1000 Mb) Ethernet 1000BASE-SX | 10 Gb Ethernet 10GBASE-SR | 40 Gb Ethernet | 100 Gb Ethernet |
|---|---|---|---|---|---|---|
| OM1 (62.5/125) | 200 / 500 MHz·km | up to 2000 meters (FX) | 275 meters (SX) | 33 meters (SR) | Not supported | Not supported |
| OM2 (50/125) | 500 / – MHz·km | up to 2000 meters (FX) | 550 meters (SX) | 82 meters (SR) | Not supported | Not supported |
| OM3 (50/125) *Laser Optimized* | 1500 / 2000 MHz·km | up to 2000 meters (FX) | 550 meters (SX) | 300 meters (SR) | 100 meters330 meters QSFP+ eSR4 | 100 meters |
| OM4 (50/125) *Laser Optimized* | 3500 / 4700 MHz·km | up to 2000 meters (FX) | 1000 meters (SX) | 400 meters (SR) | 150 meters550 meters QSFP+ eSR4 | 150 meters |
Fibre Channel loop speeds/Distance from Siemons
| Connection Speed and Distance by Cable Category | ||
|---|---|---|
| Type | Speed | Distance |
| OM2 | 1Gb/s | 500m/1,640’ |
| OM3 | 1Gb/s | 500m/1,640’ |
| OM2 | 2Gb/s | 300m/900’ |
| OM3 | 2Gb/s | 500m/1,640’ |
| OM2 | 4Gb/s | 150m/492’ |
| OM3 | 4Gb/s | 270m/886’ |
| OM2 | 8Gb/s | 50m/1,64’ |
| OM3 | 8Gb/s | 150m/492’ |
| Twinax copper | 8Gb/s | 15m max’ |
- Optical for SAS between controller and shelves distances: The point-to-point (QSFP-to-QSFP) path of any multimode cable cannot exceed 150 meters for OM4 and 100 meters for OM3. Though this isnt supported on 8.1.1.
- Important note!: If you are using patch panels with a different thickness (62.5/125 instead of 50.125), you should match the patch panel fiber thickness to the end host or san. A transition between 62.5/125 and 50/125 may result in a possible loss of signal strength. Read this for more information. ( thefoa.org )
3.3.4 LUN Connectivity Tasks
- ALUA information for pathing preferences is gathered by the host sending scsi inquiry (or new
REPORT_TARGET_PORT_GROUPS) command. (From Netapp Knowledge Base)- The storage system implements four states for a LUN:
- Active/Optimized
- Active/Non-Optimized
- Unavailable
- Transitioning
- These map to the following existing Data ONTAP terms:
- Local/Fast/Primary
- Partner/Proxy/Slow/Secondary
- Cluster IC is down, path is not functional
- Path is transitioning to another state
- The storage system implements four states for a LUN:
3.3.5 Configure FC and Ethernet switches
- Eth Switch Config
- Cisco Nexus 5000 vPC Best Practice (Not sure if they will ask about the 50×0 or the 5548/96 based off the 8.1.1 dates or even their own co-branded switches. Remember, Netapp was switching to different $1 interconnect switches at the time of exam creation)
- Cisco Enhanced vPC Guide
- Cabling the CN1610 Interconnect Switches
- Direct link to Switch zoning from Cisco Design Guide
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 |
# Cisco Nexus are typically configured in Pairs, and the configurations are mirrored between each other. #Important Netapp Related Switch config settings: #Enable LACP link aggregation feature lacp # Enable vPC ( Virtual Port Channel aka Multichassis LACP ) feature vpc # Add QoS (Quality of Service) Rules for FCoE to get very high priority and not drop class-map type qos class-fcoe class-map type queuing class-fcoe match qos-group 1 class-map type queuing class-all-flood match qos-group 2 class-map type queuing class-ip-multicast match qos-group 2 class-map type network-qos class-fcoe match qos-group 1 class-map type network-qos class-all-flood match qos-group 2 class-map type network-qos class-ip-multicast match qos-group 2 #And also to globally enable jumbo frames policy-map type network-qos jumbo class type network-qos class-default mtu 9216 multicast-optimize # Tell the system to use the above QoS junk system qos service-policy type network-qos jumbo service-policy type queuing input fcoe-default-in-policy service-policy type queuing output fcoe-default-out-policy service-policy type qos input fcoe-default-in-policy # Make some VLANs vlan 301 name VMOTION vlan 401 name IP_STORAGE vlan 402 name IP_STORAGE_ISCSI # Configure the VPN domain ID both switches will have configured, and where the other guy is to check it's heartbeat vpc domain 2 role priority 100 peer-keepalive destination 192.168.254.2 source 192.168.254.1 peer-config-check-bypass peer-gateway # Define a Port Channel for each filer, and tag it for the vpc ID each switch will use so they know these are one virtual port channel across each switch interface port-channel130 description ha-cdot-02 switchport mode trunk switchport trunk allowed vlan 2-3967,4048-4093 speed 10000 vpc 130 interface port-channel131 description ha-cdot-01 switchport mode trunk switchport trunk allowed vlan 2-3967,4048-4093 speed 10000 vpc 131 # Assign the port-channel to the 10gb interfaces interface Ethernet1/18 description ha-cdot-02 switchport mode trunk switchport trunk allowed vlan 2-3967,4048-4093 channel-group 130 mode active interface Ethernet1/20 description ha-cdot-02 switchport mode trunk switchport trunk allowed vlan 2-3967,4048-4093 channel-group 131 mode active |
- Brocade FC Zoning
- Zoning a Brocade Switch with WEBtool (Video)
- Zoning a Brocade Switch with the CLI (Video)
- How to Zone a Brocade SAN Switch
- Brocade Fabric OS Administration Guide, (FOS) Read Chapters 1 11 and 15 (Get your hands on a Brocade 320 or an older 4000 to practice zoning)
- Brocade’s Default Fabric ID=1. (This is sort of like a unsetup Cisco switch is vlan 1 everywhere, be weary of connecting 2 brocades both with fabric 1 if trying to get fabric redundancy)
- So change the Fabric ID:
- switchDisable (This will stop traffic, do it before you begin!!)
- configure (change the fabric ID)
- switchEnable
- So change the Fabric ID:
3.3.6 Host Configuration Tasks
- Verify HBA/CNA Driver and Firmware to OS and Netapp Host Utilities and Snapdrive in the Support Matrix
- Install NetApp Host Utilities
- Install SnapDrive
- SAN HBA Management Utilities
- Emulex: HBAnywhere (or newer OneCommand)
- qLogic SAN Surfer
3.3.7 Virtualized Environment/Platforms: SAN Best Practices.
3.3.8 FCoE and Unified Connect Enabling Technologies
- Relies on DataCenter Bridging (DCB)
- Data center bridging (DCB) is a collection of extensions to the existing Ethernet standard that provides a lossless transport layer for FCoE traffic.
- Per-priority pause (priority-based flow control)
- Enables a device to only inhibit the transmission of frames based on user-defined priorities.
- Enhanced transmission selection
- Allows administrators to allocate bandwidth on a percentage basis to different priorities.
- Congestion notification
- Transmits congestion information.
- DCB Exchange (DCBX) protocol
- Exchanges connection information with directly connected peers and detects misconfigurations.
- Per-priority pause (priority-based flow control)
- SAN Admin Guide Troubleshooting – Page 70-71 is a great resource for seeing this in action
- Default priorities is 3 for FCoE traffic & 50% Bandwidth
- Page 20 of TR3894 states this.
- Default priority is 0 for IP traffic.
- Default priorities is 3 for FCoE traffic & 50% Bandwidth
- Data center bridging (DCB) is a collection of extensions to the existing Ethernet standard that provides a lossless transport layer for FCoE traffic.
3.3.9 FCoE and Unified Connect Hardware
3.3.10 FCoE and Unified Connect Configuration
To move:
- Must read: FCoE End to End Deployment (TR-3800 Older – 2011, w/ Qlogic)
- Configuring CNA/UTA Ports
- ucadmin
- fcp config
- FCoE Overview for Clustered Ontap
- FC and FCoE Zoning
- Best practices and recommendations
- Netapp recommends “Single Initiator Zoning”
- A zone should include a SINGLE INITIATOR and ALL Targets the initiator is connecting to.
- Zoning should be based on World Wide Port Name (wwpn)
- Change an HBA card, update the zone. Change a server, update the zone.
- 50/125 Recommended.
- Short Wave SFPs required to connect to onboard FC.
- Should be used when you have 4 or more hosts connected (really always)
- Orange cable typically OM2. “Laser Optimized” needed for short length 10gb.
- OM3 and OM4 are cyan (blue), recommended for 8gb FC, 10GB eth.
- Netapp recommends “Single Initiator Zoning”
- Best practices and recommendations
- Why Zone?
- Reduces CROSS TALK between initiator HBAs
- Reduces paths to an available port
- Increases Security
- Shortens troubleshooting times
- Zoning
My NS0-504 Study Notes – NetApp Definitions
Commonly used definitions according to Netapp (Taken from the TR-4056 – Best Practices with Exchange and Cluster Mode)
Click to continue reading “My NS0-504 Study Notes – NetApp Definitions”
My NS0-504 NCIE-SAN Cluster Mode Study Notes
I need to renew my NCIE-SAN Cluster Mode NS0-504 this year, so I figure NetApp Insight 2014 is the place to do it. Why? Because it’s free Yo!
Much of this I already know, but to error on the side of caution, and not be too overconfident, I will be stepping through as many of the Study Guide lists as possible. Doing some hands on examples.
Click to continue reading “My NS0-504 NCIE-SAN Cluster Mode Study Notes”
Thoughts on Certifications (aka I passed my CCNP DataCenter)
6 required exams. 21 days.
I didn’t make a large hoopla when I passed my CCNP Datacenter and CCNA Datacenter last week. I’ve always wanted to be Cisco certified. Though, I always felt anything but CCIE was sort of bunk. (still do, though I have met MANY incapable CCIE) I’m no smarter today. I’m no better of an engineer today. The only thing I know better today, is where a few documents are. I’ve been using the Nexus product line since the 5010’s first came out a few years ago. I play with 5548s in customer environments from time to time, same with 6248 FIs.
Click to continue reading “Thoughts on Certifications (aka I passed my CCNP DataCenter)”
TIP #7: Using Netapp simulators to prepare for NCDA/NCIE exam
I am pretty active on LinkedIn with the NetApp groups there, and newbie NetApp admins are asking quite often lately about the NCDA exam.
Here are some helpful things to try out on the simulator. Every netapp admin should know them.
Click to continue reading “TIP #7: Using Netapp simulators to prepare for NCDA/NCIE exam”
