Total Pageviews

MDS Blogs

Please visit
http://mds9000.blogspot.com for
MDS Config and Troubleshooting Info.

-jerome.jsph@gmail.com

UCS Config -Disclaimer

Please note that this is just a lab recreation and documentation, this is no way replaces official manual and best pratice documentations

Wednesday, May 26, 2010

Palo_PTS1


 

Document Used : vMWare-PTS.pdf by Manish Tandon. (http://www-tac-sj.cisco.com/~jejoseph/SAN/UCS/vMware-PTS.pdfhttp://zed.cisco.com/confluence/images/icons/linkext7.gif )

Internal to Cisco

VN-link in hardware is a vDS for VMWare using same vDS framework as Nexus1000v and available on UCS.
VEM exists on ESX server providing PTS functionality, while UCSM acts like VSM providing management plane.

1. Export Vcenter Extension and save it . http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%201.32.58%20PM.png
2. Install UCSM Extension in vCenter:

http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%201.36.39%20PM.png
 

3.This is how Vcenter Plugin will look after UCSM Extension installation

http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%201.37.44%20PM.png
 
 4. Creation of Datacenter/Folders inhttp://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%201.41.45%20PM.png vCenter:

 a. Create a DataCenter PTS-DC
5. Creation of UCSM PTS Switch:

A.
http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%201.45.12%20PM.png
B: SKIP FOLDER AND CREATE DATACENTER PTS-DC , SAME NAME AS IN VCENTER http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%201.47.35%20PM.png
 

C:CREATE FOLDERS TO PUT VSWITCHES: http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%201.50.01%20PM.png
 
D: Create DVSs:(click on it and put in enable)

 
http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%201.51.39%20PM.png 

E: Verify in FSM tab: http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%201.56.14%20PM.png
 F: Verify in vcenter:

http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%201.55.02%20PM.png
 
 
6.CREATE PORT PROFILES:

a. for clean net
http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%201.58.27%20PM.png
 

b. second port profile for second vlan:  ( please select native vlan , I missed here, if 143 needs to get tagged   or OS has to tag it or default native vlan in 6120 is vlan 143.

(by default native vlan is 1)


http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%201.59.36%20PM.png
 these vlans already trunked up and present in UCSM LAN tab for other blades without PTS.

7. Port Profile has to be exported to vcenter.

Create port profile client for the port profile http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%202.03.30%20PM.png
 
Same for second port profile - create PC
 
http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%202.05.02%20PM.png
 
Now the port profile added vswitch in UCSM:
 

 


Palo_PTS2

 
http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%202.05.48%20PM.png
 
 
  Verify in Vcenter: http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%202.07.17%20PM.png
 
 

8.Installing the Palo Card: http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%202.09.55%20PM.png
 

9. Enable static 2 VNICs and HBAs if needed on PALO
http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%202.12.20%20PM.png
 
10 Enable Directed I/O n BIOS

http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%202.22.43%20PM.png
 
 11. Create Dynamic Vnic policy: total # of vnics = (number of uplinks between IOM and FI * 15) -2 ==

for one uplink , it will be 15 -2 =13 and also 2 VHBAs , so 13 -2 =11. http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%202.28.06%20PM.png
 
12. Associate the Dynamic Vnic policy to Service Profile (SP change will reboot the server)
http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%202.30.05%20PM.png
http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%202.46.45%20PM.png
 
13.Install ESX server 4.0

14. Enable ssh root access on ESX server and install VEM.

Tricky part to find right vem, and also use vumupdate.


http://172.25.182.88/http://zed.cisco.com/confluence/images/icons/linkext7.gif has the list of VEM and appropriate "vmware -v" version. http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-05%20at%202.37.19%20PM.png
 

15.

[root@localhost ~]# vmware -v
VMware ESX 4.0.0 build-208167
[root@localhost ~]# esxupdate -b cross_cisco-vem-v110-4.0.4.1.2.0.80-1.9.179-release.vib update --nosigcheck
cross_cisco-vem-v110-4.0.4.1... ######################################## [100%]

Unpacking cross_cisco-vem-v11.. ######################################## [100%]

Installing cisco-vem-v110-esx   ######################################## [100%]

Running [/usr/sbin/vmkmod-install.sh]...
ok.

 [root@localhost ~]# vmkload_mod -l |grep vem
vem-v110-svs-mux    0x4180320b1000    0x8000      0x417ff2e116c0    0x1000        56 Yes    
vem-v110-pts        0x4180320b9000    0xd000      0x417ff2e12ee0    0x1000        57 Yes   

16. Register the ESX host in Vcenter under specific DATACENTER/CLuster as per the requirement. http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-06%20at%2012.34.44%20PM.png
 
Add License:Enterprise License is required.--- Assign an enterprise license key....

 

17. Add STratic Vnics to VEM http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-06%20at%2012.37.45%20PM.png
 

19.

This adds the host to DVS and makes Service console /Network Adapters part of DVS
 

 


Palo_PTS3

17. Add STratic Vnics to VEM http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-06%20at%2012.37.45%20PM.png
 

19.

This adds the host to DVS and makes Service console /Network Adapters part of DVS
http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-06%20at%2012.39.11%20PM.pnghttp://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-06%20at%2012.41.47%20PM.png
 
http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-06%20at%2012.44.05%20PM.png
 
 http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-06%20at%2012.44.43%20PM.png
 
 
http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-06%20at%2012.45.40%20PM.png
 
 
now it moves to DVS from Vswitch on Networking for that host
 
http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-06%20at%2012.47.14%20PM.png
 
On UCSM, you can ESX server added to VSWITCH (DVS) and has a ServiceConsole  VNIC
 
http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-06%20at%2012.50.49%20PM.png
 
20. Add a VM ....
 http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-06%20at%2012.52.00%20PM.png
 
adding second nic to internal Net (143 VLAN) to the same VM.
http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-06%20at%2012.53.07%20PM.png
 
 Power on VM
 
and on UCSM , you will see vnics (one vlan 182 and other vlan 143) created and online for RHEL Virtual Machine

 
http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-06%20at%2012.56.02%20PM.png
 
http://zed.cisco.com/confluence/download/attachments/380808801/Screen%20shot%202010-05-06%20at%2012.57.19%20PM.png
 
 
Install OS on the RHEL Virtual Machine from Virtual Center, you will see two NICs on the RHEL Guest OS.
 

nxos-b:(show int br)
veth993       143    eth  trunk  up      none                        10G(D) --
UCS1-FI-A(nxos)# show int br | inc 994
veth994       143    eth  trunk  up      none                        10G(D) --

UCS1-FI-B(nxos)# show int br | inc 996
veth996       182    eth  trunk  up      none                        10G(D) --

---------

 Unconfiguring:

1. Shutdown the Virtual machine - remove the both network interfaces that use the DVS port profile

2. In Networking of ESX server ->Go  to DVS ->Manage phy. adapter

3. Remove one of the adapters  and add that interface to vswitch with service console.

4. Go to DVS (manage virtual adapters) - virtual interface and remove vswif0 or migrate to Virtual switch.

5. Remove the other adapter from DVS. (physical)

6. Now DVS has no phy adapter or Service console configured.

7. Inventory -->Networking and remove the ESX from the DVS
 

8. Disable DVS PTS_vswitch

 9. Go to UCSM, remove port profiles from Profile Client ( it might take time to disab;e)

DATA_PROFILE_182 used by some virtual machines :ERROR:
 

From Vsphere Clinet -- some active objects are there.

10. Service profile -remove dynamic vnic config

and this will reboot the server.

11. Now Data_Profile PC can be deleted.

12. Delete the Data Center from UCSM and also VC

13. Delete the Virtual Center from VM tab in UCSM.

14. delete port profiles if u want.

 


Followers