Configuring SRE-V

Version 1
    This document was generated from CDN thread

    Created by: Nachiket Deshpande on 20-11-2010 01:33:56 AM
    Hi,
     
    I'm trying to setup a new SRE-V here, and am running into these problems:
    1. I have the IOS side configured completely, except for the mgf ip address and default gateway. After configuring that to an address different from the one assigned to the SM, I still see the error where the MGF n/w fails to start:
     
    Running cisco-agent start
    cisco-agent: Trying to reach hostd...
    cisco-agent: Verifying Cisco MgmtVM H/G vSwitch & portgroup
    cisco-agent: Verifying Cisco MgmtVM network
    cisco-agent: Verifying Cisco MGF network
     
    I tried multiple resets, but it does not get past this stage.
     
    2. I tried running "switchport mode ?" to set the VLAN on the router, but the command does not exist. I have downloaded and installed the 3945 image from the beta testers section, and it seems to be installed on the 3945:
     
    3945-GW#sh version
    Cisco IOS Software, C3900 Software (C3900-UNIVERSALK9-M), Experimental Version 15.1(20100818:162633) [ssamant-t_base_1_0818 131]
    Copyright (c) 1986-2010 by Cisco Systems, Inc.
    Compiled Thu 19-Aug-10 00:33 by ssamant
     
    Am I running the right version?
     
    Thanks,
     
    Nash

    Subject: RE: New Message from Nachiket Deshpande in Service Ready Engine Virtualizat
    Replied by: Radhika Miriyala on 20-11-2010 01:33:56 AM
    Hi Nash,

    Can you please give us the output of the following

    1)      ¿show running-config¿ CLI from the router.

    2)      Do you happen to have any other modules on the router like HWIC? Can you give the list of these modules.

    3)      Status of the service module using the CLI ¿service-module sm x/0 status¿



    Thanks,

    Radhika

    Subject: RE: Configuring SRE-V
    Replied by: Nachiket Deshpande on 20-11-2010 01:33:56 AM
    Hi Radhika
     
    I do not have any other modules/HWIC's.
    I did a reset once more, after changing the MGF ip to another address, and it seems to move ahead. However, now I am unable to session in into the module at all.
     
    Here's the sh run output:
     
    3945-GW#sh run
    Building configuration...


    Current configuration : 2185 bytes
    !
    ! Last configuration change at 23:47:42 UTC Fri Sep 17 2010
    !
    version 15.1
    service timestamps debug datetime msec
    service timestamps log datetime msec
    no service password-encryption
    !
    hostname 3945-GW
    !
    boot-start-marker
    boot system flash c3900-universalk9-mz.SSA.T_BASE_1_20100819
    boot-end-marker
    !
    !
    enable password lab
    !
    no aaa new-model
    !
    no ipv6 cef
    ip source-route
    ip cef
    !
    !
    !
    !
    !
    ip domain list bco-eng.cisco.com
    ip domain name cisco.com
    ip name-server 10.94.148.13
    multilink bundle-name authenticated
    !
    !
    !
    !
    !
    crypto pki token default removal timeout 0
    !
    !
    voice-card 0
    !
    !
    !
    !
    !
    !        
    !
    license udi pid C3900-SPE150/K9 sn FOC14176RVN
    hw-module pvdm 0/0
    !
    hw-module sm 1
    !
    hw-module sm 2
    !
    hw-module sm 4
    !
    !
    !
    !
    redundancy
    !
    !
    !
    !
    !
    !
    interface GigabitEthernet0/0
     ip address 10.94.150.187 255.255.255.0
     duplex auto
     speed auto
    !
    interface GigabitEthernet0/1
     no ip address
     shutdown
     duplex auto
     speed auto
    !
    interface GigabitEthernet0/2
     no ip address
     shutdown
     duplex auto
     speed auto
    !
    interface SM4/0
     ip unnumbered GigabitEthernet0/0
     service-module ip address 10.94.150.237 255.255.255.0
     !Application: SRE-V Running on SMV
     service-module ip default-gateway 10.94.150.187
     service-module mgf ip address 10.94.170.237 255.255.255.0
     service-module mgf ip default-gateway 10.94.170.1
     hold-queue 60 out
    !
    interface SM4/1
     description Internal switch interface connected to Service Module
     shutdown
    !
    interface Vlan1
     no ip address
    !
    ip default-gateway 10.94.150.1
    ip forward-protocol nd
    !
    no ip http server
    no ip http secure-server
    !
    ip route 0.0.0.0 0.0.0.0 10.94.150.1
    ip route 10.94.150.237 255.255.255.255 SM4/0
    !
    !
    nls resp-timeout 1
    cpd cr-id 1
    !
    !
    control-plane
    !
    !
    !
    !
    mgcp profile default
    !
    !
    !
    !
    !
    gatekeeper
     shutdown
    !
    !
    !
    line con 0
     stopbits 1
    line aux 0
    line 259
     no activation-character
     no exec
     transport preferred none
     transport input all
     transport output pad telnet rlogin lapb-ta mop udptn v120 ssh
     stopbits 1
     flowcontrol software
    line vty 0 4
     password lab
     logging synchronous
     login
     transport input all
    line vty 5 15
     password lab
     login
     transport input all
    !
    exception data-corruption buffer truncate
    scheduler allocate 20000 1000
    end

    3945-GW#
    [Resuming connection 1 to 10.94.150.187 ... ]
    se-10-94-150-237#
    se-10-94-150-237#
    3945-GW#service-module SM 4/0 reset  
    Use reset only to recover from shutdown or failed state
    Warning: May lose data on the the NVRAM, nonvolatile file system or unsaved configuration!
    Do you want to reset?
    Trying to reload Service Module SM4/0.

    3945-GW#
    [Resuming connection 1 to 10.94.150.187 ... ]




    Initializing memory #1. Please wait...




    Initializing memory #2. Please wait...


    This may take a minute....


     Serial ATA Port 0 : Hitachi HTE545050B9A300                
     Serial ATA Port 1 : Hitachi HTE545050B9A300                
    DDR Memory 8192 MB detected
    Intel(R) Core(TM)2 Duo CPU     L9400  @ 1.86GHz
    BIOS SM 3.52.6,  BIOS Build date: 08/03/2010

    Intel(R) Core(TM)2 Duo CPU     L9400  @ 1.86GHz
    BIOS SM 3.52.6,  BIOS Build date: 08/03/2010
    System now booting...

     
    Please wait... 

    Please press P to select Primary Boot Loader ...  
              or S to select Secondary Boot Loader ...  
              or wait to boot from default configuration ...  

    .......................................................................................................
    SRE module get located and run....  

    Now booting from secondary boot loader....  


    Authenticating boot loader....  


    Secondary Boot Loader authenticated - booting....  



    Please enter '***' to change boot configuration:

    Detect and Initialze network device


    Backup current platform configurations....

    SRE step 1 - SM registration...

    Response - no installation needed (len: 422)

    SRE Installation Not Needed


    Restoring orignial configuration...

    Updating flash with bootloader configuration.
    Please wait .................. done.
    got meta list size: 3, 49, 96, 613
    Verifying ... done.
    Starting Kernel.

    Starting VMKernel initialization ...
    Initializing memory ...
    Initializing chipset ...
    Initializing timing ...
    Initializing scheduler ...
    Initializing device support ...
    Initializing processors ...
    Initializing interrupts ...
    Initializing IOV ...
    Initializing chipset IOAPIC ...
    Enabling interrupts ...
    Initializing ACPI ...
    Initializing Power Management ...
    VMKernel loaded successfully.

    Loading module procfs ...
    procfs loaded successfully.

    Loading module vmkapiv1_0_0_0_vmkernel_shim ...
    vmkapiv1_0_0_0_vmkernel_shim loaded successfully.

    Loading module vmklinux ...
    vmklinux loaded successfully.

    Loading module random ...
    random loaded successfully.

    Loading module usb ...
    usb loaded successfully.

    Loading module ehci-hcd ...
    ehci-hcd loaded successfully.

    Loading module usb-uhci ...
    usb-uhci loaded successfully.

    Loading module hid ...
    hid loaded successfully.

    Loading module dm ...
    dm loaded successfully.

    Loading module nmp ...
    nmp loaded successfully.

    Loading module vmw_satp_local ...
    vmw_satp_local loaded successfully.

    Loading module vmw_satp_default_aa ...
    vmw_satp_default_aa loaded successfully.

    Loading module vmw_psp_lib ...
    vmw_psp_lib loaded successfully.

    Loading module vmw_psp_fixed ...
    vmw_psp_fixed loaded successfully.

    Loading module vmw_psp_rr ...
    vmw_psp_rr loaded successfully.

    Loading module vmw_psp_mru ...
    vmw_psp_mru loaded successfully.

    Loading module vmw_psp_fixed_ap ...
    vmw_psp_fixed_ap loaded successfully.

    Loading module vmw_satp_alua ...
    vmw_satp_alua loaded successfully.

    Loading module vmw_satp_cx ...
    vmw_satp_cx loaded successfully.

    Loading module libata ...
    libata loaded successfully.

    Loading module usb-storage ...
    usb-storage loaded successfully.

    Loading module vfat ...
    vfat loaded successfully.

    Loading module mask_path_plugin ...
    mask_path_plugin loaded successfully.

    Loading module vaai_filter ...
    vaai_filter loaded successfully.

    Loading module vmw_vaaip_emc ...
    vmw_vaaip_emc loaded successfully.

    Loading module vmkapiv1_0_0_0_nmp_shim ...
    vmkapiv1_0_0_0_nmp_shim loaded successfully.

    Loading module vtddmar ...
    vtddmar loaded successfully.

    Loading module vmci ...
    vmci loaded successfully.

    Loading module iscsi_trans ...
    iscsi_trans loaded successfully.

    Loading module hub ...
    hub loaded successfully.

    Loading module netsched ...
    netsched loaded successfully.

    Loading module e1000e ...
    e1000e loaded successfully.

    Loading module bnx2 ...
    bnx2 loaded successfully.

    Loading module cnic ...
    cnic loaded successfully.

    Loading module iscsi_linux ...
    iscsi_linux loaded successfully.

    Loading module bnx2i ...
    bnx2i loaded successfully.

    Loading module ata_piix ...
    ata_piix loaded successfully.

    Loading module lvmdriver ...
    lvmdriver loaded successfully.

    Loading module deltadisk ...
    deltadisk loaded successfully.

    Loading module multiextent ...
    multiextent loaded successfully.

    Loading module dvsdev ...
    dvsdev loaded successfully.

    Loading module etherswitch ...
    etherswitch loaded successfully.

    Loading module shaper ...
    shaper loaded successfully.

    Loading module cdp ...
    cdp loaded successfully.

    Loading module tcpip3 ...
    tcpip3 loaded successfully.

    Loading module dvfilter ...
    dvfilter loaded successfully.

    Loading module vmkapiv1_0_0_0_dvfilter_shim ...
    vmkapiv1_0_0_0_dvfilter_shim loaded successfully.

    Loading module vmkibft ...
    vmkibft loaded successfully.

    Loading module vmfs3 ...
    vmfs3 loaded successfully.

    Loading module nfsclient ...
    nfsclient loaded successfully.

    Loading module vmkstatelogger ...
    vmkstatelogger loaded successfully.

    Loading module migrate ...
    migrate loaded successfully.

    Loading module cbt ...
    cbt loaded successfully.

    Loading module spi ...
    spi loaded successfully.

    Running ntpd start
    Running DCUI start
    Running vprobed start
    Running vobd start
    Running storageRM start
    Running sensord start
    Running lbtd start
    Running hostd start
    Running slpd start
    Running wsman start
    Running usbarbitrator start
    Running sfcbd-watchdog start
    Running cisco-agent start
    cisco-agent: Trying to reach hostd...
    cisco-agent: Verifying Cisco MgmtVM H/G vSwitch & portgroup
    cisco-agent: Verifying Cisco MgmtVM network
    cisco-agent: Verifying Cisco MGF network
    cisco-agent: Starting Cisco MgmtVM
    cisco-agent: Waiting for Cisco MgmtVM (1).
    cisco-agent: Restore default Cisco MgmtVM.
    cisco-agent: Waiting for Cisco MgmtVM (2).
    cisco-agent: Waiting for Cisco MgmtVM (3).
    cisco-agent: Cisco MgmtVM is booting up.

      Booting 'Cisco Management VM'

    root (hd0,0)
     Filesystem type is reiserfs, partition type 0x83
    kernel /bzImage root=/dev/sda1 ro plat=smv console=ttyS0,115200 quiet
       [Linux-bzImage, setup=0x1400, size=0x180598]
    initrd /initrd
       [Linux-initrd @ 0xb390000, 0xcf527 bytes]

    Platform: smv
    Red Hat nash version 4.1.18 starting
    Mount /proc
    sd 0:0:0:0:  Assuming drive cache: write through
    sd 0:0:0:0:  Assuming drive cache: write through
    mknod --mode=600 /sysroot/dev/vmci c 254 0 - -1
    mknod --mode=666 /sysroot/dev/vsock c 10 63 - -1
    Verifying application level programs
    Debug version of cisco_init, no reboot upon verification failure!
    Application level programs verification OK!
    INIT: version 2.86 booting
    mounting proc fs ...
    mounting sys fs ...
    mounting /dev/shm tmpfs ...
    reiser root fs ...
    Remounting the root filesystem read-only...
    Reiserfs super block in block 16 on 0x801 of format 3.6 with standard journal
    Blocks (total/free): 124480/90900 by 4096 bytes
    Filesystem is clean
    Filesystem seems mounted read-only. Skipping journal replay.
    Checking internal tree..finished

    FILESYSTEM CLEAN
    Remounting the root filesystem read-write...

    kernel.sem = 1900 4000 32 100
    vm.overcommit_memory = 1


            Welcome to Cisco Service Engine

    Setting the system time from hardware clock

    ********** rc.aesop ****************
    Populating resource values from /etc/smv_rsrc_file
    Populating resource values from /etc/default_rsrc_file
    Populating resource values from /usr/etc/products/galactica/default_rsrc_file
    Populating resource values from /usr/etc/products/galactica/smv_rsrc_file
    Bring up hgNet interface eth2.
    Validating hgNet connection...link is ready.
    Processing manifests . . . . . . . . . . . complete
    ==> Management interface is eth0
    ==> Management interface is eth0
    Waiting for IOS to register IP address.
     - waited 10 seconds...
    Waiting for IOS to register IP address.
     - waited 20 seconds...
    Waiting for IOS to register IP address.
     - waited 30 seconds...
    Waiting for IOS to register IP address.
     - waited 40 seconds...
    Waiting for IOS to register IP address.
     - waited 50 seconds...
    Waiting for IOS to register IP address.
     - waited 60 seconds...

    Serial Number: FOC14051AF0
    Mount host directories.
    Filesystem            Size  Used Avail Use% Mounted on
    INIT: Entering runlevel: 2
    ********** rc.post_install ****************
    INIT: no more processes left in this runlevel
    INIT: Switching to runlevel: 4
    STARTED: dwnldr_startup.sh
    STARTED: HTTP_startup.sh
    STARTED: probe
    STARTED: fndn_udins_wrapper
    STARTED: superthread_startup.sh

     Waiting 158 ...


    SYSTEM ONLINE
    se-10-94-150-237#
    se-10-94-150-237#
     
    (It is stuck at this point) - I cannot enter / type anything at the prompt here.
     
    Also,
    3945-GW#service-module SM 4/0 status
    Service Module is Cisco SM4/0
    Service Module supports session via TTY line 259
    Service Module is in Steady state
    Service Module heartbeat-reset is enabled
    Getting status from the Service Module, please wait..
    Cisco SRE-V Software 1.0.0.19
    SRE-V Running on SMV
    No install/uninstall in progress

    Local Partition Info - (0 apps)
    =====================
      Retrieving partition information
     
    My module is accessible at:
     
    telnet 10.94.150.187
    password: lab
    SM is 4/0.
     
    Thanks!

    Subject: RE: New Message from Nachiket Deshpande in Service Ready Engine Virtualizat
    Replied by: Radhika Miriyala on 20-11-2010 01:33:56 AM
    Nash,

    I am taking a look at the system now.  I will get back to you soon.

    Thanks,

    Radhika

    Subject: RE: New Message from Nachiket Deshpande in Service Ready Engine Virtualizat
    Replied by: Radhika Miriyala on 20-11-2010 01:33:56 AM
    Nash,

    A couple of things your configuration was missing configuration they are

    1)       for the vlan 1 (should be in same subnet as MGF) and should be up.

    2)      The interface sm 4/1 was also shutdown.

    3)       There was also no IP route configured for the sm 4/0 (needed as you are using ip unnumbered on the sm 4/0 interface)



    I configured these now but the module is still getting seeing the waiting for IOS messages during boot up and the CLI does not  respond once it boots up. I think you may be  running into one of the bugs that was in the build 1.0.0.19 posted on the beta forum though the symptom you are seeing is a little different the root cause could be the same..



    We will be posting a new image to the beta forum that has a fix  for some of the issues. Since you are starting now I would suggest you wait for that image to be posted on Monday and use that for testing as you will get a more stable build.



    If you would like to use this image right now I would suggest doing a SRE install again with all the correct configurations on the IOS.



    Let me know if you have any concerns or questions.



    Thanks,

    Radhika

    Subject: RE: New Message from Radhika Miriyala in Service Ready Engine Virtualizatio
    Replied by: Radhika Miriyala on 20-11-2010 01:33:57 AM
    One other thing you could do before trying a new install is power cycling the router and see if that fixes the issue.



    From: Cisco Developer Community Forums [mailto:cdicuser@developer.cisco.com]
    Sent: Friday, September 17, 2010 6:05 PM
    To: cdicuser@developer.cisco.com
    Subject: New Message from Radhika Miriyala in Service Ready Engine Virtualization - SRE-V Beta Testing: RE: New Message from Nachiket Deshpande in Service Ready Engine Virtualizat



    Radhika Miriyala has created a new message in the forum "SRE-V Beta Testing":
    --------------------------------------------------------------
    Nash,

    A couple of things your configuration was missing configuration they are

    1) for the vlan 1 (should be in same subnet as MGF) and should be up.

    2) The interface sm 4/1 was also shutdown.

    3) There was also no IP route configured for the sm 4/0 (needed as you are using ip unnumbered on the sm 4/0 interface)



    I configured these now but the module is still getting seeing the waiting for IOS messages during boot up and the CLI does not respond once it boots up. I think you may be running into one of the bugs that was in the build 1.0.0.19 posted on the beta forum though the symptom you are seeing is a little different the root cause could be the same..



    We will be posting a new image to the beta forum that has a fix for some of the issues. Since you are starting now I would suggest you wait for that image to be posted on Monday and use that for testing as you will get a more stable build.



    If you would like to use this image right now I would suggest doing a SRE install again with all the correct configurations on the IOS.



    Let me know if you have any concerns or questions.



    Thanks,

    Radhika

    Subject: RE: New Message from Radhika Miriyala in Service Ready Engine Virtualizatio
    Replied by: Nachiket Deshpande on 20-11-2010 01:33:57 AM
    Hi Radhika
     
    Thanks for all the configuration help!
    I sessioned in, and surprisingly, the CLI is responsive. I can get to linux shell and everything.
    Will try out the next steps now (hypervisor-related).
     
    -Nash

    Subject: RE: New Message from Nachiket Deshpande in Service Ready Engine Virtualizat
    Replied by: Radhika Miriyala on 20-11-2010 01:33:57 AM
    Glad I could help.

    Subject: RE: New Message from Nachiket Deshpande in Service Ready Engine Virtualizat
    Replied by: Nachiket Deshpande on 20-11-2010 01:33:57 AM
    I have some additional questions.
    I configured users and roles on the module, and I am able to SSH into it just fine from my machine.
     
    However, vCenter is unable to add it as a host.
    I tried both addresses: 10.94.150.237
    10.94.170.237 (which is configured as the mgf ip address).
     
    Which address is the right one? We would like to be able to add it as the 150 subnet one, since all our existing hosts reside on the 150 subnet.
     
    Is there some configuration I might be missing?
     
    Thanks,
     
    Nash

    Subject: RE: New Message from Nachiket Deshpande in Service Ready Engine Virtualizat
    Replied by: Radhika Miriyala on 20-11-2010 01:33:57 AM
    Nash,

    Vcenter support is not present with this release. You can use Vsphere client. The hypervisor address is the one assigned to the mgf. So in your case that would be 10.94.170.237

    Thanks,

    Radhika