VSAN 6.2

VMware VSAN 6.2 Performance & Storage savings

Chan 4 Comments

Just a quick post to share some very interesting performance stats observed on my home lab VSAN cluster (Build details here). The VSAN datastore is in addition to a few NFS datastores also mounted on the same hosts using an external Synology SAN.

I had to build a number of Test VMs, a combination of Microsoft Windows 2012 R2 Datacenter and 2016 TP4 Datacenter VMs on this cluster and I placed all of them on the VSAN datastore to test the performance. See below the storage performance stats during the provisioning (cloning from template) time. Within the Red square are the SSD drive performance stats (where the new VM’s being created) Vs Synology’s NFS mount’s performance  stats (where templates resides) in the Yellow box.

Provisioning Performance

Pretty impressive from all Flash VSAN running on a bunch of white box servers with consumer grade SSD drives (officially unsupported of course but works!), especially relative to the performance of the Synology NFS mounts (RAID1/0 setup for high performance), right??

Imagine what the performance would have been if this was on enterprise grade hardware in your datacentre?

Also caught my eye was the actual inline deduplication and compression savings immediately available on the VSAN datastore after the VM’s were provisioned.

Dedupe & Compression Savings

As you can see, to store 437GB of raw data, with a FTT=1 (where VSAN keeping redundant copies of each vmdk file), its only consuming 156GB of actual storage on the VSAN cluster, saving me 281GB of precious SSD storage capacity. Note that this is WITHOUT Erasure Coding RAID 5 or RAID 6 that’s also available with VSAN 6.2 which, had that been enabled, would have further reduced the actual consumed space more.

The point of this all is the performance and the storage savings available in VSAN, especially all flash VSAN is epic and I’ve seen this in my own environment. In an enterprise datacenter, All Flash VSAN can drastically improve your storage performance but at the same time, significantly cut down on your infrastructure costs for all of your vSphere storage environments. I personally know a number of clients who have achieved such savings in their production environments and each and every day, there seem to be more and more demand from customers for VSAN as their preferred storage / Hyper-Converged technology of choice for all their vSphere use cases.

I would strongly encourage you to have a look at this wonderful technology and realise these technical and business benefits (summary available here) for yourself.

Share your thoughts via comments below or feel free to reach out to discuss what you think via email or social media

Thanks

Chan

New VMware Product Availabilities – Now available to download

Chan Leave a comment

Update

VMware have just made a number of new product versions (mostly maintenance releases on few different products, including that of the much hyped VSAN 6.2) so a quick post to summarise the content that was released last night (15.03.2016)

  • VMware VSAN 6.2 – VMware VSAN 6.2 was officially announced in early February with a number of cool new features such as Erasure coding but unless you were a techie trying to download the software, you may have not known that it was not available for download despite being announced. That was until yesterday and the product is now available to download for every customer.

 

  • VMware vRealize Automation 7.0.1 now released and available for download
    • Release notes here
    • Product binaries here
    • Documentation here

 

  • VMware vRealize Orchestrator 7.0.1 is released and available to download
    • Release notes here
    • Product binaries here
    • Documentation here

 

  • vRealize Business for Cloud (Old ITBMS offering) is also released and available for grabs now
    • Release notes here
    • Product binaries here
    • Documentation here

 

  • vRealize Log Insight 3.3.1 is released and available to download
    • Release notes here
    • Product binaries here
    • Documentation here

 

  • vCloud Suite 7.0 is also released and available to download (here) – This includes all of the above new versions of products plus the exiting versions for vSphere Replication 6.1 + vSphere Data Protection 6.1.2 + vROPS 6.2.0a + vRealize Infrastructure Navigator 5.8.5

VMware All Flash VSAN Implementation (Home Lab)

Chan 2 Comments

I’ve been waiting for a while to be able to implement an all flash VSAN in my lab and now that VSAN 6.2 has been announced, I thought it would be time to upgrade my capacity disks from HDD’s to SSD’s and get cracking..! (note: despite the announcement, VSAN 6.2 binaries are NOT YET available to download. I’m hearing it would be available in a week or two on My VMware though so until then, mine is based on VSAN 6.1 – ESXi 6.0U1 binaries)

As I already had a normal (Hybrid) VSAN implementation using SSD+HDD in my management vSphere cluster, the plan was to keep the existing SSD’s as caching tier and replace the current HDD’s with high capacity SSD drives. So I bought 3 new Samsung 850 EVO 256GB drives from Amazon (here)                                       Capture

All Flash VSAN Setup

Given below are the typical steps involved in the processes to implement All Flash VSAN within the VMware cluster (I’m using the 3 node management cluster within my lab for the illustration below)

  1. Install the SSD drives in the server – This should be easy enough. If you are doing this in a production environment, you need to ensure that the capacity SSD’s (similar to all other components in your VSAN ready nodes)  are in the VMware HCL
  2. Enable VSAN on the cluster – Need to be done on the web client      1 - Enable VSAN
  3. Verify the new SSDs are available & recognised within the web client – All SSD’s are recognised as caching disks by default.              0 - Default disk assignment  2 - all caching
  4. Manually tag the required SSD drives as capacity disks VIA COMMANDLINE for them to be recognised as capacity disks within VSAN configuration – This step MUST be carried out using one the ways explained below and until then, SSD disks WILL NOT be available to be used as capacity disks within an all flash VSAN otherwise. (There currently is no GUI option on the web client to achieve this and cli must be used)
    1. Use esxcli command on each ESXi server
      1. SSH in to the ESXi server shell
      2. Use the vdq -q command to get the T10 SCSI name for the capacity SSD drive (Also verify “IsCapacityFlash” option is set to 0) 3 SSH
      3. Use the “esxcli vsan storage tag add -d <SCSI T10 name of the disk> -t capacityFlash” command to mark the disk as capacity SSD.   4 ESXCLI
      4. Use the vdq -q command to query the disk status and ensure the disk is now marked as “1” for “IsCapacityFlash” 5 esxcli verify
      5. If you now look at the Web client UI, the capacity SSD disk will now have been correctly identified as capacity (note the drive type changed to HDD which is somewhat misleading as the drive type is still SSD) 8.1 GUI
    2. Use the “VMware Virtual SAN All-Flash Configuration Utility” software – This is a 3rd party tool and not an officially supported VMware tool but if you do not want to manually SSH in to the ESXi servers 1 by 1, this software could be quite handy as you can bulk tag on many ESXi servers all at the same time. I’ve used this tool to tag the SSD’s in the next 2 servers of my lab in the illustration below. xx - Use VMware Virtual SAN all-flash configuration utility
  5. Verify capacity SSD across all hosts – Now that all the capacity SSD’s have been tagged as capacity disks, verify that the web client sees all capacity SSD’s across all hosts                                                9 Disk group manual
  6. Create the disk groups on each host – I’m opting to create this manually as shown below 9 Disk group manual 10 - Verify disk groups
  7. Verify the VSAN datastore now being available and accessible 11 - VSAN datastore active

There you have it. Implementing all flash VSAN requires manually tagging the SSDs as capacity SSDs for the time being and this is how you do it. I may also add that since the all flash VSAN, my storage performance has gone through the roof in my home lab which is great too. However this is all done on Whitebox hardware and not all of them are fully on VMware HCL….etc which makes those performance figures far from optimal. It would be really good to see performance statistics if you have deployed all flash VSAN in your production environment.

Cheers

Chan

 

 

New VMware Hybrid Cloud Announcements – Summary

Chan Leave a comment

Cover Photo

As you may already know by now, VMware have just announced a number of new product versions along with few changes to their Cloud Management product positioning during the online event that took place on the 10th of Feb 2016 (If you missed the announcements, you can watch the recordings here). The announcements were made for products that fall under 2 tracks (Digital workspace & Cloud Management which effective means EUC &  Datacenter track respectively).

While I’m not going to cover what was discussed under the Digital Enterprise section (mostly EUC focused, around Horizon Suite and Workspace 1), I’m going to summarize some of the key points mentioned under the Hybrid Cloud track below and the related product positioning changes.

Hybrid Cloud related new Product updates – Summary

One Cloud (Hybrid Cloud with private, hosted and public cloud), Any application, Any device seems to be the new mantra going forward and is fully underpinned by VMware’s software Defined Datacentre (SDDC). VMware are seeing the Hybrid Cloud is playing a major part in the interim future in the industry (I know many customers agree too) and they appear to be seeing user owned kit (housed in an on-premise DC or an off premise hosted DC like Equinix) along with various different public cloud platforms all playing a part of a typical customer datacentre going forward. Each public cloud provider is almost seen as a new Silo in the customers new Hybrid Cloud Datacentre and VMware are focusing on providing a unified management platform across all these Silo’s. To be frank, this is not so much news, as their focus and the subsequent messaging has been the same for a while. But their have now added compatibility with almost all key Public cloud platforms (AWS, Azure, Google, IBM SoftLayer) and stressing the “any cloud” message through this announcement.

Here’s the summary of the related new products announced

  • VMware VSAN 6.2 Updates

    • VSAN 6.2 is announced
      • For key 6.2 (new) technical features – Refer to the 2 articles below
        • Duncan Epping’s legendary Yellow-Bricks here
        • Comac Hogan’s blog here
    • VSAN (together with vSphere) is a Hyper-Converged Software Solution (finally…!!)           HCS
    • All flash VSAN is key and most new features are available on all flash VSAN only – also inline with storage industry trends.
    • 2 new VSAN ready node options from Supermicro, Hitachi and Fujitsu (different to legacy VSAN ready nodes) VSAN - Ready Nodes
      • Customers can choose to factory install the VMware hyper-converged software (HCS), namely vSphere and Virtual SAN.
      • Customers can use their existing vSphere and VSAN licenses, or  buy new licenses from the OEM vendor. All OEMs offer the flexibility of perpetual licenses that are node-transferrable, while some OEMs may also offer embedded licenses, which are fundamentally tied to the hardware system
      • Customers can continue to purchase support from VMware, or leverage a single-vendor model by getting support for both hardware and software from their OEM of choice
    • VSAN is also available for VMware Photon – DevOps & CNA friendly                    VSAN for Photon

 

  • vRealize Suite Updates

    • vRA Version 7.0 (announced in December 2015)
      • More cloud endpoint supported: now supports Google, IBM SoftLayer, as well as AWS, Azure & vCloud Air
    • vRealize Business 7.0 announced
    • vROPS remain the same as version 6.2
    • vRealize Log Insight 3.3
  • NSX Updates
    • NSX is the common networking layer across private and public cloud platforms (including AWS & Azure)

 

Product Positioning & Packaging Changes – Summary

Number of VMware Product Suite / Packages have been changed to reflect 3 different use cases VMware trying to address with their product portfolio, going forward. These key use cases are as follows,

  1. Intelligent Operations: Basic, virtualised datacentre use case
  2. Automated to IaaS: Have advanced virtualisation with additional requirements such as some automation and orchestration and IaaS capability
  3. DevOps-Ready: True Hybrid Cloud requirement

Use Cases

And the content of these product suites have also changed. A quick summary of the key changes are explained below.

  • Core Platform – “Naked” vSphere                                               vSphere versions

    • Previous: Standard, Enterprise, Enterprise plus (for both the vSphere and vSOM bundles)
    • New: Standard & Enterprise plus only – No more vSphere Enterprise!
      • For existing vSphere ENT customers, there are 2 choices
        • Upgrade to vSphere ENT+ with 50% discount (available till 25th of June 2016) OR
        • Stay on vSphere ENT till product end of support
    • vCenter list price increased, but now include 25 OSI license for vRealize Log Insight (restricted to do log analysis for vSphere hosts, vCenter & VMware content packs only) in return.

  • vSphere with Operations Management (vSOM)

    • Previous: vSOM Standard, Enterprise & Enterprise plus
    • New: Enterprise plus only – No more vSOM STD or vSOM ENT!
      • For existing vSOM STD & ENT customers, there are 2 choices
        • Upgrade to vSphere ENT+ with 50% discount (available till 25th of June 2016) OR
        • Stay on current till product end of support

  • vRealize Suite (vRS) 7.0

     vrealize-suite-lineup

    • Previous: N/A
    • New: STD, ADV, ENT
      • Standard: vRealize Business for Cloud STD, Log Insight, vROPS Advanced
      • Advanced (with IaaS capabilities): vRealize Business for Cloud STD, Log Insight, vROPS Advanced, vRealize Automation Advanced (now cheaper since vRealize Configurations Manager is now excluded)
      • Enterprise (with DevOps capabilities): vRealize Business for Cloud STD, Log Insight, vROPS Advanced, vRealize Automation Enterprise with Application Automation, vROPS App monitoring. (cheaper now as vROPS ENT  & vCM removed from the suite now)
      • vRS licenses are now portable (between private & public cloud) – Applies to the Suite licenses only (standalone components don’t qualify)
        • On-Premise = per CPU socket
        • Public Cloud (vCloud Air,, AWS, Azure) = 15 OSI’s per license unit (portable license unit = 1 cpu socket license)
        • 3rd party On-Prem (Hyper-V, XenServer, KVM) = 15 OSI’s per license unit (portable license unit = 1 cpu socket license)PLU update

  • vCloud Suite (vCS) 7 – New Packaging & Licensing

    • Previous: version 6.0  in STD, ADV, ENT
    • New: version 7.0 also in STD, ADV, ENT. See comparison below.          vCS Comparison
      • All vCS editions now include vRealize Suite & vSphere ENT+
      • SRM & vCM both now removed from vCS 7 ENT
      • New licensing available from 1st of March (Existing vCloud Suite EOA by 1st of June FY16)
      • (Only) vRS Licenses are portable (between private & public cloud)

  • VSAN

    • Previous Categories (5.5 & 6.x): Standard & Advanced
    • New categories (from version 6.2 onwards): Standard, Advanced, Enterprise   VSAN 6.2 Editions

Additional info regarding packaging changes and price changes can be found on the following links

Re-Cap and My thoughts

  • There appear to be less and less focus on core products such as vSphere and VMware’s focus is somewhat shifting to other management and enablement areas. This makes sense as the hypervisor is increasingly becoming a commodity and the value-add now is in the Cloud Management Software suite that manage the Hypervisor as well as various other Public Cloud platforms.
  • In general, cost of basic vSphere will go up for many customers due to the removal of Enterprise edition and most medium to large corporate and enterprise customers will now be forced to buy ENT+ edition, which also just happened to cost a little more than it did before, at the same time.
  • New products like VSAN & NSX-v however will increase the sticky-ness of the vSphere customers (both needs vSphere) within the customer’s datacentre still so vSphere is not yet fully done with (for the foreseeable future anyway)
  • While all the new VSAN features are really awesome and great, do bear in mind that most of them if not all are going to cost you slightly more as,
    • They are only available with more expensive Enterprise edition of VSAN
    • They are only available for on all flash VSAN’s. Meaning more expensive SSD drives for capacity too so more expensive hardware.
  • All flash VSAN should still be cheaper overall though for the customer compared to having to buy the same servers (without disks) + a separate all flash SAN
  • So all in all, except for VSAN 6.2 announcement, not a whole lot of exciting new features. This is not a major announcement but more of a minor change of product positioning, along with a re-pricing exercise, however I do like the direction VMware is heading with their product portfolio.

 

Note: Slide credit goes to VMware. Note that the NDA on some of these contents have now elapsed (after the general announcement on the 10th of Feb) so I shouldn’t get in to trouble for sharing 🙂

Cheers

Chan