A New Generation Of Data Analytics Tools For the Cloud

Cloud Data Analytics

Subscribe to Cloud Data Analytics: eMailAlertsEmail Alerts newslettersWeekly Newsletters
Get Cloud Data Analytics: homepageHomepage mobileMobile rssRSS facebookFacebook twitterTwitter linkedinLinkedIn


Cloud Data Analytics Authors: Dean Madison, William Schmarzo, Jnan Dash, John Katrick, Pat Romanski

Related Topics: Cloud Computing, Cloud Data Analytics

Blog Post

Cloud Analytics: The Power of Visualization for Cloud Cost Management | @CloudExpo #Cloud #Analytics

How to manage, monitor and track all your private and public cloud spend

From cloud cost management angle, comprehensive cloud cost analytics across multiple clouds as well as granular drill downs into each of the cost elements is very important for tighter cost control and management. As enterprises are adopting cloud across many line of businesses, departments, vertical functions and geographies, an enterprise class cloud analytics tool is a must have for holistic cloud cost management. As indicated in many of the cloud cost optimization studies published in the industry, rich cloud analytics tools can save up to 70% of cloud resource cost by giving cloud administrator visibility into optimal placement, utilization and right sizing of the cloud resources.

Jamcracker cloud management platform offers many valuable tools to holistically manage cloud costs across an enterprise organization. As an example, one of the key reports called Daily Consumption Report (DCR) report enables IT administrators to customize various cloud consumption parameters of interest such as product type, usage type, charge type, currency, quantity, unit price, unit quantity, consumption amount, etc. Thus, DCR report can be customized to aggregate the cloud cost and usage information on a daily basis across multiple clouds for a specific date range.

While reporting is a great on-demand tool for historical trend analysis of the data available in the datamarts, it does not give real time snapshot of what’s happening in terms of cloud consumption across an enterprise. Further, business users are often not interested in the technical details of cloud resources being consumed but rather the business impacting issues such as the overall cloud cost trends, cost savings due to cloud migration, cloud cost mix by cloud service providers and the overall return on investment (ROI) for the cloud deployments. This is why cloud cost management dashboards are such a powerful tool for not only the IT administrators but also the business users such as IT business analysts and IT finance managers.

In JCP – Cloud Analytics virtual appliance module, we provide various dashboards to address the needs for different stakeholders who need to keep a close watch on the live cloud usage across all parts of an enterprise. These dashboards offer live cloud consumption intelligence including cost associated with each of the cloud resources, usage of these resources and any missed opportunities for cloud cost optimization.

Let’s drill down into each of these dashboards and understand the benefits of each type of these dashboards:

1. Executive Dashboard

As the name suggests, executive dashboard is an important visualization tool for the executives. It tracks key cloud trends such as costs and resources in order to help DevOps, IT Managers, CIOs, CTOs, and Finance departments to oversee all of the cloud costs centrally.

Following are some of the key attributes of the information that can aid executives in making investment and ROI decisions:

Cloud Cost Trend: The Cloud Cost Trend shows the cost trends based on previous spending providing valuable information about cost anomalies. Analyzing the trend over monthly, year-to-date or a specific date range will give valuable insight on critical trends, spikes, and recurring patterns and enables you to react instantly and avoid unnecessary upcoming costs.

Cost by Provider: In a multi-cloud deployment, identify cost for each cloud service provider and compare the costs across providers. This data will provide insights to optimize spending and provide optimal workload allocation insights.

Cost by Products: View of cloud cost by specific cloud services consumed within an organization. All services (SaaS, IaaS or PaaS) consumed during a selected period are considered.

Cost by Resources: A cloud resource can be a virtual machine, storage volume, snapshots, machine images, IP address or any other resource that is consumed from a cloud service provider. The resource label is comprised of resource ID, resource name, and the provider's name and it uniquely identifies a cloud resource.

Cost by Tags: For organizations that take advantage of the resource-based tagging feature, this dashboard view can be used to visualize costs based on environment, project, cost center, department or any other tagging dimension. Tags allow cost management on a granular level and align cloud cost to an organization’s structure. Gain better visibility into untagged infrastructure resources and ensure accountability of cloud resources by assigning tags to unmanaged resources

2. Live Dashboard

Live Dashboard is an important visualization tool for daily operations staff such as IT administrators. It offers real-time inventory of the IaaS resources from various cloud providers.

Following are some of the key attributes of the information that can aid executives in analyzing real time health check of cloud usage and cost:

Resource Summary: Resource summary lists the cloud resources along with their current state information.

AWS Reserved Instances: View the list of reserved instances for an account by clicking Reserved Instances tab. You can view additional details of a specific reserved instance record such as scope, instance type, platforms, tenancy, terms and payment details, and offering types.

3. Cost Analytics

Since up to 70% of the cloud cost can be optimized through better utilization of cloud resources in terms of unused as well as under utilized cloud resources, cloud cost analytics dashboard is an important visibility tool to see if cloud resources are being consumed optimally.

Following are some of the key attributes of the information in this dashboard that can allow IT administrators to dig deeper into the cloud resource cost and aid with right sizing of the resource.

Product Cost Trend: View the cost trend for each product as well as the forecast for infrastructure services and plan the strategy for cost optimization.

VM Count by Instance Type/Size/Flavor: The cost of a virtual machine can be broken down by various sizing tiers such as micro, small, standard, etc. Each instance is further classified based upon its purpose e.g. for general use, computation intensive, storage, GPU, or memory.

Resource Count by Region: Different cloud regions have different pricing for each cloud provider. Resource usage can be identified and scaled effectively by this visualization that indicates the number of resources associated with each region. The label used to depict the resource count is a combination of the cloud region and the cloud provider’s name.

Resource Cost by Region: Not all cloud infrastructure regions are priced the same. Varying resource cost across different regions supported by a cloud provider or among various cloud providers make it necessary to view cloud costs based on regions supported by each of the cloud providers. This feature is especially important as it provides a quick comparison of the cost for deploying a certain type of resource in a specific region and aids in choosing the right cloud provider that fits IT needs and offers lowest price.

Cost by IaaS Usage Type: Analyzing costs based on the infrastructure usage type provides insights into hidden resource usage costs. Take the necessary action by terminating or re-sizing the instances.

Cost by OS Platform: Cloud providers often charge a premium for the instances running Windows server as they need to cover windows server licensing cost. Hence, cost details based on the OS platform can be very helpful to see where IT dollars are spent in terms of OS platform provided by a cloud provider.

4. Tag Analytics

Tag-based cost allocation involves analyzing and associating the costs with specific categories (e.g. department, projects, etc.) to provide cost visibility allowing asset management, security, and compliance tracking. This dashboard allows IT users to view the cost associated with this resource based on different dimensions and enables you to organize your resources in a way that is independent of the cloud service provider.

Following are some of the key attributes of the information in this dashboard that can allow IT administrators to visualize cloud resource cost based on associated consumption tags.

Product Cost by Tags: Analyze the cost of infrastructure services based on the resource tags and identify the cost drivers mapped to different organizational units.

VM Count by Tags: The count of VMs grouped according to an organization’s tagging schema will be displayed allowing the IT team to immediately identify whether their infrastructure requires adjustment. For the selected Tag key, this dashboard displays total number of instances for each of the associated Tag Values.

VM Cost by Tags: Tagging provides an efficient way to track and organize your resources based on the cost. For the selected Tag key, the report displays the cost of instances for each of the associated Tag Values. Thus, tags help to analyze your virtual machines cost to reflect your own cost structure.

Tag Cost Trend: View the historical cost trend of resources based on a particular Tag key-value pair selection. This report considers all resources Tagged based on the tagging standards in your organization and provide insights cost effectiveness.

Instance Type/Flavor/Size by Tags: Different providers offer different instance families to choose from and a variety of sizes for each instance type. For optimal resource allocation, analyze the cost of different types of Instances based on the associated tags.

In conclusion, in order to efficiently manage the usage and cost of cloud resources, a rich cloud analytics engine is the need of time. Various stakeholders such as the IT business analysts, finance managers, devops users from business units and CTO staff all need visibility into cloud consumption on a real-time and historical basis. With various dashboards that are available in the Jamcracker Cloud Platform, customers can gain instant visibility and almost feel like they got the superpowers to manage cloud cost.

CloudExpo | DXWorldEXPO have announced the conference tracks for Cloud Expo 2018, introducing DXWorldEXPO.

DXWordEXPO, colocated with Cloud Expo will be held June 5-7, 2018, at the Javits Center in New York City, and November 6-8, 2018, at the Santa Clara Convention Center, Santa Clara, CA.

Digital Transformation (DX) is a major focus with the introduction of DXWorld Expo within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term.

A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throughout enterprises of all sizes.

Cloud Expo | DXWorldEXPO 2018 New York
(June 5-7, 2018, Javits Center, Manhattan)

Cloud Expo | DXWorldEXPO 2018 Silicon Valley
(November 6-8, 2018, Santa Clara Convention Center, CA)

Full Conference Registration "Gold Pass" and Exhibit HallHere (Register ▸ Here via EventBrite)

DX World EXPO, LLC., a Lighthouse Point, Florida-based startup trade show producer and the creator of DXWorldEXPO® - Digital Transformation Conference & Expo has announced its conference agenda, with three major themes:

* Technology - The Revolution Continues
* Economy - The 21st Century Emerges
* Society - The Big Issues

"DX encompasses the continuing technology revolution, and is addressing society's most important issues throughout the entire $78 trillion 21st-century global economy," said Roger Strukhoff, Conference Chair. "DXWorldExpo has organized these issues along 10 tracks with more than 500 of the world's top speakers coming to Istanbul to help change the world."

There are 10 tracks running throughout the event and following the major themes. More than 500 breakout sessions will be featured, along with keynotes and general sessions from some of the world's top technology, business, and societal leaders. The event will be held over five days in Istanbul, reflecting the global nature of Digital Transformation and the city's long and historic role as a key business and intellectual center and linchpin between East and West.

Full Conference Registration "Gold Pass" and Exhibit HallHere (Register ▸ Here via EventBrite)

DX World Expo's Global Themes and Tracks are as follows:

Technology - The Revolution Continues

DX Tech: Data-Driven Global 2000
DX Tech: The Blockchain Challenge
DX Tech: AI and Cognitive
DX Tech: The Global Cloud

Economy - The 21st Century Emerges

DX Econ: Software is Rewriting the World
DX Econ: Smart Cities, Nations, and Regions
DX Econ: FinTech and the Token Economy
DX Econ: The Industrial Internet and Industrie 4.0

Society - The Big Issues

DX Society: Environment
DX Society: Education
DX Society: Agriculture
DX Society: Health Care

Call for Papers -speaking opportunities- as well as sponsorship and exhibit opportunities will open on November 1, 2017.

World's Most Important Tech Event
DXWorldEXPO® will be the world's most important tech event with 1,000 exhibitors in its first year and 2,000 exhibitors in its second year, as it guides Global 2000 companies through their Digital Transformation journey for the next two decades. The global event is set to launch September 17-20, 2018 in Istanbul. It will be sponsored by Fortune 50 companies, and more than 30 international banks will be among sponsors of its FinTech/InsurTech track.

Gaining a better understanding of customers and acting upon this information is the foundation of Digital Transformation (DX) in the enterprise. Applying the latest technologies in this area is the key to driving new topline revenue opportunities.

Global 2000 companies have more than US$40 trillion in annual revenue - more than 50% of the world's entire GDP. The Global 2000 spends a total of US$2.4 trillion annually on enterprise IT. The average Global 2000 company has US$11 billion in annual revenue. The average Global 2000 company spends more than $600 million annually on enterprise IT.

Governments throughout the world spend another US$500 billion on IT - much of it dedicated to new Smart City initiatives. There are more than a dozen Global 2000 companies in Turkey, including Isbank, Garanti Bank, other financial institutions, Turk Telecom, Turkcell, Turkish Airlines, and ENKA.

Cloud Expo | DXWorldEXPO 2018 New York
(June 5-7, 2018, Javits Center, Manhattan)

Cloud Expo | DXWorldEXPO 2018 Silicon Valley
(November 6-8, 2018, Santa Clara Convention Center, CA)

Full Conference Registration "Gold Pass" and Exhibit HallHere (Register ▸ Here via EventBrite)

More Management Quotes
"For the past 10 years at Cloud Expo, we've helped drive the migration to modern enterprise IT infrastructures, built upon the foundation of cloud computing. Today's hybrid, multiple cloud IT infrastructures integrate Big Data, analytics, blockchain, the IoT, mobile devices, and the latest in cryptography and enterprise-grade security," said Fuat Kircaali, Chairman and founder of DX World Expo, LLC.

"As a report from the World Economic Forum and Accenture recently stated, 'Companies need to fundamentally change the way they identify, develop and launch new business ventures.' We agree," said Carmen Gonzalez, president of DX World Expo, LLC.

"Digital Transformation is the key issue driving the global enterprise IT business," said Roger Strukhoff, Conference Chair and Executive Director of the Tau Institute for Global ICT Studies. "DX is most prominent among Global 2000 enterprises and government institutions. Our new event in Istanbul brings together the top companies and delegates from around the world, who are transforming the world."

2018 Conference Agenda and Tracks, June 5-7, Javits Center

Track 1 | Cloud Expo - Enterprise Cloud
Track 2 | DXWorld Expo - Digital Transformation (DX)
Track 3 | The API Enterprise | Mobility & Security
Track 4 | DevOps | Containers & Microservices
Track 5 | Cognitive Computing | AI, ML, DL
Track 6 | Big Data | Analytics
Track 7 | IoT | IIoT | Smart Cities
Track 8 | Hot Topics | FinTech | WebRTC

Cloud Expo covers all of these tools, with the most comprehensive program and more than 120 top world-class speakers throughout our Industry presenting Keynotes, General Sessions, Breakout Sessions along eight focused tracks, as well as our signature Power Panels. Our expo floor brings together the world's leading companies throughout the world of Cloud Computing, DX, and all they entail.

As your enterprise creates a vision and strategy that enables you to create your own unique, long-term success, learning about all the technologies involved is essential. Companies today not only form multi-cloud and hybrid cloud architectures, but create them with built-in cognitive capabilities. Cloud-native thinking is now the norm in financial services, manufacturing, telco, healthcare, transportation, energy, media, entertainment, retail and other consumer industries, as well as the public sector.

Cloud Expo is the world's most important, independent event where technology buyers and vendors meet to experience and discuss the big picture of Digital Tranformation and all of the strategies, tactics, and tools they need to realize their goals.

Full Conference Registration "Gold Pass" and Exhibit HallHere (Register ▸ Here via EventBrite)

Only Cloud Expo brings together all this in a single location:

  • Cloud Computing
  • Big Data & Analytics
  • Software-Defined Infrastructure
  • Industrial IoT
  • Industry 4.0
  • Artificial Intelligence
  • Cognitive Computing
  • Microservices
  • Machine Learning
  • DevOps
  • WebRTC
  • FinTech
  • Digital Transformation

Attend Cloud Expo. Build your own custom experience. Learn about the world's latest technologies and chart your course to Digital Transformation.

21st International Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world.

Download Show Prospectus ▸ Here

Full Conference Registration "Gold Pass" and Exhibit HallHere (Register ▸ Here via EventBrite)

Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Meanwhile, 94% of enterprises are using some form of XaaS - software, platform, and infrastructure as a service.

With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo, October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.

2018 Conference Agenda and Tracks, June 5-7, Javits Center

Track 1 | Cloud Expo - Enterprise Cloud
Track 2 | DXWorld Expo - Digital Transformation (DX)
Track 3 | The API Enterprise | Mobility & Security
Track 4 | DevOps | Containers & Microservices
Track 5 | Cognitive Computing | AI, ML, DL
Track 6 | Big Data | Analytics
Track 7 | IoT | IIoT | Smart Cities
Track 8 | Hot Topics | FinTech | WebRTC

Cloud Expo | DXWorldEXPO 2018 New York
(June 5-7, 2018, Javits Center, Manhattan)

Cloud Expo | DXWorldEXPO 2018 Silicon Valley
(November 6-8, 2018, Santa Clara Convention Center, CA)

Full Conference Registration "Gold Pass" and Exhibit HallHere (Register ▸ Here via EventBrite)

Download Show ProspectusHere

Every Global 2000 enterprise in the world is now integrating cloud computing in some form into its IT development and operations. Midsize and small businesses are also migrating to the cloud in increasing numbers.

Companies are each developing their unique mix of cloud technologies and services, forming multi-cloud and hybrid cloud architectures and deployments across all major industries. Cloud-driven thinking has become the norm in financial services, manufacturing, telco, healthcare, transportation, energy, media, entertainment, retail and other consumer industries, and the public sector.

Cloud Expo is the single show where technology buyers and vendors can meet to experience and discus cloud computing and all that it entails. Sponsors of Cloud Expo will benefit from unmatched branding, profile building and lead generation opportunities through:

  • Featured on-site presentation and ongoing on-demand webcast exposure to a captive audience of industry decision-makers.
  • Showcase exhibition during our new extended dedicated expo hours
  • Breakout Session Priority scheduling for Sponsors that have been guaranteed a 35-minute technical session
  • Online advertising in SYS-CON's i-Technology Publications
  • Capitalize on our Comprehensive Marketing efforts leading up to the show with print mailings, e-newsletters and extensive online media coverage.
  • Unprecedented PR Coverage: Editorial Coverage on Cloud Computing Journal.
  • Tweetup to over 75,000 plus followers
  • Press releases sent on major wire services to over 500 industry analysts.

For more information on sponsorship, exhibit, and keynote opportunities, contact Carmen Gonzalez by email at events (at) sys-con.com, or by phone 201 802-3021.

The World's Largest "Cloud Digital Transformation" Event

@CloudExpo | @ThingsExpo 2017 Silicon Valley
(Oct. 31 - Nov. 2, 2017, Santa Clara Convention Center, CA)

@CloudExpo | @ThingsExpo 2018 New York
(June 12-14, 2018, Javits Center, Manhattan)

Full Conference Registration "Gold Pass" and Exhibit HallHere (Register ▸ Here via EventBrite)

Sponsorship Opportunities

Sponsors of Cloud Expo | @ThingsExpo will benefit from unmatched branding, profile building and lead generation opportunities through:

  • Featured on-site presentation and ongoing on-demand webcast exposure to a captive audience of industry decision-makers
  • Showcase exhibition during our new extended dedicated expo hours
  • Breakout Session Priority scheduling for Sponsors that have been guaranteed a 35 minute technical session
  • Online targeted advertising in SYS-CON's i-Technology Publications
  • Capitalize on our Comprehensive Marketing efforts leading up to the show with print mailings, e-newsletters and extensive online media coverage
  • Unprecedented Marketing Coverage: Editorial Coverage on ITweetup to over 100,000 plus followers, press releases sent on major wire services to over 500 industry analysts

For more information on sponsorship, exhibit, and keynote opportunities, contact Carmen Gonzalez (@GonzalezCarmen) today by email at events (at) sys-con.com, or by phone 201 802-3021.

Secrets of Sponsors and ExhibitorsHere
Secrets of Cloud Expo SpeakersHere

All major researchers estimate there will be tens of billions devices - computers, smartphones, tablets, and sensors - connected to the Internet by 2020. This number will continue to grow at a rapid pace for the next several decades.

With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend @CloudExpo | @ThingsExpo, October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-4, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.

Delegates to Cloud Expo | @ThingsExpo will be able to attend 8 simultaneous, information-packed education tracks.

There are over 120 breakout sessions in all, with Keynotes, General Sessions, and Power Panels adding to three days of incredibly rich presentations and content.

Join Cloud Expo | @ThingsExpo conference chair Roger Strukhoff (@IoT2040), October 31 - November 2, 2017, Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, for three days of intense Enterprise Cloud and 'Digital Transformation' discussion and focus, including Big Data's indispensable role in IoT, Smart Grids and (IIoT) Industrial Internet of Things, Wearables and Consumer IoT, as well as (new) Digital Transformation in Vertical Markets.

Full Conference Registration "Gold Pass" and Exhibit HallHere (Register ▸ Here via EventBrite)

Financial Technology - or FinTech - Is Now Part of the @CloudExpo Program!

Accordingly, attendees at the upcoming 21st Cloud Expo | @ThingsExpo October 31 - November 2, 2017, Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, will find fresh new content in a new track called FinTech, which will incorporate machine learning, artificial intelligence, deep learning, and blockchain into one track.

Financial enterprises in New York City, London, Singapore, and other world financial capitals are embracing a new generation of smart, automated FinTech that eliminates many cumbersome, slow, and expensive intermediate processes from their businesses.

FinTech brings efficiency as well as the ability to deliver new services and a much improved customer experience throughout the global financial services industry. FinTech is a natural fit with cloud computing, as new services are quickly developed, deployed, and scaled on public, private, and hybrid clouds.

More than US$20 billion in venture capital is being invested in FinTech this year. @CloudExpo is pleased to bring you the latest FinTech developments as an integral part of our program, starting at the 21st International Cloud Expo October 31 - November 2, 2017 in Silicon Valley, and June 12-14, 2018, in New York City.

@CloudExpo is accepting submissions for this new track, so please visit www.CloudComputingExpo.com for the latest information.

Speaking Opportunities

The upcoming 21st International @CloudExpo | @ThingsExpo, October 31 - November 2, 2017, Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY announces that its Call For Papers for speaking opportunities is open.

Submit your speaking proposal today! ▸ Here

About @CloudEXPO and @DXWorldEXPO
SYS-CON Media (www.sys-con.com) has since 1994 been connecting technology companies and customers through a comprehensive content stream - featuring over forty focused subject areas, from Cloud Computing to Web Security - interwoven with market-leading full-scale conferences. The company's internationally recognized brands include among others Cloud Expo® (@CloudExpo), Big Data Expo® (@BigDataExpo), DevOps Summit (@DevOpsSummit), @ThingsExpo® (@ThingsExpo), and DXWorldEXPO® (@ExpoDX).

@CloudExpo® and @ThingsExpo® are registered trademarks of CLOUD EXPO INC.

DXWorldEXPO® is a registered trademark of DX WORLD EXPO LLC.

More Stories By John Katrick

John Katrick is a software engineer living in Bangalore, India. He is a fan of technology and cloud computing. He is also interested in Hybrid Cloud and focuses on articles involving the latest news in cloud management, Microsoft Azure, and cloud governance including new technology and AWS cloud news.