Nov 072014

SmartDataCenter and Manta are now open source

Joyent Inc, virtualization and cloud computing company based in San Francisco, California, to open sources its container technologies SmartDataCenter and Manta. Joyent CTO Bryan Cantrill publishes a following post on Joyent’s blog.

November 06, 2014 – by Bryan Cantrill

 Today we are announcing that we are open sourcing the two systems at the heart of our business: SmartDataCenter and the Manta object storage platform. SmartDataCenter is the container-based orchestration software that runs the Joyent public cloud; we have used it for the better half of a decade to run on-the-metal OS containers — securely and at scale. Manta is our multi-tenant ZFS-based object storage platform that provides first-class compute by allowing OS containers to be spun up directly upon objects — effecting arbitrary computation at scale without data movement. The unifying technological foundation beneath both SmartDataCenter and Manta is OS-based virtualization, a technology that Joyent pioneered in the cloud way back in 2006. We have long known the transformative power of OS containers, so it has been both exciting and validating for us to see the rise of Docker and the broadening of appreciation for OS-based virtualization. SmartDataCenter and Manta show that containers aren’t merely a fad or developer plaything but rather a fundamental technological advance that represents the foundation for the next generation of computing — and we believe that open sourcing them advances the adoption of container-based architectures more broadly.

Joyent Open Source its SmartDataCenter and Manta

Joyent Open Source its SmartDataCenter and Manta

Without any further ado — and to assure that we don’t fall into the most prominent of my own corporate open source anti-patterns — here is the source for SmartDataCenter and the source for Manta. These are sophisticated systems with many moving parts, and you’ll see that these two repositories are in fact meta-repositories that explain the design of each of the systems and then point to the (many) components that comprise them (all now open source, natch). We believe that some of these subcomponents will likely find use entirely outside of SDC and Manta. For example, Manatee is a ZooKeeper-based system that manages Postgres replication and automates failover; Moray is a key-value service that lives on top of Postgres. Taken together, Manatee and Moray implement a highly-available key-value service that we use as the foundation for many other components in SDC and Manta — and one that we think others will find useful as well.

In terms of source code mechanics, you’ll see that many of the components are implemented in either Node.js or by extending C-based systems. This is not by fiat but rather by the choices of individual engineers; over the past four years, as we learned about the nuances of Node.js error handling and as we invested heavily in tooling for running Node.js in production, Node.js became the right tool for many of our jobs — and we used it for many of the services that constitute SDC and Manta.

And because any conversation about open source has to address licensing at some point or another, let’s get that out of the way: we opted for the Mozilla Public License 2.0. While relatively new, there is a lot to like about this license: its file-based copyleft allows it to be proprietary-friendly while also forcing certain kinds of derived work to be contributed back; its explicit patent license discourages litigation, offering some measure of troll protection; its explicit warranting of original work obviates the need for a contributor license agreement (we’re not so into CLAs); and (best of all, in my opinion), it has been explicitly designed to co-exist with other open source licenses in larger derived works. Mozilla did terrific work on MPL 2.0, and we hope to see it adopted by other companies that share our thinking around open source!

In terms of the business ramifications, at Joyent we have long been believers in open source as a business model; as the leaders of the Node.js and SmartOS projects, we have seen the power of open source to start new conversations, open up new markets and (importantly) yield new customers. Ten years ago, I wrote that open source is “a loss leader — minus the loss, of course”; after a decade of experience with open source business models, I would add that open source also serves as sales outreach without cold calls, as a channel without loss of margin, and as a marketing campaign without advertisements. But while we have directly experienced the business advantages of open source, we at Joyent have also lived something of a dual life: Node.js and SmartOS have been open source, but the distributed systems that we have built using these core technologies have remained largely behind our walls. So that these systems are now open source does not change the fundamentals of our business model: if you would like to consume SmartDataCenter or Manta as a service, you can spin up an instance on the public cloud or use our Manta storage service. Similarly, if you want a support contract and/or professional services to run either SmartDataCenter or Manta on-premises, we’ll sell them to you. Based on our past experiences with open source, we do know that there will be one important change: these technologies will find their way into the hands of those that we have no other way of reaching — and that some fraction of these will become customers. Also based on past experience, we know that some (presumably much smaller) fraction of these new technologists will — by merits of their interest in and contributions to these projects — one day join us as engineers at Joyent. Bluntly, open source is our farm system, and broadening our hiring channel during a blazingly hot market for software talent is playing no small role in our decision here. In short, this is not an act of altruism: it is a business decision — if a multifaceted one that we believe has benefits beyond the balance sheet.

Welcome to open source SDC and Manta — and long-live the container revolution!

News Release Source : SmartDataCenter and Manta are now open source (blog)

Image Credit :

 Posted by at 10:59 pm

New Big Data Taxonomy Report by Cloud Security Alliance

 Big Data, Cloud Computing, Cloud Computing News, Cloud Computing Security  Comments Off on New Big Data Taxonomy Report by Cloud Security Alliance
Sep 202014

Cloud Security Alliance Releases New Big Data Taxonomy Report

Working Group Issues Comprehensive Report to Aid Understanding and Decision Making in Big Data Technology

SAN JOSE, Calif., Sept. 18, 2014 /PRNewswire-USNewswire/ — CSA Congress 2014The Cloud Security Alliance (CSA) Big Data Working Group today released the Big Data Taxonomy Report, a new guidance report that aims to help decision makers understand and navigate the myriad choices within the big data designation, including data domains, compute and storage infrastructures, data analytics, visualization, security and privacy.

New Big Data Taxonomy Report by Cloud Security Alliance

New Big Data Taxonomy Report by Cloud Security Alliance

Every day, 2.5 quintillion bytes of data are created –  90% of the data in the world today has been created in the last two years alone. The issues of storing, computing, security, privacy and analytics are all magnified by the velocity, volume, and variety of big data, such as large-scale cloud infrastructures, diversity of data sources and formats, streaming nature of data acquisition and high volume inter-cloud migration.

Big data infrastructure and methodology continue to evolve at a fast pace, but the underlying technologies were, in many cases, invented many years ago. In an effort to help IT decision makers make better, more informed choices associated with these technologies, theCSA Big Data Working Group has created a 40-page guidance report that outlines the six dimensions that arise from the key aspects needed to establish a big data infrastructure. The big data taxonomy includes data domains, compute infrastructure, storage infrastructure, analytics, visualization, security and privacy.

“All ‘data’ is not equivalent, yet we often find users treating all data components similarly, as they are uncertain as to how to address issues such as latency, or structured verses unstructured data,” said Sreeranga Rajan, chair of the Big Data Working Group.  “We hope this report brings clarity to the big data taxonomy, and provides much needed education to help users make better decisions in their own environments.”

In the report, each domain is categorized according to how data arises to help decision makers understand the infrastructure choices and requirements for particular types of data. The report also addresses each particular domain in which data arises, to help organizations determine the types of architecture that will be required to store it, process it, and perform analytics on it.

Rajan goes on to add, “The greatly increased digitization of human activity and machine-to-machine communications, combined with large-scale, inexpensive hardware, is making practical many previously academic ideas of parallel and distributed computing, along with new considerations necessary to make them even more useful in real world applications.”

The Big Data Taxonomy Report is a result of the CSA Big Data working group, chaired by Sreeranga Rajan of Fujitsu, and co-chaired by Neel Sundaresan of eBay
and Wilco van Ginkel of Verizon.

To access the report visit Individuals interested in becoming part of the working group can visit

Cloud Security Alliance Congresses continue to be the industry’s premier gathering for IT security professionals and executives who must further educate themselves on the rapidly evolving subject of cloud security. In addition to offering best practices and practical solutions for remaining secure in the cloud, CSA Congresses give attendees exposure to industry-specific case studies that will help them learn and leverage best practices used by their peers in moving to a secure cloud.

About the Cloud Security Alliance

The Cloud Security Alliance is a not-for-profit organization with a mission to promote the use of best practices for providing security assurance within Cloud Computing, and to provide education on the uses of Cloud Computing to help secure all other forms of computing. The Cloud Security Alliance is led by a broad coalition of industry practitioners, corporations, associations and other key stakeholders. For further information, visit us at, and follow us on Twitter @cloudsa.

Logo –

SOURCE Cloud Security Alliance


News Release Source :

Big Data and Cloud Certification for IT Professionals

 Big Data, Cloud Computing, Cloud Computing Training  Comments Off on Big Data and Cloud Certification for IT Professionals
Apr 012014

Simplilearn Launches Big Data and Cloud Certification for IT Professionals

Simplilearn announces the launch of its Big Data and Cloud certified training via Live Virtual Classroom for IT professionals to give them the opportunity to interact with world-class Big Data and Hadoop instructors and upgrade their skills. Simplilearn is also among the select few to have received accreditation for its E-Learning course on Comptia Cloud Essentials.

Bangalore, India (PRWEB) March 12, 2014

Simplilearn (, a leading provider of online training and professional certification courses, announces the launch of Big Data and Cloud certified training for IT professionals. Simplilearn will offer Big Data and Hadoop Live Virtual Classes (LVC) to give professionals the opportunity to interact with world-class Big Data and Hadoop instructors and upgrade their skills. Simplilearn is also amongst the few players to have received accreditation for its E-Learning course on Comptia Cloud Essentials.

Big Data and Cloud Certification for IT Professionals

Big Data and Cloud Certification for IT Professionals

According to global research firm Gartner, by 2015, nearly 4.4 million new jobs in Big Data will be created globally but the supply of resources will meet less than half the demand. According to Krishna Kumar, Founder and CEO, Simplilearn, “Big Data and Cloud Computing are two of the most trending subjects in today’s technology world, creating huge career opportunities for IT professionals. Simplilearn is trying to bridge the demand and supply gap by offering high quality Big Data and Hadoop training for professionals. Our courses have specialized content created to enable professionals become the ‘go-to expert’ in their fields”.

Professionals can choose from two options: classroom training of 4 days for a price of USD 1999 and an Online training course starting from USD 130. The key features of the course will include Hadoop Deployment and Maintenance tips as well as real-life scenario based projects. As part of an introductory offer, customers enrolling for Big Data course will also get complimentary access to high quality Comptia Cloud Essential Audio-visual online course worth USD 150. Java developers, Architects, Analysts, Big Data professionals or anyone who is looking to build a career in Big Data can benefit from these trainings.

About Simplilearn
Simplilearn is an online learning destination for young working professionals who are looking at career enhancement through certification courses across industry verticals. With study centers across the globe, offers over 80 certification courses across 11 categories. At present, Simplilearn trains about 5000 professionals a month. Simplilearn is a Global Registered Education Provider (REP) of PMI, USA, Accredited Training Organization (ATO) by APMG International, UK, Accredited Examination Center (AEC) by EXIN and PEOPLECERT. All the courses offered at are accredited for online delivery and approved worldwide. For more information, visit

News Release Source :  Simplilearn Launches Big Data and Cloud Certification for IT Professionals