Nov 072014

SmartDataCenter and Manta are now open source

Joyent Inc, virtualization and cloud computing company based in San Francisco, California, to open sources its container technologies SmartDataCenter and Manta. Joyent CTO Bryan Cantrill publishes a following post on Joyent’s blog.

November 06, 2014 – by Bryan Cantrill

 Today we are announcing that we are open sourcing the two systems at the heart of our business: SmartDataCenter and the Manta object storage platform. SmartDataCenter is the container-based orchestration software that runs the Joyent public cloud; we have used it for the better half of a decade to run on-the-metal OS containers — securely and at scale. Manta is our multi-tenant ZFS-based object storage platform that provides first-class compute by allowing OS containers to be spun up directly upon objects — effecting arbitrary computation at scale without data movement. The unifying technological foundation beneath both SmartDataCenter and Manta is OS-based virtualization, a technology that Joyent pioneered in the cloud way back in 2006. We have long known the transformative power of OS containers, so it has been both exciting and validating for us to see the rise of Docker and the broadening of appreciation for OS-based virtualization. SmartDataCenter and Manta show that containers aren’t merely a fad or developer plaything but rather a fundamental technological advance that represents the foundation for the next generation of computing — and we believe that open sourcing them advances the adoption of container-based architectures more broadly.

Joyent Open Source its SmartDataCenter and Manta

Joyent Open Source its SmartDataCenter and Manta

Without any further ado — and to assure that we don’t fall into the most prominent of my own corporate open source anti-patterns — here is the source for SmartDataCenter and the source for Manta. These are sophisticated systems with many moving parts, and you’ll see that these two repositories are in fact meta-repositories that explain the design of each of the systems and then point to the (many) components that comprise them (all now open source, natch). We believe that some of these subcomponents will likely find use entirely outside of SDC and Manta. For example, Manatee is a ZooKeeper-based system that manages Postgres replication and automates failover; Moray is a key-value service that lives on top of Postgres. Taken together, Manatee and Moray implement a highly-available key-value service that we use as the foundation for many other components in SDC and Manta — and one that we think others will find useful as well.

In terms of source code mechanics, you’ll see that many of the components are implemented in either Node.js or by extending C-based systems. This is not by fiat but rather by the choices of individual engineers; over the past four years, as we learned about the nuances of Node.js error handling and as we invested heavily in tooling for running Node.js in production, Node.js became the right tool for many of our jobs — and we used it for many of the services that constitute SDC and Manta.

And because any conversation about open source has to address licensing at some point or another, let’s get that out of the way: we opted for the Mozilla Public License 2.0. While relatively new, there is a lot to like about this license: its file-based copyleft allows it to be proprietary-friendly while also forcing certain kinds of derived work to be contributed back; its explicit patent license discourages litigation, offering some measure of troll protection; its explicit warranting of original work obviates the need for a contributor license agreement (we’re not so into CLAs); and (best of all, in my opinion), it has been explicitly designed to co-exist with other open source licenses in larger derived works. Mozilla did terrific work on MPL 2.0, and we hope to see it adopted by other companies that share our thinking around open source!

In terms of the business ramifications, at Joyent we have long been believers in open source as a business model; as the leaders of the Node.js and SmartOS projects, we have seen the power of open source to start new conversations, open up new markets and (importantly) yield new customers. Ten years ago, I wrote that open source is “a loss leader — minus the loss, of course”; after a decade of experience with open source business models, I would add that open source also serves as sales outreach without cold calls, as a channel without loss of margin, and as a marketing campaign without advertisements. But while we have directly experienced the business advantages of open source, we at Joyent have also lived something of a dual life: Node.js and SmartOS have been open source, but the distributed systems that we have built using these core technologies have remained largely behind our walls. So that these systems are now open source does not change the fundamentals of our business model: if you would like to consume SmartDataCenter or Manta as a service, you can spin up an instance on the public cloud or use our Manta storage service. Similarly, if you want a support contract and/or professional services to run either SmartDataCenter or Manta on-premises, we’ll sell them to you. Based on our past experiences with open source, we do know that there will be one important change: these technologies will find their way into the hands of those that we have no other way of reaching — and that some fraction of these will become customers. Also based on past experience, we know that some (presumably much smaller) fraction of these new technologists will — by merits of their interest in and contributions to these projects — one day join us as engineers at Joyent. Bluntly, open source is our farm system, and broadening our hiring channel during a blazingly hot market for software talent is playing no small role in our decision here. In short, this is not an act of altruism: it is a business decision — if a multifaceted one that we believe has benefits beyond the balance sheet.

Welcome to open source SDC and Manta — and long-live the container revolution!

News Release Source : SmartDataCenter and Manta are now open source (blog)

Image Credit :

 Posted by at 10:59 pm
Oct 052012

What to keep in Mind while Securing the Public Cloud


The use of Cloud Computing has eliminated many of the problems related with information technology like knowledge, capacity and integrity when these services are used. To protect data in a traditional datacenter, there is a combination of controls on physical access, access to hardware and software, and identity controls. This protective barrier that safeguards infrastructure is diffused in the cloud. To balance this, security needs to become information centric. It is necessary for data to have its own security that travels with it and protects it. To ensure this happens, it will require

Isolation of Data
Data needs to be held securely in order to protect it when multiple customers use shared resources. In most cases, virtualization, encryption and access control will be significant for enabling different degrees of separation between corporations, communities of interest, and users.

Additional granular data security
It is imperative that the granularity of data classification enforcement increases with the increase in the sensitivity of information. In most cases, as the information remains within the control of the enterprise itself, granularity of role-based access control at the level of user groups is acceptable in the current data center environment. For information in the cloud, sensitive data requires security at the file, field, to meet the demands of assurance and compliance.

Reliable data security
To meet the enterprise’s own needs as well as regulatory policy mandates, there is an evident need for policy-based content protection. For certain categories of data, information-centric security will demand encryption in transit and at rest, in addition to management across the cloud and all through the data life cycle.

Effective data classification
Cloud computing compels a resource swap between high performance and the requirements of robust security, and to balance this, data classification is an essential tool. To make performance cost and benefit decisions, as prerequisites, enterprises need to understand that data is important and where it is located. It is also imperative for enterprises to ensure that data-loss-prevention procedures focus on the most critical areas.

Information rights management (IRM)
Usually treated as a component of identity IRM is a way of setting controls about which users have access to what data. Data-centric security requires that policies and control mechanisms regarding the storage and use of information to be associated directly with the information itself.

Governance and compliance
Cloud computing infrastructures must be able to verify that data is being managed according to the applicable local and international regulations (such as PCI and HIPAA) with appropriate controls, log collection and reporting. Not only is it important to document access and denied access to data, but it is also to ensure that IT systems are configured to meet security specifications.

Sensitive data in the cloud will require granular security, maintained consistently throughout the data life cycle. Cloud computing providers in India offer great features at the most competitive price which can be an ideal solution for business owners.

Article Source:

Technology Articles RSS Feed:

Author Bio: Read more on – datacenter, Cloud computing providers in India, Dedicated hosting India