As many of us know, Eucalyptus includes a component called Walrus that implements a significant subset of the S3 API.
In this tech preview that is based off of the Eucalyptus 3.4.0 code base, there are some major architectural changes to the object storage subsystem.
We now have the ability to use third party distributed stores. For the purpose of this tech preview, we have decided on RiakCS from Basho. RiakCS is relatively easy to install and maintain, and is designed primarily as an object store.
There is a new component called the Object Storage Gateway (OSG) that has been added. You can have multiple instances of the OSG per Eucalyptus cloud. OSGs act as proxies for incoming S3 requests. They handle API validation, translation and most importantly, integration and checks for Identity and Access Management (IAM), which is the mechanism used for access control and policy enforcement for the rest of the cloud. The OSG also stores bucket and object metadata and can be used to quickly perform access checks without having the query the backend store. In addition, the OSG has logic to handle concurrent PUTs and resolve conflicts. The following figure demonstrates the high level architecture.
Note that this tech preview is only designed to showcase scale-out storage integrated with Eucalyptus. It does not currently run instances, so please only register the Cloud Controller (CLC) and one or more Object Storage Gateways (OSGs). Obviously, we don't recommend that you use this tech preview in production. You will need a fully configured RiakCS installation and at least one user defined. RiakCS installation instructions can be found here.