Welcome to Apache Libcloud’s documentation!

Apache Libcloud is a Python library which hides differences between different cloud provider APIs and allows you to manage different cloud resources through a unified and easy to use API.

Resource you can manage with Libcloud are divided in the following categories:

_images/supported_providers.png

A subset of supported providers in Libcloud.

Documentation

Main

Getting Started

Installation (stable version)

Libcloud is available on PyPi. You can install latest stable version using pip:

pip install apache-libcloud

Installation (development version)

You can install latest development version from our Git repository:

pip install -e git+https://git-wip-us.apache.org/repos/asf/libcloud.git@trunk#egg=apache-libcloud

Upgrading

If you used pip to install the library you can also use it to upgrade it:

pip install --upgrade apache-libcloud

Using it

This section describes a standard work-flow which you follow when working with any of the Libcloud drivers.

  1. Obtain reference to the provider driver
from pprint import pprint

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver

cls = get_driver(Provider.RACKSPACE)
  1. Instantiate the driver with your provider credentials
driver = cls('my username', 'my api key')

Keep in mind that some drivers take additional arguments such as region and api_version.

For more information on which arguments you can pass to your provider driver, see provider-specific documentation and the driver docstrings.

  1. Start using the driver
pprint(driver.list_sizes())
pprint(driver.list_nodes())
  1. Putting it all together
from pprint import pprint

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver

cls = get_driver(Provider.RACKSPACE)
driver = cls('my username', 'my api key')

pprint(driver.list_sizes())
pprint(driver.list_nodes())

You can find more examples with common patterns which can help you get started on the Compute Examples page.

Where to go from here?

The best thing to do after understanding the basic driver work-flow is to visit the documentation chapter for the API you are interested in (Compute, Object Storage, Load Balancer, DNS). Chapter for each API explains some basic terminology and things you need to know to make an effective use of that API.

After you have a good grasp of those basic concepts, you are encouraged to check the driver specific documentation (if available) and usage examples. If the driver specific documentation for the provider you are interested in is not available yet, you are encouraged to check docstrings for that driver.

Supported Providers

This pages lists supported providers and methods for all the APIs.

Compute

Provider Matrix
Provider Documentation Provider constant Module Class Name
Abiquo   ABIQUO libcloud.compute.drivers.abiquo AbiquoNodeDriver
PCextreme AuroraCompute Click AURORACOMPUTE libcloud.compute.drivers.auroracompute AuroraComputeNodeDriver
Azure Virtual machines Click AZURE libcloud.compute.drivers.azure AzureNodeDriver
Bluebox Blocks   BLUEBOX libcloud.compute.drivers.bluebox BlueboxNodeDriver
Brightbox   BRIGHTBOX libcloud.compute.drivers.brightbox BrightboxNodeDriver
CloudFrames Click CLOUDFRAMES libcloud.compute.drivers.cloudframes CloudFramesNodeDriver
CloudSigma (API v2.0) Click CLOUDSIGMA libcloud.compute.drivers.cloudsigma CloudSigmaNodeDriver
CloudStack Click CLOUDSTACK libcloud.compute.drivers.cloudstack CloudStackNodeDriver
Cloudwatt Click CLOUDWATT libcloud.compute.drivers.cloudwatt CloudwattNodeDriver
DigitalOcean Click DIGITAL_OCEAN libcloud.compute.drivers.digitalocean DigitalOceanNodeDriver
DimensionData Click DIMENSIONDATA libcloud.compute.drivers.dimensiondata DimensionDataNodeDriver
DreamHost VPS   DREAMHOST libcloud.compute.drivers.dreamhost DreamhostNodeDriver
Amazon EC2 Click EC2 libcloud.compute.drivers.ec2 EC2NodeDriver
Amazon EC2 (ap-northeast-1)   EC2_AP_NORTHEAST libcloud.compute.drivers.ec2 EC2APNENodeDriver
Amazon EC2 (ap-southeast-1)   EC2_AP_SOUTHEAST libcloud.compute.drivers.ec2 EC2APSENodeDriver
Amazon EC2 (ap-southeast-2)   EC2_AP_SOUTHEAST2 libcloud.compute.drivers.ec2 EC2APSESydneyNodeDriver
Amazon EC2 (eu-west-1)   EC2_EU libcloud.compute.drivers.ec2 EC2EUNodeDriver
Amazon EC2 (eu-west-1)   EC2_EU_WEST libcloud.compute.drivers.ec2 EC2EUNodeDriver
Amazon EC2 (sa-east-1)   EC2_SA_EAST libcloud.compute.drivers.ec2 EC2SAEastNodeDriver
Amazon EC2   EC2_US_EAST libcloud.compute.drivers.ec2 EC2NodeDriver
Amazon EC2 (us-west-1)   EC2_US_WEST libcloud.compute.drivers.ec2 EC2USWestNodeDriver
Amazon EC2 (us-west-2)   EC2_US_WEST_OREGON libcloud.compute.drivers.ec2 EC2USWestOregonNodeDriver
Enomaly Elastic Computing Platform   ECP libcloud.compute.drivers.ecp ECPNodeDriver
ElasticHosts   ELASTICHOSTS libcloud.compute.drivers.elastichosts ElasticHostsNodeDriver
ElasticHosts (syd-y)   ELASTICHOSTS_AU1 libcloud.compute.drivers.elastichosts ElasticHostsAU1NodeDriver
ElasticHosts (tor-p)   ELASTICHOSTS_CA1 libcloud.compute.drivers.elastichosts ElasticHostsCA1NodeDriver
ElasticHosts (cn-1)   ELASTICHOSTS_CN1 libcloud.compute.drivers.elastichosts ElasticHostsCN1NodeDriver
ElasticHosts (lon-p)   ELASTICHOSTS_UK1 libcloud.compute.drivers.elastichosts ElasticHostsUK1NodeDriver
ElasticHosts (lon-b)   ELASTICHOSTS_UK2 libcloud.compute.drivers.elastichosts ElasticHostsUK2NodeDriver
ElasticHosts (sat-p)   ELASTICHOSTS_US1 libcloud.compute.drivers.elastichosts ElasticHostsUS1NodeDriver
ElasticHosts (lax-p)   ELASTICHOSTS_US2 libcloud.compute.drivers.elastichosts ElasticHostsUS2NodeDriver
ElasticHosts (sjc-c)   ELASTICHOSTS_US3 libcloud.compute.drivers.elastichosts ElasticHostsUS3NodeDriver
Eucalyptus   EUCALYPTUS libcloud.compute.drivers.ec2 EucNodeDriver
Exoscale Click EXOSCALE libcloud.compute.drivers.exoscale ExoscaleNodeDriver
Gandi Click GANDI libcloud.compute.drivers.gandi GandiNodeDriver
Google Compute Engine Click GCE libcloud.compute.drivers.gce GCENodeDriver
GoGrid   GOGRID libcloud.compute.drivers.gogrid GoGridNodeDriver
HostVirtual   HOSTVIRTUAL libcloud.compute.drivers.hostvirtual HostVirtualNodeDriver
HP Public Cloud (Helion) Click HPCLOUD libcloud.compute.drivers.hpcloud HPCloudNodeDriver
IBM SmartCloud Enterprise   IBM libcloud.compute.drivers.ibm_sce IBMNodeDriver
Ikoula Click IKOULA libcloud.compute.drivers.ikoula IkoulaNodeDriver
Joyent   JOYENT libcloud.compute.drivers.joyent JoyentNodeDriver
Kili Public Cloud Click KILI libcloud.compute.drivers.kili KiliCloudNodeDriver
KTUCloud   KTUCLOUD libcloud.compute.drivers.ktucloud KTUCloudNodeDriver
Libvirt Click LIBVIRT libcloud.compute.drivers.libvirt_driver LibvirtNodeDriver
Linode   LINODE libcloud.compute.drivers.linode LinodeNodeDriver
NephoScale   NEPHOSCALE libcloud.compute.drivers.nephoscale NephoscaleNodeDriver
Nimbus Click NIMBUS libcloud.compute.drivers.ec2 NimbusNodeDriver
Ninefold   NINEFOLD libcloud.compute.drivers.ninefold NinefoldNodeDriver
OnApp Click ONAPP libcloud.compute.drivers.onapp OnAppNodeDriver
OpenNebula (v3.8)   OPENNEBULA libcloud.compute.drivers.opennebula OpenNebulaNodeDriver
OpenStack Click OPENSTACK libcloud.compute.drivers.openstack OpenStackNodeDriver
Opsource   OPSOURCE libcloud.compute.drivers.opsource OpsourceNodeDriver
Outscale INC Click OUTSCALE_INC libcloud.compute.drivers.ec2 OutscaleINCNodeDriver
Outscale SAS Click OUTSCALE_SAS libcloud.compute.drivers.ec2 OutscaleSASNodeDriver
Packet Click PACKET libcloud.compute.drivers.packet PacketNodeDriver
ProfitBricks   PROFIT_BRICKS libcloud.compute.drivers.profitbricks ProfitBricksNodeDriver
Rackspace Cloud (Next Gen) Click RACKSPACE libcloud.compute.drivers.rackspace RackspaceNodeDriver
Rackspace Cloud (First Gen)   RACKSPACE_FIRST_GEN libcloud.compute.drivers.rackspace RackspaceFirstGenNodeDriver
RimuHosting   RIMUHOSTING libcloud.compute.drivers.rimuhosting RimuHostingNodeDriver
RunAbove Click RUNABOVE libcloud.compute.drivers.runabove RunAboveNodeDriver
ServerLove   SERVERLOVE libcloud.compute.drivers.serverlove ServerLoveNodeDriver
skalicloud   SKALICLOUD libcloud.compute.drivers.skalicloud SkaliCloudNodeDriver
SoftLayer   SOFTLAYER libcloud.compute.drivers.softlayer SoftLayerNodeDriver
vCloud   TERREMARK libcloud.compute.drivers.vcloud TerremarkDriver
VCL   VCL libcloud.compute.drivers.vcl VCLNodeDriver
vCloud Click VCLOUD libcloud.compute.drivers.vcloud VCloudNodeDriver
Voxel VoxCLOUD   VOXEL libcloud.compute.drivers.voxel VoxelNodeDriver
vps.net   VPSNET libcloud.compute.drivers.vpsnet VPSNetNodeDriver
VMware vSphere Click VSPHERE libcloud.compute.drivers.vsphere VSphereNodeDriver
Vultr Click VULTR libcloud.compute.drivers.vultr VultrNodeDriver
Supported Methods (Base compute)
Provider list nodes create node reboot node destroy node list images list sizes deploy node
Abiquo yes yes yes yes yes yes no
PCextreme AuroraCompute yes yes yes yes yes yes yes
Azure Virtual machines yes yes yes yes yes yes yes
Bluebox Blocks yes yes yes yes yes yes yes
Brightbox yes yes no yes yes yes no
CloudFrames yes yes yes yes yes yes no
CloudSigma (API v2.0) yes yes no yes yes yes no
CloudStack yes yes yes yes yes yes yes
Cloudwatt yes yes yes yes yes yes yes
DigitalOcean yes yes yes yes yes yes no
DimensionData yes yes yes yes yes yes yes
DreamHost VPS yes yes yes yes yes yes no
Amazon EC2 yes yes yes yes yes yes yes
Amazon EC2 (ap-northeast-1) yes yes yes yes yes yes yes
Amazon EC2 (ap-southeast-1) yes yes yes yes yes yes yes
Amazon EC2 (ap-southeast-2) yes yes yes yes yes yes yes
Amazon EC2 (eu-west-1) yes yes yes yes yes yes yes
Amazon EC2 (eu-west-1) yes yes yes yes yes yes yes
Amazon EC2 (sa-east-1) yes yes yes yes yes yes yes
Amazon EC2 yes yes yes yes yes yes yes
Amazon EC2 (us-west-1) yes yes yes yes yes yes yes
Amazon EC2 (us-west-2) yes yes yes yes yes yes yes
Enomaly Elastic Computing Platform yes yes yes yes yes yes no
ElasticHosts yes yes yes yes yes yes yes
ElasticHosts (syd-y) yes yes yes yes yes yes yes
ElasticHosts (tor-p) yes yes yes yes yes yes yes
ElasticHosts (cn-1) yes yes yes yes yes yes yes
ElasticHosts (lon-p) yes yes yes yes yes yes yes
ElasticHosts (lon-b) yes yes yes yes yes yes yes
ElasticHosts (sat-p) yes yes yes yes yes yes yes
ElasticHosts (lax-p) yes yes yes yes yes yes yes
ElasticHosts (sjc-c) yes yes yes yes yes yes yes
Eucalyptus yes yes yes yes yes yes yes
Exoscale yes yes yes yes yes yes yes
Gandi yes yes yes yes yes yes no
Google Compute Engine yes yes yes yes yes yes no
GoGrid yes yes yes yes yes yes yes
HostVirtual yes yes yes yes yes yes yes
HP Public Cloud (Helion) yes yes yes yes yes yes yes
IBM SmartCloud Enterprise yes yes yes yes yes yes no
Ikoula yes yes yes yes yes yes yes
Joyent yes yes yes yes yes yes yes
Kili Public Cloud yes yes yes yes yes yes yes
KTUCloud yes yes yes yes yes yes yes
Libvirt yes no yes yes no no no
Linode yes yes yes yes yes yes yes
NephoScale yes yes yes yes yes yes yes
Nimbus yes yes yes yes yes yes yes
Ninefold yes yes yes yes yes yes yes
OnApp yes yes no yes no no no
OpenNebula (v3.8) yes yes yes yes yes yes no
OpenStack yes no yes yes yes yes no
Opsource yes yes yes yes yes yes yes
Outscale INC yes yes yes yes yes yes yes
Outscale SAS yes yes yes yes yes yes yes
Packet yes yes yes yes yes yes no
ProfitBricks yes yes yes yes yes yes no
Rackspace Cloud (Next Gen) yes yes yes yes yes yes yes
Rackspace Cloud (First Gen) yes yes yes yes yes yes yes
RimuHosting yes yes yes yes yes yes yes
RunAbove yes yes no yes yes yes yes
ServerLove yes yes yes yes yes yes yes
skalicloud yes yes yes yes yes yes yes
SoftLayer yes yes yes yes yes yes yes
vCloud yes yes yes yes yes yes yes
VCL yes yes no yes yes yes no
vCloud yes yes yes yes yes yes yes
Voxel VoxCLOUD yes yes yes yes yes yes no
vps.net yes yes yes yes yes yes no
VMware vSphere yes no yes yes yes no no
Vultr yes yes yes yes yes yes no
Supported Methods (Block Storage)
Provider list volumes create volume destroy volume attach volume detach volume list snapshots create snapshot
Abiquo no no no no no no no
PCextreme AuroraCompute yes yes yes yes yes no yes
Azure Virtual machines yes yes yes yes yes no yes
Bluebox Blocks no no no no no no no
Brightbox no no no no no no no
CloudFrames no no no no no no no
CloudSigma (API v2.0) no no no no no no no
CloudStack yes yes yes yes yes no yes
Cloudwatt yes yes yes yes yes yes yes
DigitalOcean no no no no no no no
DimensionData no no no no no no no
DreamHost VPS no no no no no no no
Amazon EC2 yes yes yes yes yes yes yes
Amazon EC2 (ap-northeast-1) yes yes yes yes yes yes yes
Amazon EC2 (ap-southeast-1) yes yes yes yes yes yes yes
Amazon EC2 (ap-southeast-2) yes yes yes yes yes yes yes
Amazon EC2 (eu-west-1) yes yes yes yes yes yes yes
Amazon EC2 (eu-west-1) yes yes yes yes yes yes yes
Amazon EC2 (sa-east-1) yes yes yes yes yes yes yes
Amazon EC2 yes yes yes yes yes yes yes
Amazon EC2 (us-west-1) yes yes yes yes yes yes yes
Amazon EC2 (us-west-2) yes yes yes yes yes yes yes
Enomaly Elastic Computing Platform no no no no no no no
ElasticHosts no no no no no no no
ElasticHosts (syd-y) no no no no no no no
ElasticHosts (tor-p) no no no no no no no
ElasticHosts (cn-1) no no no no no no no
ElasticHosts (lon-p) no no no no no no no
ElasticHosts (lon-b) no no no no no no no
ElasticHosts (sat-p) no no no no no no no
ElasticHosts (lax-p) no no no no no no no
ElasticHosts (sjc-c) no no no no no no no
Eucalyptus yes yes yes yes yes yes yes
Exoscale yes yes yes yes yes no yes
Gandi yes yes yes yes yes no no
Google Compute Engine yes yes yes yes yes yes yes
GoGrid no no no no no no no
HostVirtual no no no no no no no
HP Public Cloud (Helion) yes yes yes yes yes yes yes
IBM SmartCloud Enterprise yes yes yes yes yes no no
Ikoula yes yes yes yes yes no yes
Joyent no no no no no no no
Kili Public Cloud yes yes yes yes yes yes yes
KTUCloud yes yes yes yes yes no yes
Libvirt no no no no no no no
Linode no no yes no no no no
NephoScale no no no no no no no
Nimbus yes yes yes yes yes yes yes
Ninefold yes yes yes yes yes no yes
OnApp no no no no no no no
OpenNebula (v3.8) yes yes yes yes yes no no
OpenStack yes yes yes yes yes no no
Opsource no no no no no no no
Outscale INC yes yes yes yes yes yes yes
Outscale SAS yes yes yes yes yes yes yes
Packet no no no no no no no
ProfitBricks yes yes yes yes yes no no
Rackspace Cloud (Next Gen) yes yes yes yes yes yes yes
Rackspace Cloud (First Gen) yes yes yes yes yes no no
RimuHosting no no no no no no no
RunAbove yes yes yes yes yes no no
ServerLove no no no no no no no
skalicloud no no no no no no no
SoftLayer no no no no no no no
vCloud no no no no no no no
VCL no no no no no no no
vCloud no no no no no no no
Voxel VoxCLOUD no no no no no no no
vps.net no no no no no no no
VMware vSphere no no no no no no no
Vultr no no no no no no no
Supported Methods (Key pair management)
Provider list key pairs get key pair create key pair import public key from string import public key from file delete key pair
Abiquo no no no no no no
PCextreme AuroraCompute yes yes yes yes no yes
Azure Virtual machines no no no no no no
Bluebox Blocks no no no no no no
Brightbox no no no no no no
CloudFrames no no no no no no
CloudSigma (API v2.0) no no no no no no
CloudStack yes yes yes yes no yes
Cloudwatt yes yes yes yes no yes
DigitalOcean yes yes yes no no yes
DimensionData no no no no no no
DreamHost VPS no no no no no no
Amazon EC2 yes yes yes yes no yes
Amazon EC2 (ap-northeast-1) yes yes yes yes no yes
Amazon EC2 (ap-southeast-1) yes yes yes yes no yes
Amazon EC2 (ap-southeast-2) yes yes yes yes no yes
Amazon EC2 (eu-west-1) yes yes yes yes no yes
Amazon EC2 (eu-west-1) yes yes yes yes no yes
Amazon EC2 (sa-east-1) yes yes yes yes no yes
Amazon EC2 yes yes yes yes no yes
Amazon EC2 (us-west-1) yes yes yes yes no yes
Amazon EC2 (us-west-2) yes yes yes yes no yes
Enomaly Elastic Computing Platform no no no no no no
ElasticHosts no no no no no no
ElasticHosts (syd-y) no no no no no no
ElasticHosts (tor-p) no no no no no no
ElasticHosts (cn-1) no no no no no no
ElasticHosts (lon-p) no no no no no no
ElasticHosts (lon-b) no no no no no no
ElasticHosts (sat-p) no no no no no no
ElasticHosts (lax-p) no no no no no no
ElasticHosts (sjc-c) no no no no no no
Eucalyptus yes yes yes yes no yes
Exoscale yes yes yes yes no yes
Gandi yes yes no yes no yes
Google Compute Engine no no no no no no
GoGrid no no no no no no
HostVirtual no no no no no no
HP Public Cloud (Helion) yes yes yes yes no yes
IBM SmartCloud Enterprise no no no no no no
Ikoula yes yes yes yes no yes
Joyent no no no no no no
Kili Public Cloud yes yes yes yes no yes
KTUCloud yes yes yes yes no yes
Libvirt no no no no no no
Linode no no no no no no
NephoScale no no no no no no
Nimbus yes yes yes yes no yes
Ninefold yes yes yes yes no yes
OnApp no no no no no no
OpenNebula (v3.8) no no no no no no
OpenStack no no no no no no
Opsource no no no no no no
Outscale INC yes yes yes yes no yes
Outscale SAS yes yes yes yes no yes
Packet yes no yes no no yes
ProfitBricks no no no no no no
Rackspace Cloud (Next Gen) yes yes yes yes no yes
Rackspace Cloud (First Gen) no no no no no no
RimuHosting no no no no no no
RunAbove yes yes no yes no yes
ServerLove no no no no no no
skalicloud no no no no no no
SoftLayer yes yes yes yes no yes
vCloud no no no no no no
VCL no no no no no no
vCloud no no no no no no
Voxel VoxCLOUD no no no no no no
vps.net no no no no no no
VMware vSphere no no no no no no
Vultr yes no no no no no

Load Balancer

Provider Matrix
Provider Documentation Provider constant Module Class Name
Brightbox   BRIGHTBOX libcloud.loadbalancer.drivers.brightbox BrightboxLBDriver
CloudStack   CLOUDSTACK libcloud.loadbalancer.drivers.cloudstack CloudStackLBDriver
Dimension Data Load Balancer Click DIMENSIONDATA libcloud.loadbalancer.drivers.dimensiondata DimensionDataLBDriver
Amazon Elastic Load Balancing Click ELB libcloud.loadbalancer.drivers.elb ElasticLBDriver
Google Compute Engine Load Balancer Click GCE libcloud.loadbalancer.drivers.gce GCELBDriver
GoGrid LB   GOGRID libcloud.loadbalancer.drivers.gogrid GoGridLBDriver
Ninefold LB   NINEFOLD libcloud.loadbalancer.drivers.ninefold NinefoldLBDriver
Rackspace LB   RACKSPACE libcloud.loadbalancer.drivers.rackspace RackspaceLBDriver
Rackspace LB   RACKSPACE_UK libcloud.loadbalancer.drivers.rackspace RackspaceUKLBDriver
Rackspace LB   RACKSPACE_US libcloud.loadbalancer.drivers.rackspace RackspaceLBDriver
Softlayer Load Balancing   SOFTLAYER libcloud.loadbalancer.drivers.softlayer SoftlayerLBDriver
Supported Methods
Provider create balancer list balancers list members attach member detach member attach compute node
Brightbox yes yes yes yes yes yes
CloudStack yes yes yes yes yes no
Dimension Data Load Balancer yes yes yes yes yes no
Amazon Elastic Load Balancing yes yes yes no yes yes
Google Compute Engine Load Balancer yes yes yes yes yes yes
GoGrid LB yes yes yes yes yes no
Ninefold LB yes yes yes yes yes no
Rackspace LB yes yes yes yes yes no
Rackspace LB yes yes yes yes yes no
Rackspace LB yes yes yes yes yes no
Softlayer Load Balancing no yes yes yes yes no

Object Storage

Provider Matrix
Provider Documentation Provider constant Module Class Name
PCextreme AuroraObjects Click AURORAOBJECTS libcloud.storage.drivers.auroraobjects AuroraObjectsStorageDriver
Microsoft Azure (blobs) Click AZURE_BLOBS libcloud.storage.drivers.azure_blobs AzureBlobsStorageDriver
CloudFiles   CLOUDFILES libcloud.storage.drivers.cloudfiles CloudFilesStorageDriver
CloudFiles (UK)   CLOUDFILES_UK libcloud.storage.drivers.cloudfiles CloudFilesUKStorageDriver
CloudFiles (US)   CLOUDFILES_US libcloud.storage.drivers.cloudfiles CloudFilesUSStorageDriver
Google Storage Click GOOGLE_STORAGE libcloud.storage.drivers.google_storage GoogleStorageDriver
KTUCloud Storage   KTUCLOUD libcloud.storage.drivers.ktucloud KTUCloudStorageDriver
Nimbus.io   NIMBUS libcloud.storage.drivers.nimbus NimbusStorageDriver
Ninefold   NINEFOLD libcloud.storage.drivers.ninefold NinefoldStorageDriver
OpenStack Swift Click OPENSTACK_SWIFT libcloud.storage.drivers.cloudfiles OpenStackSwiftStorageDriver
Amazon S3 (standard) Click S3 libcloud.storage.drivers.s3 S3StorageDriver
Amazon S3 (ap-northeast-1)   S3_AP_NORTHEAST libcloud.storage.drivers.s3 S3APNEStorageDriver
Amazon S3 (ap-southeast-1)   S3_AP_SOUTHEAST libcloud.storage.drivers.s3 S3APSEStorageDriver
Amazon S3 (eu-west-1)   S3_EU_WEST libcloud.storage.drivers.s3 S3EUWestStorageDriver
Amazon S3 (sa-east-1)   S3_SA_EAST libcloud.storage.drivers.s3 S3SAEastStorageDriver
Amazon S3 (us-west-1)   S3_US_WEST libcloud.storage.drivers.s3 S3USWestStorageDriver
Amazon S3 (us-west-2)   S3_US_WEST_OREGON libcloud.storage.drivers.s3 S3USWestOregonStorageDriver
Supported Methods (Main)
Provider list containers list objects create container delete container upload object streaming object upload download object streaming object download delete object
PCextreme AuroraObjects yes yes yes yes yes yes yes yes yes
Microsoft Azure (blobs) yes yes yes yes yes yes yes yes yes
CloudFiles yes yes yes yes yes yes yes yes yes
CloudFiles (UK) yes yes yes yes yes yes yes yes yes
CloudFiles (US) yes yes yes yes yes yes yes yes yes
Google Storage yes yes yes yes yes yes yes yes yes
KTUCloud Storage yes yes yes yes yes yes yes yes yes
Nimbus.io yes no yes no no no no no no
Ninefold yes yes yes yes yes yes yes yes yes
OpenStack Swift yes yes yes yes yes yes yes yes yes
Amazon S3 (standard) yes yes yes yes yes yes yes yes yes
Amazon S3 (ap-northeast-1) yes yes yes yes yes yes yes yes yes
Amazon S3 (ap-southeast-1) yes yes yes yes yes yes yes yes yes
Amazon S3 (eu-west-1) yes yes yes yes yes yes yes yes yes
Amazon S3 (sa-east-1) yes yes yes yes yes yes yes yes yes
Amazon S3 (us-west-1) yes yes yes yes yes yes yes yes yes
Amazon S3 (us-west-2) yes yes yes yes yes yes yes yes yes
Supported Methods (CDN)
Provider enable container cdn enable object cdn get container cdn URL get object cdn URL
PCextreme AuroraObjects yes yes yes yes
Microsoft Azure (blobs) no no no no
CloudFiles yes no yes yes
CloudFiles (UK) yes no yes yes
CloudFiles (US) yes no yes yes
Google Storage no no no no
KTUCloud Storage yes no yes yes
Nimbus.io no no no no
Ninefold no yes no yes
OpenStack Swift yes no yes yes
Amazon S3 (standard) no no no no
Amazon S3 (ap-northeast-1) no no no no
Amazon S3 (ap-southeast-1) no no no no
Amazon S3 (eu-west-1) no no no no
Amazon S3 (sa-east-1) no no no no
Amazon S3 (us-west-1) no no no no
Amazon S3 (us-west-2) no no no no

DNS

Provider Matrix
Provider Documentation Provider constant Module Class Name
AuroraDNS Click AURORADNS libcloud.dns.drivers.auroradns AuroraDNSDriver
DigitalOcean Click DIGITAL_OCEAN libcloud.dns.drivers.digitalocean DigitalOceanDNSDriver
DNSimple Click DNSIMPLE libcloud.dns.drivers.dnsimple DNSimpleDNSDriver
Gandi DNS   GANDI libcloud.dns.drivers.gandi GandiDNSDriver
Google DNS   GOOGLE libcloud.dns.drivers.google GoogleDNSDriver
Host Virtual DNS Click HOSTVIRTUAL libcloud.dns.drivers.hostvirtual HostVirtualDNSDriver
Linode DNS   LINODE libcloud.dns.drivers.linode LinodeDNSDriver
Liquidweb DNS Click LIQUIDWEB libcloud.dns.drivers.liquidweb LiquidWebDNSDriver
Point DNS Click POINTDNS libcloud.dns.drivers.pointdns PointDNSDriver
Rackspace DNS   RACKSPACE libcloud.dns.drivers.rackspace RackspaceDNSDriver
Rackspace DNS (UK)   RACKSPACE_UK libcloud.dns.drivers.rackspace RackspaceUKDNSDriver
Rackspace DNS (US)   RACKSPACE_US libcloud.dns.drivers.rackspace RackspaceUSDNSDriver
Route53 DNS   ROUTE53 libcloud.dns.drivers.route53 Route53DNSDriver
Softlayer DNS   SOFTLAYER libcloud.dns.drivers.softlayer SoftLayerDNSDriver
Vultr DNS Click VULTR libcloud.dns.drivers.vultr VultrDNSDriver
World Wide DNS Click WORLDWIDEDNS libcloud.dns.drivers.worldwidedns WorldWideDNSDriver
Zerigo DNS   ZERIGO libcloud.dns.drivers.zerigo ZerigoDNSDriver
Zonomi DNS Click ZONOMI libcloud.dns.drivers.zonomi ZonomiDNSDriver
Supported Methods
Provider list zones list records create zone update zone create record update record delete zone delete record
AuroraDNS yes yes yes no yes yes yes yes
DigitalOcean yes yes yes no yes yes yes yes
DNSimple yes yes yes no yes yes yes yes
Gandi DNS yes yes yes yes yes yes yes yes
Google DNS yes yes yes no yes no yes yes
Host Virtual DNS yes yes yes yes yes yes yes yes
Linode DNS yes yes yes yes yes yes yes yes
Liquidweb DNS yes yes yes no yes yes yes yes
Point DNS yes yes yes yes yes yes yes yes
Rackspace DNS yes yes yes yes yes yes yes yes
Rackspace DNS (UK) yes yes yes yes yes yes yes yes
Rackspace DNS (US) yes yes yes yes yes yes yes yes
Route53 DNS yes yes yes no yes yes yes yes
Softlayer DNS yes yes yes no yes yes yes yes
Vultr DNS yes yes yes no yes no yes yes
World Wide DNS yes yes yes yes yes yes yes yes
Zerigo DNS yes yes yes yes yes yes yes yes
Zonomi DNS yes yes yes no yes no yes yes

Third Party Drivers

Libcloud includes most of the drivers in its core, but some providers and developers for various reasons decide to release their driver as a separate PyPi package.

This page lists those third party drivers. For documentation and usage examples, please refer to the third party driver documentation (if available).

Keep in mind that those drivers are not part of the core and such we can’t guarantee the quality of those drivers.

Compute

The compute component of libcloud allows you to manage cloud and virtual servers offered by different providers, more than 20 in total.

In addition to managing the servers this component also allows you to run deployment scripts on newly created servers. Deployment or “bootstrap” scripts allow you to execute arbitrary shell commands. This functionality is usually used to prepare your freshly created server, install your SSH key, and run a configuration management tool (such as Puppet, Chef, or cfengine) on it.

Besides managing cloud and virtual servers, compute component also allows you to manage cloud block storage (not to be confused with cloud object storage) for providers which support it. Block storage management is lives under compute API, because it is in most cases tightly coupled with compute resources.

Terminology

Compute
  • Node - represents a cloud or virtual server.
  • NodeSize - represents node hardware configuration. Usually this is amount of the available RAM, bandwidth, CPU speed and disk size. Most of the drivers also expose an hourly price (in dollars) for the Node of this size.
  • NodeImage - represents an operating system image.
  • NodeLocation - represents a physical location where a server can be.
  • NodeState - represents a node state. Standard states are: running, rebooting, terminated, pending, stopped, suspended, paused, erro, unknown.
Key Pair Management
  • KeyPair - represents an SSH key pair object.
Block Storage

Supported Providers

For a list of supported providers see supported providers page.

Pricing

For majority of the compute providers Libcloud provides estimated pricing information which tells users how much it costs per hour to run a Node with a specific NodeSize.

For more information, please see the pricing page.

Deployment

Libcloud provides deployment functionality which makes bootstrapping a server easier. It allows you to create a server and run shell commands on it once the server has been created.

For more information and examples, please see the deployment page.

SSH key pair management

Compute API also allows you to manage your SSH key pairs.

For more information and examples, please see the key pair management page.

API Reference

For a full reference of all the classes and methods exposed by the compute API, see this page.

Object Storage

Note

Object Storage API is available in Libcloud 0.5.0 and higher.

Storage API allows you to manage cloud object storage (not to be confused with cloud block storage) and services such as Amazon S3, Rackspace CloudFiles, Google Storage and others.

Besides managing cloud object storage, storage component also exposes simple CDN management functionality.

Terminology

  • Container - represents a container which can contain multiple objects. You can think of it as a folder on a file system. Difference between container and a folder on file system is that containers cannot be nested. Some APIs and providers (e.g. AWS) refer to it as a Bucket.
  • Object - represents an object or so called BLOB.

Supported Providers

For a list of supported providers see supported providers page.

API Reference

For a full reference of all the classes and methods exposed by the storage API, see this page.

Load Balancer

Note

Load Balancer API is available in Libcloud 0.5.0 and higher.

Load Balancer API allows you to manage Load Balancers as a service and services such as Rackspace Cloud Load Balancers, GoGrid Load Balancers and Ninefold Load Balancers.

Terminology

  • LoadBalancer - represents a load balancer instance.
  • Member - represents a load balancer member.
  • Algorithm - represents a load balancing algorithm (round-robin, random, least connections, etc.).

Supported Providers

For a list of supported providers see supported providers page.

API Reference

For a full reference of all the classes and methods exposed by the loadbalancer API, see this page.

DNS

Note

DNS API is available in Libcloud 0.6.0 and higher.

DNS API allows you to manage DNS as A Service and services such as Zerigo DNS, Rackspace Cloud DNS and others.

Terminology

  • Zone - Represents a DNS zone or so called domain.
  • Record - Represents a DNS record. Each record belongs to a Zone and has a type and data attribute. Value of the data attribute depends on the record type. Some record types also require user to associate additional attributes with them. Those additional attributes are stored in the extra attribute (dictionary) on the record object. An example include MX and SRV record type which also contains a priority.
  • RecordType - Represents a DNS record type (A, AAAA, MX, TXT, SRV, PTR, NS, etc.)
  • Zone Type - Each zone has a type attribute. This attribute represents a zone type. Type can either be master (also called primary) or slave (also called secondary).

Supported Providers

For a list of supported providers see supported providers page.

API Reference

For a full reference of all the classes and methods exposed by the DNS API, see this page.

Troubleshooting

This page contains various tips which can help you troubleshoot and debug code with interfaces with libcloud.

Debugging

Note

If you are sharing debug output on any public medium such as our IRC channel or an issue tracker using Pastebin, Github Gists or a similar service, make sure to remove your credentials and any other data you consider private from the output.

Libcloud has a special debug mode which when enabled, logs all the outgoing HTTP requests and all the incoming HTTP responses. Output also includes cURL commands which can be used to re-produce the requests.

When this mode is enabled and paramiko library is installed (used for deployment), paramiko library log level is set to DEBUG which helps with debugging the deployment related issues.

To make the debugging easier, Libcloud will also automatically decompress the response body (if compressed) before logging it.

To enable it, set LIBCLOUD_DEBUG environment variable and make it point to a file where the debug output should be saved.

If the API returns JSON or XML in the response body which is not human friendly, you can also set LIBCLOUD_DEBUG_PRETTY_PRINT_RESPONSE environment variable which will cause the JSON or XML to be beautified / formated so it’s easier for humans to read it. Keep in mind that this only works for non-chunked responses.

Example 1 - Logging output to standard error

If you want the output to be logged to the standard error (on Linux) you can set it to /dev/stderr:

LIBCLOUD_DEBUG=/dev/stderr python my_script.py

Example output:

# -------- begin 4431824872 request ----------
curl -i -X GET -H 'Host: s3.amazonaws.com' -H 'X-LC-Request-ID: 4431824872' -H 'Content-Length: 0' -H 'User-Agent: libcloud/0.6.0-beta1 (Amazon S3 (standard))' 'https://s3.amazonaws.com:443/?AWSAccessKeyId=foo&Signature=bar'
# -------- begin 4431824872:4431825232 response ----------
HTTP/1.1 200 OK
X-Amz-Id-2: 1234
Server: AmazonS3
Transfer-Encoding: chunked
X-Amz-Request-Id: FFFFFFFFFF
Date: Tue, 01 Nov 2011 22:29:11 GMT
Content-Type: application/xml

171
<?xml version="1.0" encoding="UTF-8"?>
<ListAllMyBucketsResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Owner><ID>sada8932dsa8d30i</ID><DisplayName>kami</DisplayName></Owner><Buckets><Bucket><Name>test34324323</Name><CreationDate>2011-11-01T22:17:23.000Z</CreationDate></Bucket></Buckets></ListAllMyBucketsResult>
0

# -------- end 4431824872:4431825232 response ----------
Example 2 - Making JSON / XML response human friendly

Non-formatted JSON response:

LIBCLOUD_DEBUG=/dev/stderr python my_script.py
# -------- begin 23125648:23160304 response ----------
HTTP/1.1 200 OK
Content-Length: 1572
X-Compute-Request-Id: req-79ab42d8-a959-44eb-8dec-bc9458b2f4b3
Server: nginx/1.4.7
Connection: keep-alive
Date: Sat, 06 Sep 2014 14:13:37 GMT
Content-Type: application/json

{"servers": [{"status": "ACTIVE", "updated": "2014-09-06T14:13:32Z", "hostId": "561d56de25c177c422278d7ca5f8b210118348040b12afbad06f278a", "addresses": {"internet-routable": [{"OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:3f:c0:a1", "version": 4, "addr": "10.100.100.101", "OS-EXT-IPS:type": "fixed"}]}, "links": [{"href": "http://nova/v2/d3b31ebfd32744d19d848f3e9c351869/servers/deb35f96-be41-431e-b931-6e615ec720f4", "rel": "self"}, {"href": "http://nova/d3b31ebfd32744d19d848f3e9c351869/servers/deb35f96-be41-431e-b931-6e615ec720f4", "rel": "bookmark"}], "key_name": null, "image": {"id": "e9537ddd-6579-4473-9898-d211ab90f6d3", "links": [{"href": "http://nova/d3b31ebfd32744d19d848f3e9c351869/images/e9537ddd-6579-4473-9898-d211ab90f6d3", "rel": "bookmark"}]}, "OS-EXT-STS:task_state": null, "OS-EXT-STS:vm_state": "active", "OS-SRV-USG:launched_at": "2014-09-06T14:13:32.000000", "flavor": {"id": "90c2a137-611b-4dd2-9d65-d4a0b0858531", "links": [{"href": "http://nova/d3b31ebfd32744d19d848f3e9c351869/flavors/90c2a137-611b-4dd2-9d65-d4a0b0858531", "rel": "bookmark"}]}, "id": "deb35f96-be41-431e-b931-6e615ec720f4", "security_groups": [{"name": "default"}], "OS-SRV-USG:terminated_at": null, "OS-EXT-AZ:availability_zone": "nova", "user_id": "06dda7c06aa246c88d7775d02bc119ac", "name": "test lc 2", "created": "2014-09-06T14:13:12Z", "tenant_id": "d3b31ebfd32744d19d848f3e9c351869", "OS-DCF:diskConfig": "MANUAL", "os-extended-volumes:volumes_attached": [], "accessIPv4": "", "accessIPv6": "", "progress": 0, "OS-EXT-STS:power_state": 1, "config_drive": "", "metadata": {}}]}
# -------- end 23125648:23160304 response ----------

Human friendly formatted JSON response:

LIBCLOUD_DEBUG=/dev/stderr LIBCLOUD_DEBUG_PRETTY_PRINT_RESPONSE=1 python my_script.py
# -------- begin 41102928:41133624 response ----------
HTTP/1.1 200 OK
Content-Length: 1572
X-Compute-Request-Id: req-3ce8b047-55cd-4e20-bfeb-b65619696aec
Server: nginx/1.4.7
Connection: keep-alive
Date: Sat, 06 Sep 2014 14:14:38 GMT
Content-Type: application/json

{
    "servers": [
        {
            "OS-DCF:diskConfig": "MANUAL",
            "OS-EXT-AZ:availability_zone": "nova",
            "OS-EXT-STS:power_state": 1,
            "OS-EXT-STS:task_state": null,
            "OS-EXT-STS:vm_state": "active",
            "OS-SRV-USG:launched_at": "2014-09-06T14:13:32.000000",
            "OS-SRV-USG:terminated_at": null,
            "accessIPv4": "",
            "accessIPv6": "",
            "addresses": {
                "internet-routable": [
                    {
                        "OS-EXT-IPS-MAC:mac_addr": "fa:16:3e:3f:c0:a1",
                        "OS-EXT-IPS:type": "fixed",
                        "addr": "10.100.100.101",
                        "version": 4
                    }
                ]
            },
            "config_drive": "",
            "created": "2014-09-06T14:13:12Z",
            "flavor": {
                "id": "90c2a137-611b-4dd2-9d65-d4a0b0858531",
                "links": [
                    {
                        "href": "http://nova/d3b31ebfd32744d19d848f3e9c351869/flavors/90c2a137-611b-4dd2-9d65-d4a0b0858531",
                        "rel": "bookmark"
                    }
                ]
            },
            "hostId": "561d56de25c177c422278d7ca5f8b210118348040b12afbad06f278a",
            "id": "deb35f96-be41-431e-b931-6e615ec720f4",
            "image": {
                "id": "e9537ddd-6579-4473-9898-d211ab90f6d3",
                "links": [
                    {
                        "href": "http://nova/d3b31ebfd32744d19d848f3e9c351869/images/e9537ddd-6579-4473-9898-d211ab90f6d3",
                        "rel": "bookmark"
                    }
                ]
            },
            "key_name": null,
            "links": [
                {
                    "href": "http://nova/v2/d3b31ebfd32744d19d848f3e9c351869/servers/deb35f96-be41-431e-b931-6e615ec720f4",
                    "rel": "self"
                },
                {
                    "href": "http://nova/d3b31ebfd32744d19d848f3e9c351869/servers/deb35f96-be41-431e-b931-6e615ec720f4",
                    "rel": "bookmark"
                }
            ],
            "metadata": {},
            "name": "test lc 2",
            "os-extended-volumes:volumes_attached": [],
            "progress": 0,
            "security_groups": [
                {
                    "name": "default"
                }
            ],
            "status": "ACTIVE",
            "tenant_id": "d3b31ebfd32744d19d848f3e9c351869",
            "updated": "2014-09-06T14:13:32Z",
            "user_id": "06dda7c06aa246c88d7775d02bc119ac"
        }
    ]
}
# -------- end 41102928:41133624 response ----------

Non-formatted XML response:

LIBCLOUD_DEBUG=/dev/stderr python my_script.py
# -------- begin 33145616:33126160 response ----------
HTTP/1.1 200 OK
X-Amzn-Requestid: e84f62d0-368e-11e4-820b-8bf013dc269e
Date: Sun, 07 Sep 2014 13:00:13 GMT
Content-Length: 457
Content-Type: text/xml

<?xml version="1.0"?>
<ListHostedZonesResponse xmlns="https://route53.amazonaws.com/doc/2012-02-29/"><HostedZones><HostedZone><Id>/hostedzone/Z14L0C73CHH1DN</Id><Name>example1.com.</Name><CallerReference>41747982-568E-0DFC-8C11-71C23757C740</CallerReference><Config><Comment>test</Comment></Config><ResourceRecordSetCount>9</ResourceRecordSetCount></HostedZone></HostedZones><IsTruncated>false</IsTruncated><MaxItems>100</MaxItems></ListHostedZonesResponse>
# -------- end 33145616:33126160 response ----------

Human friendly formatted XML response:

LIBCLOUD_DEBUG=/dev/stderr LIBCLOUD_DEBUG_PRETTY_PRINT_RESPONSE=1 python my_script.py
# -------- begin 19444496:19425040 response ----------
HTTP/1.1 200 OK
X-Amzn-Requestid: 01c02441-368f-11e4-b616-9b9bd7509a8f
Date: Sun, 07 Sep 2014 13:00:56 GMT
Content-Length: 457
Content-Type: text/xml

<?xml version="1.0" ?>
<ListHostedZonesResponse xmlns="https://route53.amazonaws.com/doc/2012-02-29/">
    <HostedZones>
        <HostedZone>
            <Id>/hostedzone/Z14L0C73CHH1DN</Id>
            <Name>example1.com.</Name>
            <CallerReference>41747982-568E-0DFC-8C11-71C23757C740</CallerReference>
            <Config>
                <Comment>test</Comment>
            </Config>
            <ResourceRecordSetCount>9</ResourceRecordSetCount>
        </HostedZone>
    </HostedZones>
    <IsTruncated>false</IsTruncated>
    <MaxItems>100</MaxItems>
</ListHostedZonesResponse>

# -------- end 19444496:19425040 response ----------

API Documentation

For automatically generated API documentation of all the modules, please visit this page.

Frequently Asked Questions (FAQ)

What are the extension methods and arguments?

Libcloud acts as a lowest common denominator and exposes a unified base API which allows you to work with many different cloud providers through a single code base.

Being a lowest common denominator by definition means that not all of the functionality offered by different cloud service providers is available through a base API.

Libcloud solves this problem and allows user to access provider specific functionality through a so called extension methods and arguments. Extension methods and arguments are all the methods and arguments which are prefixed with ex_.

Extension methods are there for your convenience, but you should be careful when you use them because they make switching or working with multiple providers harder.

How do I test if provider credentials are valid?

Libcloud makes the whole authentication process transparent to the user. As such, the easiest way to check if provider credentials are valid is by instantiating a driver and calling a method which results in an HTTP call.

If the credentials are valid, method will return a result, otherwise libcloud.common.types.InvalidCredsError exception will be thrown.

An example of such method is libcloud.compute.base.NodeDriver.list_nodes(). Keep in mind that depending on the account state, list_nodes method might return a lot of data.

If you want to avoid unnecessarily fetching a lot of data, you should find a method specific to your provider which issues a request which results in small amount of data being retrieved.

I want do add a new provider driver what should I do?

For now the best thing to do is to look at an existing driver and test cases for examples.

Libcloud currently supports more than 25 different providers. This means we have a broad range of examples of different APIs and authentication methods. APIs range from simple JSON based REST APIs to SOAP APIs. Authentication methods range from simple shared token and digest auth to HMAC signed requests.

I want to add / propose a new API, what should I do?

We are always open to accepting a now top level API as long as it matches the following criteria:

  1. API must be indented to manage an online infrastructure oriented Cloud service
  2. Similar service is offered by multiple providers
  3. It’s possible to build a common API on top of services provided by different services

Libcloud can be used with many different providers and acts as a lowest common denominator which makes the last point most important one. Sometimes it doesn’t make sense to build a common Libcloud API even if multiple providers offer a similar service. Usually the case is that the APIs are vastly different and there aren’t enough common points which would allow us to build a cross-provider API which would still provide enough value to the end user.

If the API matches the criteria defined above, you should send a proposal to our mailing list where we can discuss it further. Ideally, the proposal should also contain a prototype of a driver for at least two different providers. This helps us make sure that the API you have designed is not biased towards a single provider.

How do I obtain Libcloud version?

You can obtain currently active Libcloud version by accessing the libcloud.__version__ variable.

Example #1 (command line):

python -c "import libcloud ; print libcloud.__version__"

Example #2 (code):

import libcloud
libcloud.__version__

Registering a third party driver

Driver is considered third party if it’s not bundled with a Libcloud release.

To register a third party driver you should use provider.set_driver() function from the corresponding component.

set_driver() takes the following arguments:

set_driver('provider_name', 'path.to.the.module', 'DriverClass')

Keep in mind that the provider_name needs to be unique and this function needs to be called before using a third party driver.

For example:

from libcloud.compute.providers import get_driver
from libcloud.compute.providers import set_driver


set_driver('stratuslab',
           'stratuslab.libcloud.stratuslab_driver',
           'StratusLabNodeDriver')

# Your code which uses the driver.
# For example:
driver = get_driver('stratuslab')

An example of an existing third party driver can be found at https://github.com/StratusLab/libcloud-drivers

SSL Certificate Validation

When establishing a secure connection to a cloud provider endpoint, Libcloud verifies server SSL certificate. By default, Libcloud searches paths listed in libcloud.security.CA_CERTS_PATH variable for the CA certificate files.

CA_CERTS_PATH contains common paths to CA bundle installations on the following platforms:

  • openssl package on CentOS / Fedora
  • ca-certificates package on Debian / Ubuntu / Arch / Gentoo
  • ca_root_nss port on FreeBSD
  • curl-ca-bundle port on Mac OS X

If no valid CA certificate files are found, you will see an error message similar to the one below:

No CA Certificates were found in CA_CERTS_PATH.

Acquiring CA Certificates

If the above packages are unavailable to you, and you don’t wish to roll your own, the makers of cURL provides an excellent resource, generated from Mozilla: http://curl.haxx.se/docs/caextract.html.

Using a custom CA certificate

If you want to use a custom CA certificate file for validating the server certificate, you can do that using two different approaches:

  1. Setting SSL_CERT_FILE environment variable to point to your CA file
SSL_CERT_FILE=/home/user/path-to-your-ca-file.crt python my_script.py
  1. Setting libcloud.security.CA_CERTS_PATH variable in your script to point to your CA file
import libcloud.security
libcloud.security.CA_CERTS_PATH = ['/home/user/path-to-your-ca-file.crt']

# Instantiate and work with the driver here...

Adding additional CA certificate to the path

If you want to add an additional CA certificate to the CA_CERTS_PATH, you can do this by appending a path to your CA file to the libcloud.security.CA_CERTS_PATH list.

For example:

import libcloud.security
libcloud.security.CA_CERTS_PATH.append('/home/user/path-to-your-ca-file.crt')

# Instantiate and work with the driver here...

Disabling SSL certificate validation

Note

Disabling SSL certificate validations makes you vulnerable to MITM attacks so you are strongly discouraged from doing that. You should only disable it if you are aware of the consequences and you know what you are doing.

To disable SSL certificate validation, set libcloud.security.VERIFY_SSL_CERT variable to False at the top of your script, before instantiating a driver and interacting with other Libcloud code.

For example:

import libcloud.security
libcloud.security.VERIFY_SSL_CERT = False

# Instantiate and work with the driver here...

Using an HTTP proxy

Note

Support for HTTP proxies is only available in Libcloud trunk and higher.

Libcloud supports using an HTTP proxy for outgoing HTTP and HTTPS requests.

Proxy support has been tested with the following Python versions;

  • Python 2.6
  • Python 2.7 / PyPy
  • Python 3.1
  • Python 3.2
  • Python 3.3
  • Python 3.4

You can specify which HTTP proxy to use using one of the approaches described below:

  • By setting http_proxy environment variable (this setting is system / process wide)
  • By passing http_proxy argument to the libcloud.common.base.LibcloudHTTPConnection class constructor (this setting is local to the connection instance)
  • By calling libcloud.common.base.LibcloudHTTPConnection.set_http_proxy() method (this setting is local to the connection instance)

Known limitations

  • Only HTTP basic access authentication proxy authorization method is supported

Examples

This section includes some code examples which show how to use an HTTP proxy with Libcloud.

1. Using http_proxy environment variable

By setting http_proxy environment variable you can specify which proxy to use for all of the outgoing requests for a duration / life-time of the process or a script.

Without authentication:

http_proxy=http://<proxy hostname>:<proxy port> python my_script.py

With basic auth authentication:

http_proxy=http://<username>:<password>@<proxy hostname>:<proxy port> python my_script.py
2. Passing http_proxy argument to the connection class constructor

By passing http_proxy argument to the libcloud.common.base.Connection class constructor, you can specify which proxy to use for a particular connection.

from libcloud.compute.drivers.dreamhost import DreamhostConnection

PROXY_URL_NO_AUTH = 'http://<proxy hostname>:<proxy port>'
PROXY_URL_BASIC_AUTH = 'http://<user>:<pass>@<proxy hostname>:<proxy port>'

conn = DreamhostConnection(host='dreamhost.com', port=443,
                           timeout=None, proxy_url=PROXY_URL_NO_AUTH)
3. Calling set_http_proxy method

Calling set_http_proxy method allows you to specify which proxy to use for all the outgoing requests which follow set_http_proxy method call.

This method also allows you to use a different proxy for each request as shown in the example below.

from pprint import pprint

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver

PROXY_URL_NO_AUTH_1 = 'http://<proxy hostname 1>:<proxy port 2>'
PROXY_URL_NO_AUTH_2 = 'http://<proxy hostname 1>:<proxy port 2>'
PROXY_URL_BASIC_AUTH = 'http://<user>:<pass>@<proxy hostname>:<proxy port>'

cls = get_driver(Provider.RACKSPACE)
driver = cls('username', 'api key', region='ord')

# Use proxy 1 for this request
driver.connection.set_http_proxy(proxy_url=PROXY_URL_NO_AUTH_1)
pprint(driver.list_nodes())

# Use proxy 2 for this request
driver.connection.set_http_proxy(proxy_url=PROXY_URL_NO_AUTH_2)
pprint(driver.list_nodes())

Using Libcloud in multi-threaded and async environments

Libcloud’s primary task is to communicate with different provider APIs using HTTP. This means most of the work is not CPU intensive, but performing all those HTTP requests includes a lot of waiting which makes the library I/O bound.

Most of the time you want to perform more operations in parallel or just want your code to finish faster (for example starting a lot of servers or periodically polling for node status).

Problems like this are usually solved using threads or async libraries such as Twisted, Tornado or gevent.

This page contains some information and tips about how to use Libcloud in such environments.

Libcloud and thread-safety

Important thing to keep in mind when dealing with threads is thread-safety. Libcloud driver instance is not thread safe. This means if you don’t want to deal with complex (and usually inefficient) locking the easiest solution is to create a new driver instance inside each thread.

Using Libcloud with gevent

gevent has an ability to monkey patch and replace functions in the Python socket, urllib2, httplib and time module with its own functions which don’t block.

You need to do two things when you want to use Libcloud with gevent:

  • Enable monkey patching
from gevent import monkey
monkey.patch_all()
  • Create a separate driver instance for each Greenlet. This is necessary because a driver instance reuses the same Connection class.

For an example see Efficiently download multiple files using gevent.

Using Libcloud with Twisted

Libcloud has no Twisted support included in the core which means you need to be careful when you use it with Twisted and some other async frameworks.

If you don’t use it properly it can block the whole reactor (similar as any other blocking library or a long CPU-intensive task) which means the execution of other pending tasks in the event queue will be blocked.

A simple solution to prevent blocking the reactor is to run Libcloud calls inside a thread. In Twisted this can be achieved using threads.deferToThread which runs a provided method inside the Twisted thread pool.

The example below demonstrates how to create a new node inside a thread without blocking the whole reactor.

from __future__ import absolute_import

from pprint import pprint

from twisted.internet import defer, threads, reactor
from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver


@defer.inlineCallbacks
def create_node(name):
    node = yield threads.deferToThread(_thread_create_node,
                                       name=name)
    pprint(node)
    reactor.stop()


def _thread_create_node(name):
    Driver = get_driver(Provider.RACKSPACE)
    conn = Driver('username', 'api key')
    image = conn.list_images()[0]
    size = conn.list_sizes()[0]
    node = conn.create_node(name=name, image=image, size=size)
    return node


def stop(*args, **kwargs):
    reactor.stop()

d = create_node(name='my-lc-node')
d.addCallback(stop)
d.addErrback(stop)

reactor.run()

Working with the object oriented APIs

To make it easier for the end user, Libcloud components expose a fully object-oriented API.

This means that besides the driver object you also work with NodeImage, and NodeSize object in the compute API, Container and Object object in the Storage API, Zone and Record object in the DNS API and so on.

Methods which operate on those resources usually require you to pass in an instance of the resource you want to manipulate or work with and not just an id.

To obtain a reference to this resource, Libcloud providers corresponding get and / or list methods.

A couple of examples are shown below.

Example 1 - listing records for a zone with a known id

from libcloud.dns.providers import get_driver
from libcloud.dns.types import Provider

CREDENTIALS_ZERIGO = ('email', 'api key')
ZONE_ID = 'example.myzone.com'

Cls = get_driver(Provider.ZERIGO)
driver = Cls(*CREDENTIALS_ZERIGO)

zone = driver.get_zone(zone_id=ZONE_ID)
records = driver.list_records(zone=zone)

In this example, driver.get_zone() method call results in an HTTP call.

Example 2 - creating an EC2 instance with a known NodeSize and NodeImage id

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver

ACCESS_ID = 'your access id'
SECRET_KEY = 'your secret key'

IMAGE_ID = 'ami-c8052d8d'
SIZE_ID = 't1.micro'

cls = get_driver(Provider.EC2)
driver = cls(ACCESS_ID, SECRET_KEY, region="us-west-1")

# Here we select size and image
sizes = driver.list_sizes()
images = driver.list_images()

size = [s for s in sizes if s.id == SIZE_ID][0]
image = [i for i in images if i.id == IMAGE_ID][0]

node = driver.create_node(name='test-node', image=image, size=size)

In this example, both driver.list_sizes() an driver.list_images() method calls result in an HTTP call.

As you can see above, most of those getter methods retrieve extra information about the resource from the provider API and result in an HTTP request.

There are some cases when you might not want this:

  • You don’t care if a resource doesn’t exist
  • You don’t care about the extra attributes
  • You want to avoid an extra HTTP request
  • You want to avoid holding a reference to the resource object

If that is true for you, you can directly instantiate a resource with a known id. You can see how to do this in the examples below.

Example 1 - listing records for a zone with a known id

from libcloud.dns.base import Zone
from libcloud.dns.providers import get_driver
from libcloud.dns.types import Provider

CREDENTIALS_ZERIGO = ('email', 'api key')
ZONE_ID = 'example.myzone.com'

Cls = get_driver(Provider.ZERIGO)
driver = Cls(*CREDENTIALS_ZERIGO)

zone = Zone(ZONE_ID, domain=None, type=None, ttl=None,
            driver=driver)
records = driver.list_records(zone=zone)

Example 2 - creating an EC2 instance with a known NodeSize and NodeImage id

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver
from libcloud.compute.base import NodeSize, NodeImage

ACCESS_ID = 'your access id'
SECRET_KEY = 'your secret key'

IMAGE_ID = 'ami-c8052d8d'
SIZE_ID = 't1.micro'

cls = get_driver(Provider.EC2)
driver = cls(ACCESS_ID, SECRET_KEY, region="us-west-1")

size = NodeSize(id=SIZE_ID, name=None, ram=None, disk=None, bandwidth=None,
                price=None, driver=driver)
image = NodeImage(id=IMAGE_ID, name=None, driver=driver)

node = driver.create_node(name='test-node', image=image, size=size)

Example 3 - creating an EC2 instance with an IAM profile

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver

ACCESS_ID = 'your access id'
SECRET_KEY = 'your secret key'
IAM_PROFILE = 'your IAM profile arn or IAM profile name'

IMAGE_ID = 'ami-c8052d8d'
SIZE_ID = 't1.micro'
cls = get_driver(Provider.EC2)
driver = cls(ACCESS_ID, SECRET_KEY, region="us-west-1")

# Here we select size and image
sizes = driver.list_sizes()
images = driver.list_images()

size = [s for s in sizes if s.id == SIZE_ID][0]
image = [i for i in images if i.id == IMAGE_ID][0]

node = driver.create_node(name='test-node', image=image, size=size,
                          ex_iamprofile=IAM_PROFILE)

Developer Information

Developer Information

Mailing Lists

All of the communication about Libcloud development happens on our mailing lists.

Archive of old incubator mailing lists:

IRC

  • #libcloud on Freenode

Issue Tracker

For bug and issue tracking we use JIRA located at https://issues.apache.org/jira/browse/LIBCLOUD.

Testing

For information how to run the tests and how to generate the test coverage report, please see the Testing page.

Continuous Integration

For continuous integration we use Apache buildbot instance and Travis-CI. You can find build reports on the following two links:

Travis-CI builder is also integrated with Github which means that if you open a pull request there, Travis-CI will automatically build it.

Test Coverage

Test coverage report is automatically generated after every push and can be found at http://ci.apache.org/projects/libcloud/coverage.

Development

This page describes Libcloud development process and contains general guidelines and information on how to contribute to the project.

Contributing

We welcome contributions of any kind (ideas, code, tests, documentation, examples, ...).

If you need help or get stuck at any point during this process, stop by on our IRC channel (#libcloud on freenode) and we will do our best to assist you.

Getting started with contributing to Libcloud

General contribution guidelines

  • Any non-trivial change must contain tests. For more information, refer to the Testing page.
  • All the functions and methods must contain Sphinx docstrings which are used to generate the API documentation. For more information, refer to the Docstring conventions section below.
  • If you are adding a new feature, make sure to add a corresponding documentation.

Code style guide

  • We follow PEP8 Python Style Guide
  • Use 4 spaces for a tab
  • Use 79 characters in a line
  • Make sure edited file doesn’t contain any trailing whitespace
  • You can verify that your modifications don’t break any rules by running the flake8 script - e.g. flake8 libcloud/edited_file.py or tox -e lint. Second command will run flake8 on all the files in the repository.

And most importantly, follow the existing style in the file you are editing and be consistent.

Git pre-commit hook

To make complying with our style guide easier, we provide a git pre-commit hook which automatically checks modified Python files for violations of our style guide.

You can install it by running following command in the root of the repository checkout:

ln -s contrib/pre-commit.sh .git/hooks/pre-commit

After you have installed this hook it will automatically check modified Python files for violations before a commit. If a violation is found, commit will be aborted.

Code conventions

This section describes some general code conventions you should follow when writing a Libcloud code.

1. Import ordering

Organize the imports in the following order:

  1. Standard library imports
  2. Third-party library imports
  3. Local library (Libcloud) imports

Each section should be separated with a blank line. For example:

import sys
import base64

import paramiko

from libcloud.compute.base import Node, NodeDriver
from libcloud.compute.providers import Provider
2. Function and method ordering

Functions in a module and methods on a class should be organized in the following order:

  1. “Public” functions / methods
  2. “Private” functions / methods (methods prefixed with an underscore)
  3. “Internal” methods (methods prefixed and suffixed with a double underscore)

For example:

class Unicorn(object):
    def __init__(self, name='fluffy'):
        self._name = name

    def make_a_rainbow(self):
        pass

    def _get_rainbow_colors(self):
        pass

    def __eq__(self, other):
        return self.name == other.name

Methods on a driver class should be organized in the following order:

  1. Methods which are part of the standard API
  2. Extension methods
  3. “Private” methods (methods prefixed with an underscore)
  4. “Internal” methods (methods prefixed and suffixed with a double underscore)

Methods which perform a similar functionality should be grouped together and defined one after another.

For example:

class MyDriver(object):
    def __init__(self):
        pass

    def list_nodes(self):
        pass

    def list_images(self):
        pass

    def create_node(self):
        pass

    def reboot_node(self):
        pass

    def ex_create_image(self):
        pass

    def _to_nodes(self):
        pass

    def _to_node(self):
        pass

    def _to_images(self):
        pass

    def _to_image(self):
        pass

Methods should be ordered this way for the consistency reasons and to make reading and following the generated API documentation easier.

3. Prefer keyword over regular arguments

For better readability and understanding of the code, prefer keyword over regular arguments.

Good:

some_method(public_ips=public_ips, private_ips=private_ips)

Bad:

some_method(public_ips, private_ips)
4. Don’t abuse **kwargs

You should always explicitly declare arguments in a function or a method signature and only use **kwargs and *args respectively when there is a valid use case for it.

Using **kwargs in many contexts is against Python’s “explicit is better than implicit” mantra and makes it for a bad and a confusing API. On top of that, it makes many useful things such as programmatic API introspection hard or impossible.

A use case when it might be valid to use **kwargs is a decorator.

Good:

def my_method(self, name, description=None, public_ips=None):
    pass

Bad (please avoid):

def my_method(self, name, **kwargs):
    description = kwargs.get('description', None)
    public_ips = kwargs.get('public_ips', None)
5. When returning a dictionary, document its structure

Dynamic nature of Python can be very nice and useful, but if (ab)use it in a wrong way it can also make it hard for the API consumer to understand what is going on and what kind of values are being returned.

If you have a function or a method which returns a dictionary, make sure to explicitly document in the docstring which keys the returned dictionary contains.

6. Prefer to use “is not None” when checking if a variable is provided or defined

When checking if a variable is provided or defined, prefer to use is foo is not None instead of if foo.

If you use if foo approach, it’s easy to make a mistake when a valid value can also be falsy (e.g. a number 0).

For example:

class SomeClass(object):
    def some_method(self, domain=None):
        params = {}

        if domain is not None:
            params['Domain'] = domain

Docstring conventions

For documenting the API we we use Sphinx and reStructuredText syntax. Docstring conventions to which you should adhere to are described below.

  • Docstrings should always be used to describe the purpose of methods, functions, classes, and modules.
  • Method docstring should describe all the normal and keyword arguments. You should describe all the available arguments even if you use *args and **kwargs.
  • All parameters must be documented using :param p: or :keyword p: and :type p: annotation.
  • :param p: ... - A description of the parameter p for a function or method.
  • :keyword p: ... - A description of the keyword parameter p.
  • :type p: ... The expected type of the parameter p.
  • Return values must be documented using :return: and :rtype annotation.
  • :return: ... A description of return value for a function or method.
  • :rtype: ... The type of the return value for a function or method.
  • Required keyword arguments must contain (required) notation in description. For example: :keyword image:  OS Image to boot on node. (required)
  • Multiple types are separated with or For example: :type auth: :class:`.NodeAuthSSHKey` or :class:`.NodeAuthPassword`
  • For a description of the container types use the following notation: <container_type> of <objects_type>. For example: :rtype: `list` of :class:`Node`

For more information and examples, please refer to the following links:

Contribution workflow

1. Start a discussion on the mailing list

If you are implementing a big feature or a change, start a discussion on the mailing list first.

2. Open a new issue on our issue tracker

Go to our issue tracker and open a new issue for your changes there. This issue will be used as an umbrella place for your changes. As such, it will be used to track progress and discuss implementation details.

3. Fork our Github repository

Fork our Github git repository. Your fork will be used to hold your changes.

4. Create a new branch for your changes

For example:

git checkout -b <jira_issue_id>_<change_name>
5. Make your changes
6. Write tests for your changes and make sure all the tests pass

Make sure that all the code you have added or modified has appropriate test coverage. Also make sure all the tests including the existing ones still pass.

For more information on how to write and run tests, please see Testing page.

7. Commit your changes

Make a single commit for your changes. If a corresponding JIRA ticket exists, make sure the commit message contains the ticket number.

For example:

git commit -a -m "[LIBCLOUD-123] Add a new compute driver for CloudStack based providers."
8. Open a pull request with your changes

Go to https://github.com/apache/libcloud/ and open a new pull request with your changes. Your pull request will appear at https://github.com/apache/libcloud/pulls.

Make sure the pull request name is prefixed with a JIRA ticket number, e.g. [LIBCLOUD-436] Improvements to DigitalOcean compute driver and that the pull request description contains link to the JIRA ticket.

9. Wait for the review

Wait for your changes to be reviewed and address any outstanding comments.

10. Squash the commits and generate the patch

Once the changes has been reviewed, all the outstanding issues have been addressed and the pull request has been +1’ed, close the pull request, squash the commits (if necessary) and generate a patch.

git format-patch --stdout trunk > patch_name.patch

Make sure to use git format-patch and not git diff so we can preserve the commit authorship.

Note #1: Before you generate the patch and squash the commits, make sure to synchronize your branch with the latest trunk (run git pull upstream trunk in your branch), otherwise we might have problems applying it cleanly.

Note #2: If you have never used rebase and squashed the commits before, you can find instructions on how to do that in the following guide: squashing commits with rebase.

11. Attach a final patch with your changes to the corresponding JIRA ticket

Attach the generated patch to the JIRA issue you have created earlier.

Note about Github

Github repository is a read-only mirror of the official Apache git repository (https://git-wip-us.apache.org/repos/asf/libcloud.git). This mirror script runs only a couple of times per day which means this mirror can be slightly out of date.

You are advised to add a separate remote for the official upstream repository:

git remote add upstream https://git-wip-us.apache.org/repos/asf/libcloud.git

Github read-only mirror is used only for pull requests and code review. Once a pull request has been reviewed, all the comments have been addresses and it’s ready to be merged, user who submitted the pull request must close the pull request, create a patch and attach it to the original JIRA ticket.

Syncing your git(hub) repository with an official upstream git repository

This section describes how to synchronize your git clone / Github fork with an official upstream repository.

It’s important that your repository is in-sync with the upstream one when you start working on a new branch and before you generate a final patch. If the repository is not in-sync, generated patch will be out of sync and we won’t be able to cleanly merge it into trunk.

To synchronize it, follow the steps below in your git clone:

  1. Add upstream remote if you haven’t added it yet
git remote add upstream https://git-wip-us.apache.org/repos/asf/libcloud.git
  1. Synchronize your trunk branch with an upstream one
git checkout trunk
git pull upstream trunk
  1. Create a branch for your changes and start working on it
git checkout -b my_new_branch
  1. Before generating a final patch which is to be attached to the JIRA ticket, make sure your repository and branch is still in-sync
git pull upstream trunk
  1. Generate a patch which can be attached to the JIRA ticket
git format-patch --stdout remotes/upstream/trunk > patch_name.patch
Contributing Bigger Changes

If you are contributing a bigger change (e.g. large new feature or a new provider driver) you need to have signed Apache Individual Contributor License Agreement (ICLA) in order to have your patch accepted.

You can find more information on how to sign and file an ICLA on the Apache website.

When filling the form, leave field preferred Apache id(s) empty and in the notify project field, enter Libcloud.

Supporting Multiple Python Versions

Libcloud supports a variety of Python versions so your code also needs to work with all the supported versions. This means that in some cases you will need to include extra code to make sure it works in all the supported versions.

Some examples which show how to handle those cases are described below.

Context Managers

Context managers aren’t available in Python 2.5 by default. If you want to use them make sure to put from __future__ import with_statement on top of the file where you use them.

Exception Handling

There is no unified way to handle exceptions and extract the exception object in Python 2.5 and Python 3.x. This means you need to use a sys.exc_info()[1] approach to extract the raised exception object.

For example:

try:
    some code
except Exception:
    e = sys.exc_info()[1]
    print e
Utility functions for cross-version compatibility

You can find a lot of utility functions which make code easier to work with Python 2.x and 3.x in libcloud.utils.py3 module.

You can find some more information on changes which are involved in making the code work with multiple versions on the following link - Lessons learned while porting Libcloud to Python 3

Committer Guide

Committer Guide

New committer guidelines

Note

This section outlines steps which need to be completed by new team members and is indented for people who have been voted to join Libcloud project as a committer and / or PMC member. It also assumes you have already filled your ICLA and your Apache account has been created.

First congratulations and welcome to the team!

1. Subscribe to the public mailing lists

If you haven’t yet, subscribe to {dev,users,commits}@apache.libcloud.org mailing lists. Committs mailing list is especially important because all of the JIRA notification, Github Pull Request notifications and build notifications are sent there.

2. Subscribe to the private mailing list

Subscribe to private@libcloud.apache.org by sending an email to private-subscribe@libcloud.apache.org. Keep in mind that this list is private and your subscription needs to be approved by a moderator.

3. Create PyPi account

Creating a PyPi account by going to https://pypi.python.org/pypi?%3Aaction=register_form and send an email to private@libcloud.apache.org requesting to be added as a maintainer to apache-libcloud package. Make sure to select a strong and unique password (pwgen -s 48 1 is your friend).

After you have registered go to “Your details” page and populate PGP Key ID field with your PGP key ID.

Applying a patch

When applying a third-party patch created using git format-patch or git diff command, use the following command:

git am --signoff < patch_name.patch

--signoff argument signs the patch and lets others know that you have reviewed and merged a patch.

If you are working with a Github pull request, you can obtain a patch file by appending .patch to the end of the pull request URL. For example:

wget https://github.com/apache/libcloud/pull/<pr number>.patch
git am --signoff < <pr number>.patch
# rebase to squash commits / ammend
...

When working with a Github pull request, also don’t forget to update the commit message during rebase (or use git commit --amend if the rebase was not necessary) to include the “Closes #prnumber” message. This way, the corresponding Github pull request will get automatically closed once the Github mirror is updated.

For example:

...
Original message
...

Closes #prnumber

If the original patch author didn’t squash all of the commits into one and you think this is needed, you should squash all the commits yourself using git rebase after you have merged / applied the patch.

After the patch has been applied, make sure to update CHANGES.rst file.

Making a release (for release managers)

This section contains information a release manager should follow when preparing a release.

1. Pre-release check list
  • Make sure tests pass on all the supported Python versions (tox)
  • Make sure CHANGES file is up to date
  • Make sure __version__ string in libcloud/__init__.py is up to date
  • Remove the tox directory with rm -rf .tox
  • Remove the _secrets_ file with rm libcloud/test/secrets.py
2. Update JIRA
  • Create a new JIRA version for the release in question (if one doesn’t exist yet)
  • Close all the corresponding JIRA tickets and set Fix Version/s field to the current version
  • Release the JIRA version
3. Creating release artifacts

We have a script that runs the required setup.py commands and then hashes and signs the files. You will need the latest version of pip and the wheel package. To run it:

cd dist
./release.sh -u <yourusername>@apache.org

-u argument will be used to find a key with a matching email address in your local GPG database.

This should result in a set of apache-libcloud-${VERSION}.{tar.bz2,tar.gz,zip,whl}{,asc,md5,sha1} files that are suitable to be uploaded for a release.

Copy the artifacts in another directory, unpack one of them and test it with tox.

4. Tagging a release

Tag the tentative release with a -tentative postfix.

git tag <version> <commit hash>

For example:

git tag v0.15.0-tentative 105b9610835f99704996d861d613c5a9a8b3f8b1
5. Upload the release artifacts and start a [VOTE] thread

Upload all release artifacts including the whl files to your people.apache.org space. Then start a [VOTE] thread on the dev@libcloud.apache.org mailing list.

Once the vote has passed tag the release with a new tag, removing the -tentative postfix. Upload the release artifacts to Apache servers and Pypi.

6. Uploading release artifacts to Apache servers
7. Publishing package to PyPi

For consistency and security reasons packages are always uploaded to PyPi manually using the web interface and not using the setup.py upload command.

  • Run python setup.py register command. This will register a new version on PyPi, but it won’t upload the actual release artifacts.
  • Go to the PyPi release management page, find a new release and click on “files” link.
  • Once you are there, upload all the release artifacts (.tar.bz2, .tar.gz, .zip, and .whl). For File Type select Source (except for .whl file where you should select Python Wheel) and for Python Version select Any (ie. pure Python). Make sure to also select and upload a PGP signature for each file (PGP signature (.asc) field).

Once all the files have been uploaded, the page should look similar to the screenshot below.

_images/pypi_files_page.png
8. Verifying the release artifact check sums

To verify that nothing went wrong doing the release process, run the ./dist/verify_checksums.sh script.

This script downloads the release artifacts from the Apache and PyPi server and makes sure that the MD5 check sums of the both files match.

Usage:

./dist/verify_checksums.sh <version>

For example

./dist/verify_checksums.sh apache-libcloud-0.13.2
9. Updating doap_libcloud.rdf file

Add information about the new release to the doap_libcloud.rdf file in the root of the main code repository.

10. Updating website

Check out the website using SVN: svn co https://svn.apache.org/repos/asf/libcloud/site/trunk

  • Update the front page (source/index.html file)
  • Update “Downloads” page (source/downloads.md file)
  • Add a blog entry in the _posts directory.

Build the site locally and make sure everything is correct. Check the README.md file.

11. Sending announcements
  • Send a release announcement to {dev,users}@libcloud.apache.org. If it’s a major release also send it to announce@apache.org.
  • Send a release announcement to Twitter and Google+

Note: If the release fixes a security vulnerability, you should also send information about a vulnerability to the following full disclosure mailing lists:

The email you send should also be signed using your GPG key. You can find an example of such announcement on the following url.

If needed, use Apache URL shortening service - http://s.apache.org/

Mailing list email templates

This section includes email templates which can be used when sending out official communication to the mailing lists.

Release voting thread template

This template should be used when starting a voting thread for a new release.

Subject:

[VOTE] Release Apache Libcloud <version>

Body:

This is a voting thread for Libcloud <version>.

<short description and highlights of this release>

Full changelog can be found at <link to the CHANGES file for this release>.

Release artifacts can be found at <link to your Apache space where a release
artifacts can be found>.

KEYS file can found at https://dist.apache.org/repos/dist/release/libcloud/KEYS

Please test the release and post your votes.

+/- 1
[  ]  Release Apache Libcloud <version>

Vote will be opened until <date, it should be at minimum today + 3 days> (or longer, if needed).

Thanks,
<name>

For example:

Subject:

[VOTE] Release Apache Libcloud 0.13.2

Body:

This is a voting thread for Libcloud 0.13.2.

This is another primarily a bug-fix release. Previous release included a fix for the Content-Length bug which didn't fully fix the original issue. It missed out "raw" requests which are fixed in this release (LIBCLOUD-396).

This bug could manifest itself while uploading a file with some of the storage providers.

Besides this bug fix, it includes a couple of other smaller bug fixes and changes. Full change log
can be found at https://git-wip-us.apache.org/repos/asf?p=libcloud.git;a=blob;f=CHANGES;h=b7747f777afdeb63bcacf496d1d034f1b3287c31;hb=c4b3daae946049652a500a8515929b4cbf14a6b4

Release artifacts can be found at http://people.apache.org/~tomaz/libcloud/.

Please test the release and post your votes.

+/- 1
[  ]  Release Apache Libcloud 0.13.2

Vote will be opened until September 18th, 2013 (or longer, if needed).

Thanks,
Tomaz
Release announcement

This template should be used when sending out a release announcement.

Subject:

[ANNOUNCE] Apache Libcloud 0.13.1 release

Body:

Libcloud is a Python library that abstracts away the differences among
multiple cloud provider APIs. It allows users to manage cloud services
(servers, storage, loadbalancers, DNS) offered by many different providers
through a single, unified and easy to use API.

We are pleased to announce the release of Libcloud <version>!

<short description of the release which should include release highlights>

Full change log can be found at <link to CHANGES file for this release>

Download

Libcloud <version> can be downloaded from http://libcloud.apache.org/downloads.html
or installed using pip:

pip install apache-libcloud

Upgrading

If you have installed Libcloud using pip you can also use it to upgrade it:

pip install --upgrade apache-libcloud

Upgrade notes

A page which describes backward incompatible or semi-incompatible
changes and how to preserve the old behavior when this is possible
can be found at http://libcloud.apache.org/upgrade-notes.html.

Documentation

API documentation can be found at http://libcloud.apache.org/apidocs/<version>/.

We also have a new Sphinx documentation which can be found at https://libcloud.apache.org/docs/.

Bugs / Issues

If you find any bug or issue, please report it on our issue tracker
<https://issues.apache.org/jira/browse/LIBCLOUD>.
Don't forget to attach an example and / or test which reproduces your problem.

Thanks

Thanks to everyone who contributed and made this release possible! Full list of
people who contributed to this release can be found in the CHANGES file
<link to the changes file for this release>.

For example:

Subject:

[ANNOUNCE] Apache Libcloud 0.13.1 release

Body:

Libcloud is a Python library that abstracts away the differences among
multiple cloud provider APIs. It allows users to manage cloud services
(servers, storage, loadbalancers, DNS) offered by many different providers
through a single, unified and easy to use API.

We are pleased to announce the release of Libcloud 0.13.1!

This is a bug-fix only release. Among some smaller bugs it also fixes
Content-Length regression which broke create and update operations in
the Bluebox Compute and Azure Storage driver (LIBCLOUD-362, LIBCLOUD-3901).

Full change log can be found at <https://git-wip-us.apache.org/repos/asf?p=libcloud.git;a=blob;f=CHANGES;h=ca90c84e296ca82e2206eb86ed7364c588aad503;hb=602b6a7a27dca6990a38eb887e1d6615826387d5>

Download

Libcloud 0.13.1 can be downloaded from http://libcloud.apache.org/downloads.html
or installed using pip:

pip install apache-libcloud

Upgrading

If you have installed Libcloud using pip you can also use it to upgrade it:

pip install --upgrade apache-libcloud

Upgrade notes

A page which describes backward incompatible or semi-incompatible
changes and how to preserve the old behavior when this is possible
can be found at http://libcloud.apache.org/upgrade-notes.html.

Documentation

API documentation can be found at http://libcloud.apache.org/apidocs/0.13.1/.

We also have a new Sphinx documentation which can be found at https://libcloud.apache.org/docs/.
Keep in mind though, that this documentation reflects state in trunk which
includes some backward incompatible changes which aren't present in 0.13.1.
All the examples in the documentation which only work with trunk are clearly marked with a note.

Bugs / Issues

If you find any bug or issue, please report it on our issue tracker
<https://issues.apache.org/jira/browse/LIBCLOUD>.
Don't forget to attach an example and / or test which reproduces your problem.

Thanks

Thanks to everyone who contributed and made this release possible! Full list of
people who contributed to this release can be found in the CHANGES file
<https://git-wip-us.apache.org/repos/asf?p=libcloud.git;a=blob;f=CHANGES;h=ca90c84e296ca82e2206eb86ed7364c588aad503;hb=602b6a7a27dca6990a38eb887e1d6615826387d5>.

Other

Changelog

Changes with Apache Libcloud 0.19.0

General
  • Update Rackspace AUTH_URL (LIBCLOUD-738) [Brian Curtin]
  • Fix LIBCLOUD_DEBUG mode so it works on Python 3.x. [Tomaz Muraus]
  • Fix Libcloud code so it doesn’t throw an exception if simplejson < 2.1.0 is installed. (LIBCLOUD-714, GITHUB-577) [Erik Johnson]
  • Fix endpoint URL for DimensionData Asia Pacific region. (GITHUB-585) [Anthony Shaw]
  • Document potential time drift issue which could cause authentication in the GCE drivers to fail. (GITHUB-571) [Michal Tekel]
  • Update documentation for EC2 - make sure they reflect region changes from 0.14 release. (GITHUB-606) [James Guthrie]
Compute
  • Fixed malformed XML requests with Dimension Data driver. (LIBCLOUD-760, GITHUB-610) [Anthony Shaw]
  • Update list of scopes for Google Compute Engine driver. (GITHUB-607) [Otto Bretz]
  • Allow user to filter VPC by project in the CloudStack driver by passing project argument to the ex_list_vps method. (GITHUB-516) [Syed Mushtaq Ahmed]
  • Add volume management methods and other various improvements and fixes in the RunAbove driver. (GITHUB-561) [ZuluPro]
  • Add support and update Dimension Data driver to use API v2.0 by default. (LIBCLOUD-736, GITHUB-564) [Anthony Shaw]
  • Add new ex_virtual_network_name and ex_network_config argument to the create_node` method in the Azure driver. With those arguments user can now specify which virtual network to use. (GITHUB-569) [Jesaja Everling]
  • Fix create_node method in the GCE driver calling inexistent method (ex_get_disk instead of ex_get_volume). (GITHUB-574) [Alex Poms]
  • Allow user to pass proxy_url keyword argument to the VCloud driver constructor. (GITHUB-578) [Daniel Pool]
  • Various fixes and improvements in the DimensionData driver (support for creating servers in MCP 1 and 2 data center, performance improvements in the location fetching, etc.). (GITHUB-587, GITHUB-593, LIBCLOUD-750, LIBCLOUD-753) [Anthony Shaw]
  • Added ex_assign_public_ip argument to create_node in the EC2 driver. (GITHUB-590) [Kyle Long]
  • Added ex_terminate_on_shutdown argument to create_node in the EC2 driver. (GITHUB-595) [Kyle Long]
  • Various fixes and improvements in the ex_authorize_security_group_ingress in the CloudStack driver. (LIBCLOUD-749, GITHUB-580) [Lionel Schaub]
  • Add pricing information for Softlayer. (LIBCLOUD-759, GITHUB-603) [David Wilson]
Storage
  • Add support for sa-east-1 region to the Amazon S3 driver. (GITHUB-562) [Iuri de Silvio]
  • Fix handling of binary data in Local storage driver on Python 3. Now the file which is to be written or read from is opened in the binary mode (b flag). (LIBCLOUD-725, GITHUB-568) [Torf]
Loadbalancer
DNS
  • Update Google Cloud DNS API from ‘v1beta1’ to ‘v1’ (GITHUB-583) [Misha Brukman]
  • Add new driver for AuroraDNS service. (GITHUB-562, LIBCLOUD-735) [Wido den Hollander]
  • Fix “_to_record” in the Route53 driver - make sure it doesn’t throw if the record TTL is not available. [Tomaz Muraus]
  • Add new driver for WorldWideDNS service (http://www.worldwidedns.net/home.asp). (GITHUB-566, LIBCLOUD-732) [Alejandro Pereira]
  • Add new driver for DNSimple service (https://dnsimple.com/). (GITHUB-575, GITHUB-604, LIBCLOUD-739) [Alejandro Pereira, Patrick Humpal]
  • Add new driver for PointDNS service (https://pointhq.com). (GITHUB-576, GITHUB-591, LIBCLOUD-740) [Alejandro Pereira]
  • Add new driver for Vultr DNS service (https://www.vultr.com). (GITHUB-579, GITHUB-596, LIBCLOUD-745) [Alejandro Pereira, Janez Troha]
  • Add new driver for Liquidweb DNS service (http://www.liquidweb.com/). (GITHUB-581, LIBCLOUD-746) [Oltjano Terpollari, Alejandro Pereira]
  • Add new driver for Zonomi DNS hosting service (http://zonomi.com/). (GITHUB-582, LIBCLOUD-747) [Oltjano Terpollari, Alejandro Pereira]
  • Add new driver for Durable DNS service (https://durabledns.com/). (GITHUB-588, LIBCLOUD-748) [Oltjano Terpollari, Alejandro Pereira]

Changes with Apache Libcloud 0.18.0

General
  • Use native ssl.match_hostname functionality when running on Python >= 3.2 and only require backports.ssl_match_hostname dependency on Python versions < 3.2. [Tomaz Muraus]

  • Add support for AWS Signature version 4.

    Note: Currently only GET HTTP method is supported. (GITHUB-444) [Gertjan Oude Lohuis]

  • Fix a bug in the debug mode logging (LIBCLOUD_DEBUG). Logging to the debug file would throw an exception if the text contained non-ascii characters. [Tomaz Muraus]

  • Fix a bug with connection code throwing an exception if a port was a unicode type and not a str or int. (GITHUB-533, LIBCLOUD-716) [Avi Weit]

  • Update is_valid_ip_address function so it also works on Windows. (GITHUB-343, GITHUB-498, LIBCLOUD-601, LIBCLOUD-686) [Nicolas Fraison, Samuel Marks]

  • Add support for retrying failed HTTP requests.

    Retrying is off by default and can be enabled by setting LIBCLOUD_RETRY_FAILED_HTTP_REQUESTS environment variable. (GITHUB-515, LIBCLOUD-360, LIBCLOUD-709)

  • Fix a bug in consuming stdout and stderr strams in Paramiko SSH client. In some cases (like connecting to localhost via SSH), exit_status_ready gets set immediately even before the while loop to consume the streams kicks in. In those cases, we will not have consumed the streams at all. (GITHUB-558) [Lakshmi Kannan]

Compute
  • Google Compute now supports paginated lists including filtering. (GITHUB-491) [Lee Verberne]

  • OpenStackNodeSize objects now support optional, additional fields that are supported in OpenStack 2.1: ephemeral_disk, swap, extra. (GITHUB-488, LIBCLOUD-682) [Greg Hill]

  • StorageVolume objects now have an attribute state that holds a state variable that is standardized state across drivers. Drivers that currently support the state attribute are OpenStack and EC2. StorageVolume objects returned by drivers that do not support the attribute will have a state of None. When a provider returns a state that is unknown to the driver, the state will be UNKNOWN. Please report such states. A couple of drivers already put state fields in the extra fields of StorageVolumes. These fields were kept for backwards-compatibility and for reference. (GITHUB-476) [Allard Hoeve]

  • StorageVolume objects on EC2 and OpenStack now have a key called snapshot_id in their extra dicts containing the snapshot ID the volume was based on. (GITHUB-479) [Allard Hoeve]

  • OpenStack driver: deprecated ex_create_snapshot and ex_delete_snapshot in favor of create_volume_snapshot and destroy_volume_snapshot. Updated base driver method create_storage_volume argument name to be optional. (GITHUB-478) [Allard Hoeve]

  • Add support for creating volumes based on snapshots to EC2 and OS drivers. Also modify signature of base NodeDriver.create_volume to reflect the fact that all drivers expect a StorageSnapshot object as the snapshot argument. (GITHUB-467, LIBCLOUD-672) [Allard Hoeve]

  • VolumeSnapshots now have a created attribute that is a datetime field showing the creation datetime of the snapshot. The field in VolumeSnapshot.extra containing the original string is maintained, so this is a backwards-compatible change. (GITHUB-473) [Allard Hoeve]

  • Improve GCE create_node, make sure ex_get_disktype function (GITHUB-448) [Markos Gogoulos]

  • GCE driver fix to handle unknown image projects (GITHUB-447) [Markos Gogoulos]

  • Allow user to pass ex_blockdevicemappings argument to the create_node method in the OpenStack driver. (GITHUB-398, LIBCLOUD-637) [Allard Hoeve]

  • Fix list_volume_snapshots method in the EC2 driver so it comforms to the base API. (LIBCLOUD-664, GITHUB-451) [Allard Hoeve]

  • Add volumes_attached attibute to node.extra in the OpenStack driver. (LIBCLOUD-668, GITHUB-462) [Allard Hoeve]

  • Add the following new methods to the Linode driver: ex_list_volumes, ex_create_volume, ex_destroy_volume. (LIBCLOUD-649, GITHUB-430) [Wojciech Wirkijowski]

  • Add list_volume_snapshots method to the OpenStack driver. (LIBCLOUD-663, GITHUB-450) [Allard Hoeve]

  • Add Site to Site VPN functionality to CloudStack driver. (GITHUB-465) [Avi Nanhkoesingh]

  • Add affinity group support to CloudStack driver (LIBCLOUD-671, GITHUB-468) [Mateusz Korszun]

  • Add a support for a new AWS Frankfurt, Germany region (eu-central-1) to the EC2 driver using AWS Signature v4. (GITHUB-444) [Gertjan Oude Lohuis, Tomaz Muraus]

  • Allow Filtering in EC2 list_images() driver (GITHUB-456, LIBCLOUD-667) [Katriel Traum]

  • Add ex_list_ip_forwarding_rules() to CloudStack driver (GITHUB-483) [Atsushi Sasaki]

  • Add AURORA compute driver (LIBCLOUD-641, GITHUB-477) [Wido den Hollander]

  • Update ex_describe_tags method in the EC2 driver and allow user to list tags for any supported resource. Previously you could only list tags for a node or a storage volume. (LIBCLOUD-676, GITHUB-482) [John Kinsella]

  • Various improvements in the HostVirual driver (code refactoring, support for managing “packages”). (LIBCLOUD-670, GITHUB-472) [Dinesh Bhoopathy]

  • Add support for DigitalOcean API v2.0 while maintaining support for the old API v2.0.

    Note: API v2.0 is now used by default. To use the old API v1.0, pass api_version='1.0' argument to the driver constructor. (GITHUB-442) [Andrew Starr-Bochicchio]

  • Add new d4. instance types to the EC2 driver. Also update EC2 pricing data. (GITHUB-490) [Tomaz Muraus]

  • Add new driver for Microsft Azure Virtual Machines service. (LIBCLOUD-556, GITHUB-305, GITHUB-499, GITHUB-538) [Michael Bennett, davidcrossland, Richard Conway, Matt Baldwin, Tomaz Muraus]

  • Fix VPC lookup method in CloudStack driver (GITHUB-506) [Avi Nanhkoesingh]

  • Add new driver for the Dimension Data provider based on the OpSource driver. (LIBCLOUD-698, GITHUB-507, LIBCLOUD-700, GITHUB-513) [Anthony Shaw]

  • Add “virtualmachine_id” attribute to the CloudStackAddress class in the CloudStack driver. (LIBCLOUD-679, GITHUB-485) [Atsushi Sasaki]

  • Allow user to pass filters via arguments to the ex_list_port_forwarding_rules in the CloudStack driver. (LIBCLOUD-678, GITHUB-484) [Atsushi Sasaki]

  • Fix an issue with list_nodes in the CloudSigma driver throwing an exception if a node in the list had a static IP. (LIBCLOUD-707, GITHUB-514) [Chris O’Brien]

  • Don’t throw an exception if a limit for a particular CloudStack resource is “Unlimited” and not a number. (GITHUB-512) [Syed Mushtaq Ahmed]

  • Allow user to pass ex_config_drive argument to the create_node method in the OpenStack driver. (LIBCLOUD-356, GITHUB-330) [Ryan Parrish]

  • Add new driver for Cloudwatt (https://www.cloudwatt.com/en/) provider. (GITHUB-338) [ZuluPro]

  • Add new driver for Packet (https://www.packet.net/) provider. (LIBCLOUD-703, GITHUB-527) [Aaron Welch]

  • Update Azure VM pricing information and add information for new D instance types. (GITHUB-528) [Michael Bennett]

  • Add ex_get_node and ex_get_volume methods to CloudStack driver. (GITHUB-532) [ZuluPro]

  • Update CloudSigma driver so the “unavailable” and “paused” node state is correctly mapped to “error” and “paused” respectively. (GITHUB-517) [Chris O’Brien]

  • Add SSH key pair management methods to the Gandi driver. (GITHUB-534) [ZuluPro]

  • Add ex_get_node and ex_get_volume methods to Gandi driver. (GITHUB-534) [ZuluPro]

  • Add fault attribute to the extra dictionary of the Node instance returned by the OpenStack driver. (LIBCLOUD-730, GITHUB-557) [Nick Fox]

  • Add new driver for Onapp IaaS platform. (LIBCLOUD-691, GITHUB-502) [Matthias Wiesner]

  • Allow user to inject custom data / script into the Azure node by passing ex_custom_data argument to the create_node method. (LIBCLOUD-726, GITHUB-554) [David Wilson]

  • Add ex_create_cloud_service and ex_destroy_cloud_service method to the Azure driver. (LIBCLOUD-724, GITHUB-551) [David Wilson]

  • Add support for passing user data when creating a DigitalOcean node (ex_user_data argument). (LIBCLOUD-731, GITHUB-559) [David Wilson]

  • Allow user to specify which arguments are passed to list_nodes method which is called inside wait_until_running by passing ex_list_nodes_kwargs argument to the wait_until_running method. (ex_user_data argument). (LIBCLOUD-723, GITHUB-548) [David Wilson]

  • Allow user to pass ex_volume_type argument to the create_volume method in the OpennStack driver. (GITHUB-553) [Rico Echwald-Tijsen]

  • Add new driver for RunAbove (https://www.runabove.com) provider. (GITHUB-550) [ZuluPro]

  • Fix a bug with exception being throw inside the CloudStack driver when the provider returned no error message in the body. (GITHUB-555) [Konstantin Skaburskas]

  • Various improvements in the DigitalOcean driver: - Increase page size to API maximum. - Add ex_create_attr kwarg to create_node method. - Update all the list_* methods to use paginated requests - Allow user to specify page size by passing ex_per_page argument to the

    constructor.

    (LIBCLOUD-717, GITHUB-537) [Javier Castillo II]

Storage
  • Fix a bug with authentication in the OpenStack Swift driver. (GITHUB-492, LIBCLOUD-635) [Tom Fifield]
  • Add AuroraObjects Storage Driver. (GITHUB-540, LIBCLOUD-719) [Wido den Hollander]
Loadbalancer
DNS
  • Fix a bug when a ZoneDoesntExist exception was thrown when listing records for a zone which has no records in the HostVirtual driver. (GITHUB-460) [Vanč Levstik]
  • Correctly handle MX records priority in the Route53 driver. (GITHUB-469) [Vanč Levstik]
  • Allow user to create an A record which points directly to the domain zone name in the Route53 driver. (GITHUB-469) [Vanč Levstik]
  • Fix delete_zone method in the HostVirtual driver. (GITHUB-461) [Vanč Levstik]
  • Fix parsing of the record name in the HostVirtual driver. (GITHUB-461) [Vanč Levstik]
  • Add new driver for DigitalOcean DNS service. (GITHUB-505) [Javier Castillo II]

Changes with Apache Libcloud 0.17.0

General
  • Use match_hostname function from backports.ssl_match_hostname package to verify the SSL certificate hostname instead of relying on our own logic. (GITHUB-374) [Alex Gaynor]
Compute
  • GCE driver updated to include ex_stop_node() and ex_start_node() methods. (GITHUB-442) [Eric Johnson]
  • GCE driver now raises ResourceNotFoundError when the specified image is not found in any image project. Previously, this would return None but now raises the not-found exception instead. This fixes a bug where returning None caused ex_delete_image to raise an AttributeError. (GITHUB-441) [Eric Johnson]
  • GCE driver update to support JSON format Service Account files and a PY3 fix from Siim Põder for LIBCLOUD-627. (LIBCLOUD-627, LIBCLOUD-657, GITHUB-438) [Eric Johnson]
  • GCE driver fixed for missing param on ex_add_access_config. (GITHUB-435) [Peter Mooshammer]
  • GCE driver support for HTTP load-balancer resources. (LIBCLOUD-605, GITHUB-429) [Lee Verberne]
  • GCE driver updated to make better use of GCEDiskTypes. (GITHUB-428) [Eric Johnson]
  • GCE driver list_images() now returns all non-deprecated images by default. (LIBCLOUD-602, GITHUB-423) [Eric Johnson]
  • Improve GCE API coverage for create_node(). (GITHUB-419) [Eric Johnson]
  • GCE Licenses added to the GCE driver. (GITHUB-420) [Eric Johnson]
  • GCE Projects support common instance metadata and usage export buckets. (GITHUB-409) [Eric Johnson]
  • Improvements to TargetPool resource in GCE driver. (GITHUB-414) [Eric Johnson]
  • Adding TargetInstances resource to GCE driver. (GITHUB-393) [Eric Johnson]
  • Adding DiskTypes resource to GCE driver. (GITHUB-391) [Eric Johnson]
  • Fix boot disk auto_delete in GCE driver. (GITHUB-412) [Igor Bogomazov]
  • Add Routes to GCE driver. (GITHUB-410) [Eric Johnson]
  • Add missing ubuntu-os-cloud images to the GCE driver. (LIBCLOUD-632, GITHUB-385) [Borja Martin]
  • Add new us-east-2 and us-east-3 region to the Joyent driver. (GITHUB-386) [ZuluPro]
  • Add missing t2. instance types to the us-west-1 region in the EC2 driver. (GITHUB-388) [Matt Lehman]
  • Add option to expunge VM on destroy in CloudStack driver. (GITHUB-382) [Roeland Kuipers]
  • Add extra attribute in list_images for CloudStack driver. (GITHUB-389) [Loic Lambiel]
  • Add ex_security_group_ids argument to the create_node method in the EC2 driver. This way users can launch VPC nodes with security groups. (GITHUB-373) [Itxaka Serrano]
  • Add description argument to GCE Network. (GITHUB-397) [Eric Johnson]
  • GCE: Improve MachineType (size) coverage of GCE API. (GITHUB-396) [Eric Johnson]
  • GCE: Improved Images coverage. (GITHUB-395) [Eric Johnson]
  • GCE: Support for global IP addresses. (GITHUB-390, GITHUB-394) [Eric Johnson]
  • GCE: Add missing snapshot attributes. (GITHUB-401) [Eric Johnson]
  • AWS: Set proper disk size in c3.X instance types. (GITHUB-405) [Itxaka Serrano]
  • Fix a bug with handling of the ex_keyname argument in the Softlayer driver. (GITHUB-416, LIBCLOUD-647) [Dustin Oberloh]
  • Update CloudSigma region list (remove Las Vegas, NV region and add new San Jose, CA and Miami, FL region). (GITHUB-417) [Viktor Petersson]
  • Add ex_get_node method to the Joyent driver. (GITHUB-421) [ZuluPro]
  • Add support for placement group management to the EC2 driver. (GITHUB-418) [Mikhail Ovsyannikov]
  • Add new tok02 region to the Softlayer driver. (GITHUB-436, LIBCLOUD-656) [Dustin Oberloh]
  • Add new Honolulu, HI endpoint to the CloudSigma driver. (GITHUB-439) [Stephen D. Spencer]
  • Fix a bug with config_drive attribute in the OpenStack driver. New versions of OpenStack now return a boolean and not a string. (GITHUB-433) [quilombo]
  • Add support for Abiquo API v3.x, remove support for now obsolete API v2.x. (GITHUB-433, LIBCLOUD-652) [David Freedman]
  • Allow rootdisksize parameter in create_node CloudStack driver (GITHUB-440, LIBCLOUD-658) [Loic Lambiel]
Storage
  • Allow user to pass headers argument to the upload_object and upload_object_via_stream method.

    This way user can specify CORS headers with the drivers which support that. (GITHUB-403, GITHUB-404) [Peter Schmidt]

  • Fix upload_object_via_stream so it works correctly under Python 3.x if user manually passes an iterator to the method.

    Also improve how reading a file in chunks works with drivers which support chunked encoding - always try to fill a chunk with CHUNK_SIZE bytes instead of directly streaming the chunk which iterator returns.

    Previously, if iterator returned 1 byte in one iteration, we would directly send this as a single chunk to the API. (GITHUB-408, LIBCLOUD-639) [Peter Schmidt]

Loadbalancer
  • Updates to CloudStack driver. (GITHUB-434) [Jeroen de Korte]
DNS
  • New driver for Softlayer DNS service. (GITHUB-413, LIBCLOUD-640) [Vanč Levstik]
  • Fix a bug with ex_create_multi_value_record method in the Route53 driver only returning a single record. (GITHUB-431, LIBCLOUD-650) [Itxaka Serrano]

Changes with Apache Libcloud 0.16.0

General
  • Add new OpenStackIdentity_3_0_Connection class for working with OpenStack Identity (Keystone) service API v3. [Tomaz Muraus]
  • Add support for prettifying JSON or XML response body which is printed to a file like object when using LIBCLOUD_DEBUG environment variable. This option can be enabled by setting LIBCLOUD_DEBUG_PRETTY_PRINT_RESPONSE environment variable. [Tomaz Muraus]
  • Add support for using an HTTP proxy for outgoing HTTP and HTTPS requests. [Tomaz Muraus, Philip Kershaw]
Compute
  • Fix an issue with LIBCLOUD_DEBUG not working correctly with the Linode driver. [Tomaz Muraus, Juan Carlos Moreno] (LIBCLOUD-598, GITHUB-342)

  • Add new driver for VMware vSphere (http://www.vmware.com/products/vsphere/) based clouds. [Tomaz Muraus]

  • Add two new default node states - NodeState.SUSPENDED and NodeState.ERROR. [Tomaz Muraus]

  • Fix to join networks properly in deploy_node in the CloudStack driver. (LIBCLOUD-593, GITUHB-336) [Atsushi Sasaki]

  • Create CloudStackFirewallRule class and corresponding methods. (LIBCLOUD-594, GITHUB-337) [Atsushi Sasaki]

  • Add support for SSD disks to Google Compute driver. (GITHUB-339) [Eric Johnson]

  • Add utility get_regions and get_service_names methods to the OpenStackServiceCatalog class. [Andrew Mann, Tomaz Muraus]

  • Fix a bug in ex_get_console_output in the EC2 driver which would cause an exception to be thrown if there was no console output for a particular node.

    Reported by Chris DeRamus. [Tomaz Muraus]

  • Add ip_address parameter in CloudStack driver create_node method. (GITHUB-346) [Roeland Kuipers]

  • Fix ParamikoSSHClient.run and deploy_node method to work correctly under Python 3. (GITHUB-347) [Eddy Reyes]

  • Update OpenStack driver to map more node states to states recognized by Libcloud. [Chris DeRamus]

  • Fix a bug with ex_metadata argument handling in the Google Compute Engine driver create_node method. (LIBCLOUD-544, GITHUB-349, GITHUB-353) [Raphael Theberge]

  • Add SSH key pair management methods to the Softlayer driver. (GITHUB-321, GITHUB-354) [Itxaka Serrano]

  • Correctly categorize node IP addresses into public and private when dealing with OpenStack floating IPs. [Andrew Mann]

  • Add new t2 instance types to the EC2 driver. [Tomaz Muraus]

  • Add support for Amazon GovCloud to the EC2 driver (us-gov-west-1 region). [Chris DeRamus]

  • Allow user to pass “gp2” for “ex_volume_type” argument to the create_volume method in the EC2 driver.

    Reported by Xavier Barbosa. [Tomaz Muraus, Xavier Barbosa]

  • Add new driver for ProfitBricks provider. (LIBCLOUD-589, GITHUB-352) [Matt Baldwin]

  • Various improvements and bugs fixes in the GCE driver. For a list, see https://github.com/apache/libcloud/pull/360/commits (GITHUB-360) [Evgeny Egorochkin]

  • Allow user to specify virtualization type when registering an EC2 image by passing virtualization_type argument to the ex_register_image method. (GITHUB-361) [Andy Grimm]

  • Add ex_create_image method to the GCE driver. (GITHUB-358, LIBCLOUD-611) [Katriel Traum]

  • Add some methods to CloudStack driver: create_volume_snapshot, list_snapshots, destroy_volume_snapshot create_snapshot_template, ex_list_os_types) (GITHUB-363, LIBCLOUD-616) [Oleg Suharev]

  • Added VPC support and Egress Firewall rule support fo CloudStack (GITHUB-363) [Jeroen de Korte]

  • Add additional attributes to the extra dictionary of OpenStack StorageVolume object. (GITHUB-366) [Gertjan Oude Lohuis]

  • Fix create_volume method in the OpenStack driver to return a created volume object (instance of StorageVolume) on success, instead of a boolean indicating operation success. (GITHUB-365) [Gertjan Oude Lohuis]

  • Add optional project parameters for ex_list_networks() to CloudStack driver (GITHUB-367, LIBCLOUD-615) [Rene Moser]

  • CLOUDSTACK: option to start VM in a STOPPED state (GITHUB-368) [Roeland Kuipers]

  • Support “config_drive” in the OpenStack driver. Allow users to pass ex_config_drive argument to the create_node and ex_rebuild_node method. (GITHUB-370) [Nirmal Ranganathan]

  • Add support for service scopes to the create_node method in the GCE driver. (LIBCLOUD-578, GITHUB-373) [Eric Johnson]

  • Update GCE driver to allow for authentication with internal metadata service. (LIBCLOUD-625, LIBCLOUD-276, GITHUB-276) [Eric Johnson]

  • Fix a bug in Elasticstack node creation method where it would raise exceptions because of missing data in a response, and also fix pulling the IP from the proper data item. (GITHUB-325) [Michael Bennett]

  • Fix a bug which prevented user to connect and instantiate multiple EC2 driver instances for different regions at the same time. (GITHUB-325) [Michael Bennett]

  • Add methods in CloudStack driver to manage mutiple nics per vm. (GITHUB-369) [Roeland Kuipers]

  • Implements VPC network ACLs for CloudStack driver. (GITHUB-371) [Jeroen de Korte]

Storage
  • Fix a bug with CDN requests in the CloudFiles driver. [Tomaz Muraus]
  • Fix a bug with not being able to specify meta_data / tags when uploading an object using Google Storage driver. (LIBCLOUD-612, GITHUB-356) [Stefan Friesel]
Loadbalancer
  • Allow user to specify session affinity algorithm in the GCE driver by passing ex_session_affinity argument to the create_balancer method. (LIBCLOUD-595, GITHUB-341) [Lee Verberne, Eric Johnson]
DNS
  • Various fixes in the Google DNS driver. (GITHUB-378) [Franck Cuny]

Changes with Apache Libcloud 0.15.1

Compute
  • Allow user to limit a list of subnets which are returned by passing subnet_ids and filters argument to the ex_list_subnets method in the EC2 driver. (LIBCLOUD-571, GITHUB-306) [Lior Goikhburg]

  • Allow user to limit a list of internet gateways which are returned by passing gateway_ids and filters argument to the ex_list_internet_gateways method in the EC2 driver. (LIBCLOUD-572, GITHUB-307) [Lior Goikhburg]

  • Allow user to filter which nodes are returned by passing ex_filters argument to the list_nodes method in the EC2 driver. (LIBCLOUD-580, GITHUB-320) [Lior Goikhburg]

  • Add network_association_id to ex_list_public_ips and CloudstackAddress object (GITHUB-327) [Roeland Kuipers]

  • Allow user to specify admin password by passing ex_admin_pass argument to the create_node method in the Openstack driver. (GITHUB-315) [Marcus Devich]

  • Fix a possible race condition in deploy_node which would occur if node is online and can be accessed via SSH, but the SSH key we want to use hasn’t been installed yet.

    Previously, we would immediately throw if we can connect, but the SSH key hasn’t been installed yet. (GITHUB-331) [David Gay]

  • Propagate an exception in deploy_node method if user specified an invalid path to the private key file. Previously this exception was silently swallowed and ignored. [Tomaz Muraus]

DNS
  • Include a better message in the exception which is thrown when a request in the Rackspace driver ends up in an ERROR state. [Tomaz Muraus]

Changes with Apache Libcloud 0.15.0

General
  • Use lxml library (if available) for parsing XML. This should substantially reduce parsing time and memory usage for large XML responses (e.g. retrieving all the available images in the EC2 driver). [Andrew Mann]

  • Use –head flag instead of -X HEAD when logging curl lines for HEAD requests in debug mode.

    Reported by Brian Metzler. (LIBCLOUD-552) [Tomaz Muraus]

  • Fix Python 3 compatibility bugs in the following functions:

    • import_key_pair_from_string in the EC2 driver
    • publickey._to_md5_fingerprint
    • publickey.get_pubkey_ssh2_fingerprint

    (GITHUB-301) [Csaba Hoch]

  • Update CA_CERTS_PATH to also look for CA cert bundle which comes with openssl Homebrew formula on OS x (/usr/local/etc/openssl/cert.pem). (GITHUB-309) [Pedro Romano]

  • Update Google drivers to allow simultaneous authornization for all the supported Google Services. (GITHUB-302) [Eric Johnson]

Compute
  • Fix create_key_pair method which was not returning private key. (LIBCLOUD-566) [Sebastien Goasguen]

  • Map “Stopped” node state in the CloudStack driver to NodeState.STOPPED instead of NodeState.TERMINATED, “Stopping” to NodeState.PENDING instead of NodeState.TERMINATED and “Expunging” to NodeState.PENDING instead of NodeState.TERMINATED. (GITHUB-246) [Chris DeRamus, Tomaz Muraus]

  • Add ex_create_tags and ex_delete_tags method to the CloudStack driver. (LIBCLOUD-514, GITHUB-248) [Chris DeRamus]

  • Add new G2 instances to the EC2 driver. [Tomaz Muraus]

  • Add support for multiple API versions to the Eucalyptus driver and allows user to pass “api_version” argument to the driver constructor. (LIBCLOUD-516, GITHUB-249) [Chris DeRamus]

  • Map “Powered Off” state in the vCloud driver from “TERMINATED” to “STOPPED”. (GITHUB-251) [Ash Berlin]

  • Add ex_rename_node method to the DigitalOcean driver. (GITHUB-252) [Rahul Ranjan]

  • Improve error parsing in the DigitalOcean driver.

    Reported by Deni Bertovic. [Tomaz Muraus]

  • Add extension methods for the VPC internet gateway management to the EC2 driver. (LIBCLOUD-525, GITHUB-255) [Chris DeRamus]

  • Add CloudStackProject class to the CloudStack driver and add option to select project and disk offering on node creation. (LIBCLOUD-526, GITHUB-257) [Jim Divine]

  • Fix IP address handling in the OpenStack driver. (LIBCLOUD-503, GITHUB-235) [Markos Gogoulos]

  • Ad new ex_delete_image and ex_deprecate_image method to the GCE driver. (GITHUB-260) [Franck Cuny]

  • Ad new ex_copy_image method to the GCE driver. (GITHUB-258) [Franck Cuny]

  • Ad new ex_set_volume_auto_delete method to the GCE driver. (GITHUB-264) [Franck Cuny]

  • Add ex_revoke_security_group_ingress method to the CloudStack driver. [Chris DeRamus, Tomaz Muraus]

  • Allow user to pass ex_ebs_optimized argument to the create_node method in the EC2 driver. (GITHUB-272) [zerthimon]

  • Add “deprecated” attribute to the Node object in the Google Compute Engine driver. (GITHUB-276) [Chris / bassdread]

  • Update Softlayer driver to use “fullyQualifiedDomainName” instead of “hostname” attribute for the node name. (GITHUB-280) [RoelVanNyen]

  • Allow user to specify target tags using target_tags attribute when creating a firewall rule in the GCE driver. (GITHUB-278) [zerthimon]

  • Add new standard API for image management and initial implementation for the EC2 and Rackspace driver. (GITHUB-277) [Matt Lehman]

  • Allow user to specify “displayname” attribute when creating a CloudStack node by passing “ex_displayname” argument to the method.

    Also allow “name” argument to be empty (None). This way CloudStack automatically uses Node’s UUID for the name. (GITHUB-289) [Jeff Moody]

  • Deprecate “key” argument in the SSHClient class in favor of new “key_files” argument.

    Also add a new “key_material” argument. This argument can contain raw string version of a private key.

    Note 1: “key_files” and “key_material” arguments are mutually exclusive. Note 2: “key_material” argument is not supported in the ShellOutSSHClient.

  • Use node id attribute instead of the name for the “lconfig” label in the Linode driver. This way the label is never longer than 48 characters. (GITHUB-287) [earthgecko]

  • Add a new driver for Outscale SAS and Outscale INC cloud (http://www.outscale.com). (GITHUB-285, GITHUB-293, LIBCLOUD-536, LIBCLOUD-553) [Benoit Canet]

  • Add new driver for HP Public Cloud (Helion) available via Provider.HPCLOUD constant. [Tomaz Muraus]

  • Allow user to specify availability zone when creating an OpenStack node by passing “ex_availability_zone” argument to the create_node method. Note: This will only work if the OpenStack installation is running availability zones extension. (GITHUB-295, LIBCLOUD-555) [syndicut]

  • Allow user to pass filters to ex_list_networks method in the EC2 driver. (GITHUB-294) [zerthimon]

  • Allow user to retrieve container images using ex_get_image method in the Google Compute Engine driver. (GITHUB-299, LIBCLOUD-562) [Magnus Andersson]

  • Add new driver for Kili public cloud (http://kili.io/) [Tomaz Muraus]

  • Add “timeout” argument to the ParamikoSSHClient.run method. If this argument is specified and the command passed to run method doesn’t finish in the defined timeout, SSHCommandTimeoutError is throw and the connection to the remote server is closed.

    Note #1: If timed out happens, this functionality doesn’t guarantee that the underlying command will be stopped / killed. The way it works it simply closes a connect to the remote server. [Tomaz Muraus]

    Note #2: “timeout” argument is only available in the Paramiko SSH client.

  • Make “cidrs_ips” argument in the ex_authorize_security_group_egress method in the EC2 driver mandatory. (GITHUB-301) [Csaba Hoch]

  • Add extension methods for managing floating IPs (ex_get_floating_ip, ex_create_floating_ip, ex_delete_floating_ip) to the Openstack 1.1 driver. (GITHUB-301) [Csaba Hoch]

  • Fix bug in RimuHosting driver which caused driver not to work when the provider returned compressed (gzip’ed) response. (LIBCLOUD-569, GITHUB-303) [amastracci]

  • Fix issue with overwriting the server memory values in the RimuHosting driver. (GUTHUB-308) [Dustin Oberloh]

  • Add ex_all_tenants argument to the list_nodes method in the OpenStack driver. (GITHUB-312) [LIBCLOUD-575, Zak Estrada]

  • Add support for network management for advanced zones (ex_list_network_offerings, ex_create_network, ex_delete_network) in the CloudStack driver. (GITHUB-316) [Roeland Kuipers]

  • Add extension methods for routes and route table management to the EC2 driver (ex_list_route_tables, ex_create_route_table, ex_delete_route_table, ex_associate_route_table, ex_dissociate_route_table, ex_replace_route_table_association, ex_create_route, ex_delete_route, ex_replace_route) (LIBCLOUD-574, GITHUB-313) [Lior Goikhburg]

  • Fix ex_list_snapshots for HP Helion OpenStack based driver. [Tomaz Muraus]

  • Allow user to specify volume type and number of IOPS when creating a new volume in the EC2 driver by passing ex_volume_type and ex_iops argument to the create_volume method. [Tomaz Muraus]

  • Fix ex_unpause_node method in the OpenStack driver. (GITHUB-317) [Pablo Orduña]

  • Allow user to launch EC2 node in a specific VPC subnet by passing ex_subnet argument to the create_node method. (GITHUB-318) [Lior Goikhburg]

Storage
  • Fix container name encoding in the iterate_container_objects and get_container_cdn_url method in the CloudFiles driver. Previously, those methods would throw an exception if user passed in a container name which contained a whitespace.

    Reported by Brian Metzler. (LIBCLOUD-552) [Tomaz MUraus]

  • Fix a bug in the OpenStack Swift driver which prevented the driver to work with installations where region names in the service catalog weren’t upper case. (LIBCLOUD-576, GITHUB-311) [Zak Estrada]

Load Balancer
  • Add extension methods for policy managagement to the ELB driver. (LIBCLOUD-522, GITHUB-253) [Rahul Ranjan]
DNS
  • Fix update_record method in the Route56 driver so it works correctly for records with multiple values. [Tomaz Muraus]
  • Add ex_create_multi_value_record method to the Route53 driver which allows user to create a record with multiple values with a single call. [Tomaz Muraus]
  • Add new driver for Google DNS. (GITHUB-269) [Franck Cuny]

Changes with Apache Libcloud 0.14.1

Compute
  • Add new m3.medium and m3.large instance information to the EC2 driver. [Tomaz Muraus]
  • Add a new driver for CloudSigma API v2.0. [Tomaz Muraus]
  • Add “volume_id” attribute to the Node “extra” dictionary in the EC2 driver. Also fix the value of the “device” extra attribute in the StorageVolume object. (LIBCLOUD-501) [Oleg Suharev]
  • Add the following extension methods to the OpenStack driver: ex_pause_node, ex_unpause_node, ex_suspend_node, ex_resume_node. (LIBCLOUD-505, GITHUB-238) [Chris DeRamus]
  • Add ex_limits method to the CloudStack driver. (LIBCLOUD-507, GITHUB-240) [Chris DeRamus]
  • Add “extra” dictionary to the CloudStackNode object and include more attributes in the “extra” dictionary of the network and volume object. (LIBCLOUD-506, GITHUB-239) [Chris DeRamus]
  • Add ex_register_image method to the EC2 driver. (LIBCLOUD-508, GITHUB-241) [Chris DeRamus]
  • Add methods for managing volume snapshots to the OpenStack driver. (LIBCLOUD-512, GITHUB-245) [Chris DeRamus]
Load Balancer
  • Fix a bug in the ex_targetpool_add_node and ex_targetpool_remove_node method in the GCE driver. [Rick Wright]
Storage
  • Allow user to use an internal endpoint in the CloudFiles driver by passing “use_internal_url” argument to the driver constructor. (GITHUB-229, GITHUB-231) [John Obelenus]
DNS
  • Add PTR to the supported record types in the Rackspace driver. [Tomaz Muraus]
  • Fix Zerigo driver to set Record.name attribute for records which refer to the bare domain to “None” instead of an empty string. [Tomaz Muraus]
  • For consistency with other drivers, update Rackspace driver to set Record.name attribute for the records which refer to the bare domain to “None” instead of setting them to FQDN. [Tomaz Muraus]
  • Update Rackspace driver to support paginating through zones and records. (GITHUB-230) [Roy Wellington]
  • Update Route53 driver so it supports handling records with multiple values (e.g. MX). (LIBCLOUD-504, GITHUB-237) [Chris DeRamus]
  • Update Route53 driver to better handle SRV records. [Tomaz Muraus]
  • Update Route53 driver, make sure “ttl” attribute in the Record extra dictionary is always an int. [Tomaz Muraus]

Changes with Apache Libcloud 0.14.0

General
  • Update API endpoints which are used in the HostVirtual drivers. (LIBCLOUD-489) [Dinesh Bhoopathy]
  • Add support for Amazon security token to the Amazon drivers. (LIBCLOUD-498, GITHUB-223) [Noah Kantrowitz]
Compute
  • Remove Slicehost driver.

    SliceHost API has been shut down in 2012 so it makes no sense to keep this driver. [Tomaz Muraus]

  • Modify drivers for public cloud providers which use HTTP Basic authentication to not allow insecure connections (secure constructor kwarg being set to False) by default.

    This way credentials can’t accidentally be sent in plain text over the write.

    Affected drivers: Bluebox, Joyent, NephoScale, OpSource, VPSNet [Tomaz Muraus]

  • Remove “public_ip” and “private_ip” property which has been deprecated in 0.7.0 from the Node object. [Tomaz Muraus]

  • Move “is_private_ip” and “is_valid_ip_address” function from libcloud.compute.base into libcloud.utils.networking module. [Tomaz Muraus]

  • Allow user to pass “url” argument to the CloudStack driver constructor. This argument can be provided instead of “host” and “path” arguments and can contain a full URL to the API endpoint. (LIBCLOUD-430) [Tomaz Muraus]

  • Allow user to pass None as a “location” argument to the create_node method. (LIBCLOUD-431) [Tomaz Muraus]

  • Refactor CloudStack Connection class so it looks more like other connection classes and user can specify which attributes to send as part of query parameters in the GET request and which inside the body of a POST request. [Tomaz Muraus, Philipp Strube]

  • Add a new driver for Exoscale (https://www.exoscale.ch/) provider. [Tomaz Muraus]

  • Fix a bug in Abiquo driver which caused the driver to fail if the endpoint URL didn’t start with “/api”. (LIBCLOUD-447)

    Reported by Igor Ajdisek. [Tomaz Muraus]

  • Modify CloudStack driver to correctly throw InvalidCredsError exception if invalid credentials are provided. [Tomaz Muraus]

  • Don’t throw an exception if a node object is missing an “image” attribute in the list nodes / get node response.

    This could happen if node is in an error state. (LIBCLOUD-455) [Dustin Spicuzza, Tomaz Muraus]

  • Update CloudStack driver to better handle errors and throw ProviderError instead of a generic Exception. [Tomaz Muraus]

  • Modify ex_list_networks methods in CloudStack driver to not thrown if there are no networks available. [Tomaz Muraus]

  • Bump API version used in the EC2 driver from 2010-08-21 to 2013-10-15. (LIBCLOUD-454) [Tomaz Muraus]

  • Add ex_get_limits method for retrieving account resource limits to the EC2 driver. [Tomaz Muraus]

  • Update us-west-1 region in the EC2 driver to include c3 instance types. Also include pricing information. [Tomaz Muraus]

  • For consistency, rename “ex_add_ip_forwarding_rule” method to “ex_create_ip_forwarding_rule”. (GITHUB-196) [Oleg Suharev]

  • Add support for new “i2” instance types to Amazon EC2 driver. Also update pricing file. (LIBCLOUD-465) [Chris DeRamus]

  • Allow user to specify VPC id when creating a security group in the EC2 driver by passing “vpc_id” argument to ex_create_security_group method. (LIBCLOUD-463, GITHUB-201) [Chris DeRamus]

  • Add extension methods for managing security group rules (ex_authorize_security_group_ingress, ex_authorize_security_group_egress, ex_revoke_security_group_ingress, ex_revoke_security_group_egress) to the EC2 driver. (LIBCLOUD-466, GITHUB-202) [Chris DeRamus]

  • Add extension methods for deleting security groups (ex_delete_security_group, ex_delete_security_group_by_id, ex_delete_security_group_by_name) to the EC2 driver. (LIBCLOUD-464, GITHUB-199) [Chris DeRamus]

  • Add extension method for listing reserved instances (ex_list_reserved_nodes) to the EC2 driver. (LIBCLOUD-469, GITHUB-205) [Chris DeRamus]

  • Add extension methods for VPC management (ex_list_networks, ex_create_network, ex_delete_network) to the EC2 driver. (LIBCLOUD-467, GITHUB-203) [Chris DeRamus]

  • Add extension methods for VPC subnet management (ex_list_subnets, ex_create_subnet, ex_delete_subnet) to the EC2 driver. (LIBCLOUD-468, GITHUB-207) [Chris DeRamus]

  • Add ex_get_console_output extension method to the EC2 driver. (LIBCLOUD-471, GITHUB-209) [Chris DeRamus]

  • Include additional provider-specific attributes in the ‘extra’ dictionary of the StorageVolume class in the EC2 driver. (LIBCLOUD-473, GITHUB-210) [Chris DeRamus]

  • Change attribute name in the ‘extra’ dictionary of EC2 and CloudStack Node object from “keyname” to “key_name”. (LIBCLOUD-475) [Oleg Suharev]

  • Fix a deployment issue which would some times cause a process to hang if the executed deployment script printed a lot of output to stdout or stderr. [Tomaz Muraus]

  • Add additional attributes to the “extra” dictionary of the VolumeSnapshot object in the EC2 driver.

    Also modify create_volume_snapshot method to correctly handle “name” argument. Previous, “name” argument was used as a snapshot description, now it’s used as a Tag with a key “Name”. (LIBCLOUD-480, GITHUB-214) [Chris DeRamus]

  • Store additional attributes (iops, tags, block_device_mapping) in the “extra” dictionary of the NodeImage object in the EC2 driver.

    Also fix ex_image_ids filtering in the list_images method. (LIBCLOUD-481, GITHUB-215) [Chris DeRamus]

  • Add extension methods for network interface management (ex_list_network_interfaces, ex_create_network_interface, ex_attach_network_interface_to_node, ex_detach_network_interface, ex_delete_network_interface) to the EC2 driver. (LIBCLOUD-474) [Chris DeRamus]

  • Update Google Compute Engine driver to use and work with API v1. (LIBCLOUD-450) [Rick Wright]

  • Modify ParamikoSSHClient so that “password” and “key” arguments are not mutually exclusive and both can be provided. (LIBCLOUD-461, GITHUB-194) [Markos Gogoulos]

  • Add extension methods for the Elastic IP management to the EC2 driver. Also modify “ex_allocate_address” and “ex_release_address” method to take “domain” argument so it also works with VPC. (LIBCLOUD-470, GITHUB-208, GITHUB-220) [Chris DeRamus]

  • Add additional provider specific attributes to the “extra” dictionary of the Node object in the EC2 driver. (LIBCLOUD-493, GITHUB-221) [Chris DeRamus]

  • Add ex_copy_image and ex_create_image_from_node method to the EC2 driver. (LIBCLOUD-494, GITHUB-222) [Chris DeRamus]

Storage
  • Allow user to specify ‘Content-Disposition’ header in the CloudFiles driver by passing ‘content_disposition’ key in the extra dictionary of the upload object methods. (LIBCLOUD-430) [Michael Farrell]

  • Fix CloudFiles driver so it references a correct service catalog entry for the CDN endpoint.

    This was broken in the 0.14.0-beta3 release when we migrated all the Rackspace drivers to use auth 2.0 by default. (GITHUB-186) [John Obelenus]

  • Update storage drivers to default to “application/octet-stream” Content-Type if none is provided and none can be guessed. (LIBCLOUD-433) [Michael Farrell]

  • Fix a bug so you can now upload 0 bytes sized objects using multipart upload in the S3 driver. (LIBCLOUD-490)

    Reported by Noah Kantrowitz. [Tomaz Muraus]

  • Update OpenStack Swift driver constructor so it accepts “region”, “ex_force_service_type” and “ex_force_service_name” argument. [Tomaz Muraus]

  • Deprecate “CLOUDFILES_SWIFT” provider constant in favor of new “OPENSTACK_SWIFT” one. [Tomaz Muraus]

  • Add support for setting an ACL when uploading and object. (LIBCLOUD-497, GITHUB-223) [Noah Kantrowitz]

  • Modify get_container method to use a more efficient “HEAD” approach instead of calling list_containers + doing late filterting. (LIBCLOUD-498, GITHUB-223) [Noah Kantrowitz]

DNS
  • Implement iterate_* methods in the Route53 driver and makes it work correctly if there are more results which can fit on a single page. Previously, only first 100 results were returned. (LIBCLOUD-434) [Chris Clarke]

  • Update HostVirtual driver constructor to only take “key” and other valid arguments. Previously it also took “secret” argument which it silently ignored. (LIBCLOUD-483)

    Reported by Andrew Udvare. [Tomaz Muraus]

  • Fix list_records method in the HostVirtual driver. (LIBCLOUD-484, GITHUB-218)

    Reported by Andrew Udvare. [Dinesh Bhoopathy]

Changes with Apache Libcloud 0.14.0-beta3

General
  • If the file exists, read pricing data from ~/.libcloud/pricing.json by default. If the file doesn’t exist, fall back to the old behavior and use pricing data which is bundled with the release. [Tomaz Muraus]
  • Add libcloud.pricing.download_pricing_file function for downloading and updating the pricing file. [Tomaz Muraus]
  • Fix libcloud.utils.py3.urlquote so it works with unicode strings under Python 2. (LIBCLOUD-429) [Michael Farrell]
Compute
  • Refactor Rackspace driver classes and make them easier to use. Now there are two Rackspace provider constants - Provider.RACKSPACE which represents new next-gen OpenStack servers and Provider.RACKSPACE_FIRST_GEN which represents old first-gen cloud servers.

    Note: This change is backward incompatible. For more information on those changes and how to update your code, please visit “Upgrade Notes” documentation page - http://s.apache.org/lc0140un [Tomaz Muraus]

  • Deprecate the following EC2 provider constants: EC2_US_EAST, EC2_EU, EC2_EU_WEST, EC2_AP_SOUTHEAST, EC2_AP_NORTHEAST, EC2_US_WEST_OREGON, EC2_SA_EAST, EC2_SA_EAST and replace it with a new EC2 constant. Driver referenced by this new constant now takes a “region” argument which dictates to which region to connect.

    Note: Deprecated constants will continue to work until the next major release. For more information on those changes and how to update your code, please visit “Upgrade Notes” documentation page - http://s.apache.org/lc0140un [Tomaz Muraus]

  • Add support for volume related functions to OpenNebula driver. (LIBCLOUD-354) [Emanuele Rocca]

  • Add methods for managing storage volumes to the OpenStack driver. (LIBCLOUD-353) [Bernard Kerckenaere]

  • Add new driver for Google Compute Engine (LIBCLOUD-266, LIBCLOUD-386) [Rick Wright]

  • Fix create_node “features” metadata and update affected drivers. (LIBCLOUD-367) [John Carr]

  • Update EC2 driver to accept the auth kwarg (it will accept NodeAuthSSH objects and automatically import a public key that is not already uploaded to the EC2 keyring). (Follow on from LIBCLOUD-367). [John Carr]

  • Unify extension argument names for assigning a node to security groups in EC2 and OpenStack driver. Argument in the EC2 driver has been renamed from ex_securitygroup to ex_security_groups. For backward compatibility reasons, old argument will continue to work until the next major release. (LIBCLOUD-375) [Tomaz Muraus]

  • Add ex_import_keypair_from_string and ex_import_keypair method to the CloudStack driver. (LIBCLOUD-380) [Sebastien Goasguen]

  • Add support for managing floating IP addresses to the OpenStack driver. (LIBCLOUD-382) [Ivan Kusalic]

  • Add extension methods for handling port forwarding to the CloudStack driver, rename CloudStackForwardingRule class to CloudStackIPForwardingRule. (LIBCLOUD-348, LIBCLOUD-381) [sebastien goasguen]

  • Hook up deploy_node functionality in the CloudStack driver and unify extension arguments for handling security groups. (LIBCLOUD-388) [sebastien goasguen]

  • Allow user to pass “args” argument to the ScriptDeployment and ScriptFileDeployment class. This argument tells which command line arguments get passed to the ScriptDeployment script. (LIBCLOUD-394)

    Note: This change is backward incompatible. For more information on how this affects your code and how to update it, visit “Upgrade Notes” documentation page - http://s.apache.org/lc0140un [Tomaz Muraus]

  • Allow user to specify IAM profile to use when creating an EC2 node. (LIBCLOUD-403) [Xavier Barbosa]

  • Add support for keypair management to the OpenStack driver. (LIBCLOUD-392) [L. Schaub]

  • Allow user to specify disk partitioning mode using ex_disk_config argument in the OpenStack based drivers. (LIBCLOUD-402) [Brian Curtin]

  • Add new driver for NephoScale provider (http://nephoscale.com/). (LIBCLOUD-404) [Markos Gogoulos]

  • Update network related extension methods so they work correctly with both, OpenStack and Rackspace driver. (LIBCLOUD-368) [Tomaz Muraus]

  • Add tests for networking functionality in the OpenStack and Rackspace driver. [Tomaz Muraus]

  • Allow user to pass all supported extension arguments to ex_rebuild_server method in the OpenStack driver. (LIBCLOUD-408) [Dave King]

  • Add pricing information for Rackspace Cloud Sydney region. [Tomaz Muraus]

  • Update EC2 instance type map and pricing data. High Storage instances are now also available in Sydney and Singapore region. [Tomaz Muraus]

  • Add new methods for managing storage volumes and snapshots to the EC2 driver (list_volumes, list_snapshots, destroy_volume_snapshot, create_volume_snapshot) (LIBCLOUD-409) [Oleg Suharev]

  • Add the following new extension methods to EC2 driver: ex_destroy_image, ex_modify_instance_attributes, ex_delete_keypair. (LIBCLOUD-409) [Oleg Suharev]

  • Allow user to specify a port range when creating a port forwarding rule. (LIBCLOUD-409) [Oleg Suharev]

  • Align Joyent driver with other drivers and deprecate “location” argument in the driver constructor in favor of “region” argument.

    Note: Deprecated argument will continue to work until the next major release. [Tomaz Muraus]

  • Deprecate the following ElasticHosts provider constants: ELASTICHOSTS_UK1, ELASTICHOSTS_UK2, ELASTICHOSTS_US1, ELASTICHOSTS_US2, ELASTICHOSTS_US3, ELASTICHOSTS_CA1, ELASTICHOSTS_AU1, ELASTICHOSTS_CN1 and replace it with a new ELASTICHOSTS constant. Driver referenced by this new constant now takes a “region” argument which dictates to which region to connect.

    Note: Deprecated constants will continue to work until the next major release. For more information on those changes and how to update your code, please visit “Upgrade Notes” documentation page - http://s.apache.org/lc0140un (LIBCLOUD-383) [Michael Bennett, Tomaz Muraus]

  • Add log statements to our ParamikoSSHClient wrapper. This should make debugging deployment issues easier. (LIBCLOUD-414) [Tomaz Muraus]

  • Add new “NodeState.STOPPED” node state. Update HostVirual and EC2 driver to also recognize this new state. (LIBCLOUD-296) [Jayy Vis]

  • Add new Hong Kong endpoint to Rackspace driver. [Brian Curtin]

  • Fix ex_delete_keypair method in the EC2 driver. (LIBCLOUD-415) [Oleg Suharev]

  • Add the following new extension methods for elastic IP management to the EC2 driver: ex_allocate_address, ex_disassociate_address, ex_release_address. (LIBCLOUD-417) [Patrick Armstrong]

  • For consistency and accuracy, rename “ex_associate_addresses” method in the EC2 driver to “ex_associate_address_with_node”.

    Note: Old method will continue to work until the next major release. [Tomaz Muraus]

  • Add new driver for CloudFrames (http://www.cloudfounders.com/CloudFrames) provider. (LIBCLOUD-358) [Bernard Kerckenaere]

  • Update default kernel versions which are used when creating a Linode server.

    Old default kernel versions:

    • x86 - 2.6.18.8-x86_64-linode1
    • x86_64 - 2.6.39.1-linode34

    New default kernel versions:

    • x86 - 3.9.3-x86-linode52
    • x86_64 - 3.9.3-x86_64-linode33

    (LIBCLOUD-424) [Tomaz Muraus, Jon Chen]

  • Disable cache busting functionality in the OpenStack and Rackspace next-gen driver and enable it only for Rackspace first-gen driver. [Tomaz Muraus]

  • Update Google Compute Engine driver to v1beta16. [Rick Wright]

  • Modify auth_url variable in the OpenStack drivers so it works more like users would expect it to.

    Previously path specified in the auth_url was ignored and only protocol, hostname and port were used. Now user can provide a full url for the auth_url variable and the path provided in the url is also used. [DaeMyung Kang, Tomaz Muraus]

  • Allow user to associate arbitrary key/value pairs with a node by passing “ex_metadata” argument (dictionary) to create_node method in the EC2 driver. Those values are associated with a node using tags functionality. (LIBCLOUD-395) [Ivan Kusalic]

  • Add “ex_get_metadata” method to EC2 and OpenStack driver. This method reads metadata dictionary from the Node object. (LIBCLOUD-395) [Ivan Kusalic]

  • Multiple improvements in the Softlayer driver:
    • Map “INITIATING” node state to NodeState.PENDING
    • If node is launching remap “halted” state to “pending”
    • Add more node sizes
    • Add ex_stop_node and ex_start_node method
    • Update tests response fixtures

    (LIBCLOUD-416) [Markos Gogoulos]

  • Modify list_sizes method in the KT UCloud driver to work, even if the item doesn’t have ‘diskofferingid’ attribute. (LIBCLOUD-435) [DaeMyung Kang]

  • Add new c3 instance types to the EC2 driver. [Tomaz Muraus]

  • Fix an issue with the ex_list_keypairs and ex_list_security_groups method in the CloudStack driver which caused an exception to be thrown if the API returned no keypairs / security groups. (LIBCLOUD-438) [Carlos Reategui, Tomaz Muraus]

  • Fix a bug in the OpenStack based drivers with not correctly checking if the auth token has expired before re-using it. (LIBCLOUD-428)

    Reported by Michael Farrell. [Tomaz Muraus, Michael Farrell]

Storage
  • Deprecate CLOUDFILES_US and CLOUDFILES_UK provider constant and replace it with a new CLOUDFILES constant. Driver referenced by this new constant takes a “region” keyword argument which can be one of ‘ord’, ‘dfw’, ‘iad’, ‘syd’, ‘lon’.

    Note: Deprecated constants will continue to work until the next major release. For more information on this change, please visit “Upgrade Notes” documentation section - http://s.apache.org/lc0140un [Tomaz Muraus]

  • Allow users to filter objects starting with a prefix by passing ex_prefix argument to the list_container_objects method in the S3, Google Storage and CloudFiles driver. (LIBCLOUD-369) [Stefan Friesel]

  • Fix an issue with mutating connectionCls.host attribute in the Azure driver. This bug prevented user from having multiple Azure drivers with different keys instantiated at the same time. (LIBCLOUD-399) [Olivier Grisel]

  • Add a new driver for KT UCloud based on the OpenStack Swift driver. (LIBCLOUD-431). [DaeMyung Kang]

Load Balancer
  • Deprecate RACKSPACE_US and RACKSPACE_UK provider constant and replace it with a new RACKSPACE constant. Driver referenced by this new constant takes a “region” keyword argument which can be one of the following: ‘ord’, ‘dfw’, ‘iad’, ‘syd’, ‘lon’.

    Note: Deprecated constants will continue to work until the next major release. For more information on this change, please visit “Upgrade Notes” documentation section - http://s.apache.org/lc0140un [Tomaz Muraus]

  • Add new driver for Google Compute Engine (LIBCLOUD-386) [Rick Wright]

  • Add new Hong Kong endpoint to Rackspace driver. [Brian Curtin]

DNS
  • Deprecate RACKSPACE_US and RACKSPACE_UK provider constant and replace it with a new RACKSPACE constant. Driver referenced by this new constant takes a “region” keyword argument which can be one of the following: ‘us’, ‘uk’.

    Note: Deprecated constants will continue to work until the next major release. For more information on this change, please visit “Upgrade Notes” documentation section - http://s.apache.org/lc0140un [Tomaz Muraus]

  • Use string instead of integer for RecordType ENUM value.

    Note: If you directly use an integer instead of RecordType ENUM class you need to update your code to use the RecordType ENUM otherwise the code won’t work. For more information on how to do that, see “Upgrade Notes” documentation section - http://s.apache.org/lc0140un [Tomaz Muraus]

  • Add “export_zone_to_bind_format” and export_zone_to_bind_zone_file method which allows users to export Libcloud Zone to BIND zone format. (LIBCLOUD-398) [Tomaz Muraus]

  • Update issue with inexistent zone / record handling in the get_zone and get_record method in the Linode driver. Those issues were related to changes in the Linode API. (LIBCLOUD-425) [Jon Chen]

Changes with Apache Libcloud 0.13.3

Compute
  • Send “scrub_data” query parameter when destroying a DigitalOcean node. This will cause disk to be scrubbed (overwritten with 0’s) when destroying a node. (LIBCLOUD-487)

    Note: This fixes a security issue with a potential leak of data contained on the destroyed node which only affects users of the DigitalOcean driver. (CVE-2013-6480) [Tomaz Muraus]

Changes with Apache Libcloud 0.13.2

General
  • Don’t sent Content-Length: 0 header with POST and PUT request if “raw” mode is used. This fixes a regression which could cause broken behavior in some storage driver when uploading a file from disk. (LIBCLOUD-396) [Ivan Kusalic]
Compute
  • Added Ubuntu Linux 12.04 image to ElasticHost driver image list. (LIBCLOUD-364) [Bob Thompson]
  • Update ElasticHosts driver to store drive UUID in the node ‘extra’ field. (LIBCLOUD-357) [Bob Thompson]
Storage
  • Store last_modified timestamp in the Object extra dictionary in the S3 driver. (LIBCLOUD-373) [Stefan Friesel]
Load Balancer
  • Expose CloudStack driver directly through the Provider.CLOUDSTACK constant. [Tomaz Muraus]
DNS
  • Modify Zerigo driver to include record TTL in the record ‘extra’ attribute if a record has a TTL set. [Tomaz Muraus]
  • Modify values in the Record ‘extra’ dictionary attribute in the Zerigo DNS driver to be set to None instead of an empty string (‘’) if a value for the provided key is not set. [Tomaz Muraus]

Changes with Apache Libcloud 0.13.1

General
  • Fix a regression introduced in 0.13.0 and make sure to include Content-Length 0 with PUT and POST requests. (LIBCLOUD-362, LIBCLOUD-390) [Tomaz Muraus]
Compute
  • Fix a bug in the ElasticHosts driver and check for right HTTP status code when determining drive imaging success. (LIBCLOUD-363) [Bob Thompson]
  • Update Opsource driver to include node public ip address (if available). (LIBCLOUD-384) [Michael Bennett]
Storage
  • Fix a regression with calling encode_container_name instead of encode_object_name on object name in get_object method. Reported by Ben Meng (LIBCLOUD-366) [Tomaz Muraus]
  • Ensure that AWS S3 multipart upload works for small iterators. (LIBCLOUD-378) [Mahendra M]

Changes with Apache Libcloud 0.13.0

General
  • Add homebrew curl-ca-bundle path to CA_CERTS_PATH. This will make Libcloud use homebrew curl ca bundle file (if available) for server certificate validation. (LIBCLOUD-324) [Robert Chiniquy]
  • Modify OpenStackAuthConnection and change auth_token_expires attribute to be a datetime object instead of a string. [Tomaz Muraus]
  • Modify OpenStackAuthConnection to support re-using of the existing auth token if it’s still valid instead of re-authenticating on every authenticate() call. [Tomaz Muraus]
  • Modify base Connection class to not send Content-Length header if body is not provided. [Tomaz Muraus]
  • Add the new error class ProviderError and modify InvalidCredsError to inherit from it. (LIBCLOUD-331) [Jayy Vis]

Misc

  • Add unittest2 library dependency for tests and update some tests to use it. [Tomaz Muraus]
Compute
  • Fix destroy_node method in the experimental libvirt driver. [Aymen Fitati]
  • Add ex_start_node method to the Joyent driver. (LIBCLOUD-319) [rszabo50]
  • Fix Python 3 compatibility issue in the ScriptFileDeployment class. (LIBCLOUD-321) [Arfrever Frehtes Taifersar Arahesis]
  • Add ex_set_metadata_entry and ex_get_metadata method to the VCloud driver. (LIBCLOUD-318) [Michel Samia]
  • Various improvements and bug-fixes in the VCloud driver. (LIBCLOUD-323) [Michel Samia]
  • Various bug fixes and improvements in the HostVirtual driver. (LIBCLOUD-249) [Dinesh Bhoopathy]
  • Modify list_sizes method in the OpenStack driver to include OpenStackNodeSize object which includes ‘vcpus’ attribute which holds a number of virtual CPUs for this size. (LIBCLOUD-325) [Carlo]
  • For consistency rename “ex_describe_keypairs” method in the EC2 driver to “ex_describe_keypair”. [Tomaz Muraus]
  • Modify “ex_describe_keypair” method to return key fingerprint in the return value. (LIBCLOUD-326) [Andre Merzky, Tomaz Muraus]
  • Populate private_ips attribute in the CloudStack drive when returning a Node object from the create_node method. (LIBCLOUD-329) [Sebastien Goasguen, Tomaz Muraus]
  • Allow user to pass extra arguments via “extra_args” argument which are then passed to the “deployVirtualMachine” call in the CloudStack driver create_node method. (LIBCLOUD-330) [Sebastien Goasguen, Tomaz Muraus]
  • Update Gandi driver to handle new billing model. (LIBCLOUD-317) [Aymeric Barantal]
  • Fix a bug in the Linode driver and remove extra newline which is added when generating a random root password in create_node. (LIBCLOUD-334) [Juan Carlos Moreno]
  • Add extension methods for managing keypairs to the CloudStack driver. (LIBCLOUD-333) [sebastien goasguen]
  • Add extension methods for managing security groups to the CloudStack driver. (LIBCLOUD-332) [sebastien goasguen]
  • Add extension methods for starting and stoping the node to the CloudStack driver. (LIBCLOUD-338) [sebastien goasguen]
  • Fix old _wait_until_running method. (LIBCLOUD-339) [Bob Thompson]
  • Allow user to override default async task completion timeout by specifying ex_clone_timeout argument. (LIBCLOUD-340) [Michal Galet]
  • Fix a bug in the GoGrid driver get_uuid method. (LIBCLOUD-341) [Bob Thompson]
  • Fix a bug with deploy_node not respecting ‘timeout’ kwarg. [Kevin Carter]
  • Modify create_node method in CloudStack driver to return an instance of CloudStackNode and add a new “expunging” node state. (LIBCLOUD-345) [sebastien goasguen]
  • Update API endpoint hostnames in the ElasticHost driver and use hostnames which return a valid SSL certificate. (LIBCLOUD-346) [Bob Thompson]
  • Add ex_list_networks method and missing tests for list_templates to the CloudStack driver. (LIBCLOUD-349) [Philipp Strube]
  • Correctly throw InvalidCredsError if user passes invalid credentials to the DigitalOcean driver. [Tomaz Muraus]
Storage
  • Fix an issue with double encoding the container name in the CloudFiles driver upload_object method. Also properly encode container and object name used in the HTTP request in the get_container and get_object method. (LIBCLOUD-328) [Tomaz Muraus]
Load Balancer
  • Add ex_list_current_usage method to the Rackspace driver.

Changes with Apache Libcloud 0.12.4

Compute
  • Fix a regression in Softlayer driver caused by the xmlrpclib changes. (LIBCLOUD-310) [Jason Johnson]
  • Allow user to pass alternate ssh usernames to deploy_node (ssh_alternate_usernames kwarg) which are used for authentication if the default one doesn’t work. (LIBCLOUD-309) [Chris Psaltis, Tomaz Muraus]
  • Fix a bug in EC2 list_locations method - ‘name’ attribute didn’t contain a the right value. [Tomaz Muraus]
  • Add new ScriptFileDeployment deployment class which reads deploy script from a file. [Rudolf J Streif]
  • Add support for API version 5.1 to the vCloud driver and accept any value which is a multiple of four for ex_vm_memory kwarg in create_node method. (LIBCLOUD-314) [Trevor Powell]
Storage
  • Fix a regression with removed ex_force_service_region constructor kwarg in the CloudFiles driver. (LIBCLOUD-260)

Changes with Apache Libcloud 0.12.3

General
  • Fix Python 3.x related regressions. (LIBCLOUD-245) Reported by Arfrever Frehtes Taifersar Arahesis. [Tomaz Muraus]

  • Fix a regression introduced with recent xmlrpiclib changes which broke all the Gandi.net drivers. (LIBCLOUD-288)

    Reported by Hutson Betts. [Tomaz Muraus]

  • Improve deploy code to work correctly if the ssh user doesn’t have access to the /root directory.

    Previously the ScriptDeployment script was stored in /root folder by default. Now it’s stored in users home directory under filename ~/libcloud_deploymeny_<random>.sh. (LIBCLOUD-302)

    Reported by rotem on #libcloud. [Tomaz Muraus]

Compute
  • Improve public and private IP address handling in OpenStack 1.1 driver. Assume every IP address which doesn’t have a label “public” or “internet” is private. (LIBCLOUD-297) [Grischa Meyer, Tomaz Muraus]
  • Add new driver for DigitalOcean provider - https://www.digitalocean.com/. (LIBCLOUD-304) [Tomaz Muraus]
  • Fix a regression in ParamikoSSHClient.run method which caused this methid to only work as expected if you passed an absolute or a relative path to the script to it. (LIBCLOUD-278) [Tomaz Muraus]
DNS
  • Allow user to specify ‘priority’ extra argument when creating a MX or SRV record. [Brian Jinwright, Tomaz Muraus]

Changes with Apache Libcloud 0.12.1

General
  • Deprecate LazyList method of iteration over large paginated collections and use a new, more efficient generator based approach which doesn’t require the iterator to be pre-exhausted and buffering all of the values in memory.

    Existing list_* methods which previously used LazyList class are preserving the old behavior and new iterate_* methods which use a new generator based approach have been added. (LIBCLOUD-254) [Mahendra M]

  • Replace old ENUM style provider constants and replace them with a string version. This change allows users to dynamically register new drivers using a new set_driver method. (LIBCLOUD-255) [Mahendra M]

  • Allow user to explicitly specify which CA file is used for verifying the server certificate by setting ‘SSL_CERT_FILE’ environment variable.

    Note: When this variable is specified, the specified path is the only CA file which is used to verifying the server certificate. (LIBCLOUD-283) [Tomaz Muraus, Erinn Looney-Triggs]

  • Add a common module (libcloud.common.xmlrpc) for handling XML-RPC requests using Libcloud http layer.

    Also refactor existing drivers which use xmlrpclib directly (VCL, Gandi, Softlayer) to use this module.

    This change allows drivers to support LIBCLOUD_DEBUG and SSL certificate validation functionality. Previously they have bypassed Libcloud http layer so this functionality was not available. (LIBCLOUD-288) [John Carr]

Compute
  • Fix string interpolation bug in __repr__ methods in the IBM SCE driver. (LIBCLOUD-242) [Tomaz Muraus]

  • Fix test failures which happened in Python 3.3 due to: - hash randomization - changes in xml.etree module - changes in xmlrpc module (LIBCLOUD-245) [Tomaz Muraus]

  • Improvements and additions in vCloud driver:
    • Expose generic query method (ex_query)
    • Provide functionality to get and set control access for vApps. This way created vApps can be shared between users/groups or everyone.

    (LIBCLOUD-251) [Michal Galet]

  • Update EC2 pricing data to reflect new, lower prices - http://aws.typepad.com/aws/2012/10/new-ec2-second-generation-standard-instances-and-price-reductions-1.html [Tomaz Muraus]

  • Update EC2 instance size to reflect new m3 instance types. Also refactor the code to make it easier to maintain. [Tomaz Muraus]

  • Add a new driver for HostVirtual (http://www.vr.org) provider. (LIBCLOUD-249) [Dinesh Bhoopathy]

  • Fix a bug where a numeric instead of a string value was used for the content-length header in VCloud driver. (LIBCLOUD-256) [Brian DeGeeter, Tomaz Muraus]

  • Add a new driver for new Asia Pacific (Sydney) EC2 region. [Tomaz Muraus]

  • Add support for managing security groups to the OpenStack driver. This patch adds the following extension methods: - ex_list_security_groups, ex_get_node_security_groups methods - ex_create_security_group, ex_delete_security_group - ex_create_security_group_rule, ex_delete_security_group_rule (LIBCLOUD-253) [L. Schaub]

  • Modify ElasticStack driver class to pass ‘vnc auto’ instead of ‘vnc:ip auto’ argument to the API when creating a server. It looks like ‘vnc:ip’ has been replaced with ‘vnc’. [Rick Copeland, Tomaz Muraus]

  • Add new EC2 instance type - High Storage Eight Extra Large Instance (hs1.8xlarge). [Tomaz Muraus]

  • Map ‘shutting-down’ node state in EC2 driver to UNKNOWN. Previously it was mapped to TERMINATED. (LIBCLOUD-280)

    Note: This change is backward incompatible which means you need to update your code if you rely on the old behavior. [Tomaz Muraus, Marcin Kuzminski]

  • Change _wait_until_running method so it supports waiting on multiple nodes and make it public (wait_until_running). (LIBCLOUD-274) [Nick Bailey]

  • Add new EC2 instance type - High Memory Cluster Eight Extra Large. (cr1.8xlarge). [Tomaz Muraus]

  • Add new driver for Abiquo provider - http://www.abiquo.com (LIBCLOUD-250). [Jaume Devesa]

  • Allow user to pass ‘ex_blockdevicemappings’ kwarg to the EC2 driver ‘create_node’ method. (LIBCLOUD-282) [Joe Miller, Tomaz Muraus]

  • Improve error handling in the Brightbox driver. [Tomaz Muraus]

  • Fix the ScriptDeployment step to work correctly if user provides a relative path for the script argument. (LIBCLOUD-278) [Jaume Devesa]

  • Fix Softlayer driver and make sure all the code is up to date and works with the latest version of the actual Softlayer deployment (v3). (LIBCLOUD-287) [Kevin McDonald]

  • Update EC2 driver, m3 instance types are now available in all the regions except Brazil.

    Also update pricing to reflect new (lower) prices. [Tomaz Muraus]

  • Minor improvements in the HostVirtual driver and add new ex_get_node and ex_build_node extension method. (LIBCLOUD-249) [Dinesh Bhoopathy]

  • Add ex_destroy_image method to IBM SCE driver. (LIBCLOUD-291) [Perry Zou]

  • Add the following new regions to the ElasticHosts driver: sjc-c, syd-v, hkg-e. (LIBCLOUD-293) [Tomaz Muraus]

  • Fix create_node in OpenStack driver to work correctly if ‘adminPass’ attribute is not present in the response. [Gavin McCance, Tomaz Muraus]

  • Allow users to filter images returned by the list_images method in the EC2 driver by providing ex_image_ids argument. (LIBCLOUD-294) [Chris Psaltis, Joseph Hall]

  • Add support for OpenNebula 3.8. (LIBCLOUD-295) [Guillaume ZITTA]

  • Add missing ‘deletd’ -> terminated mapping to OpenStack driver. (LIBCLOUD-276) [Jayy Vis]

  • Fix create_node in OpenStack driver to work correctly if ‘adminPass’ attribute is not present in the response. (LIBCLOUD-292) [Gavin McCance, Tomaz Muraus]

Storage
  • Add a new local storage driver. (LIBCLOUD-252, LIBCLOUD-258, LIBCLOUD-265, LIBCLOUD-273) [Mahendra M]

  • Fix a bug which caused the connection to not be closed when using Python 2.6 and calling get_object on an object which doesn’t exist in the S3 driver. (LIBCLOUD-257) [John Carr]

  • Add a new generator based method for listing / iterating over the containers (iterate_containers). (LIBCLOUD-261) [Mahendra M]

  • Add ex_purge_object_from_cdn method to the CloudFiles driver. (LIBCLOUD-267) [Tomaz Muraus]

  • Support for multipart uploads and other improvements in the S3 driver so it can more easily be re-used with other implementations (e.g. Google Storage, etc.).

    Also default to a multipart upload when using upload_object_via_stream. This methods is more efficient compared to old approach because it only requires buffering a single multipart chunk (5 MB) in memory. (LIBCLOUD-269) [Mahendra M]

  • Add new driver for Windows Azure Storage with support for block and page blobs. (LIBCLOUD-80) [Mahendra M]

DNS
  • Update ‘if type’ checks in the update_record methods to behave correctly if users passes in RecordType.A with a value of 0 - if type is not None. (LIBCLOUD-247) [Tomaz Muraus]
  • New driver for HostVirtual provider (www.vr.org). (LIBCLOUD-249) [Dinesh Bhoopathy]
  • Finish Amazon Route53 driver. (LIBCLOUD-132) [John Carr]
  • Add new driver for Gandi provider (https://www.gandi.net). (LIBCLOUD-281) [John Carr]
Load-Balancer
  • Add new driver for AWS Elastic Load Balancing service. (LIBCLOUD-169) [John Carr]

Changes with Apache Libcloud 0.11.4

General
  • Fix some of tests failures which happened in Python 3.3 due to randomized dictionary ordering. (LIBCLOUD-245) [Tomaz Muraus]
Compute
  • Fix a bug where a numeric instead of a string value was used for the content-length header in VCloud driver. (LIBCLOUD-256) [Brian DeGeeter, Tomaz Muraus]
Storage
  • Don’t ignore ex_force_service_region argument in the CloudFiles driver. (LIBCLOUD-260) [Dan Di Spaltro]
  • Fix a bug which caused the connection to not be closed when using Python 2.6 and calling get_object on an object which doesn’t exist in the S3 driver. (LIBCLOUD-257) [John Carr]
DNS
  • Update ‘if type’ checks in the update_record methods to behave correctly if users passes in RecordType.A with a value of 0 - if type is not None. (LIBCLOUD-247) [Tomaz Muraus]

Changes with Apache Libcloud 0.11.3

Storage
  • Include ‘last_modified’ and ‘content_type’ attribute in the Object ‘extra’ dictionary when retrieving object using get_object in the S3 driver. Also modify ‘meta_data’ dictionary to include all the headers prefixed with ‘x-amz-meta-‘. [Tomaz Muraus]

Changes with Apache Libcloud 0.11.2

General
  • Fix a bug with the Libcloud SSL verification code. Code was too strict and didn’t allow “-” character in the sub-domain when using a wildcard certificate.

    Note: This is NOT a security vulnerability. (LIBCLOUD-244) [Tomaz Muraus]

Compute
  • Add new Rackspace Nova driver for Chicago (ORD) location (LIBCLOUD-234) [Brian McDaniel]
  • Add capacity information to Vdc objects and implement power operations. (LIBCLOUD-239) [Michal Galet]
  • Allow user to pass ‘timeout’ argument to the ‘deploy_node’ method. [Tomaz Muraus]
  • Add ex_list_security_groups, ex_authorize_security_group and ex_describe_all_keypairs methods to the EC2 driver. (LIBCLOUD-241, LIBCLOUD-243) [Nick Bailey]
  • Add new methods for managing storage volumes and other extenstion methods to the IBM SCE driver. (LIBCLOUD-242) [Sengor Kusturica]
Storage
  • Add the following new methods to the CloudFiles driver: ex_set_account_metadata_temp_url_key, ex_get_object_temp_url. (GITHUB-72) [Shawn Smith]
Load-balancer
  • Add ‘balancer’ attribute to the Member instance. This attribute refers to the LoadBalancer instance this member belongs to. [Tomaz Muraus]

Changes with Apache Libcloud 0.11.1

General
  • Fix hostname validation in the SSL verification code (CVE-2012-3446).

    Reported by researchers from the University of Texas at Austin (Martin Georgiev, Suman Jana and Vitaly Shmatikov).

Changes with Apache Libcloud 0.11.0

Compute
  • Add a timeout of 10 seconds to OpenStackAuthConnection class. (LIBCLOUD-199) [Chris Gilmer]
  • Add time.sleep(wait_period) to _ssh_client_connect to prevent busy loops when we immediately can’t connect to a server. (LIBCLOUD-197) [Jay Doane]
  • Fix a bug with Python 3 support in the following drivers - IBM SCE, - CloudStack - CloudSigma - OpenNebula - VpsNet - EC2 - ElasticStack - vCloud - OpSource - Slicehost - Joyent (LIBCLOUD-204) [Sengor Kusturica, Hutson Betts, Tomaz Muraus]
  • Make CloudStack driver more robust and make it work if list_images() call returns no images. (LIBCLOUD-202) [Gabriel Reid]
  • Add force_ipv4 argument to _wait_until_running and default it to True. This will make Libcloud ignore IPv6 addresses when using deploy_node. (LIBCLOUD-200) [Jay Doane, Tomaz Muraus]
  • Include error text if a CloudStack async job returns an error code. (LIBCLOUD-207) [Gabriel Reid]
  • Add extenstion methods for block storage volume management to the CloudStack driver. (LIBCLOUD-208) [Gabriel Reid]
  • New driver for KT UCloud (http://home.ucloud.olleh.com/main.kt) based on the CloudStack driver. [DaeMyung Kang]
  • Add a standard API and methods for managing storage volumes to the EC2 and CloudStack drivers. Base API consistent of the following methods: create_volume, destroy_volume, attach_volume, detach_volume. (LIBCLOUD-213) [Gabriel Reid]
  • Change ex_describe_tags, ex_create_tags and ex_delete_tags methods signature in the EC2 driver. Argument is now called resource (previously it was called node). This methods work with both Node and StorageVolume objects. (LIBCLOUD-213) [Gabriel Reid, Tomaz Muraus]
  • Add Rackspace Nova London driver. [Chris Gilmer]
  • Fix a bug - If user doesn’t pass in ‘network_id’ argument to the create_node method in the CloudStack driver, don’t explicitly define it. (LIBCLOUD-219) [Bruno Mahé, Tomaz Muraus]
  • Modify EC2 driver to also return cc2.8xlarge cluster compute instance in the eu-west-1 region. [Tomaz Muraus]
  • Add ‘auth_user_variable’ to the OpenStackAuthConnection class. [Mark Everett]
  • Fix a bug with repeated URLs in some requests the vCloud driver. (LIBCLOUD-222) [Michal Galet]
  • New Gridspot driver with basic list and destroy functionality. (LIBCLOUD-223) [Amir Elaguizy]
  • Add methods for managing storage volumes to the Gandi driver. (LIBCLOUD-225) [Aymeric Barantal]
DNS
  • Add support for GEO RecordType to Zerigo driver. (LIBCLOUD-203) [Gary Wilson]
  • Fix a bug with Python 3 support in the following drivers (LIBCLOUD-204) - Zerigo [Tomaz Muraus]
  • Add support for URL RecordType to Zerigo driver. (LIBCLOUD-209) [Bojan Mihelac]
  • Properly handle record creation when user doesn’t provider a record name and wants to create a record for the actual domain. Reported by Matt Perry (LIBCLOUD-224) [Tomaz Muraus]
Storage
  • Fix a bug with Python 3 support in the following drivers - Atmos - Google Storage - Amazon S3 (LIBCLOUD-204) [Tomaz Muraus]
  • Fix a bug in the CloudFiles driver which prevented it to work with accounts which use a non ORD endpoint. (LIBCLOUD-205) [Geoff Greer]
  • Fix a bug in the enable_container_cdn method. (LIBCLOUD-206) [Geoff Greer]
  • Allow user to specify container CDN TTL when calling container.enable_cd() using ex_ttl keyword argument in the CloudFiles driver. [Tomaz Muraus]
  • Add ex_enable_static_website and ex_set_error_page method to the CloudFiles driver. [Tomaz Muraus]
  • Propagate kwargs passed to container.download_object() to driver.download_object(). (LIBCLOUD-227) [Benno Rice]
  • Fix a bug with not escaping container and object name in the Atmos driver. [Russell Keith-Magee, Benno Rice]
  • Fix upload_object_via_stream method in the Atmos driver. (LIBCLOUD-228) [Benno Rice]
  • Fix a bug with uploading zero-sized files in the OpenStack Swift / CloudFiles driver. [Tomaz Muraus]
  • Fix a bug with content_type and encoding of object and path names in the Atmos driver. [Russell Keith-Magee]
Other
  • Unify docstrings formatting in the compute drivers. (LIBCLOUD-229) [Ilgiz Islamgulov]

Changes with Apache Libcloud 0.10.1

General
  • Add timeout attribute to base ‘Connection’ class and pass it to the connection class constructor if Python version is not 2.5. [Chris Gilmer]
Compute
  • Update IBM SBC driver so it works with IBM Smart Cloud Enterprise. (LIBCLOUD-195) [Sengor Kusturica]

  • Add ex_register_iso method to the CloudStack driver. (LIBCLOUD-196) [Daemian Mack]

  • Allow user to specify which IP to use when calling deploy_node. (defaults to ‘public_ips’). Previously it only worked with public IP, now user can pass ‘private_ips’ as an argument and SSH client will try to connect to the node first private IP address. [Jay Doane]

  • Fix CloudSigmaLvsNodeDriver connectionCls bug. [Jerry Chen]

  • Add ‘ex_keyname’ argument to the create_node method in the OpenStack driver. (LIBCLOUD-177) [Jay Doane]

  • Fix a problem in deploy_node - make it work with providers which don’t instantly return created node in the list_node response. Also add __str__ and __repr__ method to DeploymentError so the error message is more useful. (LIBCLOUD-176) [Jouke Waleson, Tomaz Muraus]

  • Add ‘ssh_key’ feature to Brigthbox driver. This way it works with deploy_node. (LIBCLOUD-179) [Neil Wilson]

  • Add Joyent compute driver. [Tomaz Muraus]

  • Store auth token expire times on the connection class in the attribute called ‘auth_token_expires’. (LIBCLOUD-178) [Chris Gilmer, Brad Morgan]

  • Add new driver for VCL cloud (http://www.educause.edu/blog/hes8/CloudComputingandtheVirtualCom/167931) (LIBCLOUD-180) [Jason Gionta, Tomaz Muraus]

  • Improve and add new features to Brightbox driver
    • Update fixtures to represent actual api output
    • Update compute tests to 100% coverage
    • Add userdata and server group extensions to create_node
    • Add ipv6 support to public ip list
    • Improve in line documentation
    • Add lots of api output information to Node and Image ‘extra’ attributes
    • Allow variable API versions (api_version argument)
    • Allow reverse dns updates for cloud ip extensions

    (LIBCLOUD-184) [Neil Wilson, Tomaz Muraus]

  • Add ex_userdata argument to the OpenStack 1.1 driver. (LIBCLOUD-185) [Jay Doane]

  • Modify Vmware vCloud driver and implement new features for the vCloud version 1.5. (LIBCLOUD-183) [Michal Galet, Sengor Kusturica]

  • Allow user to pass mode argument to SSHClient.put method and default it to ‘w’. (LIBCLOUD-188) [Jay Doane]

  • Modify SSHKeyDeployment step to use append mode so it doesn’t overwrite existing entries in .ssh/authorized_keys. (LIBCLOUD-187) [Jay Doane]

  • Modify ParamikoSSHClient to connect to the SSH agent and automatically look for private keys in ~/.ssh if the ‘auth’ and ‘ssh_key’ argument is not specified when calling deploy_node. (LIBCLOUD-182) [Tomaz Muraus]

  • Add ex_rescue and ex_unrescue method to OpenStack 1.1 driver. (LIBCLOUD-193) [Shawn Smith]

  • Include ‘password’ in the node extra dictionary when calling deploy_node if the password auth is used. [Juan Carlos Moreno]

  • Add FileDeployment class to libcloud.compute.deployment module. This can be used as a replacement for ex_files argument if the provider supports deployment functionality. (LIBCLOUD-190) [Jay Doane]

Storage
  • Large object upload support for CloudFiles driver
  • Add CLOUDFILES_SWIFT driver to connect to OpenStack Swift [Dmitry Russkikh, Roman Bogorodskiy]
Load-balancer
  • Don’t include ‘body_regex’ attribute in the Rackspace driver body if body_regex is None or empty string. (LIBCLOUD-186) [Bill Woodward]
  • Don’t split Load balancer IP addresses into public and private list. Include all the addresses in the ‘virtualIps’ variable in the extra dictionary (Rackspace driver). (LIBCLOUD-191) [Adam Pickeral]

Changes with Apache Libcloud 0.9.1

General
  • Make parsing of the Auth API responses in the OpenStack drivers more flexible and extensible.

    Now, every connection class that inherits from the openstack base connection must implement get_endpoint(), who’s job is to return the correct endpoint out of the service catalog.

    Note: The openstack.py base driver no longer works by default with Rackspace nova. The default endpoint parsed from the service catalog is the default compute endpoint for devstack. (LIBCLOUD-151) [Brad Morgan]

  • Allow user to pass ex_tenant_name keyword argument to the OpenStack node driver class. This scopes all the endpoints returned by the Auth API endpoint to the provided tenant. (LIBCLOUD-172) [James E. Blair]

  • Allow user to specify OpenStack service catalog parameters (service type, name and region). This way base OpenStack driver can be used with different providers without needing to subclass. (LIBCLOUD-173) [James E. Blair]

  • Fix a bug with handling compressed responses in the Linode driver. (LIBCLOUD-158) [Ben Agricola]

Compute
  • Add new RackspaceNovaBeta and RackspaveNovaDfw driver based on the OpenStack. (LIBCLOUD-151) [Brad Morgan]
  • Include ‘created’ and ‘updated’ attribute in the OpenStack 1.1 driver. (LIBCLOUD-155) [Chris Gilmer]
  • Include ‘minRam’ and ‘minDisk’ attribute in the OpenStack 1.1 driver Node extra dictionary. (LIBCLOUD-163) [Chris Gilmer]
  • Allow users to use a list of tuples for the query string parameters inside the OpenStack connection classes. This way same key can be specified multiple times (LIBCLOUD-153) [Dave King]
  • Allow user to pass ‘max_tries’ keyword argument to deploy_node method. [Tomaz Muraus]
  • Include original exception error message when re-throwing an exception inside _run_deployment_script method. [Tomaz Muraus]
  • Add support for ElasticHosts new United States (Los Angeles) and Canada (Toronto) locations. (GITHUB-53) [Jaime Irurzun]
  • Add serverId attribute to the NodeImage object extra dictionary in the OpenStack driver. [Mark Everett]
  • Add new EC2 instance type - m1.medium. [Tomaz Muraus]
  • Allow user to re-use auth tokens and pass ‘ex_force_auth_token’ keyword argument to the OpenStack driver constructor. (LIBCLOUD-164) [Dave King]
  • Add new experimental libvirt driver. [Tomaz Muraus]
  • Properly handle OpenStack providers which return public IP addresses under the ‘internet’ key in the addresses dictionary. [Tomaz Muraus]
  • Update create_node in Linode driver and make it return a Node object instead of a list. Reported by Jouke Waleson. (LIBCLOUD-175) [Tomaz Muraus]
Storage
  • Don’t lowercase special header names in the Amazon S3 storage driver. (LIBCLOUD-149) [Tomaz Muraus]
Load-balancer
  • Allow user to specify a condition and weight when adding a member in the Rackspace driver. [Adam Pickeral]
  • Add an extension method (ex_balancer_attach_members) for attaching multiple members to a load balancer in the Rackspace driver. (LIBCLOUD-152) [Adam Pickeral]
  • Add ex_creaate_balancer method to the Rackspace driver and allow user to pass ‘vip’ argument to it. (LIBCLOUD-166) [Adam Pickeral]
  • Update Rackspace driver to support Auth 2.0. (LIBCLOUD-165) [Dave King]
  • Add new ex_create_balancer_access_rule and ex_create_balancer_access_rule_no_poll method to the Rackspace driver. (LIBCLOUD-170) [Dave King]
DNS
  • Update Rackspace driver to support Auth 2.0. (LIBCLOUD-165) [Dave King]

Changes with Apache Libcloud 0.8.0

General
  • Add ‘request_kwargs’ argument to the get_poll_request_kwargs method. This argument contains kwargs which were previously used to initiate the poll request. [Mark Everett]
  • Add support for handling compressed responses (deflate, gzip). Also send “Accept-Encoding” “gzip,deflate” header with all the requests. [Tomaz Muraus]
  • Fix debug module (LIBCLOUD_DEBUG env variable) so it works with Python 3 [Tomaz Muraus]
Compute
  • Added support for retrieving OpenNebula v3.2 instance types, OpenNebula v3.0 network Public attribute support, and additional code coverage tests. [Hutson Betts]
  • Add implementation for ex_save_image method to the OpenStack 1.1 driver. [Shawn Smith]
  • Add support for Amazon new South America (Sao Paulo) location. [Tomaz Muraus]
  • Fix a bug in OpenStack driver when 2.0_apikey or 2.0_password ‘auth_version’ is used. [Tomaz Muraus]
  • Current OpenNebula OCCI implementation does not support a proper restart method. Rather it suspends and resumes. Therefore, restart_node has been removed from the OpenNebula driver. [Hutson Betts]
  • Enable ex_delete_image method in the OpenStack 1.1 driver. [Shawn Smith]
  • Return NodeImage instance in OpenStack 1.1 driver ex_save_image method (LIBCLOUD-138) [Shawn Smith]
  • Enable reboot_node method in the OpenNebula 3.2 driver. [Hutson Betts]
  • Fix a public_ips Node variable assignment in the Gandi.net driver. [Aymeric Barantal]
  • Updated the list of node states for OpenNebula drivers. (LIBCLOUD-148) [Hutson Betts]
Storage
  • Propagate extra keyword arguments passed to the Rackspace driver connection class. [Dave King]
Load-balancer
  • Add ‘extra’ attribute to the LoadBalancer object and retrieve all the virtual IP addresses in the Rackspace driver. [Dave King]

  • Add list_supported_algorithms() method to the base LoadBalancer class. This method returns a list of supported algorithms by the provider. [Dave King]

  • Update Rackspace driver:
    • Add two new supported algorithms: WEIGHTED_ROUND_ROBIN, WEIGHTED_LEAST_CONNECTIONS
    • Add ex_list_algorithm_names method
    • Add ex_get_balancer_error_page method
    • Add ex_balancer_access_list method
    • Populate LoadBalancer extra dictionary with more attributes
    • Add support for health monitors and connection throttling
    • Add more balancer states
    • ex_list_protocols_with_default_ports

    [Dave King]

  • Propagate extra keyword arguments passed to the Rackspace driver connection class. [Dave King]

  • Add ‘extra’ attribute to the Member object and populate it in the Rackspace driver. [Mark Everett]

  • Adds status to the Member object and conditions an ‘enum’ (Rackspace driver). [Mark Everett]

  • Add update_balancer method to the base LoadBalancer class. [Mark Everett]

  • Add update_balancer method to the Rackspace driver. [Mark Everett]

  • Add created and updated attribute to the LoadBalancer extra dictionary in the Rackspace driver. [Mark Everett]

  • Fix protocol name maping in the Rackspace driver. [Bill Woodward]

Changes with Apache Libcloud 0.7.1

General
  • Fix a minor bug in debug mode (LIBCLOUD_DEBUG=/dev/stderr) which has been introduced when adding Python 3 compatibility layer. [Paul Querna]
  • Update OpenStack Auth API endpoint paths. [Paul Querna]

Changes with Apache Libcloud 0.7.0

General
  • Add support for Python 3.x. [Tomaz Muraus]
  • Remove old deprecated paths. [Tomaz Muraus]
Compute
  • Update CloudSigma Zurich API endpoint address. [Tomaz Muraus]

  • Add new US Las Vegas endpoint to CloudSigma driver (types.CLOUDSIGMA_US) [Tomaz Muraus]

  • Allow user to specify drive type (hdd, ssd) when creating a CloudSigma server.

    Note ‘ssd’ drive_type doesn’t work with the API yet. [Tomaz Muraus]

  • Update OpenStack 1.1 driver to comply with the API specs. Need to make another call to retrieve node name and ip addresses when creating a node, because the first call only returns an id an the password. (GITHUB-40) [Dave King]

  • Add ex_node_ids argument to the EC2 driver list_nodes method. (GITHUB-39) [Suvish Vt]

  • If OpenStack Auth 2.0 API is used, also parse out tenant id and name and save it on the connection class (conn.tenant[‘id’], conn.tenant[‘name’]). [Tomaz Muraus]

  • Add new “Cluster Compute Eight Extra Large” size to the Amazon EC2 driver. [Tomaz Muraus]

  • Add the following extension methods to the EC2 compute driver: ex_describe_all_addresses, ex_associate_addresses, ex_start_node, ex_stop_node. [Suvish Vt]

  • Change public_ip and private_ip attribute on the Node object to the public_ips and private_ips since both of the objects are always a list.

    Note: For backward compatibility you can still access public_ip and private_ip attributes, but this will be removed in the next release. [Tomaz Muraus]

  • Fix an inconsistency in IBM SBC driver and make sure public_ips and private_ips attributes are a list. [Tomaz Muraus]

  • Fix an inconsistency in OpSource driver and make sure public_ips is an empty list ([]), not ‘unknown’ [Tomaz Muraus]

  • Updated support for OpenNebula.org v1.4, v2.x, and v3.x APIs and included additional compute tests validating functionality. (LIBCLOUD-121) [Hutson Betts]

Load-balancer
  • Add ex_member_address argument to the Rackspace driver list_balancers method. If this argument is provided, only loadbalancers which have a member with the provided IP address attached are returned. [Tomaz Muraus]

Changes with Apache Libcloud 0.6.2

General
  • Fix a bug in PollingConnection class - actually use and don’t ignore the poll_interval [Tomaz Muraus]
Compute
  • Add support for Auth 2.0 API (keystone) to the OpenStack Auth connection class. [Brad Morgan]
  • Add list_locations method to the OpenStack driver and fix some inconsistencies in the OpenStack driver extension method signatures. [Brad Morgan]
  • Update Amazon EC2 driver and pricing data to support a new region - US West 2 (Oregon) [Tomaz Muraus]
  • Expose ‘CLOUDSTACK’ provider. This driver can be used with an arbitrary CloudStack installation. [Tomaz Muraus]
Storage
  • Update Amazon S3 driver to support a new region - US West 2 (Oregon) [Tomaz Muraus]
DNS
  • Increase the default poll interval in the Rackspace driver to 2.5 seconds. [Tomaz Muraus]
  • Fix a bug in Rackspace Cloud DNS driver and make sure to throw an exception if an unexpected status code is returned. Reported by “jeblair”. [Tomaz Muraus]

Changes with Apache Libcloud 0.6.1

General
  • Modify ParamikoSSHClient.connect so it supports authentication using a key file, (LIBCLOUD-116) [Jay Doane]
  • User must now explicitly specify a path when using LIBCLOUD_DEBUG environment variable. (LIBCLOUD-95) [daveb, Tomaz Muraus]
  • Add new XmlResponse and JsonResponse base class and modify all the driver-specific response classes to inherit from one of those two classes where applicable. [Caio Romão]
  • Add new ‘PollingConnection’ class. This class can work with ‘async’ APIs. It sends and an initial request and then periodically poll the API until the job has completed or a timeout has been reached. [Tomaz Muraus]
Compute
  • Add 24GB size to the GoGrid driver [Roman Bogorodskiy]
  • Fix API endpoint URL in the Softlayer driver [Tomaz Muraus]
  • Add support for OpenNebula 3.0 API (LIBCLOUD-120) [Hutson Betts]
  • Add more attributes to the extra dictionary in the EC2 driver. (GITHUB-31) [Juan Carlos Moreno]
  • Fix IP address assignment in the EC2 driver. Don’t include “None” in the public_ip and private_ip Node list attribute. [Tomaz Muraus]
  • Make deploy_node functionality more robust and don’t start deployment if node public_ip attribute is an empty list. [Tomaz Muraus]
  • Support SSH key authentication when using deploy_node. [Russell Haering, Tomaz Muraus]
  • Enable deploy_node functionality in the EC2 driver using SSH key authentication [Russell Haering, Tomaz Muraus]
  • Enable paramiko library debug log level if LIBCLOUD_DEBUG is used and paramiko is installed. [Tomaz Muraus]
  • Fix the request signature generation in the base EC2 compute driver. If the endpoint is using a non-standard port (Eucalyptus based installations), append it to the hostname used to generate the signature. [Simon Delamare]
  • Add new “unavailable” state to the BrightboxNodeDriver class. [Tim Fletcher]
  • Increase a PollingConnection timeout in the CloudStack connection and fix the context dictionary creation in the _async_request method. [Oleg Suharev]
  • Fix networks retrieval in the CloudStack driver create_node method. Also only pass ‘networkids’ field to the API if there are any networks available. [Oleg Suharev, Tomaz Muraus]
  • Fix list_nodes in the CloudStack driver. Private IPs aren’t always available. [Tomaz Muraus]
Load-baancer
  • Add a missing argument to the method call inside LoadBalancer.attach_compute_node and Driver.balancer_attach_compute_node. [Tim Fletcher, Tomaz Muraus]
  • Add missing destroy() method to the LoadBalancer class. [Tomaz Muraus]
DNS
  • New drivers for Rackspace Cloud DNS (US and UK region) [Tomaz Muraus]
  • Add list_record_types() method. This method returns a list of record types supported by the provider. [Tomaz Muraus]

Changes with Apache Libcloud 0.6.0-beta1

General
  • All the driver classes now inherit from the BaseDriver class [Tomaz Muraus]
  • Prefer simplejson (if available) over json module. (LIBCLOUD-112) [Geoff Greer]
  • Update compute demo and change the syntax of test credentials stored in test/secrets.py-dist. (LIBCLOUD-111) [Mike Nerone]
  • Enable SSL certificate verification by default and throw an exception if CA certificate files cannot be found. This can be overridden by setting libcloud.security.VERIFY_SSL_CERT_STRICT to False. [Tomaz Muraus]
Compute
  • Support for 1.1 API and many other improvements in the OpenStack driver ; LIBCLOUD-83 [Mike Nerone, Paul Querna, Brad Morgan, Tomaz Muraus]
  • Add some extra methods to the Gandi.net driver (LIBCLOUD-115) [Aymeric Barantal]
  • Add ex_delete_image method to the Rackspace driver. (GITHUB-27) [David Busby]
  • Linode driver now supports new ‘Japan’ location [Jed Smith]
  • Rackspace driver now inherits from the OpenStack one instead of doing it vice versa. (LIBCLOUD-110) [Mike Nerone]
  • Properly populate NodeImage “details” dictionary in the Rackspace compute driver. (LIBCLOUD-107) [Lucy Mendel]
  • Fix a bug in Eucalyptus driver ex_describe_addresses method. [Tomaz Muraus]
  • Add the following new extenstion methods to the Rackspace driver: ex_resize, ex_confirm_resize, ex_revert_resize. [Tomaz Muraus]
  • Also allow user to pass in Node object to some ex_ methods in the Rackspace compute driver. [Tomaz Muraus]
  • Throw an exception in deploy_node if paramiko library is not available [Tomaz Muraus]
  • Fix chmod argument value which is passed to the sftpclient.put method; GITHUB-17 [John Carr]
  • New driver for Ninefold.com. (LIBCLOUD-98) [Benno Rice]
Storage
  • New driver for Google Storage based on the v1.0 / legacy API [Tomaz Muraus]
  • New driver for Ninefold.com. (GITHUB-19) [Benno Rice]
  • Fix a bug in uploading an object with some versions of Python 2.7 where httplib library doesn’t automatically call str() on the header values. [Tomaz Muraus]
  • Allow users to upload (create) 0-bytes large (empty) objects [Tomaz Muraus]
Load-balancer
  • New driver for Rackspace UK location [Tomaz Muraus]
  • New driver for Ninefold.com. (LIBCLOUD-98) [Benno Rice]
DNS
  • Drivers for Linode DNS and Zerigo DNS [Tomaz Muraus]
  • Brand new DNS API! [Tomaz Muraus]

Changes with Apache Libcloud 0.5.2

Compute
  • New driver for serverlove.com and skalicloud.com [Tomaz Muraus]
  • Fix node name and tag handling in the Amazon EC2 driver [Wiktor Kolodziej]
  • Fix pricing and response handling in the OpenStack driver [Andrey Zhuchkov]
  • Fix deploy_node() method and make it more robust [Tomaz Muraus]
  • Users can now pass file like objects to ScriptDeployment and SSHKeyDeployment constructor. [Tomaz Muraus]
  • Include node tags when calling list_nodes() in the Amazon EC2 driver [Trevor Pounds]
  • Properly handle response errors in the Rackspace driver and only throw InvalidCredsError if the returned status code is 401 [Brad Morgan]
  • Fix the create_node method in the Nimbus driver and make the “ex_create_tag” method a no-op, because Nimbus doesn’t support creating tags. [Tomaz Muraus]
Storage
  • Fix handling of the containers with a lot of objects. Now a LazyList object is returned when user calls list_container_objects() method and this object transparently handles pagination. [Danny Clark, Wiktor Kolodziej]

Changes with Apache Libcloud 0.5.0

  • Existing APIs directly on the libcloud.* module have been deprecated and will be removed in version 0.6.0. Most methods were moved to the libcloud.compute.* module.

  • Add new libcloud.loadbalancers API, with initial support for:
    • GoGrid Load Balancers
    • Rackspace Load Balancers

    [Roman Bogorodskiy]

  • Add new libcloud.storage API, with initial support for:
    • Amazon S3
    • Rackspace CloudFiles

    [Tomaz Muraus]

  • Add new libcloud.compute drivers for:
    • Bluebox [Christian Paredes]
    • Gandi.net [Aymeric Barantal]
    • Nimbus [David LaBissoniere]
    • OpenStack [Roman Bogorodskiy]
    • Opsource.net [Joe Miller]
  • Added “pricing” module and improved pricing handling. [Tomaz Muraus]

  • Updates to the GoGrid compute driver:
    • Use API version 1.0.
    • Remove sandbox flag.
    • Add ex_list_ips() to list IP addresses assigned to the account.
    • Implement ex_edit_image method which allows changing image attributes like name, description and make image public or private.

    [Roman Bogorodskiy]

  • Updates to the Amazon EC2 compute driver:
    • When creating a Node, use the name argument to set a Tag with the value. [Tomaz Muraus]
    • Add extension method for modifying node attributes and changing the node size. [Tomaz Muraus]
    • Add support for the new Amazon Region (Tokyo). [Tomaz Muraus]
    • Added ex_create_tags and ex_delete_tags. [Brandon Rhodes]
    • Include node Elastic IP addresses in the node public_ip attribute for the EC2 nodes. [Tomaz Muraus]
    • Use ipAddress and privateIpAddress attribute for the EC 2node public and private ip. [Tomaz Muraus]
    • Add ex_describe_addresses method to the EC2 driver. [Tomaz Muraus]
  • Updates to the Rackspace CloudServers compute driver:
    • Add ex_rebuild() and ex_get_node_details() [Andrew Klochkov]
    • Expose URI of a Rackspace node to the node meta data. [Paul Querna]
  • Minor fixes to get the library and tests working on Python 2.7 and PyPy. [Tomaz Muraus]

Changes with Apache Libcloud 0.4.2 (Released January 18, 2011)

  • Fix EC2 create_node to become backward compatible for NodeLocation. [Tomaz Muraus]

  • Update code for compatibility with CPython 2.5 [Jerry Chen]

  • Implement ex_edit_node method for GoGrid driver which allows changing node attributes like amount of RAM or description. [Roman Bogorodskiy]

  • Add ex_set_password and ex_set_server_name to Rackspace driver. [Peter Herndon, Paul Querna]

  • Add Hard and Soft reboot methods to Rackspace driver. [Peter Herndon]

  • EC2 Driver availability zones, via ex_list_availability_zones; list_locations rewrite to include availability zones [Tomaz Muraus]

  • EC2 Driver Idempotency capability in create_node; LIBCLOUD-69 [David LaBissoniere]

  • SSL Certificate Name Verification:
    • libcloud.security module
    • LibcloudHTTPSConnection, LibcloudHTTPConnection (alias)
    • Emits warning when not verifying, or CA certs not found
  • Append ORD1 to available Rackspace location, but keep in the same node as DFW1, because it’s not readable or writeable from the API. [Per suggestion of Grig Gheorghiu]

  • ex_create_ip_group, ex_list_ip_groups, ex_delete_ip_group, ex_share_ip, ex_unshare_ip, ex_list_ip_addresses additions to Rackspace driver [Andrew Klochkov]

  • New driver for CloudSigma. [Tomaz Muraus]

  • New driver for Brightbox Cloud. (LIBCLOUD-63) [Tim Fletcher]

  • Deployment capability to ElasticHosts [Tomaz Muraus]

  • Allow deploy_node to use non-standard SSH username and port [Tomaz Muraus]

  • Added Rackspace UK (London) support [Chmouel Boudjnah]

  • GoGrid driver: add support for locations, i.e. listing of locations and creation of a node in specified location [Roman Bogorodskiy]

  • GoGrid and Rackspace drivers: add ex_save_image() extra call to convert running node to an image [Roman Bogorodskiy]

  • GoGrid driver: add support for creating ‘sandbox’ server and populate isSandbox flag in node’s extra information. [Roman Bogorodskiy]

  • Add ImportKeyPair and DescribeKeyPair to EC2. (LIBCLOUD-62) [Philip Schwartz]

  • Update EC2 driver and test fixtures for new API. [Philip Schwartz]

Changes with Apache Libcloud 0.4.0 [Released October 6, 2010]

  • Add create keypair functionality to EC2 Drivers. (LIBCLOUD-57) [Grig Gheorghiu]

  • Improve handling of GoGrid accounts with limited access API keys. [Paul Querna]

  • New Driver for ElasticHosts. (LIBCLOUD-45) [Tomaz Muraus]

  • Use more consistent name for GoGrid driver and use http POST method for ‘unsafe’ operations [Russell Haering]

  • Implement password handling and add deployment support for GoGrid nodes. [Roman Bogorodskiy]

  • Fix behavior of GoGrid’s create_node to wait for a Node ID. [Roman Bogorodskiy]

  • Add ex_create_node_nowait to GoGrid driver if you don’t need to wait for a Node ID when creating a node. [Roman Bogorodskiy]

  • Removed libcloud.interfaces module. [Paul Querna]

  • Removed dependency on zope.interfaces. [Paul Querna]

  • RimuHosting moved API endpoint address. [Paul Querna]

  • Fix regression and error in GoGrid driver for parsing node objects. [Roman Bogorodskiy]

  • Added more test cases for GoGrid driver. (LIBCLOUD-34) [Roman Bogorodskiy, Jerry Chen]

  • Fix parsing of Slicehost nodes with multiple Public IP addresses. [Paul Querna]

  • Add exit_status to ScriptDeployment. (LIBCLOUD-36) [Paul Querna]

  • Update prices for several drivers.

    [Brad Morgan, Paul Querna]

  • Update Linode driver to reflect new plan sizes. [Jed Smith]

  • Change default of ‘location’ in Linode create_node. (LIBCLOUD-41)

    [Jed Smith, Steve Steiner]

  • Document the Linode driver. [Jed Smith]

  • Request a private, LAN IP address at Linode creation. [Jed Smith]

Changes with Apache Libcloud 0.3.1 [Released May 11, 2010]

  • Updates to Apache License blocks to correctly reflect status as an

    Apache Project.

  • Fix NOTICE file to use 2010 copyright date.

  • Improve error messages for when running the test cases without first setting up a secrets.py

Changes with Apache Libcloud 0.3.0 [Tagged May 6, 2010, not released]

  • New Drivers for:
    • Dreamhost
    • Eucalyptus
    • Enomaly ECP
    • IBM Developer Cloud
    • OpenNebula
    • SoftLayer
  • Added new deployment and bootstrap API.

  • Improved Voxel driver.

  • Added support for Amazon EC2 Asia Pacific (Singapore) Region.

  • Improved test coverage for all drivers.

  • Add support for multiple security groups in EC2.

  • Fixed bug in Rackspace and RimuHosting when using multiple threads.

  • Improved debugging and logging of HTTP requests.

  • Improved documentation for all classes and methods.

Changes with Apache Libcloud 0.2.0 [Tagged February 2, 2010]

  • First public release.

Upgrade Notes

This page describes how to upgrade from a previous version to a new version which contains backward incompatible or semi-incompatible changes and how to preserve the old behavior when this is possible.

Development

  • The base signature of NodeDriver.create_volume has changed. The snapshot argument is now expected to be a VolumeSnapshot instead of a string. The older signature was never correct for built-in drivers, but custom drivers may break. (GCE accepted strings, names or None and still does. Other drivers did not implement creating volumes from snapshots at all until now.)
  • VolumeSnapshots now have a created attribute that is a datetime field showing the creation datetime of the snapshot. The field in VolumeSnapshot.extra containing the original string is maintained, so this is a backwards-compatible change.
  • The OpenStack compute driver methods ex_create_snapshot and ex_delete_snapshot are now deprecated by the standard methods create_volume_snapshot and destroy_volume_snapshot. You should update your code.
  • The compute base driver now considers the name argument to create_volume_snapshot to be optional. All official implementations of this methods already considered it optional. You should update any custom drivers if they rely on the name being mandatory.

Libcloud 0.16.0

Changes in the OpenStack authentication and service catalog classes

Note

If you are only working with the driver classes and have never dorectly touched the classes mentioned below, then you aren’t affected and those changes are fully backward compatible.

To make OpenStack authentication and identity related classes more extensible, easier to main and easier to use, those classes have been refactored. All of the changes are described below.

  • New libcloud.common.openstack_identity module has been added. This module contains code for working with OpenStack Identity (Keystone) service.
  • OpenStackAuthConnection class has been removed and replaced with one connection class per Keystone API version (OpenStackIdentity_1_0_Connection, OpenStackIdentity_2_0_Connection, OpenStackIdentity_3_0_Connection).
  • New get_auth_class method has been added to OpenStackBaseConnection class. This method allows you to retrieve an instance of the authentication class which is used with the current connection.
  • OpenStackServiceCatalog class has been refactored to store parsed catalog entries in a structured format (OpenStackServiceCatalogEntry and OpenStackServiceCatalogEntryEndpoint class). Previously entries were stored in an unstructured form in a dictionary. All the catalog entries can be retrieved by using OpenStackServiceCatalog.get_entris method.
  • ex_force_auth_version argument in OpenStackServiceCatalog constructor method has been renamed to auth_version
  • get_regions, get_service_types and get_service_names methods on the OpenStackServiceCatalog class have been modified to always return the result in the same order (result values are sorted beforehand).

For more information and examples, please refer to the Libcloud now supports OpenStack Identity (Keystone) API v3 blog post.

Libcloud 0.14.1

Fix record name inconsistencies in the Rackspace DNS driver

Record.name attribute is now correctly set to None for records which refer to the bare domain name. Previously, Record.name attribute for such records was set to the domain name.

For example, lets have a look at a record which points to the domain example.com.

New Record.name attribute value for such record: None

Old Record.name attribute value for such record: example.com

This was done to make the Rackspace driver consistent with the other ones.

Libcloud 0.14.0

To make drivers with multiple regions easier to use, one of the big changes in this version is move away from the old “one class per region” model to a new single class plus region argument model.

More information on how this affects existing drivers and your code can be found below.

Default Content-Type is now provided if none is supplied and none can be guessed

In older versions, Libcloud would throw an exception when a content type is not supplied and none can’t be automatically detected when uploading an object.

This has changed with the 0.14.0 release. Now if no content type is specified and none can’t be detected, a default content type of application/octet-stream is used.

If you want to preserve the old behavior, you can set strict_mode attribute on the driver object to True.

from libcloud.storage.types import Provider
from libcloud.stoage.providers import get_driver

cls = get_driver(Provider.CLOUDFILES)
driver = cls('username', 'api key')

driver.strict_mode = True

If you are not using strict mode and you are uploading a binary object, we still encourage you to practice Python’s “explicit is better than implicit” mantra and explicitly specify Content-Type of application/octet-stream.

SSH Key pair management functionality has been promoted to the base API

SSH key pair management functionality has been promoted to be a part of the base compute API.

As such, the following new classes and methods have been added:

  • libcloud.compute.base.KeyPair
  • libcloud.compute.base.NodeDriver.list_key_pairs
  • libcloud.compute.base.NodeDriver.create_key_pair
  • libcloud.compute.base.NodeDriver.import_key_pair_from_string
  • libcloud.compute.base.NodeDriver.import_key_pair_from_file
  • libcloud.compute.base.NodeDriver.delete_key_pair

Previously, this functionality was available in some of the provider drivers (CloudStack, EC2, OpenStack) via the following extension methods:

  • ex_list_keypairs
  • ex_create_keypair
  • ex_import_keypair_from_string
  • ex_import_keypair
  • ex_delete_keypair

Existing extension methods will continue to work until the next major release, but you are strongly encouraged to start using new methods which are now part of the base compute API and are guaranteed to work the same across different providers.

New default kernel versions used when creating Linode servers

Kernel versions which are used by default when creating Linode servers have been updated.

Old default kernel versions:

  • x86 (no paravirt-ops) - 2.6.18.8-x86_64-linode1 (#60)
  • x86 (paravirt-ops) - 2.6.18.8-x86_64-linode1 (#110)
  • x86_64 (no paravirt-ops) - 2.6.39.1-linode34 (#107)
  • x86 (paravirt-ops)64 - 2.6.18.8-x86_64-linode1 (#111)

New default kernel versions:

  • x86 - 3.9.3-x86-linode52 (#137)
  • x86_64 - 3.9.3-x86_64-linode33 (#138)

Those new kernel versions now come with paravirt-ops by default.

If you want to preserve the old behavior, you can pass ex_kernel argument to the create_node method.

Keep in mind that using old kernels is strongly discouraged since they contain known security holes.

For example:

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver

cls = get_driver(Provider.LINODE)

driver = cls('username', 'api_key')
driver.create_node(..., ex_kernel=110)
Addition of new “STOPPED” node state

This version includes a new state called libcloud.compute.types.NodeState.STOPPED. This state represents a node which has been stopped and can be started later on (unlike TERMINATED state which represents a node which has been terminated and can’t be started later on).

As such, EC2 and HostVirual drivers have also been updated to recognize this new state.

Before addition of this state, nodes in this state were mapped to NodeState.UNKNOWN.

Amazon EC2 compute driver changes

Amazon EC2 compute driver has moved to single class plus region argument model. As such, the following provider constants have been deprecated:

  • EC2_US_EAST
  • EC2_US_WEST_OREGON
  • EC2_EU
  • EC2_EU_WEST
  • EC2_AP_SOUTHEAST
  • EC2_AP_SOUTHEAST2
  • EC2_AP_NORTHEAST
  • EC2_SA_EAST

And replaced with a single constant:

  • EC2 - Supported values for the region argument are: us-east-1, us-west-1, us-west-2, eu-west-1, ap-southeast-1, ap-northeast-1, sa-east-1, ap-southeast-2. Default value is us-east-1.

List which shows how old classes map to a new region argument value:

  • EC2_US_EAST -> us-east-1
  • EC2_US_WEST -> us-west-1
  • EC2_US_WEST_OREGON -> us-west-2
  • EC2_EU -> eu-west-1
  • EC2_EU_WEST -> eu-west-1
  • EC2_AP_SOUTHEAST -> ap-southeast-1
  • EC2_AP_SOUTHEAST2 -> ap-southeast-2
  • EC2_AP_NORTHEAST -> ap-northeast-1
  • EC2_SA_EAST -> sa-east-1

Old code:

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver

cls1 = get_driver(Provider.EC2)
cls2 = get_driver(Provider.EC2_EU_WEST)

driver1 = cls('username', 'api_key')
driver2 = cls('username', 'api_key')

New code:

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver

cls = get_driver(Provider.EC2)

driver1 = cls('username', 'api_key', region='us-east-1')
driver2 = cls('username', 'api_key', region='eu-west-1')
Rackspace compute driver changes

Rackspace compute driver has moved to single class plus region argument model. As such, the following provider constants have been removed:

  • RACKSPACE
  • RACKSPACE_UK
  • RACKSPACE_AU
  • RACKSPACE_NOVA_ORD
  • RACKSPACE_NOVA_DFW
  • RACKSPACE_NOVA_LON
  • RACKSPACE_NOVA_BETA

And replaced with two new constants:

  • RACKSPACE_FIRST_GEN - Supported values for region argument are: us, uk. Default value is us.
  • RACKSPACE - Supported values for the region argument are: dfw, ord, iad, lon, syd, hkg. Default value is dfw.

Besides that, RACKSPACE provider constant now defaults to next-generation OpenStack based servers. Previously it defaulted to first generation cloud servers.

If you want to preserve old behavior and use first-gen drivers you need to use RACKSPACE_FIRST_GEN provider constant.

First generation cloud servers now also use auth 2.0 by default. Previously they used auth 1.0.

Because of the nature of this first-gen to next-gen change, old constants have been fully removed and unlike region changes in other driver, this change is not backward compatible.

List which shows how old, first-gen classes map to a new region argument value:

  • RACKSPACE -> us
  • RACKSPACE_UK -> uk

List which shows how old, next-gen classes map to a new region argument value:

  • RACKSPACE_NOVA_ORD -> ord
  • RACKSPACE_NOVA_DFW -> dfw
  • RACKSPACE_NOVA_LON -> lon
  • RACKSPACE_AU -> syd

More examples which show how to update your code to work with a new version can be found below.

Old code (connecting to a first-gen provider):

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver

cls1 = get_driver(Provider.RACKSPACE) # US regon
cls2 = get_driver(Provider.RACKSPACE_UK) # UK regon

driver1 = cls('username', 'api_key')
driver2 = cls('username', 'api_key')

New code (connecting to a first-gen provider):

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver

cls = get_driver(Provider.RACKSPACE_FIRST_GEN)

driver1 = cls('username', 'api_key', region='us')
driver2 = cls('username', 'api_key', region='uk')

Old code (connecting to a next-gen provider)

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver

cls1 = get_driver(Provider.RACKSPACE_NOVA_ORD)
cls2 = get_driver(Provider.RACKSPACE_NOVA_DFW)
cls3 = get_driver(Provider.RACKSPACE_NOVA_LON)

driver1 = cls('username', 'api_key')
driver2 = cls('username', 'api_key')
driver3 = cls('username', 'api_key')

New code (connecting to a next-gen provider)

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver

cls = get_driver(Provider.RACKSPACE)

driver1 = cls('username', 'api_key', region='ord')
driver2 = cls('username', 'api_key', region='dfw')
driver3 = cls('username', 'api_key', region='lon')
CloudStack compute driver changes

CloudStack driver received a lot of changes and additions which will make it more pleasant to use. Backward incompatible changes are listed below:

  • CloudStackForwardingRule class has been renamed to CloudStackIPForwardingRule
  • create_node method arguments are now more consistent with other drivers. Security groups are now passed as ex_security_groups, SSH keypairs are now passed as ex_keyname and userdata is now passed as ex_userdata.
  • For advanced networking zones, multiple networks can now be passed to the create_node method instead of a single network id. These networks need to be instances of the CloudStackNetwork class.
  • The extra_args argument of the create_node method has been removed. The only arguments accepted are now the defaults name, size, image, location plus ex_keyname, ex_userdata, ex_security_groups and networks.
Joyent compute driver changes

Joyent driver has been aligned with other drivers and now the constructor takes region instead of location argument.

For backward compatibility reasons, old argument will continue to work until the next major release.

Old code:

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver

cls = get_driver(Provider.JOYENT)

driver = cls('username', 'api_key', location='us-east-1')

Old code:

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver

cls = get_driver(Provider.JOYENT)

driver = cls('username', 'api_key', region='us-east-1')
ElasticHosts compute driver changes

ElasticHosts compute driver has moved to single class plus region argument model. As such, the following provider constants have been deprecated:

  • ELASTICHOSTS_UK1
  • ELASTICHOSTS_UK1
  • ELASTICHOSTS_US1
  • ELASTICHOSTS_US2
  • ELASTICHOSTS_US3
  • ELASTICHOSTS_CA1
  • ELASTICHOSTS_AU1
  • ELASTICHOSTS_CN1

And replaced with a single constant:

  • ELASTICHOSTS - Supported values for the region argument are: lon-p, lon-b, sat-p, lax-p, sjc-c, tor-p, syd-y, cn-1 Default value is sat-p.

List which shows how old classes map to a new region argument value:

  • ELASTICHOSTS_UK1 -> lon-p
  • ELASTICHOSTS_UK1 -> lon-b
  • ELASTICHOSTS_US1 -> sat-p
  • ELASTICHOSTS_US2 -> lax-p
  • ELASTICHOSTS_US3 -> sjc-c
  • ELASTICHOSTS_CA1 -> tor-p
  • ELASTICHOSTS_AU1 -> syd-y
  • ELASTICHOSTS_CN1 -> cn-1

Because of this change main driver class has also been renamed from libcloud.compute.drivers.elastichosts.ElasticHostsBaseNodeDriver to libcloud.compute.drivers.elastichosts.ElasticHostsNodeDriver.

Only users who directly instantiate a driver and don’t use recommended get_driver method are affected by this change.

Old code:

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver

cls1 = get_driver(Provider.ELASTICHOSTS_UK1)
cls2 = get_driver(Provider.ELASTICHOSTS_US2)

driver1 = cls('username', 'api_key')
driver2 = cls('username', 'api_key')

New code:

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver

cls = get_driver(Provider.ELASTICHOSTS)

driver1 = cls('username', 'api_key', region='lon-p')
driver2 = cls('username', 'api_key', region='lax-p')
Unification of extension arguments for security group handling in the EC2 driver

To unify extension arguments for handling security groups between drivers, ex_securitygroup argument in the EC2 create_node method has been renamed to ex_security_groups.

For backward compatibility reasons, old argument will continue to work for until a next major release.

CloudFiles Storage driver changes

CLOUDFILES_US and CLOUDFILES_UK provider constants have been deprecated and a new CLOUDFILES constant has been added.

User can now use this single constant and specify which region to use by passing region argument to the driver constructor.

Old code:

from libcloud.storage.types import Provider
from libcloud.storage.providers import get_driver

cls1 = get_driver(Provider.CLOUDFILES_US)
cls2 = get_driver(Provider.CLOUDFILES_UK)

driver1 = cls1('username', 'api_key')
driver2 = cls1('username', 'api_key')

New code:

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver

cls = get_driver(Provider.CLOUDFILES)

driver1 = cls1('username', 'api_key', region='dfw')
driver2 = cls1('username', 'api_key', region='lon')
Rackspace DNS driver changes

Rackspace DNS driver has moved to one class plus region argument model. As such, the following provider constants have been deprecated:

  • RACKSPACE_US
  • RACKSPACE_UK

And replaced with a single constant:

  • RACKSPACE - Supported values for region arguments are us, uk. Default value is us.

Old code:

from libcloud.dns.types import Provider
from libcloud.dns.providers import get_driver

cls1 = get_driver(Provider.RACKSPACE_US)
cls2 = get_driver(Provider.RACKSPACE_UK)

driver1 = cls1('username', 'api_key')
driver2 = cls1('username', 'api_key')

New code:

from libcloud.dns.types import Provider
from libcloud.dns.providers import get_driver

cls = get_driver(Provider.RACKSPACE)

driver1 = cls1('username', 'api_key', region='us')
driver2 = cls1('username', 'api_key', region='uk')
Rackspace load balancer driver changes

Rackspace loadbalancer driver has moved to one class plus region argument model. As such, the following provider constants have been deprecated:

  • RACKSPACE_US
  • RACKSPACE_UK

And replaced with a single constant:

  • RACKSPACE - Supported values for region arguments are dfw, ord, iad, lon, syd, hkg. Default value is dfw.

Old code:

from libcloud.loadbalancer.types import Provider
from libcloud.loadbalancer.providers import get_driver

cls1 = get_driver(Provider.RACKSPACE_US)
cls2 = get_driver(Provider.RACKSPACE_UK)

driver1 = cls1('username', 'api_key')
driver2 = cls1('username', 'api_key')

New code:

from libcloud.loadbalancer.types import Provider
from libcloud.loadbalancer.providers import get_driver

cls = get_driver(Provider.RACKSPACE)

driver1 = cls1('username', 'api_key', region='ord')
driver2 = cls1('username', 'api_key', region='lon')
ScriptDeployment and ScriptFileDeployment constructor now takes args argument

libcloud.compute.deployment.ScriptDeployment and libcloud.compute.deployment.ScriptFileDeployment class constructor now take args as a second argument.

Previously this argument was not present and the second argument was name.

If you have a code which instantiate those classes directly and passes two or more arguments (not keyword arguments) to the constructor you need to update it to preserve the old behavior.

Old code:

sd = ScriptDeployment('#!/usr/bin/env bash echo "ponies!"', 'ponies.sh')

New code:

sd = ScriptDeployment('#!/usr/bin/env bash echo "ponies!"', None,
                      'ponies.sh')

Even better (using keyword arguments):

sd = ScriptDeployment(script='#!/usr/bin/env bash echo "ponies!"',
                      name='ponies.sh')
Pricing data changes

By default this version of Libcloud tries to read pricing data from the ~/.libcloud/pricing.json file. If this file doesn’t exist, Libcloud falls back to the old behavior and the pricing data is read from the pricing file which is shipped with each release.

For more information, please see Using a custom pricing file page.

RecordType ENUM value is now a string

libcloud.dns.types.RecordType ENUM value used be an integer, but from this version on, it’s now a string. This was done to make it simpler and remove unnecessary indirection.

If you use RecordType class in your code as recommended, no changes are required, but if you use integer values directly, you need to update your code to use RecordType class otherwise it will break.

OK:

# ...
record = driver.create_record(name=www, zone=zone, type=RecordType.A,
                              data='127.0.0.1')

Not OK:

# ...
record = driver.create_record(name=www, zone=zone, type=0,
                              data='127.0.0.1')
Cache busting functionality is now only enabled in Rackspace first-gen driver

Cache busting functionality has been disabled in the Rackspace next-gen driver and all of the OpenStack drivers. It’s now only enabled in the Rackspace first-gen driver.

Cache busting functionality works by appending a random query parameter to every GET HTTP request. It was originally added to the Rackspace first-gen driver a long time ago to avoid excessive HTTP caching on the provider side. This excessive caching some times caused list_nodes and other calls to return stale data.

This approach should not be needed with Rackspace next-gen and OpenStack drivers so it has been disabled.

No action is required on the user’s side.

libcloud.security.VERIFY_SSL_CERT_STRICT variable has been removed

libcloud.security.VERIFY_SSL_CERT_STRICT variable has been introduced in version 0.4.2 when we initially added support for SSL certificate verification. This variable was added to ease the migration from older versions of Libcloud which didn’t verify SSL certificates.

In version 0.6.0, this variable has been set to True by default and deprecated.

In this release, this variable has been fully removed. For more information on how SSL certificate validation works in Libcloud, see the SSL Certificate Validation page.

get_container method changes in the S3 driver

Previously, the get_container method in the S3 driver used a very inefficient approach of using list_containers + late filterting.

The code was changed to use a more efficient approach which means using a single HTTP HEAD request.

The only downside of this approach is that it doesn’t return container creation date.

If you need the container creation date, you should use list_containers method and do the later filtering yourself.

Libcloud 0.8

  • restart_node method has been removed from the OpenNebula compute driver, because OpenNebula OCCI implementation does not support a proper restart method.
  • ex_save_image method in the OpenStack driver now returns a NodeImage instance.

For a full list of changes, please see the CHANGES file.

Libcloud 0.7

  • For consistency, public_ip and private_ip attribute on the Node object have been renamed to public_ips and private_ips respectively.

In 0.7 you can still access those attributes using the old way, but this option will be removed in the next major release.

Note: If you have places in your code where you directly instantiate a ``Node`` class, you need to update it.

Old code:

node = Node(id='1', name='test node', state=NodeState.PENDING,
            private_ip=['10.0.0.1'], public_ip=['88.77.66.77'],
            driver=driver)

Updated code:

node = Node(id='1', name='test node', state=NodeState.PENDING,
            private_ips=['10.0.0.1'], public_ips=['88.77.66.77'],
            driver=driver)
  • Old deprecated paths have been removed. If you still haven’t updated your code you need to do it now, otherwise it won’t work with 0.7 and future releases.

Bellow is a list of old paths and their new locations:

  • libcloud.base -> libcloud.compute.base
  • libcloud.deployment -> libcloud.compute.deployment
  • libcloud.drivers.* -> libcloud.compute.drivers.*
  • libcloud.ssh -> libcloud.compute.ssh
  • libcloud.types -> libcloud.compute.types
  • libcloud.providers -> libcloud.compute.providers

In the contrib/ directory you can also find a simple bash script which can perform a search and replace for you - migrate_paths.py.

For a full list of changes, please see the CHANGES file.

Libcloud 0.6

  • SSL certificate verification is now enabled by default and an exception is thrown if CA certificate files cannot be found.

To revert to the old behavior, set libcloud.security.VERIFY_SSL_CERT_STRICT variable to False:

libcloud.security.VERIFY_SSL_CERT_STRICT = False

Note: You are strongly discouraged from disabling SSL certificate validation. If you disable it and no CA certificates files are found on the system you are vulnerable to a man-in-the-middle attack

More information on how to acquire and install CA certificate files on different operating systems can be found on SSL Certificate Validation page

  • OpenStack driver now defaults to using OpenStack 1.1 API.

To preserve the old behavior and use OpenStack 1.0 API, pass api_version='1.0' keyword argument to the driver constructor.

For example:

Cls = get_provider(Provider.OPENSTACK)
driver = Cls('user_name', 'api_key', False, 'host', 8774, api_version='1.0')
  • OpenNebula driver now defaults to using OpenNebula 3.0 API

To preserve the old behavior and use OpenNebula 1.4 API, pass api_version='1.4' keyword argument to the driver constructor.

For example:

Cls = get_provider(Provider.OPENNEBULA)
driver = Cls('key', 'secret', api_version='1.4')

For a full list of changes, please see the CHANGES file.

Security

Reporting a vulnerability

Note

Please do not report security issues using our public JIRA instance. Use the private mailing list described below.

If you believe you’ve found a security issue or a vulnerability, please send a description of it to our private mailing list at security@libcloud.apache.org

You are also encouraged to encrypt this email using PGP. Keys of our developers can be found at https://www.apache.org/dist/libcloud/KEYS.

Once you’ve submitted an issue, you should receive an acknowledgment from one our of team members in 48 hours or less. If further action is necessary, you may receive additional follow-up emails.

How are vulnerabilities handled?

We follow a standard Apache Software Foundation vulnerability handling process which is described at http://www.apache.org/security/committers.html#vulnerability-handling

Note

Unless noted otherwise, all of the examples and code snippets in the documentation are licensed under the Apache 2.0 license.