Using an HTTP proxy


Support for HTTP proxies is only available in Libcloud trunk and higher.

Libcloud supports using an HTTP proxy for outgoing HTTP and HTTPS requests.

Proxy support has been tested with the following Python versions;

  • Python 2.6
  • Python 2.7 / PyPy
  • Python 3.1
  • Python 3.2
  • Python 3.3
  • Python 3.4

You can specify which HTTP proxy to use using one of the approaches described bellow:

  • By setting http_proxy environment variable (this setting is system / process wide)
  • By passing http_proxy argument to the libcloud.common.base.LibcloudHTTPConnection class constructor (this setting is local to the connection instance)
  • By calling libcloud.common.base.LibcloudHTTPConnection.set_http_proxy() method (this setting is local to the connection instance)

Known limitations

  • Only HTTP basic access authentication proxy authorization method is supported


This section includes some code examples which show how to use an HTTP proxy with Libcloud.

1. Using http_proxy environment variable

By setting http_proxy environment variable you can specify which proxy to use for all of the outgoing requests for a duration / life-time of the process or a script.

Without authentication:

http_proxy=http://<proxy hostname>:<proxy port> python

With basic auth authentication:

http_proxy=http://<username>:<password>@<proxy hostname>:<proxy port> python

2. Passing http_proxy argument to the connection class constructor

By passing http_proxy argument to the libcloud.common.base.Connection class constructor, you can specify which proxy to use for a particular connection.

from libcloud.compute.drivers.dreamhost import DreamhostConnection

PROXY_URL_NO_AUTH = 'http://<proxy hostname>:<proxy port>'
PROXY_URL_BASIC_AUTH = 'http://<user>:<pass>@<proxy hostname>:<proxy port>'

conn = DreamhostConnection(host='', port=443,
                           timeout=None, proxy_url=PROXY_URL_NO_AUTH)

3. Calling set_http_proxy method

Calling set_http_proxy method allows you to specify which proxy to use for all the outgoing requests which follow set_http_proxy method call.

This method also allows you to use a different proxy for each request as shown in the example bellow.

from pprint import pprint

from libcloud.compute.types import Provider
from libcloud.compute.providers import get_driver

PROXY_URL_NO_AUTH_1 = 'http://<proxy hostname 1>:<proxy port 2>'
PROXY_URL_NO_AUTH_2 = 'http://<proxy hostname 1>:<proxy port 2>'
PROXY_URL_BASIC_AUTH = 'http://<user>:<pass>@<proxy hostname>:<proxy port>'

cls = get_driver(Provider.RACKSPACE)
driver = cls('username', 'api key', region='ord')

# Use proxy 1 for this request

# Use proxy 2 for this request