2007
09.22

libgmail throught HTTP(S) proxy

Category: Computer Science, Programming / Tags: no tag / Add Comment

libgmail is, in words of its author, a pure python binding to provide access to your gmail account.

I’m using it and find it very useful. However, within my organization, I must connect to the internet via an HTTP/HTTPS proxy firewall. Direct internet connections are filtered, so I developed a hack to make it to work via an HTTP(S) proxied connection.

Basically I ripped the code from this ASPN snippet, and derived the urllib proxied transport to create a new one.

To use it behind a proxy, you can copy the libgmail example, and define the proxy this way:

import libgmail

libgmail.PROXY_URL = 'www.myproxy.org:3128'  # Define the proxy.

ga = libgmail.GmailAccount("google@gmail.com", "mymailismypass")
ga.login()
folder = ga.getMessagesByFolder('inbox')

for thread in folder:
    print thread.id, len(thread), thread.subject
    for msg in thread:
        print "  ", msg.id, msg.number, msg.subject
    print msg.source

I patched the libgmail.py file and write the proxied transport in another one: gmail_transport.py. You will need to copy both the file gmail_transport.py and the modified version of libgmail.py (overwrite it) into the same directory libgmail.py is installed.

There is also a diff file available, for libgmail-0.6.1.2.

Update (2007-10-06): It’s now possible to use proxy authentication. To do it so, you must use the proxy host address on the previous example this way: user:password@myproxy.org:3128 where user and password are your proxy user and password respectively. You’ll have to download again the file gmail_transport.py.

Now, the example to use it behind a proxy requiring with user/passwd authentication is like this:

import libgmail

# Connect from behind a proxy www.myproxy.org:3128 using
# proxy authentication user = 'john', password = 'proxy4321'
libgmail.PROXY_URL = 'john:proxy4321@www.myproxy.org:3128'  # Define the proxy 

ga = libgmail.GmailAccount("google@gmail.com", "mymailismypass")
ga.login()
folder = ga.getMessagesByFolder('inbox')

for thread in folder:
    print thread.id, len(thread), thread.subject
    for msg in thread:
        print "  ", msg.id, msg.number, msg.subject
    print msg.source
  • Google Buzz
  • Twitter
  • Meneame
  • Facebook
  • Posterous
  • Share/Bookmark

Related posts:

  1. XML-RPC over the proxy server
  2. Self-replication
  3. Python with elegance
  4. Read/Write removable devices under NTFS in Kubuntu
  1. [United States] Lizbeth said: 2009-11-13 6.15 pm

    what website can i use to unblock myspace or yahoo or facebook or any websites in the schools library? :( i wanna check it on school thats why
    plz help
    thx

  2. Zak Kinion said: 2009-06-20 6.22 am

    Hello,

    I am having the same issue as well…

    File “/libgmail.py”, line 335, in login
    pageData = self._retrievePage(req)
    File “/libgmail.py”, line 385, in _retrievePage
    resp = self.opener.open(req)
    File “/usr/lib/python2.5/site-packages/mechanize/_opener.py”, line 181, in open
    response = urlopen(self, req, data)
    File “/usr/lib/python2.5/urllib2.py”, line 399, in _open
    ‘_open’, req)
    File “/usr/lib/python2.5/urllib2.py”, line 360, in _call_chain
    result = func(*args)
    File “/usr/lib/python2.5/site-packages/mechanize/_http.py”, line 727, in https_open
    key_file, cert_file = self.client_cert_manager.find_key_cert(
    AttributeError: ‘int’ object has no attribute ‘find_key_cert’

    I was forced to use an older version of 0.8 libgmail because the gmail_transport doesn’t work with 1.11, but recent changes have forced me back to 1.11, and now I can only send directly, and not behind a firewall…

  3. Ryan said: 2009-05-29 8.56 am

    I have error when using proxy (privoxy, 192.168.0.1:8118)

    Traceback (most recent call last):
    File “Z:\kerja\odesk\16-gmail\root\test.py”, line 6, in <mo
    ga.login()
    File “Z:\kerja\odesk\16-gmail\root\libgmail.py”, line 307,
    pageData = self._retrievePage(req)
    File “Z:\kerja\odesk\16-gmail\root\libgmail.py”, line 349,
    resp = self.opener.open(req)
    File “Z:\kerja\odesk\16-gmail\root\mechanize\_opener.py”, l
    response = urlopen(self, req, data)
    File “C:\Python25\lib\urllib2.py”, line 399, in _open
    ‘_open’, req)
    File “C:\Python25\lib\urllib2.py”, line 360, in _call_chain
    result = func(*args)
    File “Z:\kerja\odesk\16-gmail\root\mechanize\_http.py”, lin
    n
    key_file, cert_file = self.client_cert_manager.find_key_c
    AttributeError: ‘int’ object has no attribute ‘find_key_cert’

  4. [Islamic Republic Of Iran] Hosi said: 2008-10-28 4.12 pm

    Hi again, I downloaded the libgmail-0.1.10 from the source forge, and installed it:
    1) setup build
    2) setup install
    but still the same error !!!

  5. [Spain] Boriel said: 2008-09-21 10.59 am

    Hi, Hosi

    Download the very latest libgmail patch from the sourceforge web. It fix this problem (and many others).

    This problem appeared after Google changed his API.

  6. [Islamic Republic Of Iran] Hosi said: 2008-09-21 8.41 am

    Hi every body, this is my output :
    HTTP Error 302: The HTTP server returned a redirect error that would lead to an infinite loop.
    The last 30x error message was:
    Moved Temporarily

    Why ?

  7. [Spain] Boriel said: 2008-06-28 3.55 pm

    sprzedam (#8):
    Are you using the authentication line?
    (ej. user john, passwd: proxy4321) =>
    libgmail.PROXY_URL = ‘john:proxy4321@www.myproxy.org:3128′ # Define the proxy

  8. sprzedam stronę said: 2008-06-28 1.50 pm

    Good Conception!

    :? “407 Proxy Authentication Required”

  9. [Singapore] cci[RR]us said: 2007-10-09 2.19 am

    :idea: Good news :idea:

    Release Name: 0.1.7

    Changes: Added support for proxy servers for libgmail (both passwordless and password-ful proxies). This came from a patch by Jose Rodriguez, for which we’re very thankful.

    >> https://sourceforge.net/project/shownotes.php?release_id=545286

  10. [Singapore] cci[RR]us said: 2007-10-08 5.22 am

    Sweet! 8O I just tried your code and it worked perfectly!!! :lol: Many thanks and great job there, Boriel!

  11. [Spain] Boriel said: 2007-10-06 1.36 pm

    cci[RR]us (#3):
    I’ve already patched it. Download gmail_transport.py and use user:passwd@your.proxy.org:3128 as your proxy. It should work now.

    Note (for everybody reading this): 3128 is just a port example. Replace 3128 with your proxy port (usually 3128 or 8080).

  12. [Spain] Boriel said: 2007-10-01 9.52 am

    Yes, I’ve sent the patch to the developers mainling list and they say it will probably be included in future releases.

    I will try to send them the new patch with User/Pass support.

  13. [Singapore] cci[RR]us said: 2007-10-01 9.18 am

    Thanks for the continued work!!! :lol:

    I must say that your enhancement for supporting HTTP proxy is a godsend, and should be added into libgmail. Proxied environments are very common nowadays and the lack of proxy support severely limits libgmail capabilities.

    Have you considered adding your code into libgmail’s CVS? I’m sure many people would appreciate it!!! :)

  14. [Spain] Boriel said: 2007-10-01 8.25 am

    Hi, cci[RR]us

    I’m working on the User/Password proxy scheme, and it will be implemented as soon as possible (probably today). ;-)

    Stay tuned!

  15. [Singapore] cci[RR]us said: 2007-10-01 8.07 am

    Hi,

    Thanks to your post, I am able to write a program to upload files to my Gmail account over a HTTP(S) proxy. However, there are cases when the proxy server requires authentication and the program fails: :(


    urlopen error Proxy connection failed:
    407 Proxy Authentication Required

    Do you know how to enable proxy authentication? Thanks!