Net-http-persistent 2.4.1 Released

dubstep · February 6, 2012, 10:15pm

net-http-persistent version 2.4.1 has been released!

Manages persistent connections using Net::HTTP plus a speed fix for Ruby
1.8.
It’s thread-safe too!

Using persistent HTTP connections can dramatically increase the speed of
HTTP.
Creating a new HTTP connection for every request involves an extra TCP
round-trip and causes TCP congestion avoidance negotiation to start
over.

Net::HTTP supports persistent connections with some API methods but does
not
handle reconnection gracefully. Net::HTTP::Persistent supports
reconnection
and retry according to RFC 2616.

=== 2.4.1 / 2012-02-03

Bug fixes
When FakeWeb or WebMock are loaded SSL sessions will not be reused to
prevent breakage of testing frameworks. Issue #13 by Matt Brictson,
pull
request #14 by Zachary S.
SSL connections are reset when the SSL parameters change.
Mechanize issue #194 by dsisnero
Last-use times are now cleaned up in #shutdown.

miracleofmagick · February 7, 2012, 2:23am

Just thought I’d say thanks for this awesome library.

miracleofmagick · February 7, 2012, 10:41am

On Mon, Feb 6, 2012 at 1:14 PM, Eric H. [email protected] wrote:

HTTP.
Creating a new HTTP connection for every request involves an extra TCP
round-trip and causes TCP congestion avoidance negotiation to start over.

Could net-http-persistent be used with Faraday so that consecutive API
calls
(e.g. for paginating through a long list, where only 200 entries are
returned
per API call) could be more efficient? Would this be a useful use case
for
net-http-persistent?

Searching for ‘net-http-persistent’ on the Faraday project

GitHub - technoweenie/faraday: READ-ONLY fork of https://github.com/lostisland/faraday

did not reveal any existing references. And searching for Faraday on
the net-http-persistent project did not reveal relevant results.

Thanks,

Peter

miracleofmagick · February 7, 2012, 10:57am

On Feb 7, 2012, at 01:40 , Peter V. wrote:

Using persistent HTTP connections can dramatically increase the speed of
Searching for ‘net-http-persistent’ on the Faraday project

GitHub - technoweenie/faraday: READ-ONLY fork of https://github.com/lostisland/faraday

did not reveal any existing references. And searching for Faraday on
the net-http-persistent project did not reveal relevant results.

This is just a guess, but I think out of the box the answer is no. But
looking at:

github.com

technoweenie/faraday/blob/master/lib/faraday/adapter/net_http.rb#L78


      
          
          
  if env[:body].respond_to?(:read)
              request.body_stream = env[:body]
            else
              request.body = env[:body]
            end
            request
          end
          
          
def perform_request(http, env)
            if :get == env[:method] and !env[:body]
              # prefer `get` to `request` because the former handles gzip (ruby 1.9)
              http.get env[:url].request_uri, env[:request_headers]
            else
              http.request create_request(env)
            end
          end
          
          
def with_net_http_connection(env)
            yield net_http_connection(env)
          end

it looks like it is probably very easy to add the support.

miracleofmagick · February 10, 2012, 5:04am

On Feb 7, 2012, at 1:57 AM, Ryan D. wrote:

it looks like it is probably very easy to add the support.

It would be better to keep this part:

github.com

technoweenie/faraday/blob/master/lib/faraday/adapter/net_http.rb#L42-76


      
          with_net_http_connection(env) do |http|
            configure_ssl(http, env[:ssl]) if env[:url].scheme == 'https' and env[:ssl]
          
          
  req = env[:request]
            http.read_timeout = http.open_timeout = req[:timeout] if req[:timeout]
            http.open_timeout = req[:open_timeout]                if req[:open_timeout]
          
          
  begin
              http_response = perform_request(http, env)
            rescue *NET_HTTP_EXCEPTIONS => err
              if defined?(OpenSSL) && OpenSSL::SSL::SSLError === err
                raise Faraday::SSLError, err
              else
                raise Error::ConnectionFailed, err
              end
            end
          
          
  save_response(env, http_response.code.to_i, http_response.body || '') do |response_headers|
              http_response.each_header do |key, value|
                response_headers[key] = value
              end

and rewrite the bit above that to set up Net::HTTP::Persistent instead.