Problem with bundler and git-sourced gems

addis_a · September 27, 2014, 12:08am

I’m having this problem with JRuby + bundler + git-sourced gems. Anyone
else experiencing something similar?

installing github-sourced gems with multiple jobs breaks under JRuby

opened 08:20PM - 14 Sep 14 UTC

closed 11:49PM - 18 Nov 14 UTC

I've been experiencing this problem for several weeks with both bundler 1.6 and …1.7. I've observed it happening under JRuby 1.7.13, 1.7.14, and 1.7.15. I haven't tried other versions. Anecdotally I think it started happening more often with 1.7.14/15. But that might be totally wrong. The problem: when using `-j1`, `bundle install` always succeeds. When using a higher value, it will sometimes fail and sometimes succeed. On Heroku where I believe `-j4` is used, `bundle install` succeeds about 1/6 times. On my dev machine experimenting with `-j16` and `-j32`, it seems to break all the time (I have not done a large volume of experiments). The failure is not always with the same gem. But it is always with a github-sourced gem. I haven't experimented to see if it will happen with any git-sourced gem, or only github-sourced gems. The variance in failure includes on Heroku where AFAIK the starting state is always identical (I don't think their cache is updated unless a push succeeds). Here is one example of a failure: ``` ...many lines of successful gem installs... Using rails_autolink 1.1.6 Using rolify 3.4.0 from git://github.com/jjb/rolify.git (at do-not-require-db-when-precompiling) Using dullard 0.1.0 from git://github.com/jjb/dullard.git (at jruby-fixes) Using metainspector 2.3.0 from git://github.com/jjb/metainspector.git (at typhoeus) Using activerecord-session_store 0.1.0 from git://github.com/medstro/activerecord-session_store.git (at 2c1c092) Gem::Package::TarWriter::FileOverflow: You tried to feed more data than fits in the file. Gem::Installer::ExtensionBuildError: ERROR: Failed to build gem native extension. /Users/john/.rbenv/versions/jruby-1.7.13/bin/jruby extconf.rb Error opening script file: /Users/john/.rbenv/versions/jruby-1.7.13/lib/ruby/gems/shared/bundler/gems/devise-f0738098f043/extconf.rb (No such file or directory) Gem files will remain installed in /Users/john/.rbenv/versions/jruby-1.7.13/lib/ruby/gems/shared/gems/capybara-webkit-1.3.0 for inspection. Results logged to /Users/john/.rbenv/versions/jruby-1.7.13/lib/ruby/gems/shared/gems/capybara-webkit-1.3.0/./gem_make.out Errno::ENOENT: No such file or directory - No such file or directory - .travis.yml Using sass-rails 4.0.1 from git://github.com/rails/sass-rails.git (at master) An error occurred while installing action_dispatch-gz_static (0.0.3), and Bundler cannot continue. Make sure that `gem install action_dispatch-gz_static -v '0.0.3'` succeeds before bundling. ``` and another ``` ...many lines of successful gem installs... Using metamagic 3.0.3 Using informant-rails 0.7.0 Using rails_autolink 1.1.6 Using carmen-rails 1.0.1 Using rails-env-favicon 0.0.5 Installing dotenv 0.10.0 Errno::ENOENT: No such file or directory - No such file or directory - spec/fixtures/guardian.co.uk.response Using rolify 3.4.0 from git://github.com/jjb/rolify.git (at do-not-require-db-when-precompiling) Errno::ENOENT: No such file or directory - No such file or directory - lib/active_record/session_store/session.rb Using action_dispatch-gz_static 0.0.3 from git://github.com/medstro/action_dispatch-gz_static.git (at master) Installing dotenv-rails 0.10.0 Using devise 3.2.4 from git://github.com/medstro/devise.git (at f073809) Using sass-rails 4.0.1 from git://github.com/rails/sass-rails.git (at master) An error occurred while installing metainspector (2.3.0), and Bundler cannot continue. Make sure that `gem install metainspector -v '2.3.0'` succeeds before bundling. ``` Let me know if you want more info. If you would like my Gemfile and Gemfile.lock, I can email them to you.

johnnybutler7 · January 21, 2015, 9:50pm

following up on this: it was fixed in bundler 1.7.7

github.com

rubygems/bundler/blob/master/CHANGELOG.md#177-2014-11-19

## 2.1.4 (January 5, 2020)

Bugfixes:

  - Fix `net-http-pipeline` no longer being allowed in Gemfiles if already installed in the system due to our vendored version of `net-http-persistent` optionally requiring it [#7529](https://github.com/bundler/bundler/pull/7529)
  - Fix inline gems no longer being requirable if no Gemfile is present in the directory hierarchy [#7537](https://github.com/bundler/bundler/pull/7537)

## 2.1.3 (January 2, 2020)

Bugfixes:

  - Fix `rake build` when path has spaces on it [#7514](https://github.com/bundler/bundler/pull/7514)
  - Fix `rake release` git push tasks when the running shell has `git` as an alias of another command (like `hub`) [#7510](https://github.com/bundler/bundler/pull/7510)
  - Fix some circular require warnings [#7520](https://github.com/bundler/bundler/pull/7520)
  - Fix `bundle config set deployment true` recommended alternative to `bundle config --deployment` to behave in the same way as the `--deployment` flag [#7519](https://github.com/bundler/bundler/pull/7519)

## 2.1.2 (December 20, 2019)

Bugfixes:

This file has been truncated. show original

On Fri, Sep 26, 2014 at 6:07 PM, John Joseph B. <