366 lines
		
	
	
		
			12 KiB
		
	
	
	
		
			Markdown
		
	
	
	
	
	
			
		
		
	
	
			366 lines
		
	
	
		
			12 KiB
		
	
	
	
		
			Markdown
		
	
	
	
	
	
---
 | 
						|
title: Ruby
 | 
						|
author: Michael Fellinger
 | 
						|
date: 2019-05-23
 | 
						|
---
 | 
						|
 | 
						|
# Ruby
 | 
						|
 | 
						|
## User Guide
 | 
						|
 | 
						|
### Using Ruby
 | 
						|
 | 
						|
#### Overview
 | 
						|
 | 
						|
Several versions of Ruby interpreters are available on Nix, as well as over 250 gems and many applications written in Ruby.
 | 
						|
The attribute `ruby` refers to the default Ruby interpreter, which is currently
 | 
						|
MRI 2.5. It's also possible to refer to specific versions, e.g. `ruby_2_6`, `jruby`, or `mruby`.
 | 
						|
 | 
						|
In the nixpkgs tree, Ruby packages can be found throughout, depending on what
 | 
						|
they do, and are called from the main package set. Ruby gems, however are
 | 
						|
separate sets, and there's one default set for each interpreter (currently MRI
 | 
						|
only).
 | 
						|
 | 
						|
There are two main approaches for using Ruby with gems.
 | 
						|
One is to use a specifically locked `Gemfile` for an application that has very strict dependencies.
 | 
						|
The other is to depend on the common gems, which we'll explain further down, and
 | 
						|
rely on them being updated regularly.
 | 
						|
 | 
						|
The interpreters have common attributes, namely `gems`, and `withPackages`. So
 | 
						|
you can refer to `ruby.gems.nokogiri`, or `ruby_2_5.gems.nokogiri` to get the
 | 
						|
Nokogiri gem already compiled and ready to use.
 | 
						|
 | 
						|
Since not all gems have executables like `nokogiri`, it's usually more
 | 
						|
convenient to use the `withPackages` function like this:
 | 
						|
`ruby.withPackages (p: with p; [ nokogiri ])`. This will also make sure that the
 | 
						|
Ruby in your environment will be able to find the gem and it can be used in your
 | 
						|
Ruby code (for example via `ruby` or `irb` executables) via `require "nokogiri"`
 | 
						|
as usual.
 | 
						|
 | 
						|
#### Temporary Ruby environment with `nix-shell`
 | 
						|
 | 
						|
Rather than having a single Ruby environment shared by all Ruby
 | 
						|
development projects on a system, Nix allows you to create separate
 | 
						|
environments per project.  `nix-shell` gives you the possibility to
 | 
						|
temporarily load another environment akin to a combined `chruby` or
 | 
						|
`rvm` and `bundle exec`.
 | 
						|
 | 
						|
There are two methods for loading a shell with Ruby packages. The first and
 | 
						|
recommended method is to create an environment with `ruby.withPackages` and load
 | 
						|
that.
 | 
						|
 | 
						|
```shell
 | 
						|
nix-shell -p "ruby.withPackages (ps: with ps; [ nokogiri pry ])"
 | 
						|
```
 | 
						|
 | 
						|
The other method, which is not recommended, is to create an environment and list
 | 
						|
all the packages directly.
 | 
						|
 | 
						|
```shell
 | 
						|
nix-shell -p ruby.gems.nokogiri ruby.gems.pry
 | 
						|
```
 | 
						|
 | 
						|
Again, it's possible to launch the interpreter from the shell. The Ruby
 | 
						|
interpreter has the attribute `gems` which contains all Ruby gems for that
 | 
						|
specific interpreter.
 | 
						|
 | 
						|
##### Load environment from `.nix` expression
 | 
						|
 | 
						|
As explained in the Nix manual, `nix-shell` can also load an expression from a
 | 
						|
`.nix` file. Say we want to have Ruby 2.5, `nokogori`, and `pry`. Consider a
 | 
						|
`shell.nix` file with:
 | 
						|
 | 
						|
```nix
 | 
						|
with import <nixpkgs> {};
 | 
						|
ruby.withPackages (ps: with ps; [ nokogiri pry ])
 | 
						|
```
 | 
						|
 | 
						|
What's happening here?
 | 
						|
 | 
						|
1. We begin with importing the Nix Packages collections. `import <nixpkgs>`
 | 
						|
   imports the `<nixpkgs>` function, `{}` calls it and the `with` statement
 | 
						|
   brings all attributes of `nixpkgs` in the local scope. These attributes form
 | 
						|
   the main package set.
 | 
						|
2. Then we create a Ruby environment with the `withPackages` function.
 | 
						|
3. The `withPackages` function expects us to provide a function as an argument
 | 
						|
   that takes the set of all ruby gems and returns a list of packages to include
 | 
						|
   in the environment. Here, we select the packages `nokogiri` and `pry` from
 | 
						|
   the package set.
 | 
						|
 | 
						|
##### Execute command with `--run`
 | 
						|
 | 
						|
A convenient flag for `nix-shell` is `--run`. It executes a command in the
 | 
						|
`nix-shell`. We can e.g. directly open a `pry` REPL:
 | 
						|
 | 
						|
```shell
 | 
						|
nix-shell -p "ruby.withPackages (ps: with ps; [ nokogiri pry ])" --run "pry"
 | 
						|
```
 | 
						|
 | 
						|
Or immediately require `nokogiri` in pry:
 | 
						|
 | 
						|
```shell
 | 
						|
nix-shell -p "ruby.withPackages (ps: with ps; [ nokogiri pry ])" --run "pry -rnokogiri"
 | 
						|
```
 | 
						|
 | 
						|
Or run a script using this environment:
 | 
						|
 | 
						|
```shell
 | 
						|
nix-shell -p "ruby.withPackages (ps: with ps; [ nokogiri pry ])" --run "ruby example.rb"
 | 
						|
```
 | 
						|
 | 
						|
##### Using `nix-shell` as shebang
 | 
						|
 | 
						|
In fact, for the last case, there is a more convenient method. You can add a
 | 
						|
[shebang](https://en.wikipedia.org/wiki/Shebang_(Unix)) to your script
 | 
						|
specifying which dependencies `nix-shell` needs. With the following shebang, you
 | 
						|
can just execute `./example.rb`, and it will run with all dependencies.
 | 
						|
 | 
						|
```ruby
 | 
						|
#! /usr/bin/env nix-shell
 | 
						|
#! nix-shell -i ruby -p "ruby.withPackages (ps: with ps; [ nokogiri rest-client ])"
 | 
						|
 | 
						|
require 'nokogiri'
 | 
						|
require 'rest-client'
 | 
						|
 | 
						|
body = RestClient.get('http://example.com').body
 | 
						|
puts Nokogiri::HTML(body).at('h1').text
 | 
						|
```
 | 
						|
 | 
						|
### Developing with Ruby
 | 
						|
 | 
						|
#### Using an existing Gemfile
 | 
						|
 | 
						|
In most cases, you'll already have a `Gemfile.lock` listing all your dependencies.
 | 
						|
This can be used to generate a `gemset.nix` which is used to fetch the gems and
 | 
						|
combine them into a single environment.
 | 
						|
The reason why you need to have a separate file for this, is that Nix requires
 | 
						|
you to have a checksum for each input to your build.
 | 
						|
Since the `Gemfile.lock` that `bundler` generates doesn't provide us with
 | 
						|
checksums, we have to first download each gem, calculate its SHA256, and store
 | 
						|
it in this separate file.
 | 
						|
 | 
						|
So the steps from having just a `Gemfile` to a `gemset.nix` are:
 | 
						|
 | 
						|
```shell
 | 
						|
bundle lock
 | 
						|
bundix
 | 
						|
```
 | 
						|
 | 
						|
If you already have a `Gemfile.lock`, you can simply run `bundix` and it will
 | 
						|
work the same.
 | 
						|
 | 
						|
To update the gems in your `Gemfile.lock`, you may use the `bundix -l` flag,
 | 
						|
which will create a new `Gemfile.lock` in case the `Gemfile` has a more recent
 | 
						|
time of modification.
 | 
						|
 | 
						|
Once the `gemset.nix` is generated, it can be used in a
 | 
						|
`bundlerEnv` derivation. Here is an example you could use for your `shell.nix`:
 | 
						|
 | 
						|
```nix
 | 
						|
# ...
 | 
						|
let
 | 
						|
  gems = bundlerEnv {
 | 
						|
    name = "gems-for-some-project";
 | 
						|
    gemdir = ./.;
 | 
						|
  };
 | 
						|
in mkShell { buildInputs = [ gems gems.wrappedRuby ]; }
 | 
						|
```
 | 
						|
 | 
						|
With this file in your directory, you can run `nix-shell` to build and use the gems.
 | 
						|
The important parts here are `bundlerEnv` and `wrappedRuby`.
 | 
						|
 | 
						|
The `bundlerEnv` is a wrapper over all the gems in your gemset. This means that
 | 
						|
all the `/lib` and `/bin` directories will be available, and the executables of
 | 
						|
all gems (even of indirect dependencies) will end up in your `$PATH`.
 | 
						|
The `wrappedRuby` provides you with all executables that come with Ruby itself,
 | 
						|
but wrapped so they can easily find the gems in your gemset.
 | 
						|
 | 
						|
One common issue that you might have is that you have Ruby 2.6, but also
 | 
						|
`bundler` in your gemset. That leads to a conflict for `/bin/bundle` and
 | 
						|
`/bin/bundler`. You can resolve this by wrapping either your Ruby or your gems
 | 
						|
in a `lowPrio` call. So in order to give the `bundler` from your gemset
 | 
						|
priority, it would be used like this:
 | 
						|
 | 
						|
```nix
 | 
						|
# ...
 | 
						|
mkShell { buildInputs = [ gems (lowPrio gems.wrappedRuby) ]; }
 | 
						|
```
 | 
						|
 | 
						|
 | 
						|
#### Gem-specific configurations and workarounds
 | 
						|
 | 
						|
In some cases, especially if the gem has native extensions, you might need to
 | 
						|
modify the way the gem is built.
 | 
						|
 | 
						|
This is done via a common configuration file that includes all of the
 | 
						|
workarounds for each gem.
 | 
						|
 | 
						|
This file lives at `/pkgs/development/ruby-modules/gem-config/default.nix`,
 | 
						|
since it already contains a lot of entries, it should be pretty easy to add the
 | 
						|
modifications you need for your needs.
 | 
						|
 | 
						|
In the meanwhile, or if the modification is for a private gem, you can also add
 | 
						|
the configuration to only your own environment.
 | 
						|
 | 
						|
Two places that allow this modification are the `ruby` derivation, or `bundlerEnv`.
 | 
						|
 | 
						|
Here's the `ruby` one:
 | 
						|
 | 
						|
```nix
 | 
						|
{ pg_version ? "10", pkgs ? import <nixpkgs> { } }:
 | 
						|
let
 | 
						|
  myRuby = pkgs.ruby.override {
 | 
						|
    defaultGemConfig = pkgs.defaultGemConfig // {
 | 
						|
      pg = attrs: {
 | 
						|
        buildFlags =
 | 
						|
        [ "--with-pg-config=${pkgs."postgresql_${pg_version}"}/bin/pg_config" ];
 | 
						|
      };
 | 
						|
    };
 | 
						|
  };
 | 
						|
in myRuby.withPackages (ps: with ps; [ pg ])
 | 
						|
```
 | 
						|
 | 
						|
And an example with `bundlerEnv`:
 | 
						|
 | 
						|
```nix
 | 
						|
{ pg_version ? "10", pkgs ? import <nixpkgs> { } }:
 | 
						|
let
 | 
						|
  gems = pkgs.bundlerEnv {
 | 
						|
    name = "gems-for-some-project";
 | 
						|
    gemdir = ./.;
 | 
						|
    gemConfig = pkgs.defaultGemConfig // {
 | 
						|
      pg = attrs: {
 | 
						|
        buildFlags =
 | 
						|
        [ "--with-pg-config=${pkgs."postgresql_${pg_version}"}/bin/pg_config" ];
 | 
						|
      };
 | 
						|
    };
 | 
						|
  };
 | 
						|
in mkShell { buildInputs = [ gems gems.wrappedRuby ]; }
 | 
						|
```
 | 
						|
 | 
						|
And finally via overlays:
 | 
						|
 | 
						|
```nix
 | 
						|
{ pg_version ? "10" }:
 | 
						|
let
 | 
						|
  pkgs = import <nixpkgs> {
 | 
						|
    overlays = [
 | 
						|
      (self: super: {
 | 
						|
        defaultGemConfig = super.defaultGemConfig // {
 | 
						|
          pg = attrs: {
 | 
						|
            buildFlags = [
 | 
						|
              "--with-pg-config=${
 | 
						|
                pkgs."postgresql_${pg_version}"
 | 
						|
              }/bin/pg_config"
 | 
						|
            ];
 | 
						|
          };
 | 
						|
        };
 | 
						|
      })
 | 
						|
    ];
 | 
						|
  };
 | 
						|
in pkgs.ruby.withPackages (ps: with ps; [ pg ])
 | 
						|
```
 | 
						|
 | 
						|
Then we can get whichever postgresql version we desire and the `pg` gem will
 | 
						|
always reference it correctly:
 | 
						|
 | 
						|
```shell
 | 
						|
$ nix-shell --argstr pg_version 9_4 --run 'ruby -rpg -e "puts PG.library_version"'
 | 
						|
90421
 | 
						|
 | 
						|
$ nix-shell --run 'ruby -rpg -e "puts PG.library_version"'
 | 
						|
100007
 | 
						|
```
 | 
						|
 | 
						|
Of course for this use-case one could also use overlays since the configuration
 | 
						|
for `pg` depends on the `postgresql` alias, but for demonstration purposes this
 | 
						|
has to suffice.
 | 
						|
 | 
						|
#### Adding a gem to the default gemset
 | 
						|
 | 
						|
Now that you know how to get a working Ruby environment with Nix, it's time to
 | 
						|
go forward and start actually developing with Ruby.
 | 
						|
We will first have a look at how Ruby gems are packaged on Nix. Then, we will
 | 
						|
look at how you can use development mode with your code.
 | 
						|
 | 
						|
All gems in the standard set are automatically generated from a single
 | 
						|
`Gemfile`. The dependency resolution is done with `bundler` and makes it more
 | 
						|
likely that all gems are compatible to each other.
 | 
						|
 | 
						|
In order to add a new gem to nixpkgs, you can put it into the
 | 
						|
`/pkgs/development/ruby-modules/with-packages/Gemfile` and run
 | 
						|
`./maintainers/scripts/update-ruby-packages`.
 | 
						|
 | 
						|
To test that it works, you can then try using the gem with:
 | 
						|
 | 
						|
```shell
 | 
						|
NIX_PATH=nixpkgs=$PWD nix-shell -p "ruby.withPackages (ps: with ps; [ name-of-your-gem ])"
 | 
						|
```
 | 
						|
 | 
						|
#### Packaging applications
 | 
						|
 | 
						|
A common task is to add a ruby executable to nixpkgs, popular examples would be
 | 
						|
`chef`, `jekyll`, or `sass`. A good way to do that is to use the `bundlerApp`
 | 
						|
function, that allows you to make a package that only exposes the listed
 | 
						|
executables, otherwise the package may cause conflicts through common paths like
 | 
						|
`bin/rake` or `bin/bundler` that aren't meant to be used.
 | 
						|
 | 
						|
The absolute easiest way to do that is to write a
 | 
						|
`Gemfile` along these lines:
 | 
						|
 | 
						|
```ruby
 | 
						|
source 'https://rubygems.org' do
 | 
						|
  gem 'mdl'
 | 
						|
end
 | 
						|
```
 | 
						|
 | 
						|
If you want to package a specific version, you can use the standard Gemfile
 | 
						|
syntax for that, e.g. `gem 'mdl', '0.5.0'`, but if you want the latest stable
 | 
						|
version anyway, it's easier to update by simply running the `bundle lock` and
 | 
						|
`bundix` steps again.
 | 
						|
 | 
						|
Now you can also also make a `default.nix` that looks like this:
 | 
						|
 | 
						|
```nix
 | 
						|
{ lib, bundlerApp }:
 | 
						|
 | 
						|
bundlerApp {
 | 
						|
  pname = "mdl";
 | 
						|
  gemdir = ./.;
 | 
						|
  exes = [ "mdl" ];
 | 
						|
}
 | 
						|
```
 | 
						|
 | 
						|
All that's left to do is to generate the corresponding `Gemfile.lock` and
 | 
						|
`gemset.nix` as described above in the `Using an existing Gemfile` section.
 | 
						|
 | 
						|
##### Packaging executables that require wrapping
 | 
						|
 | 
						|
Sometimes your app will depend on other executables at runtime, and tries to
 | 
						|
find it through the `PATH` environment variable.
 | 
						|
 | 
						|
In this case, you can provide a `postBuild` hook to `bundlerApp` that wraps the
 | 
						|
gem in another script that prefixes the `PATH`.
 | 
						|
 | 
						|
Of course you could also make a custom `gemConfig` if you know exactly how to
 | 
						|
patch it, but it's usually much easier to maintain with a simple wrapper so the
 | 
						|
patch doesn't have to be adjusted for each version.
 | 
						|
 | 
						|
Here's another example:
 | 
						|
 | 
						|
```nix
 | 
						|
{ lib, bundlerApp, makeWrapper, git, gnutar, gzip }:
 | 
						|
 | 
						|
bundlerApp {
 | 
						|
  pname = "r10k";
 | 
						|
  gemdir = ./.;
 | 
						|
  exes = [ "r10k" ];
 | 
						|
 | 
						|
  buildInputs = [ makeWrapper ];
 | 
						|
 | 
						|
  postBuild = ''
 | 
						|
    wrapProgram $out/bin/r10k --prefix PATH : ${lib.makeBinPath [ git gnutar gzip ]}
 | 
						|
  '';
 | 
						|
}
 | 
						|
```
 |