Skip to content
Snippets Groups Projects
guix.texi 215 KiB
Newer Older
  • Learn to ignore specific revisions
  • The system type targeted by the derivation---e.g., @code{x86_64-linux}.
    
    @item
    The file name of a build script in the store, along with the arguments
    to be passed.
    
    @item
    A list of environment variables to be defined.
    
    @end itemize
    
    @cindex derivation path
    Derivations allow clients of the daemon to communicate build actions to
    the store.  They exist in two forms: as an in-memory representation,
    both on the client- and daemon-side, and as files in the store whose
    name end in @code{.drv}---these files are referred to as @dfn{derivation
    paths}.  Derivations paths can be passed to the @code{build-derivations}
    procedure to perform the build actions they prescribe (@pxref{The
    Store}).
    
    The @code{(guix derivations)} module provides a representation of
    derivations as Scheme objects, along with procedures to create and
    otherwise manipulate derivations.  The lowest-level primitive to create
    a derivation is the @code{derivation} procedure:
    
    
    @deffn {Scheme Procedure} derivation @var{store} @var{name} @var{builder} @
      @var{args} [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
    
      [#:recursive? #f] [#:inputs '()] [#:env-vars '()] @
    
      [#:system (%current-system)] [#:references-graphs #f] @
    
      [#:allowed-references #f] [#:local-build? #f]
    
    Build a derivation with the given arguments, and return the resulting
    @code{<derivation>} object.
    
    When @var{hash} and @var{hash-algo} are given, a
    
    @dfn{fixed-output derivation} is created---i.e., one whose result is
    
    known in advance, such as a file download.  If, in addition,
    @var{recursive?} is true, then that fixed output may be an executable
    file or a directory and @var{hash} must be the hash of an archive
    containing this output.
    
    When @var{references-graphs} is true, it must be a list of file
    
    name/store path pairs.  In that case, the reference graph of each store
    path is exported in the build environment in the corresponding file, in
    a simple text format.
    
    When @var{allowed-references} is true, it must be a list of store items
    or outputs that the derivation's output may refer to.
    
    
    When @var{local-build?} is true, declare that the derivation is not a
    good candidate for offloading and should rather be built locally
    (@pxref{Daemon Offload Setup}).  This is the case for small derivations
    where the costs of data transfers would outweigh the benefits.
    
    @end deffn
    
    @noindent
    Here's an example with a shell script as its builder, assuming
    @var{store} is an open connection to the daemon, and @var{bash} points
    to a Bash executable in the store:
    
    @lisp
    (use-modules (guix utils)
                 (guix store)
                 (guix derivations))
    
    
    (let ((builder   ; add the Bash script to the store
            (add-text-to-store store "my-builder.sh"
                               "echo hello world > $out\n" '())))
      (derivation store "foo"
                  bash `("-e" ,builder)
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
                  #:inputs `((,bash) (,builder))
    
                  #:env-vars '(("HOME" . "/homeless"))))
    
    @result{} #<derivation /gnu/store/@dots{}-foo.drv => /gnu/store/@dots{}-foo>
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    As can be guessed, this primitive is cumbersome to use directly.  A
    better approach is to write build scripts in Scheme, of course!  The
    best course of action for that is to write the build code as a
    ``G-expression'', and to pass it to @code{gexp->derivation}.  For more
    
    information, @pxref{G-Expressions}.
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    
    Once upon a time, @code{gexp->derivation} did not exist and constructing
    derivations with build code written in Scheme was achieved with
    @code{build-expression->derivation}, documented below.  This procedure
    is now deprecated in favor of the much nicer @code{gexp->derivation}.
    
    @deffn {Scheme Procedure} build-expression->derivation @var{store} @
           @var{name} @var{exp} @
           [#:system (%current-system)] [#:inputs '()] @
           [#:outputs '("out")] [#:hash #f] [#:hash-algo #f] @
    
           [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
    
           [#:references-graphs #f] [#:allowed-references #f] @
           [#:local-build? #f] [#:guile-for-build #f]
    
    Return a derivation that executes Scheme expression @var{exp} as a
    builder for derivation @var{name}.  @var{inputs} must be a list of
    @code{(name drv-path sub-drv)} tuples; when @var{sub-drv} is omitted,
    @code{"out"} is assumed.  @var{modules} is a list of names of Guile
    modules from the current search path to be copied in the store,
    compiled, and made available in the load path during the execution of
    @var{exp}---e.g., @code{((guix build utils) (guix build
    gnu-build-system))}.
    
    @var{exp} is evaluated in an environment where @code{%outputs} is bound
    to a list of output/path pairs, and where @code{%build-inputs} is bound
    to a list of string/output-path pairs made from @var{inputs}.
    Optionally, @var{env-vars} is a list of string pairs specifying the name
    and value of environment variables visible to the builder.  The builder
    terminates by passing the result of @var{exp} to @code{exit}; thus, when
    @var{exp} returns @code{#f}, the build is considered to have failed.
    
    @var{exp} is built using @var{guile-for-build} (a derivation).  When
    @var{guile-for-build} is omitted or is @code{#f}, the value of the
    @code{%guile-for-build} fluid is used instead.
    
    See the @code{derivation} procedure for the meaning of
    @var{references-graphs}, @var{allowed-references}, and @var{local-build?}.
    
    @end deffn
    
    @noindent
    Here's an example of a single-output derivation that creates a directory
    containing one file:
    
    @lisp
    (let ((builder '(let ((out (assoc-ref %outputs "out")))
    
                      (mkdir out)    ; create /gnu/store/@dots{}-goo
    
                      (call-with-output-file (string-append out "/test")
                        (lambda (p)
                          (display '(hello guix) p))))))
    
      (build-expression->derivation store "goo" builder))
    
    @result{} #<derivation /gnu/store/@dots{}-goo.drv => @dots{}>
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @node The Store Monad
    @section The Store Monad
    
    @cindex monad
    
    The procedures that operate on the store described in the previous
    sections all take an open connection to the build daemon as their first
    argument.  Although the underlying model is functional, they either have
    side effects or depend on the current state of the store.
    
    The former is inconvenient: the connection to the build daemon has to be
    carried around in all those functions, making it impossible to compose
    functions that do not take that parameter with functions that do.  The
    latter can be problematic: since store operations have side effects
    and/or depend on external state, they have to be properly sequenced.
    
    @cindex monadic values
    @cindex monadic functions
    This is where the @code{(guix monads)} module comes in.  This module
    provides a framework for working with @dfn{monads}, and a particularly
    useful monad for our uses, the @dfn{store monad}.  Monads are a
    construct that allows two things: associating ``context'' with values
    (in our case, the context is the store), and building sequences of
    
    computations (here computations include accesses to the store.)  Values
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    in a monad---values that carry this additional context---are called
    @dfn{monadic values}; procedures that return such values are called
    @dfn{monadic procedures}.
    
    Consider this ``normal'' procedure:
    
    @example
    
    (define (sh-symlink store)
      ;; Return a derivation that symlinks the 'bash' executable.
      (let* ((drv (package-derivation store bash))
             (out (derivation->output-path drv))
             (sh  (string-append out "/bin/bash")))
        (build-expression->derivation store "sh"
                                      `(symlink ,sh %output))))
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @end example
    
    Using @code{(guix monads)}, it may be rewritten as a monadic function:
    
    
    @c FIXME: Find a better example, one that uses 'mlet'.
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @example
    
    (define (sh-symlink)
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
      ;; Same, but return a monadic value.
    
      (gexp->derivation "sh"
                        #~(symlink (string-append #$bash "/bin/bash") #$output)))
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @end example
    
    There are two things to note in the second version: the @code{store}
    parameter is now implicit, and the monadic value returned by
    @code{package-file}---a wrapper around @code{package-derivation} and
    @code{derivation->output-path}---is @dfn{bound} using @code{mlet}
    instead of plain @code{let}.
    
    Calling the monadic @code{profile.sh} has no effect.  To get the desired
    effect, one must use @code{run-with-store}:
    
    @example
    (run-with-store (open-connection) (profile.sh))
    
    @result{} /gnu/store/...-profile.sh
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @end example
    
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    Note that the @code{(guix monad-repl)} module extends Guile's REPL with
    new ``meta-commands'' to make it easier to deal with monadic procedures:
    @code{run-in-store}, and @code{enter-store-monad}.  The former, is used
    to ``run'' a single monadic value through the store:
    
    @example
    scheme@@(guile-user)> ,run-in-store (package->derivation hello)
    $1 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
    @end example
    
    The latter enters a recursive REPL, where all the return values are
    automatically run through the store:
    
    @example
    scheme@@(guile-user)> ,enter-store-monad
    store-monad@@(guile-user) [1]> (package->derivation hello)
    $2 = #<derivation /gnu/store/@dots{}-hello-2.9.drv => @dots{}>
    store-monad@@(guile-user) [1]> (text-file "foo" "Hello!")
    $3 = "/gnu/store/@dots{}-foo"
    store-monad@@(guile-user) [1]> ,q
    scheme@@(guile-user)>
    @end example
    
    @noindent
    Note that non-monadic values cannot be returned in the
    @code{store-monad} REPL.
    
    
    The main syntactic forms to deal with monads in general are provided by
    the @code{(guix monads)} module and are described below.
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    
    @deffn {Scheme Syntax} with-monad @var{monad} @var{body} ...
    Evaluate any @code{>>=} or @code{return} forms in @var{body} as being
    in @var{monad}.
    @end deffn
    
    @deffn {Scheme Syntax} return @var{val}
    Return a monadic value that encapsulates @var{val}.
    @end deffn
    
    @deffn {Scheme Syntax} >>= @var{mval} @var{mproc}
    @dfn{Bind} monadic value @var{mval}, passing its ``contents'' to monadic
    procedure @var{mproc}@footnote{This operation is commonly referred to as
    ``bind'', but that name denotes an unrelated procedure in Guile.  Thus
    we use this somewhat cryptic symbol inherited from the Haskell
    language.}.
    @end deffn
    
    @deffn {Scheme Syntax} mlet @var{monad} ((@var{var} @var{mval}) ...) @
           @var{body} ...
    @deffnx {Scheme Syntax} mlet* @var{monad} ((@var{var} @var{mval}) ...) @
           @var{body} ...
    Bind the variables @var{var} to the monadic values @var{mval} in
    @var{body}.  The form (@var{var} -> @var{val}) binds @var{var} to the
    ``normal'' value @var{val}, as per @code{let}.
    
    @code{mlet*} is to @code{mlet} what @code{let*} is to @code{let}
    (@pxref{Local Bindings,,, guile, GNU Guile Reference Manual}).
    @end deffn
    
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @deffn {Scheme System} mbegin @var{monad} @var{mexp} ...
    Bind @var{mexp} and the following monadic expressions in sequence,
    returning the result of the last expression.
    
    This is akin to @code{mlet}, except that the return values of the
    monadic expressions are ignored.  In that sense, it is analogous to
    @code{begin}, but applied to monadic expressions.
    @end deffn
    
    
    @cindex state monad
    The @code{(guix monads)} module provides the @dfn{state monad}, which
    allows an additional value---the state---to be @emph{threaded} through
    monadic procedure calls.
    
    @defvr {Scheme Variable} %state-monad
    The state monad.  Procedures in the state monad can access and change
    the state that is threaded.
    
    Consider the example below.  The @code{square} procedure returns a value
    in the state monad.  It returns the square of its argument, but also
    increments the current state value:
    
    @example
    (define (square x)
      (mlet %state-monad ((count (current-state)))
        (mbegin %state-monad
          (set-current-state (+ 1 count))
          (return (* x x)))))
    
    (run-with-state (sequence %state-monad (map square (iota 3))) 0)
    @result{} (0 1 4)
    @result{} 3
    @end example
    
    When ``run'' through @var{%state-monad}, we obtain that additional state
    value, which is the number of @code{square} calls.
    @end defvr
    
    @deffn {Monadic Procedure} current-state
    Return the current state as a monadic value.
    @end deffn
    
    @deffn {Monadic Procedure} set-current-state @var{value}
    Set the current state to @var{value} and return the previous state as a
    monadic value.
    @end deffn
    
    @deffn {Monadic Procedure} state-push @var{value}
    Push @var{value} to the current state, which is assumed to be a list,
    and return the previous state as a monadic value.
    @end deffn
    
    @deffn {Monadic Procedure} state-pop
    Pop a value from the current state and return it as a monadic value.
    The state is assumed to be a list.
    @end deffn
    
    @deffn {Scheme Procedure} run-with-state @var{mval} [@var{state}]
    Run monadic value @var{mval} starting with @var{state} as the initial
    state.  Return two values: the resulting value, and the resulting state.
    @end deffn
    
    
    The main interface to the store monad, provided by the @code{(guix
    store)} module, is as follows.
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    
    @defvr {Scheme Variable} %store-monad
    
    The store monad---an alias for @var{%state-monad}.
    
    Values in the store monad encapsulate accesses to the store.  When its
    effect is needed, a value of the store monad must be ``evaluated'' by
    passing it to the @code{run-with-store} procedure (see below.)
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @end defvr
    
    @deffn {Scheme Procedure} run-with-store @var{store} @var{mval} [#:guile-for-build] [#:system (%current-system)]
    Run @var{mval}, a monadic value in the store monad, in @var{store}, an
    open store connection.
    @end deffn
    
    @deffn {Monadic Procedure} text-file @var{name} @var{text}
    Return as a monadic value the absolute file name in the store of the file
    
    containing @var{text}, a string.
    @end deffn
    
    
    @deffn {Monadic Procedure} interned-file @var{file} [@var{name}] @
             [#:recursive? #t]
    Return the name of @var{file} once interned in the store.  Use
    @var{name} as its store name, or the basename of @var{file} if
    @var{name} is omitted.
    
    When @var{recursive?} is true, the contents of @var{file} are added
    recursively; if @var{file} designates a flat file and @var{recursive?}
    is true, its contents are added, and its permission bits are kept.
    
    The example below adds a file to the store, under two different names:
    
    @example
    (run-with-store (open-connection)
      (mlet %store-monad ((a (interned-file "README"))
                          (b (interned-file "README" "LEGU-MIN")))
        (return (list a b))))
    
    @result{} ("/gnu/store/rwm@dots{}-README" "/gnu/store/44i@dots{}-LEGU-MIN")
    @end example
    
    @end deffn
    
    
    The @code{(guix packages)} module exports the following package-related
    monadic procedures:
    
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @deffn {Monadic Procedure} package-file @var{package} [@var{file}] @
    
           [#:system (%current-system)] [#:target #f] @
           [#:output "out"] Return as a monadic
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    value in the absolute file name of @var{file} within the @var{output}
    directory of @var{package}.  When @var{file} is omitted, return the name
    
    of the @var{output} directory of @var{package}.  When @var{target} is
    true, use it as a cross-compilation target triplet.
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @end deffn
    
    @deffn {Monadic Procedure} package->derivation @var{package} [@var{system}]
    
    @deffnx {Monadic Procedure} package->cross-derivation @var{package} @
              @var{target} [@var{system}]
    Monadic version of @code{package-derivation} and
    @code{package-cross-derivation} (@pxref{Defining Packages}).
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @node G-Expressions
    @section G-Expressions
    
    @cindex G-expression
    @cindex build code quoting
    So we have ``derivations'', which represent a sequence of build actions
    to be performed to produce an item in the store (@pxref{Derivations}).
    Those build actions are performed when asking the daemon to actually
    build the derivations; they are run by the daemon in a container
    (@pxref{Invoking guix-daemon}).
    
    @cindex strata of code
    It should come as no surprise that we like to write those build actions
    in Scheme.  When we do that, we end up with two @dfn{strata} of Scheme
    code@footnote{The term @dfn{stratum} in this context was coined by
    
    Manuel Serrano et al.@: in the context of their work on Hop.  Oleg
    Kiselyov, who has written insightful
    @url{http://okmij.org/ftp/meta-programming/#meta-scheme, essays and code
    on this topic}, refers to this kind of code generation as
    @dfn{staging}.}: the ``host code''---code that defines packages, talks
    to the daemon, etc.---and the ``build code''---code that actually
    performs build actions, such as making directories, invoking
    @command{make}, etc.
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    
    To describe a derivation and its build actions, one typically needs to
    embed build code inside host code.  It boils down to manipulating build
    code as data, and Scheme's homoiconicity---code has a direct
    representation as data---comes in handy for that.  But we need more than
    Scheme's normal @code{quasiquote} mechanism to construct build
    expressions.
    
    The @code{(guix gexp)} module implements @dfn{G-expressions}, a form of
    S-expressions adapted to build expressions.  G-expressions, or
    @dfn{gexps}, consist essentially in three syntactic forms: @code{gexp},
    @code{ungexp}, and @code{ungexp-splicing} (or simply: @code{#~},
    @code{#$}, and @code{#$@@}), which are comparable respectively to
    @code{quasiquote}, @code{unquote}, and @code{unquote-splicing}
    (@pxref{Expression Syntax, @code{quasiquote},, guile, GNU Guile
    Reference Manual}).  However, there are major differences:
    
    @itemize
    @item
    Gexps are meant to be written to a file and run or manipulated by other
    processes.
    
    @item
    When a package or derivation is unquoted inside a gexp, the result is as
    if its output file name had been introduced.
    
    @item
    Gexps carry information about the packages or derivations they refer to,
    and these dependencies are automatically added as inputs to the build
    processes that use them.
    @end itemize
    
    To illustrate the idea, here is an example of a gexp:
    
    @example
    (define build-exp
      #~(begin
          (mkdir #$output)
          (chdir #$output)
          (symlink (string-append #$coreutils "/bin/ls") 
                   "list-files")))
    @end example
    
    This gexp can be passed to @code{gexp->derivation}; we obtain a
    derivation that builds a directory containing exactly one symlink to
    @file{/gnu/store/@dots{}-coreutils-8.22/bin/ls}:
    
    @example
    (gexp->derivation "the-thing" build-exp)
    @end example
    
    
    As one would expect, the @code{"/gnu/store/@dots{}-coreutils-8.22"} string is
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    substituted to the reference to the @var{coreutils} package in the
    actual build code, and @var{coreutils} is automatically made an input to
    the derivation.  Likewise, @code{#$output} (equivalent to @code{(ungexp
    output)}) is replaced by a string containing the derivation's output
    
    directory name.
    
    @cindex cross compilation
    In a cross-compilation context, it is useful to distinguish between
    references to the @emph{native} build of a package---that can run on the
    host---versus references to cross builds of a package.  To that end, the
    @code{#+} plays the same role as @code{#$}, but is a reference to a
    native package build:
    
    @example
    (gexp->derivation "vi"
       #~(begin
           (mkdir #$output)
           (system* (string-append #+coreutils "/bin/ln")
                    "-s"
                    (string-append #$emacs "/bin/emacs")
                    (string-append #$output "/bin/vi")))
       #:target "mips64el-linux")
    @end example
    
    @noindent
    In the example above, the native build of @var{coreutils} is used, so
    that @command{ln} can actually run on the host; but then the
    cross-compiled build of @var{emacs} is referenced.
    
    The syntactic form to construct gexps is summarized below.
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    
    @deffn {Scheme Syntax} #~@var{exp}
    @deffnx {Scheme Syntax} (gexp @var{exp})
    Return a G-expression containing @var{exp}.  @var{exp} may contain one
    or more of the following forms:
    
    @table @code
    @item #$@var{obj}
    @itemx (ungexp @var{obj})
    Introduce a reference to @var{obj}.  @var{obj} may be a package or a
    derivation, in which case the @code{ungexp} form is replaced by its
    output file name---e.g., @code{"/gnu/store/@dots{}-coreutils-8.22}.
    
    If @var{obj} is a list, it is traversed and any package or derivation
    references are substituted similarly.
    
    If @var{obj} is another gexp, its contents are inserted and its
    dependencies are added to those of the containing gexp.
    
    If @var{obj} is another kind of object, it is inserted as is.
    
    @item #$@var{package-or-derivation}:@var{output}
    @itemx (ungexp @var{package-or-derivation} @var{output})
    This is like the form above, but referring explicitly to the
    @var{output} of @var{package-or-derivation}---this is useful when
    @var{package-or-derivation} produces multiple outputs (@pxref{Packages
    with Multiple Outputs}).
    
    
    @item #+@var{obj}
    @itemx #+@var{obj}:output
    @itemx (ungexp-native @var{obj})
    @itemx (ungexp-native @var{obj} @var{output})
    Same as @code{ungexp}, but produces a reference to the @emph{native}
    build of @var{obj} when used in a cross compilation context.
    
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @item #$output[:@var{output}]
    @itemx (ungexp output [@var{output}])
    Insert a reference to derivation output @var{output}, or to the main
    output when @var{output} is omitted.
    
    This only makes sense for gexps passed to @code{gexp->derivation}.
    
    @item #$@@@var{lst}
    @itemx (ungexp-splicing @var{lst})
    Like the above, but splices the contents of @var{lst} inside the
    containing list.
    
    
    @item #+@@@var{lst}
    @itemx (ungexp-native-splicing @var{lst})
    Like the above, but refers to native builds of the objects listed in
    @var{lst}.
    
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @end table
    
    G-expressions created by @code{gexp} or @code{#~} are run-time objects
    of the @code{gexp?} type (see below.)
    @end deffn
    
    @deffn {Scheme Procedure} gexp? @var{obj}
    Return @code{#t} if @var{obj} is a G-expression.
    @end deffn
    
    G-expressions are meant to be written to disk, either as code building
    some derivation, or as plain files in the store.  The monadic procedures
    below allow you to do that (@pxref{The Store Monad}, for more
    information about monads.)
    
    @deffn {Monadic Procedure} gexp->derivation @var{name} @var{exp} @
    
           [#:system (%current-system)] [#:target #f] [#:inputs '()] @
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
           [#:hash #f] [#:hash-algo #f] @
           [#:recursive? #f] [#:env-vars '()] [#:modules '()] @
    
           [#:module-path @var{%load-path}] @
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
           [#:references-graphs #f] [#:local-build? #f] @
           [#:guile-for-build #f]
    Return a derivation @var{name} that runs @var{exp} (a gexp) with
    
    @var{guile-for-build} (a derivation) on @var{system}.  When @var{target}
    is true, it is used as the cross-compilation target triplet for packages
    referred to by @var{exp}.
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    
    Make @var{modules} available in the evaluation context of @var{EXP};
    
    @var{MODULES} is a list of names of Guile modules searched in
    @var{MODULE-PATH} to be copied in the store, compiled, and made available in
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    the load path during the execution of @var{exp}---e.g., @code{((guix
    build utils) (guix build gnu-build-system))}.
    
    
    When @var{references-graphs} is true, it must be a list of tuples of one of the
    following forms:
    
    @example
    (@var{file-name} @var{package})
    (@var{file-name} @var{package} @var{output})
    (@var{file-name} @var{derivation})
    (@var{file-name} @var{derivation} @var{output})
    (@var{file-name} @var{store-item})
    @end example
    
    The right-hand-side of each element of @var{references-graphs} is automatically made
    an input of the build process of @var{exp}.  In the build environment, each
    @var{file-name} contains the reference graph of the corresponding item, in a simple
    text format.
    
    
    The other arguments are as for @code{derivation} (@pxref{Derivations}).
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @end deffn
    
    @deffn {Monadic Procedure} gexp->script @var{name} @var{exp}
    Return an executable script @var{name} that runs @var{exp} using
    @var{guile} with @var{modules} in its search path.
    
    The example below builds a script that simply invokes the @command{ls}
    command:
    
    @example
    (use-modules (guix gexp) (gnu packages base))
    
    (gexp->script "list-files"
                  #~(execl (string-append #$coreutils "/bin/ls")
                           "ls"))
    @end example
    
    When ``running'' it through the store (@pxref{The Store Monad,
    
    @code{run-with-store}}), we obtain a derivation that produces an
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    executable file @file{/gnu/store/@dots{}-list-files} along these lines:
    
    @example
    #!/gnu/store/@dots{}-guile-2.0.11/bin/guile -ds
    !#
    (execl (string-append "/gnu/store/@dots{}-coreutils-8.22"/bin/ls")
           "ls")
    @end example
    @end deffn
    
    @deffn {Monadic Procedure} gexp->file @var{name} @var{exp}
    Return a derivation that builds a file @var{name} containing @var{exp}.
    
    The resulting file holds references to all the dependencies of @var{exp}
    or a subset thereof.
    @end deffn
    
    
    @deffn {Monadic Procedure} text-file* @var{name} @var{text} @dots{}
    Return as a monadic value a derivation that builds a text file
    containing all of @var{text}.  @var{text} may list, in addition to
    strings, packages, derivations, and store file names; the resulting
    store file holds references to all these.
    
    This variant should be preferred over @code{text-file} anytime the file
    to create will reference items from the store.  This is typically the
    case when building a configuration file that embeds store file names,
    like this:
    
    @example
    (define (profile.sh)
      ;; Return the name of a shell script in the store that
      ;; initializes the 'PATH' environment variable.
      (text-file* "profile.sh"
                  "export PATH=" coreutils "/bin:"
                  grep "/bin:" sed "/bin\n"))
    @end example
    
    In this example, the resulting @file{/gnu/store/@dots{}-profile.sh} file
    will references @var{coreutils}, @var{grep}, and @var{sed}, thereby
    preventing them from being garbage-collected during its lifetime.
    @end deffn
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    
    Of course, in addition to gexps embedded in ``host'' code, there are
    also modules containing build tools.  To make it clear that they are
    meant to be used in the build stratum, these modules are kept in the
    @code{(guix build @dots{})} name space.
    
    
    
    @c *********************************************************************
    @node Utilities
    @chapter Utilities
    
    
    This section describes tools primarily targeted at developers and users
    who write new package definitions.  They complement the Scheme
    programming interface of Guix in a convenient way.
    
    
    * Invoking guix build::         Building packages from the command line.
    
    * Invoking guix download::      Downloading a file and printing its hash.
    
    * Invoking guix hash::          Computing the cryptographic hash of a file.
    
    * Invoking guix import::        Importing package definitions.
    
    * Invoking guix refresh::       Updating package definitions.
    
    Cyril Roelandt's avatar
    Cyril Roelandt committed
    * Invoking guix lint::          Finding errors in package definitions.
    
    * Invoking guix environment::   Setting up development environments.
    
    @node Invoking guix build
    @section Invoking @command{guix build}
    
    The @command{guix build} command builds packages or derivations and
    
    their dependencies, and prints the resulting store paths.  Note that it
    does not modify the user's profile---this is the job of the
    
    @command{guix package} command (@pxref{Invoking guix package}).  Thus,
    
    it is mainly useful for distribution developers.
    
    The general syntax is:
    
    guix build @var{options} @var{package-or-derivation}@dots{}
    
    @end example
    
    @var{package-or-derivation} may be either the name of a package found in
    
    the software distribution such as @code{coreutils} or
    @code{coreutils-8.20}, or a derivation such as
    
    @file{/gnu/store/@dots{}-coreutils-8.19.drv}.  In the former case, a
    
    package with the corresponding name (and optionally version) is searched
    for among the GNU distribution modules (@pxref{Package Modules}).
    
    Alternatively, the @code{--expression} option may be used to specify a
    Scheme expression that evaluates to a package; this is useful when
    disambiguation among several same-named packages or package variants is
    needed.
    
    
    The @var{options} may be zero or more of the following:
    
    @table @code
    
    @item --expression=@var{expr}
    @itemx -e @var{expr}
    
    Build the package or derivation @var{expr} evaluates to.
    
    For example, @var{expr} may be @code{(@@ (gnu packages guile)
    
    guile-1.8)}, which unambiguously designates this specific variant of
    version 1.8 of Guile.
    
    
    Alternately, @var{expr} may be a G-expression, in which case it is used
    as a build program passed to @code{gexp->derivation}
    (@pxref{G-Expressions}).
    
    Lastly, @var{expr} may refer to a zero-argument monadic procedure
    
    (@pxref{The Store Monad}).  The procedure must return a derivation as a
    monadic value, which is then passed through @code{run-with-store}.
    
    
    @item --source
    @itemx -S
    Build the packages' source derivations, rather than the packages
    themselves.
    
    
    For instance, @code{guix build -S gcc} returns something like
    
    @file{/gnu/store/@dots{}-gcc-4.7.2.tar.bz2}, which is GCC's source tarball.
    
    The returned source tarball is the result of applying any patches and
    code snippets specified in the package's @code{origin} (@pxref{Defining
    Packages}).
    
    
    @item --system=@var{system}
    @itemx -s @var{system}
    Attempt to build for @var{system}---e.g., @code{i686-linux}---instead of
    the host's system type.
    
    An example use of this is on Linux-based systems, which can emulate
    different personalities.  For instance, passing
    @code{--system=i686-linux} on an @code{x86_64-linux} system allows users
    to build packages in a complete 32-bit environment.
    
    
    @item --target=@var{triplet}
    @cindex cross-compilation
    Cross-build for @var{triplet}, which must be a valid GNU triplet, such
    as @code{"mips64el-linux-gnu"} (@pxref{Configuration Names, GNU
    configuration triplets,, configure, GNU Configure and Build System}).
    
    
    @item --with-source=@var{source}
    Use @var{source} as the source of the corresponding package.
    @var{source} must be a file name or a URL, as for @command{guix
    download} (@pxref{Invoking guix download}).
    
    The ``corresponding package'' is taken to be one specified on the
    command line whose name matches the base of @var{source}---e.g., if
    @var{source} is @code{/src/guile-2.0.10.tar.gz}, the corresponding
    package is @code{guile}.  Likewise, the version string is inferred from
    @var{source}; in the previous example, it's @code{2.0.10}.
    
    This option allows users to try out versions of packages other than the
    one provided by the distribution.  The example below downloads
    @file{ed-1.7.tar.gz} from a GNU mirror and uses that as the source for
    the @code{ed} package:
    
    @example
    guix build ed --with-source=mirror://gnu/ed/ed-1.7.tar.gz
    @end example
    
    As a developer, @code{--with-source} makes it easy to test release
    candidates:
    
    @example
    guix build guile --with-source=../guile-2.0.9.219-e1bb7.tar.xz
    @end example
    
    
    @item --no-grafts
    Do not ``graft'' packages.  In practice, this means that package updates
    available as grafts are not applied.  @xref{Security Updates}, for more
    information on grafts.
    
    @item --derivations
    @itemx -d
    Return the derivation paths, not the output paths, of the given
    packages.
    
    
    @item --root=@var{file}
    @itemx -r @var{file}
    Make @var{file} a symlink to the result, and register it as a garbage
    collector root.
    
    @item --log-file
    Return the build log file names for the given
    @var{package-or-derivation}s, or raise an error if build logs are
    missing.
    
    This works regardless of how packages or derivations are specified.  For
    instance, the following invocations are equivalent:
    
    @example
    guix build --log-file `guix build -d guile`
    guix build --log-file `guix build guile`
    guix build --log-file guile
    guix build --log-file -e '(@@ (gnu packages guile) guile-2.0)'
    @end example
    
    
    @end table
    
    @cindex common build options
    In addition, a number of options that control the build process are
    common to @command{guix build} and other commands that can spawn builds,
    such as @command{guix package} or @command{guix archive}.  These are the
    following:
    
    @table @code
    
    
    @item --load-path=@var{directory}
    @itemx -L @var{directory}
    Add @var{directory} to the front of the package module search path
    (@pxref{Package Modules}).
    
    This allows users to define their own packages and make them visible to
    the command-line tools.
    
    
    @item --keep-failed
    @itemx -K
    Keep the build tree of failed builds.  Thus, if a build fail, its build
    tree is kept under @file{/tmp}, in a directory whose name is shown at
    the end of the build log.  This is useful when debugging build issues.
    
    @item --dry-run
    @itemx -n
    Do not build the derivations.
    
    
    @item --fallback
    When substituting a pre-built binary fails, fall back to building
    packages locally.
    
    
    @item --no-substitutes
    
    Do not use substitutes for build products.  That is, always build things
    
    locally instead of allowing downloads of pre-built binaries
    (@pxref{Substitutes}).
    
    @item --no-build-hook
    
    Do not attempt to offload builds @i{via} the daemon's ``build hook''
    (@pxref{Daemon Offload Setup}).  That is, always build things locally
    instead of offloading builds to remote machines.
    
    @item --max-silent-time=@var{seconds}
    When the build or substitution process remains silent for more than
    @var{seconds}, terminate it and report a build failure.
    
    
    @item --timeout=@var{seconds}
    Likewise, when the build or substitution process lasts for more than
    @var{seconds}, terminate it and report a build failure.
    
    By default there is no timeout.  This behavior can be restored with
    @code{--timeout=0}.
    
    
    @item --verbosity=@var{level}
    Use the given verbosity level.  @var{level} must be an integer between 0
    and 5; higher means more verbose output.  Setting a level of 4 or more
    may be helpful when debugging setup issues with the build daemon.
    
    
    @item --cores=@var{n}
    @itemx -c @var{n}
    Allow the use of up to @var{n} CPU cores for the build.  The special
    value @code{0} means to use as many CPU cores as available.
    
    @item --max-jobs=@var{n}
    @itemx -M @var{n}
    Allow at most @var{n} build jobs in parallel.  @xref{Invoking
    guix-daemon, @code{--max-jobs}}, for details about this option and the
    equivalent @command{guix-daemon} option.
    
    
    Behind the scenes, @command{guix build} is essentially an interface to
    
    the @code{package-derivation} procedure of the @code{(guix packages)}
    module, and to the @code{build-derivations} procedure of the @code{(guix
    
    derivations)} module.
    
    In addition to options explicitly passed on the command line,
    @command{guix build} and other @command{guix} commands that support
    building honor the @code{GUIX_BUILD_OPTIONS} environment variable.
    
    @defvr {Environment Variable} GUIX_BUILD_OPTIONS
    Users can define this variable to a list of command line options that
    will automatically be used by @command{guix build} and other
    @command{guix} commands that can perform builds, as in the example
    below:
    
    @example
    $ export GUIX_BUILD_OPTIONS="--no-substitutes -c 2 -L /foo/bar"
    @end example
    
    
    These options are parsed independently, and the result is appended to
    the parsed command-line options.
    
    @node Invoking guix download
    @section Invoking @command{guix download}
    
    When writing a package definition, developers typically need to download
    the package's source tarball, compute its SHA256 hash, and write that
    hash in the package definition (@pxref{Defining Packages}).  The
    @command{guix download} tool helps with this task: it downloads a file
    from the given URI, adds it to the store, and prints both its file name
    in the store and its SHA256 hash.
    
    The fact that the downloaded file is added to the store saves bandwidth:
    when the developer eventually tries to build the newly defined package
    with @command{guix build}, the source tarball will not have to be
    downloaded again because it is already in the store.  It is also a
    convenient way to temporarily stash files, which may be deleted
    eventually (@pxref{Invoking guix gc}).
    
    The @command{guix download} command supports the same URIs as used in
    package definitions.  In particular, it supports @code{mirror://} URIs.
    @code{https} URIs (HTTP over TLS) are supported @emph{provided} the
    Guile bindings for GnuTLS are available in the user's environment; when
    
    they are not available, an error is raised.  @xref{Guile Preparations,
    how to install the GnuTLS bindings for Guile,, gnutls-guile,
    GnuTLS-Guile}, for more information.
    
    
    The following option is available:
    
    @table @code
    @item --format=@var{fmt}
    @itemx -f @var{fmt}
    Write the hash in the format specified by @var{fmt}.  For more
    
    information on the valid values for @var{fmt}, @pxref{Invoking guix hash}.
    
    Nikita Karetnikov's avatar
    Nikita Karetnikov committed
    @node Invoking guix hash
    @section Invoking @command{guix hash}
    
    
    The @command{guix hash} command computes the SHA256 hash of a file.
    
    Nikita Karetnikov's avatar
    Nikita Karetnikov committed
    It is primarily a convenience tool for anyone contributing to the
    distribution: it computes the cryptographic hash of a file, which can be
    used in the definition of a package (@pxref{Defining Packages}).
    
    The general syntax is:
    
    @example
    guix hash @var{option} @var{file}
    @end example
    
    @command{guix hash} has the following option:
    
    @table @code
    
    @item --format=@var{fmt}
    @itemx -f @var{fmt}
    
    Write the hash in the format specified by @var{fmt}.
    
    Nikita Karetnikov's avatar
    Nikita Karetnikov committed
    
    Supported formats: @code{nix-base32}, @code{base32}, @code{base16}
    (@code{hex} and @code{hexadecimal} can be used as well).
    
    If the @option{--format} option is not specified, @command{guix hash}
    will output the hash in @code{nix-base32}.  This representation is used
    in the definitions of packages.
    
    
    @item --recursive
    @itemx -r
    Compute the hash on @var{file} recursively.
    
    In this case, the hash is computed on an archive containing @var{file},
    including its children if it is a directory.  Some of @var{file}'s
    meta-data is part of the archive; for instance, when @var{file} is a
    regular file, the hash is different depending on whether @var{file} is
    executable or not.  Meta-data such as time stamps has no impact on the
    hash (@pxref{Invoking guix archive}).
    @c FIXME: Replace xref above with xref to an ``Archive'' section when
    @c it exists.
    
    
    Nikita Karetnikov's avatar
    Nikita Karetnikov committed
    @end table
    
    
    @node Invoking guix import
    @section Invoking @command{guix import}
    
    @cindex importing packages
    @cindex package import
    @cindex package conversion
    The @command{guix import} command is useful for people willing to add a
    package to the distribution but who'd rather do as little work as
    possible to get there---a legitimate demand.  The command knows of a few
    repositories from which it can ``import'' package meta-data.  The result
    is a package definition, or a template thereof, in the format we know
    (@pxref{Defining Packages}).
    
    The general syntax is:
    
    @example
    guix import @var{importer} @var{options}@dots{}
    @end example
    
    @var{importer} specifies the source from which to import package