Skip to content
Snippets Groups Projects
guix.texi 224 KiB
Newer Older
  • Learn to ignore specific revisions
  • For example, GCC needs the @code{CPATH} and @code{LIBRARY_PATH}
    environment variables to be defined so it can look for headers and
    libraries in the user's profile (@pxref{Environment Variables,,, gcc,
    Using the GNU Compiler Collection (GCC)}).  If GCC and, say, the C
    library are installed in the profile, then @code{--search-paths} will
    suggest setting these variables to @code{@var{profile}/include} and
    @code{@var{profile}/lib}, respectively.
    
    
    @item --profile=@var{profile}
    @itemx -p @var{profile}
    Use @var{profile} instead of the user's default profile.
    
    
    @item --verbose
    Produce verbose output.  In particular, emit the environment's build log
    on the standard error port.
    
    
    @item --bootstrap
    Use the bootstrap Guile to build the profile.  This option is only
    useful to distribution developers.
    
    @end table
    
    
    In addition to these actions @command{guix package} supports the
    
    following options to query the current state of a profile, or the
    availability of packages:
    
    @item --search=@var{regexp}
    @itemx -s @var{regexp}
    List the available packages whose synopsis or description matches
    
    @var{regexp}.  Print all the meta-data of matching packages in
    @code{recutils} format (@pxref{Top, GNU recutils databases,, recutils,
    GNU recutils manual}).
    
    This allows specific fields to be extracted using the @command{recsel}
    command, for instance:
    
    @example
    
    $ guix package -s malloc | recsel -p name,version
    
    name: glibc
    version: 2.17
    
    name: libgc
    version: 7.2alpha6
    @end example
    
    Similarly, to show the name of all the packages available under the
    terms of the GNU@tie{}LGPL version 3:
    
    @example
    $ guix package -s "" | recsel -p name -e 'license ~ "LGPL 3"'
    name: elfutils
    
    name: gmp
    @dots{}
    @end example
    
    
    @item --show=@var{package}
    Show details about @var{package}, taken from the list of available packages, in
    @code{recutils} format (@pxref{Top, GNU recutils databases,, recutils, GNU
    recutils manual}).
    
    @example
    $ guix package --show=python | recsel -p name,version
    name: python
    version: 2.7.6
    
    name: python
    version: 3.3.5
    @end example
    
    You may also specify the full name of a package to only get details about a
    specific version of it:
    @example
    $ guix package --show=python-3.3.5 | recsel -p name,version
    name: python
    version: 3.3.5
    @end example
    
    
    
    
    @item --list-installed[=@var{regexp}]
    @itemx -I [@var{regexp}]
    
    List the currently installed packages in the specified profile, with the
    most recently installed packages shown last.  When @var{regexp} is
    specified, list only installed packages whose name matches @var{regexp}.
    
    
    For each installed package, print the following items, separated by
    tabs: the package name, its version string, the part of the package that
    is installed (for instance, @code{out} for the default output,
    @code{include} for its headers, etc.), and the path of this package in
    the store.
    
    
    @item --list-available[=@var{regexp}]
    @itemx -A [@var{regexp}]
    
    List packages currently available in the software distribution
    (@pxref{GNU Distribution}).  When @var{regexp} is specified, list only
    installed packages whose name matches @var{regexp}.
    
    
    For each package, print the following items separated by tabs: its name,
    
    its version string, the parts of the package (@pxref{Packages with
    Multiple Outputs}), and the source location of its definition.
    
    @item --list-generations[=@var{pattern}]
    @itemx -l [@var{pattern}]
    Return a list of generations along with their creation dates; for each
    generation, show the installed packages, with the most recently
    
    installed packages shown last.  Note that the zeroth generation is never
    shown.
    
    
    For each installed package, print the following items, separated by
    tabs: the name of a package, its version string, the part of the package
    that is installed (@pxref{Packages with Multiple Outputs}), and the
    location of this package in the store.
    
    When @var{pattern} is used, the command returns only matching
    generations.  Valid patterns include:
    
    @itemize
    @item @emph{Integers and comma-separated integers}.  Both patterns denote
    generation numbers.  For instance, @code{--list-generations=1} returns
    the first one.
    
    And @code{--list-generations=1,8,2} outputs three generations in the
    specified order.  Neither spaces nor trailing commas are allowed.
    
    @item @emph{Ranges}.  @code{--list-generations=2..9} prints the
    specified generations and everything in between.  Note that the start of
    a range must be lesser than its end.
    
    It is also possible to omit the endpoint.  For example,
    @code{--list-generations=2..}, returns all generations starting from the
    second one.
    
    @item @emph{Durations}.  You can also get the last @emph{N}@tie{}days, weeks,
    or months by passing an integer along with the first letter of the
    
    duration.  For example, @code{--list-generations=20d} lists generations
    that are up to 20 days old.
    
    @item --delete-generations[=@var{pattern}]
    @itemx -d [@var{pattern}]
    
    When @var{pattern} is omitted, delete all generations except the current
    one.
    
    
    This command accepts the same patterns as @option{--list-generations}.
    
    When @var{pattern} is specified, delete the matching generations.  When
    @var{pattern} specifies a duration, generations @emph{older} than the
    specified duration match.  For instance, @code{--delete-generations=1m}
    deletes generations that are more than one month old.
    
    If the current generation matches, it is deleted atomically---i.e., by
    switching to the previous available generation.  Note that the zeroth
    generation is never deleted.
    
    Note that deleting generations prevents roll-back to them.
    Consequently, this command must be used with care.
    
    
    Finally, since @command{guix package} may actually start build
    processes, it supports all the common build options that @command{guix
    build} supports (@pxref{Invoking guix build, common build options}).
    
    
    Alex Kost's avatar
    Alex Kost committed
    @include emacs.texi
    
    
    @node Substitutes
    @section Substitutes
    
    @cindex substitutes
    @cindex pre-built binaries
    Guix supports transparent source/binary deployment, which means that it
    can either build things locally, or download pre-built items from a
    server.  We call these pre-built items @dfn{substitutes}---they are
    substitutes for local build results.  In many cases, downloading a
    substitute is much faster than building things locally.
    
    Substitutes can be anything resulting from a derivation build
    (@pxref{Derivations}).  Of course, in the common case, they are
    pre-built package binaries, but source tarballs, for instance, which
    also result from derivation builds, can be available as substitutes.
    
    The @code{hydra.gnu.org} server is a front-end to a build farm that
    builds packages from the GNU distribution continuously for some
    
    architectures, and makes them available as substitutes.  This is the
    default source of substitutes; it can be overridden by passing
    @command{guix-daemon} the @code{--substitute-urls} option
    (@pxref{Invoking guix-daemon}).
    
    
    @cindex security
    @cindex digital signatures
    To allow Guix to download substitutes from @code{hydra.gnu.org}, you
    must add its public key to the access control list (ACL) of archive
    imports, using the @command{guix archive} command (@pxref{Invoking guix
    archive}).  Doing so implies that you trust @code{hydra.gnu.org} to not
    be compromised and to serve genuine substitutes.
    
    This public key is installed along with Guix, in
    @code{@var{prefix}/share/guix/hydra.gnu.org.pub}, where @var{prefix} is
    the installation prefix of Guix.  If you installed Guix from source,
    make sure you checked the GPG signature of
    @file{guix-@value{VERSION}.tar.gz}, which contains this public key file.
    Then, you can run something like this:
    
    @example
    # guix archive --authorize < hydra.gnu.org.pub
    @end example
    
    Once this is in place, the output of a command like @code{guix build}
    should change from something like:
    
    @example
    $ guix build emacs --dry-run
    The following derivations would be built:
       /gnu/store/yr7bnx8xwcayd6j95r2clmkdl1qh688w-emacs-24.3.drv
       /gnu/store/x8qsh1hlhgjx6cwsjyvybnfv2i37z23w-dbus-1.6.4.tar.gz.drv
       /gnu/store/1ixwp12fl950d15h2cj11c73733jay0z-alsa-lib-1.0.27.1.tar.bz2.drv
       /gnu/store/nlma1pw0p603fpfiqy7kn4zm105r5dmw-util-linux-2.21.drv
    @dots{}
    @end example
    
    @noindent
    to something like:
    
    @example
    $ guix build emacs --dry-run
    The following files would be downloaded:
       /gnu/store/pk3n22lbq6ydamyymqkkz7i69wiwjiwi-emacs-24.3
       /gnu/store/2ygn4ncnhrpr61rssa6z0d9x22si0va3-libjpeg-8d
       /gnu/store/71yz6lgx4dazma9dwn2mcjxaah9w77jq-cairo-1.12.16
       /gnu/store/7zdhgp0n1518lvfn8mb96sxqfmvqrl7v-libxrender-0.9.7
    @dots{}
    @end example
    
    @noindent
    This indicates that substitutes from @code{hydra.gnu.org} are usable and
    will be downloaded, when possible, for future builds.
    
    Guix ignores substitutes that are not signed, or that are not signed by
    
    Alex Sassmannshausen's avatar
    Alex Sassmannshausen committed
    one of the keys listed in the ACL.  It also detects and raises an error
    
    when attempting to use a substitute that has been tampered with.
    
    The substitute mechanism can be disabled globally by running
    @code{guix-daemon} with @code{--no-substitutes} (@pxref{Invoking
    guix-daemon}).  It can also be disabled temporarily by passing the
    @code{--no-substitutes} option to @command{guix package}, @command{guix
    build}, and other command-line tools.
    
    
    Today, each individual's control over their own computing is at the
    mercy of institutions, corporations, and groups with enough power and
    determination to subvert the computing infrastructure and exploit its
    weaknesses.  While using @code{hydra.gnu.org} substitutes can be
    convenient, we encourage users to also build on their own, or even run
    their own build farm, such that @code{hydra.gnu.org} is less of an
    interesting target.
    
    Guix has the foundations to maximize build reproducibility
    (@pxref{Features}).  In most cases, independent builds of a given
    package or derivation should yield bit-identical results.  Thus, through
    a diverse set of independent package builds, we can strengthen the
    integrity of our systems.
    
    In the future, we want Guix to have support to publish and retrieve
    binaries to/from other users, in a peer-to-peer fashion.  If you would
    like to discuss this project, join us on @email{guix-devel@@gnu.org}.
    
    
    
    @node Packages with Multiple Outputs
    @section Packages with Multiple Outputs
    
    @cindex multiple-output packages
    @cindex package outputs
    
    Often, packages defined in Guix have a single @dfn{output}---i.e., the
    source package leads exactly one directory in the store.  When running
    @command{guix package -i glibc}, one installs the default output of the
    GNU libc package; the default output is called @code{out}, but its name
    can be omitted as shown in this command.  In this particular case, the
    default output of @code{glibc} contains all the C header files, shared
    libraries, static libraries, Info documentation, and other supporting
    files.
    
    Sometimes it is more appropriate to separate the various types of files
    produced from a single source package into separate outputs.  For
    instance, the GLib C library (used by GTK+ and related packages)
    installs more than 20 MiB of reference documentation as HTML pages.
    To save space for users who do not need it, the documentation goes to a
    separate output, called @code{doc}.  To install the main GLib output,
    which contains everything but the documentation, one would run:
    
    @example
    guix package -i glib
    @end example
    
    The command to install its documentation is:
    
    @example
    guix package -i glib:doc
    @end example
    
    Some packages install programs with different ``dependency footprints''.
    For instance, the WordNet package install both command-line tools and
    graphical user interfaces (GUIs).  The former depend solely on the C
    library, whereas the latter depend on Tcl/Tk and the underlying X
    libraries.  In this case, we leave the command-line tools in the default
    output, whereas the GUIs are in a separate output.  This allows users
    who do not need the GUIs to save space.
    
    There are several such multiple-output packages in the GNU distribution.
    
    Other conventional output names include @code{lib} for libraries and
    possibly header files, @code{bin} for stand-alone programs, and
    @code{debug} for debugging information (@pxref{Installing Debugging
    Files}).  The outputs of a packages are listed in the third column of
    the output of @command{guix package --list-available} (@pxref{Invoking
    guix package}).
    
    @node Invoking guix gc
    @section Invoking @command{guix gc}
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    
    @cindex garbage collector
    Packages that are installed but not used may be @dfn{garbage-collected}.
    
    The @command{guix gc} command allows users to explicitly run the garbage
    
    collector to reclaim space from the @file{/gnu/store} directory.
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    
    The garbage collector has a set of known @dfn{roots}: any file under
    
    @file{/gnu/store} reachable from a root is considered @dfn{live} and
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    cannot be deleted; any other file is considered @dfn{dead} and may be
    deleted.  The set of garbage collector roots includes default user
    
    profiles, and may be augmented with @command{guix build --root}, for
    example (@pxref{Invoking guix build}).
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    
    
    Prior to running @code{guix gc --collect-garbage} to make space, it is
    often useful to remove old generations from user profiles; that way, old
    package builds referenced by those generations can be reclaimed.  This
    is achieved by running @code{guix package --delete-generations}
    (@pxref{Invoking guix package}).
    
    
    The @command{guix gc} command has three modes of operation: it can be
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    used to garbage-collect any dead files (the default), to delete specific
    files (the @code{--delete} option), or to print garbage-collector
    information.  The available options are listed below:
    
    @table @code
    @item --collect-garbage[=@var{min}]
    @itemx -C [@var{min}]
    
    Collect garbage---i.e., unreachable @file{/gnu/store} files and
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    sub-directories.  This is the default operation when no option is
    specified.
    
    When @var{min} is given, stop once @var{min} bytes have been collected.
    @var{min} may be a number of bytes, or it may include a unit as a
    
    suffix, such as @code{MiB} for mebibytes and @code{GB} for gigabytes
    (@pxref{Block size, size specifications,, coreutils, GNU Coreutils}).
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    
    When @var{min} is omitted, collect all the garbage.
    
    @item --delete
    @itemx -d
    Attempt to delete all the store files and directories specified as
    arguments.  This fails if some of the files are not in the store, or if
    they are still live.
    
    @item --list-dead
    Show the list of dead files and directories still present in the
    store---i.e., files and directories no longer reachable from any root.
    
    @item --list-live
    Show the list of live store files and directories.
    
    
    @end table
    
    In addition, the references among existing store files can be queried:
    
    @table @code
    
    @item --references
    @itemx --referrers
    List the references (respectively, the referrers) of store files given
    as arguments.
    
    
    @item --requisites
    @itemx -R
    List the requisites of the store files passed as arguments.  Requisites
    include the store files themselves, their references, and the references
    of these, recursively.  In other words, the returned list is the
    @dfn{transitive closure} of the store files.
    
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @end table
    
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @node Invoking guix pull
    @section Invoking @command{guix pull}
    
    Packages are installed or upgraded to the latest version available in
    the distribution currently available on your local machine.  To update
    that distribution, along with the Guix tools, you must run @command{guix
    pull}: the command downloads the latest Guix source code and package
    descriptions, and deploys it.
    
    On completion, @command{guix package} will use packages and package
    versions from this just-retrieved copy of Guix.  Not only that, but all
    the Guix commands and Scheme modules will also be taken from that latest
    version.  New @command{guix} sub-commands added by the update also
    become available.
    
    The @command{guix pull} command is usually invoked with no arguments,
    but it supports the following options:
    
    @table @code
    @item --verbose
    Produce verbose output, writing build logs to the standard error output.
    
    
    @item --url=@var{url}
    Download the source tarball of Guix from @var{url}.
    
    By default, the tarball is taken from its canonical address at
    @code{gnu.org}, for the stable branch of Guix.
    
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @item --bootstrap
    Use the bootstrap Guile to build the latest Guix.  This option is only
    useful to Guix developers.
    @end table
    
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    
    @node Invoking guix archive
    @section Invoking @command{guix archive}
    
    The @command{guix archive} command allows users to @dfn{export} files
    from the store into a single archive, and to later @dfn{import} them.
    In particular, it allows store files to be transferred from one machine
    to another machine's store.  For example, to transfer the @code{emacs}
    package to a machine connected over SSH, one would run:
    
    @example
    
    guix archive --export -r emacs | ssh the-machine guix archive --import
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @end example
    
    
    @noindent
    
    Similarly, a complete user profile may be transferred from one machine
    to another like this:
    
    @example
    guix archive --export -r $(readlink -f ~/.guix-profile) | \
      ssh the-machine guix-archive --import
    @end example
    
    @noindent
    However, note that, in both examples, all of @code{emacs} and the
    profile as well as all of their dependencies are transferred (due to
    @code{-r}), regardless of what is already available in the target
    machine's store.  The @code{--missing} option can help figure out which
    items are missing from the target's store.
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    Archives are stored in the ``Nix archive'' or ``Nar'' format, which is
    
    comparable in spirit to `tar', but with a few noteworthy differences
    that make it more appropriate for our purposes.  First, rather than
    recording all Unix meta-data for each file, the Nar format only mentions
    the file type (regular, directory, or symbolic link); Unix permissions
    and owner/group are dismissed.  Second, the order in which directory
    entries are stored always follows the order of file names according to
    the C locale collation order.  This makes archive production fully
    deterministic.
    
    When exporting, the daemon digitally signs the contents of the archive,
    and that digital signature is appended.  When importing, the daemon
    verifies the signature and rejects the import in case of an invalid
    signature or if the signing key is not authorized.
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @c FIXME: Add xref to daemon doc about signatures.
    
    The main options are:
    
    @table @code
    @item --export
    Export the specified store files or packages (see below.)  Write the
    resulting archive to the standard output.
    
    
    Dependencies are @emph{not} included in the output, unless
    @code{--recursive} is passed.
    
    @item -r
    @itemx --recursive
    When combined with @code{--export}, this instructs @command{guix
    archive} to include dependencies of the given items in the archive.
    Thus, the resulting archive is self-contained: it contains the closure
    of the exported store items.
    
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @item --import
    Read an archive from the standard input, and import the files listed
    therein into the store.  Abort if the archive has an invalid digital
    
    signature, or if it is signed by a public key not among the authorized
    keys (see @code{--authorize} below.)
    
    @item --missing
    Read a list of store file names from the standard input, one per line,
    and write on the standard output the subset of these files missing from
    the store.
    
    
    @item --generate-key[=@var{parameters}]
    
    @cindex signing, archives
    
    Generate a new key pair for the daemons.  This is a prerequisite before
    archives can be exported with @code{--export}.  Note that this operation
    usually takes time, because it needs to gather enough entropy to
    generate the key pair.
    
    The generated key pair is typically stored under @file{/etc/guix}, in
    @file{signing-key.pub} (public key) and @file{signing-key.sec} (private
    
    key, which must be kept secret.)  When @var{parameters} is omitted,
    an ECDSA key using the Ed25519 curve is generated, or, for Libgcrypt
    versions before 1.6.0, it is a 4096-bit RSA key.
    Alternately, @var{parameters} can specify
    
    @code{genkey} parameters suitable for Libgcrypt (@pxref{General
    public-key related Functions, @code{gcry_pk_genkey},, gcrypt, The
    Libgcrypt Reference Manual}).
    
    
    @item --authorize
    @cindex authorizing, archives
    Authorize imports signed by the public key passed on standard input.
    The public key must be in ``s-expression advanced format''---i.e., the
    same format as the @file{signing-key.pub} file.
    
    The list of authorized keys is kept in the human-editable file
    @file{/etc/guix/acl}.  The file contains
    @url{http://people.csail.mit.edu/rivest/Sexp.txt, ``advanced-format
    s-expressions''} and is structured as an access-control list in the
    @url{http://theworld.com/~cme/spki.txt, Simple Public-Key Infrastructure
    (SPKI)}.
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @end table
    
    To export store files as an archive to the standard output, run:
    
    @example
    guix archive --export @var{options} @var{specifications}...
    @end example
    
    @var{specifications} may be either store file names or package
    specifications, as for @command{guix package} (@pxref{Invoking guix
    package}).  For instance, the following command creates an archive
    containing the @code{gui} output of the @code{git} package and the main
    output of @code{emacs}:
    
    @example
    
    guix archive --export git:gui /gnu/store/...-emacs-24.3 > great.nar
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    @end example
    
    If the specified packages are not built yet, @command{guix archive}
    automatically builds them.  The build process may be controlled with the
    same options that can be passed to the @command{guix build} command
    
    (@pxref{Invoking guix build, common build options}).
    
    @c *********************************************************************
    @node Programming Interface
    @chapter Programming Interface
    
    
    GNU Guix provides several Scheme programming interfaces (APIs) to
    define, build, and query packages.  The first interface allows users to
    write high-level package definitions.  These definitions refer to
    familiar packaging concepts, such as the name and version of a package,
    its build system, and its dependencies.  These definitions can then be
    turned into concrete build actions.
    
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    Build actions are performed by the Guix daemon, on behalf of users.  In a
    
    standard setup, the daemon has write access to the store---the
    
    @file{/gnu/store} directory---whereas users do not.  The recommended
    
    setup also has the daemon perform builds in chroots, under a specific
    build users, to minimize interference with the rest of the system.
    
    @cindex derivation
    Lower-level APIs are available to interact with the daemon and the
    store.  To instruct the daemon to perform a build action, users actually
    provide it with a @dfn{derivation}.  A derivation is a low-level
    representation of the build actions to be taken, and the environment in
    which they should occur---derivations are to package definitions what
    
    assembly is to C programs.  The term ``derivation'' comes from the fact
    that build results @emph{derive} from them.
    
    
    This chapter describes all these APIs in turn, starting from high-level
    package definitions.
    
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    * Defining Packages::           Defining new packages.
    
    * Build Systems::               Specifying how packages are built.
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    * The Store::                   Manipulating the package store.
    * Derivations::                 Low-level interface to package derivations.
    * The Store Monad::             Purely functional interface to the store.
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    * G-Expressions::               Manipulating build expressions.
    
    @end menu
    
    @node Defining Packages
    @section Defining Packages
    
    
    The high-level interface to package definitions is implemented in the
    @code{(guix packages)} and @code{(guix build-system)} modules.  As an
    example, the package definition, or @dfn{recipe}, for the GNU Hello
    package looks like this:
    
    @example
    
    (define-module (gnu packages hello)
      #:use-module (guix packages)
      #:use-module (guix download)
      #:use-module (guix build-system gnu)
      #:use-module (guix licenses))
    
      (package
        (name "hello")
        (version "2.8")
        (source (origin
                 (method url-fetch)
                 (uri (string-append "mirror://gnu/hello/hello-" version
                                     ".tar.gz"))
                 (sha256
                  (base32 "0wqd8sjmxfskrflaxywc7gqw7sfawrfvdxd9skxawzfgyy0pzdz6"))))
        (build-system gnu-build-system)
    
        (arguments `(#:configure-flags '("--enable-silent-rules")))
    
        (inputs `(("gawk" ,gawk)))
    
        (synopsis "Hello, GNU world: An example GNU package")
        (description "Guess what GNU Hello prints!")
    
        (home-page "http://www.gnu.org/software/hello/")
    
    @end example
    
    @noindent
    Without being a Scheme expert, the reader may have guessed the meaning
    
    of the various fields here.  This expression binds variable @code{hello}
    
    to a @code{<package>} object, which is essentially a record
    (@pxref{SRFI-9, Scheme records,, guile, GNU Guile Reference Manual}).
    This package object can be inspected using procedures found in the
    @code{(guix packages)} module; for instance, @code{(package-name hello)}
    returns---surprise!---@code{"hello"}.
    
    
    With luck, you may be able to import part or all of the definition of
    the package you are interested in from another repository, using the
    @code{guix import} command (@pxref{Invoking guix import}).
    
    
    In the example above, @var{hello} is defined into a module of its own,
    @code{(gnu packages hello)}.  Technically, this is not strictly
    necessary, but it is convenient to do so: all the packages defined in
    modules under @code{(gnu packages @dots{})} are automatically known to
    the command-line tools (@pxref{Package Modules}).
    
    
    There are a few points worth noting in the above package definition:
    
    @itemize
    @item
    The @code{source} field of the package is an @code{<origin>} object.
    Here, the @code{url-fetch} method from @code{(guix download)} is used,
    meaning that the source is a file to be downloaded over FTP or HTTP.
    
    The @code{mirror://gnu} prefix instructs @code{url-fetch} to use one of
    the GNU mirrors defined in @code{(guix download)}.
    
    The @code{sha256} field specifies the expected SHA256 hash of the file
    being downloaded.  It is mandatory, and allows Guix to check the
    integrity of the file.  The @code{(base32 @dots{})} form introduces the
    
    Nikita Karetnikov's avatar
    Nikita Karetnikov committed
    base32 representation of the hash.  You can obtain this information with
    
    @code{guix download} (@pxref{Invoking guix download}) and @code{guix
    hash} (@pxref{Invoking guix hash}).
    
    @cindex patches
    When needed, the @code{origin} form can also have a @code{patches} field
    listing patches to be applied, and a @code{snippet} field giving a
    Scheme expression to modify the source code.
    
    
    @item
    @cindex GNU Build System
    
    The @code{build-system} field specifies the procedure to build the
    package (@pxref{Build Systems}).  Here, @var{gnu-build-system}
    represents the familiar GNU Build System, where packages may be
    configured, built, and installed with the usual @code{./configure &&
    make && make check && make install} command sequence.
    
    @item
    The @code{arguments} field specifies options for the build system
    (@pxref{Build Systems}).  Here it is interpreted by
    @var{gnu-build-system} as a request run @file{configure} with the
    @code{--enable-silent-rules} flag.
    
    
    @item
    The @code{inputs} field specifies inputs to the build process---i.e.,
    build-time or run-time dependencies of the package.  Here, we define an
    input called @code{"gawk"} whose value is that of the @var{gawk}
    variable; @var{gawk} is itself bound to a @code{<package>} object.
    
    Note that GCC, Coreutils, Bash, and other essential tools do not need to
    be specified as inputs here.  Instead, @var{gnu-build-system} takes care
    
    of ensuring that they are present (@pxref{Build Systems}).
    
    
    However, any other dependencies need to be specified in the
    @code{inputs} field.  Any dependency not specified here will simply be
    unavailable to the build process, possibly leading to a build failure.
    @end itemize
    
    
    Once a package definition is in place, the
    
    package may actually be built using the @code{guix build} command-line
    
    tool (@pxref{Invoking guix build}).  @xref{Packaging Guidelines}, for
    
    Cyril Roelandt's avatar
    Cyril Roelandt committed
    more information on how to test package definitions, and
    @ref{Invoking guix lint}, for information on how to check a definition
    for style conformance.
    
    
    Eventually, updating the package definition to a new upstream version
    can be partly automated by the @command{guix refresh} command
    (@pxref{Invoking guix refresh}).
    
    
    Behind the scenes, a derivation corresponding to the @code{<package>}
    object is first computed by the @code{package-derivation} procedure.
    
    That derivation is stored in a @code{.drv} file under @file{/gnu/store}.
    
    Ludovic Courtès's avatar
    Ludovic Courtès committed
    The build actions it prescribes may then be realized by using the
    
    @code{build-derivations} procedure (@pxref{The Store}).
    
    @deffn {Scheme Procedure} package-derivation @var{store} @var{package} [@var{system}]
    
    Return the @code{<derivation>} object of @var{package} for @var{system}
    (@pxref{Derivations}).
    
    
    @var{package} must be a valid @code{<package>} object, and @var{system}
    must be a string denoting the target system type---e.g.,
    @code{"x86_64-linux"} for an x86_64 Linux-based GNU system.  @var{store}
    must be a connection to the daemon, which operates on the store
    (@pxref{The Store}).
    @end deffn
    
    @noindent
    @cindex cross-compilation
    Similarly, it is possible to compute a derivation that cross-builds a
    package for some other system:
    
    @deffn {Scheme Procedure} package-cross-derivation @var{store} @
                @var{package} @var{target} [@var{system}]
    
    Return the @code{<derivation>} object of @var{package} cross-built from
    @var{system} to @var{target}.
    
    
    @var{target} must be a valid GNU triplet denoting the target hardware
    and operating system, such as @code{"mips64el-linux-gnu"}
    (@pxref{Configuration Names, GNU configuration triplets,, configure, GNU
    Configure and Build System}).
    @end deffn
    
    
    
    @node Build Systems
    @section Build Systems
    
    @cindex build system
    Each package definition specifies a @dfn{build system} and arguments for
    that build system (@pxref{Defining Packages}).  This @code{build-system}
    field represents the build procedure of the package, as well implicit
    dependencies of that build procedure.
    
    Build systems are @code{<build-system>} objects.  The interface to
    create and manipulate them is provided by the @code{(guix build-system)}
    module, and actual build systems are exported by specific modules.
    
    
    @cindex bag (low-level package representation)
    
    Under the hood, build systems first compile package objects to
    @dfn{bags}.  A @dfn{bag} is like a package, but with less
    ornamentation---in other words, a bag is a lower-level representation of
    a package, which includes all the inputs of that package, including some
    that were implicitly added by the build system.  This intermediate
    representation is then compiled to a derivation (@pxref{Derivations}).
    
    
    Build systems accept an optional list of @dfn{arguments}.  In package
    definitions, these are passed @i{via} the @code{arguments} field
    (@pxref{Defining Packages}).  They are typically keyword arguments
    (@pxref{Optional Arguments, keyword arguments in Guile,, guile, GNU
    Guile Reference Manual}).  The value of these arguments is usually
    evaluated in the @dfn{build stratum}---i.e., by a Guile process launched
    by the daemon (@pxref{Derivations}).
    
    The main build system is @var{gnu-build-system}, which implements the
    standard build procedure for GNU packages and many other packages.  It
    is provided by the @code{(guix build-system gnu)} module.
    
    @defvr {Scheme Variable} gnu-build-system
    @var{gnu-build-system} represents the GNU Build System, and variants
    thereof (@pxref{Configuration, configuration and makefile conventions,,
    standards, GNU Coding Standards}).
    
    @cindex build phases
    In a nutshell, packages using it configured, built, and installed with
    the usual @code{./configure && make && make check && make install}
    command sequence.  In practice, a few additional steps are often needed.
    All these steps are split up in separate @dfn{phases},
    notably@footnote{Please see the @code{(guix build gnu-build-system)}
    modules for more details about the build phases.}:
    
    @table @code
    @item unpack
    Unpack the source tarball, and change the current directory to the
    extracted source tree.  If the source is actually a directory, copy it
    to the build tree, and enter that directory.
    
    @item patch-source-shebangs
    Patch shebangs encountered in source files so they refer to the right
    store file names.  For instance, this changes @code{#!/bin/sh} to
    @code{#!/gnu/store/@dots{}-bash-4.3/bin/sh}.
    
    @item configure
    Run the @file{configure} script with a number of default options, such
    as @code{--prefix=/gnu/store/@dots{}}, as well as the options specified
    by the @code{#:configure-flags} argument.
    
    @item build
    Run @code{make} with the list of flags specified with
    @code{#:make-flags}.  If the @code{#:parallel-builds?} argument is true
    (the default), build with @code{make -j}.
    
    @item check
    Run @code{make check}, or some other target specified with
    @code{#:test-target}, unless @code{#:tests? #f} is passed.  If the
    @code{#:parallel-tests?} argument is true (the default), run @code{make
    check -j}.
    
    @item install
    Run @code{make install} with the flags listed in @code{#:make-flags}.
    
    @item patch-shebangs
    Patch shebangs on the installed executable files.
    
    @item strip
    Strip debugging symbols from ELF files (unless @code{#:strip-binaries?}
    is false), copying them to the @code{debug} output when available
    (@pxref{Installing Debugging Files}).
    @end table
    
    @vindex %standard-phases
    The build-side module @code{(guix build gnu-build-system)} defines
    @var{%standard-phases} as the default list of build phases.
    @var{%standard-phases} is a list of symbol/procedure pairs, where the
    procedure implements the actual phase.
    
    The list of phases used for a particular package can be changed with the
    @code{#:phases} parameter.  For instance, passing:
    
    @example
    #:phases (alist-delete 'configure %standard-phases)
    @end example
    
    
    Alírio Eyng's avatar
    Alírio Eyng committed
    means that all the phases described above will be used, except the
    
    @code{configure} phase.
    
    In addition, this build system ensures that the ``standard'' environment
    for GNU packages is available.  This includes tools such as GCC, libc,
    Coreutils, Bash, Make, Diffutils, grep, and sed (see the @code{(guix
    build-system gnu)} module for a complete list.)  We call these the
    @dfn{implicit inputs} of a package, because package definitions don't
    have to mention them.
    @end defvr
    
    Other @code{<build-system>} objects are defined to support other
    conventions and tools used by free software packages.  They inherit most
    of @var{gnu-build-system}, and differ mainly in the set of inputs
    implicitly added to the build process, and in the list of phases
    executed.  Some of these build systems are listed below.
    
    @defvr {Scheme Variable} cmake-build-system
    This variable is exported by @code{(guix build-system cmake)}.  It
    implements the build procedure for packages using the
    @url{http://www.cmake.org, CMake build tool}.
    
    It automatically adds the @code{cmake} package to the set of inputs.
    Which package is used can be specified with the @code{#:cmake}
    parameter.
    
    
    The @code{#:configure-flags} parameter is taken as a list of flags
    passed to the @command{cmake} command.  The @code{#:build-type}
    parameter specifies in abstract terms the flags passed to the compiler;
    it defaults to @code{"RelWithDebInfo"} (short for ``release mode with
    debugging information''), which roughly means that code is compiled with
    @code{-O2 -g}, as is the case for Autoconf-based packages by default.
    
    @defvr {Scheme Variable} glib-or-gtk-build-system
    This variable is exported by @code{(guix build-system glib-or-gtk)}.  It
    is intended for use with packages making use of GLib or GTK+.
    
    This build system adds the following two phases to the ones defined by
    @var{gnu-build-system}:
    
    @table @code
    @item glib-or-gtk-wrap
    The phase @code{glib-or-gtk-wrap} ensures that programs found under
    @file{bin/} are able to find GLib's ``schemas'' and
    @uref{https://developer.gnome.org/gtk3/stable/gtk-running.html, GTK+
    modules}.  This is achieved by wrapping the programs in launch scripts
    that appropriately set the @code{XDG_DATA_DIRS} and @code{GTK_PATH}
    environment variables.
    
    
    It is possible to exclude specific package outputs from that wrapping
    process by listing their names in the
    @code{#:glib-or-gtk-wrap-excluded-outputs} parameter.  This is useful
    when an output is known not to contain any GLib or GTK+ binaries, and
    where wrapping would gratuitously add a dependency of that output on
    GLib and GTK+.
    
    
    @item glib-or-gtk-compile-schemas
    The phase @code{glib-or-gtk-compile-schemas} makes sure that all GLib's
    @uref{https://developer.gnome.org/gio/stable/glib-compile-schemas.html,
    GSettings schemas} are compiled.  Compilation is performed by the
    @command{glib-compile-schemas} program.  It is provided by the package
    @code{glib:bin} which is automatically imported by the build system.
    The @code{glib} package providing @command{glib-compile-schemas} can be
    specified with the @code{#:glib} parameter.
    @end table
    
    Both phases are executed after the @code{install} phase.
    @end defvr
    
    
    @defvr {Scheme Variable} python-build-system
    This variable is exported by @code{(guix build-system python)}.  It
    implements the more or less standard build procedure used by Python
    packages, which consists in running @code{python setup.py build} and
    then @code{python setup.py install --prefix=/gnu/store/@dots{}}.
    
    For packages that install stand-alone Python programs under @code{bin/},
    it takes care of wrapping these programs so their @code{PYTHONPATH}
    environment variable points to all the Python libraries they depend on.
    
    Which Python package is used can be specified with the @code{#:python}
    parameter.
    @end defvr
    
    @defvr {Scheme Variable} perl-build-system
    This variable is exported by @code{(guix build-system perl)}.  It
    
    implements the standard build procedure for Perl packages, which either
    consists in running @code{perl Build.PL --prefix=/gnu/store/@dots{}},
    followed by @code{Build} and @code{Build install}; or in running
    @code{perl Makefile.PL PREFIX=/gnu/store/@dots{}}, followed by
    @code{make} and @code{make install}; depending on which of
    @code{Build.PL} or @code{Makefile.PL} is present in the package
    distribution.  Preference is given to the former if both @code{Build.PL}
    and @code{Makefile.PL} exist in the package distribution.  This
    preference can be reversed by specifying @code{#t} for the
    @code{#:make-maker?} parameter.
    
    The initial @code{perl Makefile.PL} or @code{perl Build.PL} invocation
    passes flags specified by the @code{#:make-maker-flags} or
    @code{#:module-build-flags} parameter, respectively.
    
    
    Which Perl package is used can be specified with @code{#:perl}.
    @end defvr
    
    
    @defvr {Scheme Variable} ruby-build-system
    This variable is exported by @code{(guix build-system ruby)}.  It
    implements the RubyGems build procedure used by Ruby packages, which
    involves running @code{gem build} followed by @code{gem install}.
    
    Which Ruby package is used can be specified with the @code{#:ruby}
    parameter.
    @end defvr
    
    @defvr {Scheme Variable} waf-build-system
    This variable is exported by @code{(guix build-system waf)}.  It
    implements a build procedure around the @code{waf} script.  The common
    phases---@code{configure}, @code{build}, and @code{install}---are
    implemented by passing their names as arguments to the @code{waf}
    script.
    
    The @code{waf} script is executed by the Python interpreter.  Which
    Python package is used to run the script can be specified with the
    @code{#:python} parameter.
    @end defvr
    
    
    Lastly, for packages that do not need anything as sophisticated, a
    ``trivial'' build system is provided.  It is trivial in the sense that
    it provides basically no support: it does not pull any implicit inputs,
    and does not have a notion of build phases.
    
    @defvr {Scheme Variable} trivial-build-system
    This variable is exported by @code{(guix build-system trivial)}.
    
    This build system requires a @code{#:builder} argument.  This argument
    must be a Scheme expression that builds the package's output(s)---as
    with @code{build-expression->derivation} (@pxref{Derivations,
    @code{build-expression->derivation}}).
    @end defvr
    
    
    @node The Store
    @section The Store
    
    
    @cindex store
    @cindex store paths
    
    Conceptually, the @dfn{store} is where derivations that have been
    
    successfully built are stored---by default, under @file{/gnu/store}.
    
    Sub-directories in the store are referred to as @dfn{store paths}.  The
    store has an associated database that contains information such has the
    store paths referred to by each store path, and the list of @emph{valid}
    store paths---paths that result from a successful build.
    
    The store is always accessed by the daemon on behalf of its clients
    (@pxref{Invoking guix-daemon}).  To manipulate the store, clients
    connect to the daemon over a Unix-domain socket, send it requests, and
    read the result---these are remote procedure calls, or RPCs.
    
    The @code{(guix store)} module provides procedures to connect to the
    daemon, and to perform RPCs.  These are described below.
    
    @deffn {Scheme Procedure} open-connection [@var{file}] [#:reserve-space? #t]