2021-01-01 17:45:43 +00:00
# Rust {#rust}
2017-03-20 19:41:37 +00:00
To install the rust compiler and cargo put
2021-03-13 23:30:36 +00:00
```nix
2024-03-27 18:10:27 +00:00
{
environment.systemPackages = [
rustc
cargo
];
}
2017-03-20 19:41:37 +00:00
```
2021-03-13 23:30:36 +00:00
into your `configuration.nix` or bring them into scope with `nix-shell -p rustc cargo` .
2017-03-20 19:41:37 +00:00
2020-08-11 11:21:25 +01:00
For other versions such as daily builds (beta and nightly),
use either `rustup` from nixpkgs (which will manage the rust installation in your home directory),
2023-03-04 02:00:54 +00:00
or use [community maintained Rust toolchains ](#using-community-maintained-rust-toolchains ).
2017-03-20 19:41:37 +00:00
2022-08-22 22:37:41 +01:00
## `buildRustPackage`: Compiling Rust applications with Cargo {#compiling-rust-applications-with-cargo}
2017-03-20 19:41:37 +00:00
Rust applications are packaged by using the `buildRustPackage` helper from `rustPlatform` :
2021-03-13 23:30:36 +00:00
```nix
2021-09-19 14:29:06 +01:00
{ lib, fetchFromGitHub, rustPlatform }:
2021-01-21 00:07:16 +00:00
2017-11-17 07:26:51 +00:00
rustPlatform.buildRustPackage rec {
2020-01-12 17:19:57 +00:00
pname = "ripgrep";
2020-12-03 08:39:39 +00:00
version = "12.1.1";
2017-03-20 19:41:37 +00:00
src = fetchFromGitHub {
owner = "BurntSushi";
2020-01-12 17:19:57 +00:00
repo = pname;
rev = version;
doc: use sri hash syntax
The nixpkgs manual contains references to both sri hash and explicit
sha256 attributes. This is at best confusing to new users. Since the
final destination is exclusive use of sri hashes, see nixos/rfcs#131,
might as well push new users in that direction gently.
Notable exceptions to sri hash support are builtins.fetchTarball,
cataclysm-dda, coq, dockerTools.pullimage, elixir.override, and
fetchCrate. None, other than builtins.fetchTarball, are fundamentally
incompatible, but all currently accept explicit sha256 attributes as
input. Because adding backwards compatibility is out of scope for this
change, they have been left intact, but migration to sri format has been
made for any using old hash formats.
All hashes have been manually tested to be accurate, and updates were
only made for missing upstream artefacts or bugs.
2022-12-03 19:49:00 +00:00
hash = "sha256-+s5RBC3XSgb8omTbUNLywZnP6jSxZBKSS1BmXOjRF8M=";
2017-03-20 19:41:37 +00:00
};
doc: use sri hash syntax
The nixpkgs manual contains references to both sri hash and explicit
sha256 attributes. This is at best confusing to new users. Since the
final destination is exclusive use of sri hashes, see nixos/rfcs#131,
might as well push new users in that direction gently.
Notable exceptions to sri hash support are builtins.fetchTarball,
cataclysm-dda, coq, dockerTools.pullimage, elixir.override, and
fetchCrate. None, other than builtins.fetchTarball, are fundamentally
incompatible, but all currently accept explicit sha256 attributes as
input. Because adding backwards compatibility is out of scope for this
change, they have been left intact, but migration to sri format has been
made for any using old hash formats.
All hashes have been manually tested to be accurate, and updates were
only made for missing upstream artefacts or bugs.
2022-12-03 19:49:00 +00:00
cargoHash = "sha256-jtBw4ahSl88L0iuCXxQgZVm1EcboWRJMNtjxLVTtzts=";
2017-03-20 19:41:37 +00:00
Nix docs: remove `with lib;` from example code
Following [Best Practices](https://nix.dev/guides/best-practices#with-scopes),
`with` is a problematic language construction and should be avoided.
Usually it is employed like a "factorization": `[ X.A X.B X.C X.D ]` is written
`with X; [ A B C D ]`.
However, as shown in the link above, the syntatical rules of `with` are not so
intuitive, and this "distributive rule" is very selective, in the sense that
`with X; [ A B C D ]` is not equivalent to `[ X.A X.B X.C X.D ]`.
However, this factorization is still useful to "squeeze" some code, especially
in lists like `meta.maintainers`.
On the other hand, it becomes less justifiable in bigger scopes. This is
especially true in cases like `with lib;` in the top of expression and in sets
like `meta = with lib; { . . . }`.
That being said, this patch removes most of example code in the current
documentation.
The exceptions are, for now
- doc/functions/generators.section.md
- doc/languages-frameworks/coq.section.md
because, well, they are way more complicated, and I couldn't parse them
mentally - yet another reason why `with` should be avoided!
2024-03-06 11:51:54 +00:00
meta = {
2024-07-20 08:08:30 +01:00
description = "Fast line-oriented regex search tool, similar to ag and ack";
2020-02-16 16:31:03 +00:00
homepage = "https://github.com/BurntSushi/ripgrep";
Nix docs: remove `with lib;` from example code
Following [Best Practices](https://nix.dev/guides/best-practices#with-scopes),
`with` is a problematic language construction and should be avoided.
Usually it is employed like a "factorization": `[ X.A X.B X.C X.D ]` is written
`with X; [ A B C D ]`.
However, as shown in the link above, the syntatical rules of `with` are not so
intuitive, and this "distributive rule" is very selective, in the sense that
`with X; [ A B C D ]` is not equivalent to `[ X.A X.B X.C X.D ]`.
However, this factorization is still useful to "squeeze" some code, especially
in lists like `meta.maintainers`.
On the other hand, it becomes less justifiable in bigger scopes. This is
especially true in cases like `with lib;` in the top of expression and in sets
like `meta = with lib; { . . . }`.
That being said, this patch removes most of example code in the current
documentation.
The exceptions are, for now
- doc/functions/generators.section.md
- doc/languages-frameworks/coq.section.md
because, well, they are way more complicated, and I couldn't parse them
mentally - yet another reason why `with` should be avoided!
2024-03-06 11:51:54 +00:00
license = lib.licenses.unlicense;
2024-07-30 15:21:42 +01:00
maintainers = [ ];
2017-03-20 19:41:37 +00:00
};
}
```
2024-07-03 14:14:55 +01:00
`buildRustPackage` requires a `cargoHash` attribute, computed over all crate sources of this package.
::: {.warning}
`cargoSha256` is already deprecated, and is subject to removal in favor of
`cargoHash` which supports [SRI ](https://www.w3.org/TR/SRI/ ) hashes.
If you are still using `cargoSha256` , you can simply replace it with
`cargoHash` and recompute the hash, or convert the original sha256 to SRI
hash using `nix-hash --to-sri --type sha256 "<original sha256>"` .
:::
2023-12-22 01:01:17 +00:00
```nix
2024-03-27 18:10:27 +00:00
{
2023-12-22 01:01:17 +00:00
cargoHash = "sha256-l1vL2ZdtDRxSGvP0X/l3nMw8+6WF67KPutJEzUROjg8=";
2024-03-27 18:10:27 +00:00
}
2023-12-22 01:01:17 +00:00
```
2020-12-03 08:39:39 +00:00
2024-07-03 14:14:55 +01:00
Exception: If the application has cargo `git` dependencies, the `cargoHash`
2024-11-12 17:22:59 +00:00
approach will not work by default. In this case, you can set `useFetchCargoVendor = true`
to use an improved fetcher that supports handling `git` dependencies.
2023-03-25 23:25:35 +00:00
2024-11-12 17:22:59 +00:00
```nix
{
useFetchCargoVendor = true;
cargoHash = "sha256-RqPVFovDaD2rW31HyETJfQ0qVwFxoGEvqkIgag3H6KU=";
}
```
If this method still does not work, you can resort to copying the `Cargo.lock` file into nixpkgs
and importing it as described in the [next section ](#importing-a-cargo.lock-file ).
2020-12-03 08:39:39 +00:00
Both types of hashes are permitted when contributing to nixpkgs. The
Cargo hash is obtained by inserting a fake checksum into the
expression and building the package once. The correct checksum can
then be taken from the failed build. A fake hash can be used for
2024-02-08 23:41:32 +00:00
`cargoHash` as follows:
2020-12-03 08:39:39 +00:00
2021-03-13 23:30:36 +00:00
```nix
2024-03-27 18:10:27 +00:00
{
2024-02-08 23:41:32 +00:00
cargoHash = lib.fakeHash;
2024-03-27 18:10:27 +00:00
}
2020-12-03 08:39:39 +00:00
```
2020-02-16 07:33:02 +00:00
Per the instructions in the [Cargo Book ](https://doc.rust-lang.org/cargo/guide/cargo-toml-vs-cargo-lock.html )
best practices guide, Rust applications should always commit the `Cargo.lock`
file in git to ensure a reproducible build. However, a few packages do not, and
2021-02-24 08:25:49 +00:00
Nix depends on this file, so if it is missing you can use `cargoPatches` to
apply it in the `patchPhase` . Consider sending a PR upstream with a note to the
2020-02-16 07:33:02 +00:00
maintainer describing why it's important to include in the application.
2018-08-14 03:20:30 +01:00
2020-03-19 00:43:07 +00:00
The fetcher will verify that the `Cargo.lock` file is in sync with the `src`
attribute, and fail the build if not. It will also will compress the vendor
directory into a tar.gz archive.
2019-08-24 13:29:47 +01:00
2021-02-15 06:06:31 +00:00
The tarball with vendored dependencies contains a directory with the
package's `name` , which is normally composed of `pname` and
`version` . This means that the vendored dependencies hash
2024-07-03 14:14:55 +01:00
(`cargoHash`) is dependent on the package name and
2021-02-15 06:06:31 +00:00
version. The `cargoDepsName` attribute can be used to use another name
for the directory of vendored dependencies. For example, the hash can
be made invariant to the version by setting `cargoDepsName` to
`pname` :
```nix
rustPlatform.buildRustPackage rec {
pname = "broot";
version = "1.2.0";
src = fetchCrate {
inherit pname version;
2023-09-13 14:22:37 +01:00
hash = "sha256-aDQA4A5mScX9or3Lyiv/5GyAehidnpKKE0grhbP1Ctc=";
2021-02-15 06:06:31 +00:00
};
doc: use sri hash syntax
The nixpkgs manual contains references to both sri hash and explicit
sha256 attributes. This is at best confusing to new users. Since the
final destination is exclusive use of sri hashes, see nixos/rfcs#131,
might as well push new users in that direction gently.
Notable exceptions to sri hash support are builtins.fetchTarball,
cataclysm-dda, coq, dockerTools.pullimage, elixir.override, and
fetchCrate. None, other than builtins.fetchTarball, are fundamentally
incompatible, but all currently accept explicit sha256 attributes as
input. Because adding backwards compatibility is out of scope for this
change, they have been left intact, but migration to sri format has been
made for any using old hash formats.
All hashes have been manually tested to be accurate, and updates were
only made for missing upstream artefacts or bugs.
2022-12-03 19:49:00 +00:00
cargoHash = "sha256-tbrTbutUs5aPSV+yE0IBUZAAytgmZV7Eqxia7g+9zRs=";
2021-02-15 06:06:31 +00:00
cargoDepsName = pname;
# ...
}
```
2021-06-05 20:22:45 +01:00
### Importing a `Cargo.lock` file {#importing-a-cargo.lock-file}
2021-05-08 06:44:31 +01:00
2024-07-03 14:14:55 +01:00
Using a vendored hash (`cargoHash`) is tedious when using
2021-05-08 06:44:31 +01:00
`buildRustPackage` within a project, since it requires that the hash
is updated after every change to `Cargo.lock` . Therefore,
`buildRustPackage` also supports vendoring dependencies directly from
a `Cargo.lock` file using the `cargoLock` argument. For example:
```nix
2021-09-22 11:20:24 +01:00
rustPlatform.buildRustPackage {
2021-05-08 06:44:31 +01:00
pname = "myproject";
version = "1.0.0";
cargoLock = {
lockFile = ./Cargo.lock;
2021-09-21 12:48:25 +01:00
};
2021-05-08 06:44:31 +01:00
# ...
}
```
This will retrieve the dependencies using fixed-output derivations from
2021-09-21 12:48:25 +01:00
the specified lockfile.
2021-09-22 11:51:05 +01:00
One caveat is that `Cargo.lock` cannot be patched in the `patchPhase`
because it runs after the dependencies have already been fetched. If
you need to patch or generate the lockfile you can alternatively set
`cargoLock.lockFileContents` to a string of its contents:
2021-09-21 12:48:25 +01:00
```nix
2021-09-22 11:20:24 +01:00
rustPlatform.buildRustPackage {
2021-09-21 12:48:25 +01:00
pname = "myproject";
version = "1.0.0";
cargoLock = let
2021-09-21 13:58:40 +01:00
fixupLockFile = path: f (builtins.readFile path);
2021-09-21 12:48:25 +01:00
in {
lockFileContents = fixupLockFile ./Cargo.lock;
};
# ...
}
```
2024-09-06 20:26:47 +01:00
If the upstream source repository lacks a `Cargo.lock` file, you must add one
to `src` , as it is essential for building a Rust package. Setting
`cargoLock.lockFile` or `cargoLock.lockFileContents` will not automatically add
a `Cargo.lock` file to `src` . A straightforward solution is to use:
2021-08-01 22:01:13 +01:00
```nix
2024-03-27 18:10:27 +00:00
{
postPatch = ''
ln -s ${./Cargo.lock} Cargo.lock
'';
}
2021-08-01 22:01:13 +01:00
```
2021-05-08 06:44:31 +01:00
The output hash of each dependency that uses a git source must be
specified in the `outputHashes` attribute. For example:
```nix
rustPlatform.buildRustPackage rec {
pname = "myproject";
version = "1.0.0";
cargoLock = {
lockFile = ./Cargo.lock;
outputHashes = {
"finalfusion-0.14.0" = "17f4bsdzpcshwh74w5z119xjy2if6l2wgyjy56v621skr2r8y904";
};
2021-07-30 09:37:25 +01:00
};
2021-05-08 06:44:31 +01:00
# ...
}
```
If you do not specify an output hash for a git dependency, building
the package will fail and inform you of which crate needs to be
added. To find the correct hash, you can first use `lib.fakeSha256` or
`lib.fakeHash` as a stub hash. Building the package (and thus the
vendored dependencies) will then inform you of the correct hash.
2021-02-15 06:06:31 +00:00
2022-12-13 16:22:07 +00:00
For usage outside nixpkgs, `allowBuiltinFetchGit` could be used to
avoid having to specify `outputHashes` . For example:
```nix
rustPlatform.buildRustPackage rec {
pname = "myproject";
version = "1.0.0";
cargoLock = {
lockFile = ./Cargo.lock;
allowBuiltinFetchGit = true;
};
# ...
}
```
2021-10-27 14:24:19 +01:00
### Cargo features {#cargo-features}
You can disable default features using `buildNoDefaultFeatures` , and
extra features can be added with `buildFeatures` .
If you want to use different features for check phase, you can use
`checkNoDefaultFeatures` and `checkFeatures` . They are only passed to
`cargo test` and not `cargo build` . If left unset, they default to
`buildNoDefaultFeatures` and `buildFeatures` .
For example:
```nix
rustPlatform.buildRustPackage rec {
pname = "myproject";
version = "1.0.0";
buildNoDefaultFeatures = true;
buildFeatures = [ "color" "net" ];
# disable network features in tests
checkFeatures = [ "color" ];
# ...
}
```
2021-06-05 20:22:45 +01:00
### Cross compilation {#cross-compilation}
2020-10-14 04:37:29 +01:00
By default, Rust packages are compiled for the host platform, just like any
other package is. The `--target` passed to rust tools is computed from this.
By default, it takes the `stdenv.hostPlatform.config` and replaces components
where they are known to differ. But there are ways to customize the argument:
- To choose a different target by name, define
2024-06-13 19:00:43 +01:00
`stdenv.hostPlatform.rust.rustcTarget` as that name (a string), and that
2020-10-14 04:37:29 +01:00
name will be used instead.
For example:
2021-06-05 20:22:45 +01:00
2020-10-14 04:37:29 +01:00
```nix
import < nixpkgs > {
crossSystem = (import < nixpkgs / lib > ).systems.examples.armhf-embedded // {
2024-06-13 19:00:43 +01:00
rust.rustcTarget = "thumbv7em-none-eabi";
2020-10-14 04:37:29 +01:00
};
}
```
2021-06-05 20:22:45 +01:00
2020-10-14 04:37:29 +01:00
will result in:
2021-06-05 20:22:45 +01:00
2020-10-14 04:37:29 +01:00
```shell
--target thumbv7em-none-eabi
```
- To pass a completely custom target, define
2024-06-13 19:00:43 +01:00
`stdenv.hostPlatform.rust.rustcTarget` with its name, and
`stdenv.hostPlatform.rust.platform` with the value. The value will be
2020-10-14 04:37:29 +01:00
serialized to JSON in a file called
2024-06-13 19:00:43 +01:00
`${stdenv.hostPlatform.rust.rustcTarget}.json` , and the path of that file
2020-10-14 04:37:29 +01:00
will be used instead.
For example:
2021-06-05 20:22:45 +01:00
2020-10-14 04:37:29 +01:00
```nix
import < nixpkgs > {
crossSystem = (import < nixpkgs / lib > ).systems.examples.armhf-embedded // {
2024-06-13 19:00:43 +01:00
rust.rustcTarget = "thumb-crazy";
rust.platform = { foo = ""; bar = ""; };
2020-10-14 04:37:29 +01:00
};
}
2021-02-24 08:25:49 +00:00
```
2021-06-05 20:22:45 +01:00
2020-10-14 04:37:29 +01:00
will result in:
2021-06-05 20:22:45 +01:00
2020-10-14 04:37:29 +01:00
```shell
--target /nix/store/asdfasdfsadf-thumb-crazy.json # contains {"foo":"","bar":""}
```
2020-10-17 08:48:07 +01:00
Note that currently custom targets aren't compiled with `std` , so `cargo test`
will fail. This can be ignored by adding `doCheck = false;` to your derivation.
2021-06-05 20:22:45 +01:00
### Running package tests {#running-package-tests}
2020-05-24 17:37:34 +01:00
When using `buildRustPackage` , the `checkPhase` is enabled by default and runs
`cargo test` on the package to build. To make sure that we don't compile the
2020-07-31 06:06:53 +01:00
sources twice and to actually test the artifacts that will be used at runtime,
2020-05-31 19:47:32 +01:00
the tests will be ran in the `release` mode by default.
2020-05-24 17:37:34 +01:00
However, in some cases the test-suite of a package doesn't work properly in the
2020-05-31 19:47:32 +01:00
`release` mode. For these situations, the mode for `checkPhase` can be changed like
so:
2020-05-24 17:37:34 +01:00
```nix
rustPlatform.buildRustPackage {
/* ... */
checkType = "debug";
}
```
2020-05-31 19:47:32 +01:00
Please note that the code will be compiled twice here: once in `release` mode
for the `buildPhase` , and again in `debug` mode for the `checkPhase` .
2020-05-24 17:37:34 +01:00
2021-10-27 14:24:19 +01:00
Test flags, e.g., `--package foo` , can be passed to `cargo test` via the
2021-02-24 08:32:22 +00:00
`cargoTestFlags` attribute.
Another attribute, called `checkFlags` , is used to pass arguments to the test
binary itself, as stated
2021-12-18 13:05:46 +00:00
[here ](https://doc.rust-lang.org/cargo/commands/cargo-test.html ).
2021-02-24 08:32:22 +00:00
2021-06-05 20:22:45 +01:00
#### Tests relying on the structure of the `target/` directory {#tests-relying-on-the-structure-of-the-target-directory}
2020-05-31 19:47:32 +01:00
Some tests may rely on the structure of the `target/` directory. Those tests
are likely to fail because we use `cargo --target` during the build. This means that
2020-05-24 17:37:34 +01:00
the artifacts
2020-05-31 19:47:32 +01:00
[are stored in `target/<architecture>/release/` ](https://doc.rust-lang.org/cargo/guide/build-cache.html ),
rather than in `target/release/` .
2020-05-24 17:37:34 +01:00
2020-05-31 19:47:32 +01:00
This can only be worked around by patching the affected tests accordingly.
2020-05-24 17:37:34 +01:00
2021-06-05 20:22:45 +01:00
#### Disabling package-tests {#disabling-package-tests}
2020-05-24 17:37:34 +01:00
2020-05-31 19:47:32 +01:00
In some instances, it may be necessary to disable testing altogether (with `doCheck = false;` ):
2020-05-24 17:37:34 +01:00
2020-05-31 19:47:32 +01:00
* If no tests exist -- the `checkPhase` should be explicitly disabled to skip
unnecessary build steps to speed up the build.
* If tests are highly impure (e.g. due to network usage).
2020-05-24 17:37:34 +01:00
2020-05-31 19:47:32 +01:00
There will obviously be some corner-cases not listed above where it's sensible to disable tests.
The above are just guidelines, and exceptions may be granted on a case-by-case basis.
2020-05-24 17:37:34 +01:00
2020-05-31 19:47:32 +01:00
However, please check if it's possible to disable a problematic subset of the
test suite and leave a comment explaining your reasoning.
2020-05-24 17:37:34 +01:00
2022-12-17 23:21:48 +00:00
This can be achieved with `--skip` in `checkFlags` :
2022-10-31 21:39:34 +00:00
```nix
rustPlatform.buildRustPackage {
/* ... */
checkFlags = [
# reason for disabling test
"--skip=example::tests:example_test"
];
}
```
2022-11-28 22:25:46 +00:00
#### Using `cargo-nextest` {#using-cargo-nextest}
Tests can be run with [cargo-nextest ](https://github.com/nextest-rs/nextest )
by setting `useNextest = true` . The same options still apply, but nextest
accepts a different set of arguments and the settings might need to be
adapted to be compatible with cargo-nextest.
```nix
rustPlatform.buildRustPackage {
/* ... */
useNextest = true;
}
```
2021-06-05 20:22:45 +01:00
#### Setting `test-threads` {#setting-test-threads}
2020-09-09 12:39:23 +01:00
`buildRustPackage` will use parallel test threads by default,
sometimes it may be necessary to disable this so the tests run consecutively.
```nix
rustPlatform.buildRustPackage {
/* ... */
2021-02-15 09:26:40 +00:00
dontUseCargoParallelTests = true;
2020-09-09 12:39:23 +01:00
}
```
2021-06-05 20:22:45 +01:00
### Building a package in `debug` mode {#building-a-package-in-debug-mode}
2020-05-24 17:37:34 +01:00
2020-05-31 19:47:32 +01:00
By default, `buildRustPackage` will use `release` mode for builds. If a package
should be built in `debug` mode, it can be configured like so:
2020-05-24 17:37:34 +01:00
```nix
rustPlatform.buildRustPackage {
/* ... */
buildType = "debug";
}
```
2020-05-31 19:47:32 +01:00
In this scenario, the `checkPhase` will be ran in `debug` mode as well.
2020-05-24 17:37:34 +01:00
2021-06-05 20:22:45 +01:00
### Custom `build`/`install`-procedures {#custom-buildinstall-procedures}
2020-05-24 17:37:34 +01:00
Some packages may use custom scripts for building/installing, e.g. with a `Makefile` .
2020-05-31 19:47:32 +01:00
In these cases, it's recommended to override the `buildPhase` /`installPhase`/`checkPhase`.
2020-05-24 17:37:34 +01:00
2020-05-31 19:47:32 +01:00
Otherwise, some steps may fail because of the modified directory structure of `target/` .
2020-05-24 17:37:34 +01:00
2021-06-05 20:22:45 +01:00
### Building a crate with an absent or out-of-date Cargo.lock file {#building-a-crate-with-an-absent-or-out-of-date-cargo.lock-file}
2020-06-05 08:10:53 +01:00
`buildRustPackage` needs a `Cargo.lock` file to get all dependencies in the
source code in a reproducible way. If it is missing or out-of-date one can use
the `cargoPatches` attribute to update or add it.
2021-03-13 23:30:36 +00:00
```nix
2020-06-05 08:10:53 +01:00
rustPlatform.buildRustPackage rec {
2024-03-27 18:10:27 +00:00
# ...
2020-06-05 08:10:53 +01:00
cargoPatches = [
# a patch file to add/update Cargo.lock in the source code
./add-Cargo.lock.patch
];
}
```
2022-08-22 22:29:50 +01:00
### Compiling non-Rust packages that include Rust code {#compiling-non-rust-packages-that-include-rust-code}
2021-02-09 12:46:32 +00:00
Several non-Rust packages incorporate Rust code for performance- or
security-sensitive parts. `rustPlatform` exposes several functions and
hooks that can be used to integrate Cargo in non-Rust packages.
2022-08-22 22:29:50 +01:00
#### Vendoring of dependencies {#vendoring-of-dependencies}
2021-02-09 12:46:32 +00:00
Since network access is not allowed in sandboxed builds, Rust crate
dependencies need to be retrieved using a fetcher. `rustPlatform`
provides the `fetchCargoTarball` fetcher, which vendors all
2021-02-12 07:35:50 +00:00
dependencies of a crate. For example, given a source path `src`
containing `Cargo.toml` and `Cargo.lock` , `fetchCargoTarball`
can be used as follows:
```nix
2024-03-27 18:10:27 +00:00
{
cargoDeps = rustPlatform.fetchCargoTarball {
inherit src;
hash = "sha256-BoHIN/519Top1NUBjpB/oEMqi86Omt3zTQcXFWqrek0=";
};
}
2021-02-12 07:35:50 +00:00
```
The `src` attribute is required, as well as a hash specified through
doc: use sri hash syntax
The nixpkgs manual contains references to both sri hash and explicit
sha256 attributes. This is at best confusing to new users. Since the
final destination is exclusive use of sri hashes, see nixos/rfcs#131,
might as well push new users in that direction gently.
Notable exceptions to sri hash support are builtins.fetchTarball,
cataclysm-dda, coq, dockerTools.pullimage, elixir.override, and
fetchCrate. None, other than builtins.fetchTarball, are fundamentally
incompatible, but all currently accept explicit sha256 attributes as
input. Because adding backwards compatibility is out of scope for this
change, they have been left intact, but migration to sri format has been
made for any using old hash formats.
All hashes have been manually tested to be accurate, and updates were
only made for missing upstream artefacts or bugs.
2022-12-03 19:49:00 +00:00
one of the `hash` attribute. The following optional attributes can
also be used:
2021-02-12 07:35:50 +00:00
* `name` : the name that is used for the dependencies tarball. If
`name` is not specified, then the name `cargo-deps` will be used.
* `sourceRoot` : when the `Cargo.lock` /`Cargo.toml` are in a
subdirectory, `sourceRoot` specifies the relative path to these
files.
* `patches` : patches to apply before vendoring. This is useful when
the `Cargo.lock` /`Cargo.toml` files need to be patched before
vendoring.
2024-11-12 17:22:59 +00:00
In case the lockfile contains cargo `git` dependencies, you can use
`fetchCargoVendor` instead.
```nix
{
cargoDeps = rustPlatform.fetchCargoVendor {
inherit src;
hash = "sha256-RqPVFovDaD2rW31HyETJfQ0qVwFxoGEvqkIgag3H6KU=";
};
}
```
2021-05-08 06:40:34 +01:00
If a `Cargo.lock` file is available, you can alternatively use the
`importCargoLock` function. In contrast to `fetchCargoTarball` , this
function does not require a hash (unless git dependencies are used)
and fetches every dependency as a separate fixed-output derivation.
`importCargoLock` can be used as follows:
2024-03-27 16:33:27 +00:00
```nix
2024-03-27 18:10:27 +00:00
{
cargoDeps = rustPlatform.importCargoLock {
lockFile = ./Cargo.lock;
};
}
2021-05-08 06:40:34 +01:00
```
If the `Cargo.lock` file includes git dependencies, then their output
hashes need to be specified since they are not available through the
lock file. For example:
2024-03-27 16:33:27 +00:00
```nix
2024-03-27 18:10:27 +00:00
{
cargoDeps = rustPlatform.importCargoLock {
lockFile = ./Cargo.lock;
outputHashes = {
"rand-0.8.3" = "0ya2hia3cn31qa8894s3av2s8j5bjwb6yq92k0jsnlx7jid0jwqa";
};
2021-05-08 06:40:34 +01:00
};
2024-03-27 18:10:27 +00:00
}
2021-05-08 06:40:34 +01:00
```
If you do not specify an output hash for a git dependency, building
`cargoDeps` will fail and inform you of which crate needs to be
added. To find the correct hash, you can first use `lib.fakeSha256` or
`lib.fakeHash` as a stub hash. Building `cargoDeps` will then inform
you of the correct hash.
2022-08-22 22:29:50 +01:00
#### Hooks {#hooks}
2021-02-12 07:35:50 +00:00
`rustPlatform` provides the following hooks to automate Cargo builds:
2021-11-04 20:19:01 +00:00
* `cargoSetupHook` : configure Cargo to use dependencies vendored
2021-02-12 07:35:50 +00:00
through `fetchCargoTarball` . This hook uses the `cargoDeps`
environment variable to find the vendored dependencies. If a project
already vendors its dependencies, the variable `cargoVendorDir` can
be used instead. When the `Cargo.toml` /`Cargo.lock` files are not in
`sourceRoot` , then the optional `cargoRoot` is used to specify the
Cargo root directory relative to `sourceRoot` .
* `cargoBuildHook` : use Cargo to build a crate. If the crate to be
built is a crate in e.g. a Cargo workspace, the relative path to the
crate to build can be set through the optional `buildAndTestSubdir`
2021-10-27 14:24:19 +01:00
environment variable. Features can be specified with
`cargoBuildNoDefaultFeatures` and `cargoBuildFeatures` . Additional
Cargo build flags can be passed through `cargoBuildFlags` .
2021-02-12 07:35:50 +00:00
* `maturinBuildHook` : use [Maturin ](https://github.com/PyO3/maturin )
to build a Python wheel. Similar to `cargoBuildHook` , the optional
variable `buildAndTestSubdir` can be used to build a crate in a
2021-11-05 14:40:59 +00:00
Cargo workspace. Additional Maturin flags can be passed through
2021-02-12 07:35:50 +00:00
`maturinBuildFlags` .
2021-02-26 10:51:31 +00:00
* `cargoCheckHook` : run tests using Cargo. The build type for checks
2021-10-27 14:24:19 +01:00
can be set using `cargoCheckType` . Features can be specified with
2022-09-03 21:45:21 +01:00
`cargoCheckNoDefaultFeatures` and `cargoCheckFeatures` . Additional
2021-10-27 14:24:19 +01:00
flags can be passed to the tests using `checkFlags` and
`checkFlagsArray` . By default, tests are run in parallel. This can
be disabled by setting `dontUseCargoParallelTests` .
2022-11-28 22:25:46 +00:00
* `cargoNextestHook` : run tests using
[cargo-nextest ](https://github.com/nextest-rs/nextest ). The same
options for `cargoCheckHook` also applies to `cargoNextestHook` .
2021-02-15 05:54:18 +00:00
* `cargoInstallHook` : install binaries and static/shared libraries
that were built using `cargoBuildHook` .
2022-02-13 12:00:00 +00:00
* `bindgenHook` : for crates which use `bindgen` as a build dependency, lets
`bindgen` find `libclang` and `libclang` find the libraries in `buildInputs` .
2021-02-12 07:35:50 +00:00
2022-08-22 22:29:50 +01:00
#### Examples {#examples}
2021-02-12 07:35:50 +00:00
2021-06-05 20:22:45 +01:00
#### Python package using `setuptools-rust` {#python-package-using-setuptools-rust}
2021-02-12 07:35:50 +00:00
For Python packages using `setuptools-rust` , you can use
`fetchCargoTarball` and `cargoSetupHook` to retrieve and set up Cargo
dependencies. The build itself is then performed by
`buildPythonPackage` .
The following example outlines how the `tokenizers` Python package is
built. Since the Python package is in the `source/bindings/python`
2021-11-05 14:40:59 +00:00
directory of the `tokenizers` project's source archive, we use
2021-02-12 07:35:50 +00:00
`sourceRoot` to point the tooling to this directory:
2021-02-09 12:46:32 +00:00
```nix
{ fetchFromGitHub
, buildPythonPackage
2023-05-12 15:17:16 +01:00
, cargo
2021-02-09 12:46:32 +00:00
, rustPlatform
2023-05-12 15:17:16 +01:00
, rustc
2021-02-09 12:46:32 +00:00
, setuptools-rust
}:
buildPythonPackage rec {
pname = "tokenizers";
version = "0.10.0";
src = fetchFromGitHub {
owner = "huggingface";
repo = pname;
rev = "python-v${version}";
hash = "sha256-rQ2hRV52naEf6PvRsWVCTN7B1oXAQGmnpJw4iIdhamw=";
};
cargoDeps = rustPlatform.fetchCargoTarball {
2024-08-10 02:18:50 +01:00
inherit pname version src sourceRoot;
doc: use sri hash syntax
The nixpkgs manual contains references to both sri hash and explicit
sha256 attributes. This is at best confusing to new users. Since the
final destination is exclusive use of sri hashes, see nixos/rfcs#131,
might as well push new users in that direction gently.
Notable exceptions to sri hash support are builtins.fetchTarball,
cataclysm-dda, coq, dockerTools.pullimage, elixir.override, and
fetchCrate. None, other than builtins.fetchTarball, are fundamentally
incompatible, but all currently accept explicit sha256 attributes as
input. Because adding backwards compatibility is out of scope for this
change, they have been left intact, but migration to sri format has been
made for any using old hash formats.
All hashes have been manually tested to be accurate, and updates were
only made for missing upstream artefacts or bugs.
2022-12-03 19:49:00 +00:00
hash = "sha256-miW//pnOmww2i6SOGbkrAIdc/JMDT4FJLqdMFojZeoY=";
2021-02-09 12:46:32 +00:00
};
2023-07-25 14:29:56 +01:00
sourceRoot = "${src.name}/bindings/python";
2021-02-09 12:46:32 +00:00
2023-05-12 15:17:16 +01:00
nativeBuildInputs = [
cargo
rustPlatform.cargoSetupHook
rustc
setuptools-rust
];
2021-02-09 12:46:32 +00:00
# ...
}
```
2021-02-12 07:35:50 +00:00
In some projects, the Rust crate is not in the main Python source
directory. In such cases, the `cargoRoot` attribute can be used to
specify the crate's directory relative to `sourceRoot` . In the
2021-02-09 12:46:32 +00:00
following example, the crate is in `src/rust` , as specified in the
`cargoRoot` attribute. Note that we also need to specify the correct
path for `fetchCargoTarball` .
```nix
{ buildPythonPackage
, fetchPypi
, rustPlatform
, setuptools-rust
, openssl
}:
buildPythonPackage rec {
pname = "cryptography";
version = "3.4.2"; # Also update the hash in vectors.nix
src = fetchPypi {
inherit pname version;
doc: use sri hash syntax
The nixpkgs manual contains references to both sri hash and explicit
sha256 attributes. This is at best confusing to new users. Since the
final destination is exclusive use of sri hashes, see nixos/rfcs#131,
might as well push new users in that direction gently.
Notable exceptions to sri hash support are builtins.fetchTarball,
cataclysm-dda, coq, dockerTools.pullimage, elixir.override, and
fetchCrate. None, other than builtins.fetchTarball, are fundamentally
incompatible, but all currently accept explicit sha256 attributes as
input. Because adding backwards compatibility is out of scope for this
change, they have been left intact, but migration to sri format has been
made for any using old hash formats.
All hashes have been manually tested to be accurate, and updates were
only made for missing upstream artefacts or bugs.
2022-12-03 19:49:00 +00:00
hash = "sha256-xGDilsjLOnls3MfVbGKnj80KCUCczZxlis5PmHzpNcQ=";
2021-02-09 12:46:32 +00:00
};
cargoDeps = rustPlatform.fetchCargoTarball {
2024-08-10 02:18:50 +01:00
inherit pname version src;
2021-02-09 12:46:32 +00:00
sourceRoot = "${pname}-${version}/${cargoRoot}";
hash = "sha256-PS562W4L1NimqDV2H0jl5vYhL08H9est/pbIxSdYVfo=";
};
cargoRoot = "src/rust";
# ...
}
```
2021-06-05 20:22:45 +01:00
#### Python package using `maturin` {#python-package-using-maturin}
2021-02-12 07:35:50 +00:00
Python packages that use [Maturin ](https://github.com/PyO3/maturin )
can be built with `fetchCargoTarball` , `cargoSetupHook` , and
`maturinBuildHook` . For example, the following (partial) derivation
builds the `retworkx` Python package. `fetchCargoTarball` and
`cargoSetupHook` are used to fetch and set up the crate dependencies.
`maturinBuildHook` is used to perform the build.
```nix
{ lib
, buildPythonPackage
, rustPlatform
, fetchFromGitHub
}:
buildPythonPackage rec {
pname = "retworkx";
version = "0.6.0";
2024-07-26 15:03:13 +01:00
pyproject = true;
2021-02-12 07:35:50 +00:00
src = fetchFromGitHub {
owner = "Qiskit";
repo = "retworkx";
rev = version;
doc: use sri hash syntax
The nixpkgs manual contains references to both sri hash and explicit
sha256 attributes. This is at best confusing to new users. Since the
final destination is exclusive use of sri hashes, see nixos/rfcs#131,
might as well push new users in that direction gently.
Notable exceptions to sri hash support are builtins.fetchTarball,
cataclysm-dda, coq, dockerTools.pullimage, elixir.override, and
fetchCrate. None, other than builtins.fetchTarball, are fundamentally
incompatible, but all currently accept explicit sha256 attributes as
input. Because adding backwards compatibility is out of scope for this
change, they have been left intact, but migration to sri format has been
made for any using old hash formats.
All hashes have been manually tested to be accurate, and updates were
only made for missing upstream artefacts or bugs.
2022-12-03 19:49:00 +00:00
hash = "sha256-11n30ldg3y3y6qxg3hbj837pnbwjkqw3nxq6frds647mmmprrd20=";
2021-02-12 07:35:50 +00:00
};
cargoDeps = rustPlatform.fetchCargoTarball {
2024-08-10 02:18:50 +01:00
inherit pname version src;
2021-02-12 07:35:50 +00:00
hash = "sha256-heOBK8qi2nuc/Ib+I/vLzZ1fUUD/G/KTw9d7M4Hz5O0=";
};
nativeBuildInputs = with rustPlatform; [ cargoSetupHook maturinBuildHook ];
# ...
}
```
2024-03-25 20:45:19 +00:00
#### Rust package built with `meson` {#rust-package-built-with-meson}
Some projects, especially GNOME applications, are built with the Meson Build System instead of calling Cargo directly. Using `rustPlatform.buildRustPackage` may successfully build the main program, but related files will be missing. Instead, you need to set up Cargo dependencies with `fetchCargoTarball` and `cargoSetupHook` and leave the rest to Meson. `rust` and `cargo` are still needed in `nativeBuildInputs` for Meson to use.
```nix
{ lib
, stdenv
, fetchFromGitLab
, meson
, ninja
, pkg-config
, rustPlatform
, rustc
, cargo
, wrapGAppsHook4
, blueprint-compiler
, libadwaita
, libsecret
2024-09-05 13:26:23 +01:00
, tinysparql
2024-03-25 20:45:19 +00:00
}:
stdenv.mkDerivation rec {
pname = "health";
version = "0.95.0";
src = fetchFromGitLab {
domain = "gitlab.gnome.org";
owner = "World";
repo = "health";
rev = version;
hash = "sha256-PrNPprSS98yN8b8yw2G6hzTSaoE65VbsM3q7FVB4mds=";
};
cargoDeps = rustPlatform.fetchCargoTarball {
2024-08-10 02:18:50 +01:00
inherit pname version src;
2024-03-25 20:45:19 +00:00
hash = "sha256-8fa3fa+sFi5H+49B5sr2vYPkp9C9s6CcE0zv4xB8gww=";
};
nativeBuildInputs = [
meson
ninja
pkg-config
rustPlatform.cargoSetupHook
rustc
cargo
wrapGAppsHook4
blueprint-compiler
];
buildInputs = [
libadwaita
libsecret
2024-09-05 13:26:23 +01:00
tinysparql
2024-03-25 20:45:19 +00:00
];
# ...
}
```
2023-03-16 02:41:48 +00:00
## `buildRustCrate`: Compiling Rust crates using Nix instead of Cargo {#compiling-rust-crates-using-nix-instead-of-cargo}
### Simple operation {#simple-operation}
When run, `cargo build` produces a file called `Cargo.lock` ,
containing pinned versions of all dependencies. Nixpkgs contains a
2023-03-17 19:13:13 +00:00
tool called `crate2Nix` (`nix-shell -p crate2nix`), which can be
used to turn a `Cargo.lock` into a Nix expression. That Nix
expression calls `rustc` directly (hence bypassing Cargo), and can
be used to compile a crate and all its dependencies.
2023-03-16 02:41:48 +00:00
2023-03-17 19:13:13 +00:00
See [`crate2nix`'s documentation ](https://github.com/kolloch/crate2nix#known-restrictions )
for instructions on how to use it.
2023-03-16 02:41:48 +00:00
### Handling external dependencies {#handling-external-dependencies}
Some crates require external libraries. For crates from
[crates.io ](https://crates.io ), such libraries can be specified in
`defaultCrateOverrides` package in nixpkgs itself.
Starting from that file, one can add more overrides, to add features
or build inputs by overriding the hello crate in a separate file.
```nix
with import < nixpkgs > {};
((import ./hello.nix).hello {}).override {
crateOverrides = defaultCrateOverrides // {
hello = attrs: { buildInputs = [ openssl ]; };
};
}
```
Here, `crateOverrides` is expected to be a attribute set, where the
key is the crate name without version number and the value a function.
The function gets all attributes passed to `buildRustCrate` as first
argument and returns a set that contains all attribute that should be
overwritten.
For more complicated cases, such as when parts of the crate's
derivation depend on the crate's version, the `attrs` argument of
the override above can be read, as in the following example, which
patches the derivation:
```nix
with import < nixpkgs > {};
((import ./hello.nix).hello {}).override {
crateOverrides = defaultCrateOverrides // {
hello = attrs: lib.optionalAttrs (lib.versionAtLeast attrs.version "1.0") {
postPatch = ''
substituteInPlace lib/zoneinfo.rs \
2023-10-12 22:43:03 +01:00
--replace-fail "/usr/share/zoneinfo" "${tzdata}/share/zoneinfo"
2023-03-16 02:41:48 +00:00
'';
};
};
}
```
Another situation is when we want to override a nested
dependency. This actually works in the exact same way, since the
`crateOverrides` parameter is forwarded to the crate's
dependencies. For instance, to override the build inputs for crate
`libc` in the example above, where `libc` is a dependency of the main
crate, we could do:
```nix
with import < nixpkgs > {};
((import hello.nix).hello {}).override {
crateOverrides = defaultCrateOverrides // {
libc = attrs: { buildInputs = []; };
};
}
```
### Options and phases configuration {#options-and-phases-configuration}
Actually, the overrides introduced in the previous section are more
general. A number of other parameters can be overridden:
- The version of `rustc` used to compile the crate:
```nix
2024-03-27 18:10:27 +00:00
(hello {}).override { rust = pkgs.rust; }
2023-03-16 02:41:48 +00:00
```
- Whether to build in release mode or debug mode (release mode by
default):
```nix
2024-03-27 18:10:27 +00:00
(hello {}).override { release = false; }
2023-03-16 02:41:48 +00:00
```
- Whether to print the commands sent to `rustc` when building
(equivalent to `--verbose` in cargo:
```nix
2024-03-27 18:10:27 +00:00
(hello {}).override { verbose = false; }
2023-03-16 02:41:48 +00:00
```
- Extra arguments to be passed to `rustc` :
```nix
2024-03-27 18:10:27 +00:00
(hello {}).override { extraRustcOpts = "-Z debuginfo=2"; }
2023-03-16 02:41:48 +00:00
```
- Phases, just like in any other derivation, can be specified using
the following attributes: `preUnpack` , `postUnpack` , `prePatch` ,
`patches` , `postPatch` , `preConfigure` (in the case of a Rust crate,
this is run before calling the "build" script), `postConfigure`
(after the "build" script),`preBuild`, `postBuild` , `preInstall` and
`postInstall` . As an example, here is how to create a new module
before running the build script:
```nix
(hello {}).override {
preConfigure = ''
echo "pub const PATH=\"${hi.out}\";" >> src/path.rs"
'';
2024-03-27 18:10:27 +00:00
}
2023-03-16 02:41:48 +00:00
```
2022-08-22 22:29:50 +01:00
### Setting Up `nix-shell` {#setting-up-nix-shell}
2018-03-28 02:07:19 +01:00
Oftentimes you want to develop code from within `nix-shell` . Unfortunately
`buildRustCrate` does not support common `nix-shell` operations directly
(see [this issue ](https://github.com/NixOS/nixpkgs/issues/37945 ))
so we will use `stdenv.mkDerivation` instead.
Using the example `hello` project above, we want to do the following:
2021-06-05 20:22:45 +01:00
2018-03-28 02:07:19 +01:00
- Have access to `cargo` and `rustc`
- Have the `openssl` library available to a crate through it's _normal_
compilation mechanism (`pkg-config`).
A typical `shell.nix` might look like:
2021-03-13 23:30:36 +00:00
```nix
2018-03-28 02:07:19 +01:00
with import < nixpkgs > {};
stdenv.mkDerivation {
name = "rust-env";
2018-12-13 07:05:30 +00:00
nativeBuildInputs = [
2018-03-28 02:07:19 +01:00
rustc cargo
2018-12-13 07:05:30 +00:00
# Example Build-time Additional Dependencies
2021-01-19 03:19:48 +00:00
pkg-config
2018-12-13 07:05:30 +00:00
];
buildInputs = [
# Example Run-time Additional Dependencies
openssl
2018-03-28 02:07:19 +01:00
];
# Set Environment Variables
RUST_BACKTRACE = 1;
}
```
You should now be able to run the following:
2021-06-05 20:22:45 +01:00
```ShellSession
2018-03-28 02:07:19 +01:00
$ nix-shell --pure
$ cargo build
$ cargo test
```
2023-03-04 02:00:54 +00:00
## Using community maintained Rust toolchains {#using-community-maintained-rust-toolchains}
2021-06-05 20:22:45 +01:00
2023-03-04 02:00:54 +00:00
::: {.note}
2023-10-09 22:57:03 +01:00
The following projects cannot be used within Nixpkgs since [Import From Derivation ](https://nixos.org/manual/nix/unstable/language/import-from-derivation ) (IFD) is disallowed in Nixpkgs.
2023-03-04 02:00:54 +00:00
To package things that require Rust nightly, `RUSTC_BOOTSTRAP = true;` can sometimes be used as a hack.
:::
There are two community maintained approaches to Rust toolchain management:
- [oxalica's Rust overlay ](https://github.com/oxalica/rust-overlay )
- [fenix ](https://github.com/nix-community/fenix )
Despite their names, both projects provides a similar set of packages and overlays under different APIs.
Oxalica's overlay allows you to select a particular Rust version without you providing a hash or a flake input,
but comes with a larger git repository than fenix.
Fenix also provides rust-analyzer nightly in addition to the Rust toolchains.
Both oxalica's overlay and fenix better integrate with nix and cache optimizations.
Because of this and ergonomics, either of those community projects
should be preferred to the Mozilla's Rust overlay ([nixpkgs-mozilla](https://github.com/mozilla/nixpkgs-mozilla)).
The following documentation demonstrates examples using fenix and oxalica's Rust overlay
with `nix-shell` and building derivations. More advanced usages like flake usage
are documented in their own repositories.
### Using Rust nightly with `nix-shell` {#using-rust-nightly-with-nix-shell}
Here is a simple `shell.nix` that provides Rust nightly (default profile) using fenix:
2018-03-28 02:07:19 +01:00
2021-03-13 23:30:36 +00:00
```nix
2023-03-04 02:00:54 +00:00
with import < nixpkgs > { };
let
fenix = callPackage
(fetchFromGitHub {
owner = "nix-community";
repo = "fenix";
# commit from: 2023-03-03
rev = "e2ea04982b892263c4d939f1cc3bf60a9c4deaa1";
hash = "sha256-AsOim1A8KKtMWIxG+lXh5Q4P2bhOZjoUhFWJ1EuZNNk=";
})
{ };
2018-03-28 02:07:19 +01:00
in
2023-03-04 02:00:54 +00:00
mkShell {
2018-03-28 02:07:19 +01:00
name = "rust-env";
2023-03-04 02:00:54 +00:00
nativeBuildInputs = [
# Note: to use stable, just replace `default` with `stable`
fenix.default.toolchain
2018-03-28 02:07:19 +01:00
2023-03-04 02:00:54 +00:00
# Example Build-time Additional Dependencies
pkg-config
];
buildInputs = [
# Example Run-time Additional Dependencies
openssl
2018-03-28 02:07:19 +01:00
];
# Set Environment Variables
RUST_BACKTRACE = 1;
}
```
2023-03-04 02:00:54 +00:00
Save this to `shell.nix` , then run:
2021-06-05 20:22:45 +01:00
2021-03-13 23:30:36 +00:00
```ShellSession
2018-03-28 02:07:19 +01:00
$ rustc --version
2023-03-04 02:00:54 +00:00
rustc 1.69.0-nightly (13471d3b2 2023-03-02)
2018-03-28 02:07:19 +01:00
```
To see that you are using nightly.
2023-03-04 02:00:54 +00:00
Oxalica's Rust overlay has more complete examples of `shell.nix` (and cross compilation) under its
[`examples` directory ](https://github.com/oxalica/rust-overlay/tree/e53e8853aa7b0688bc270e9e6a681d22e01cf299/examples ).
2017-03-20 19:41:37 +00:00
2023-03-04 02:00:54 +00:00
### Using Rust nightly in a derivation with `buildRustPackage` {#using-rust-nightly-in-a-derivation-with-buildrustpackage}
2020-08-11 11:21:25 +01:00
2023-03-04 02:00:54 +00:00
You can also use Rust nightly to build rust packages using `makeRustPlatform` .
The below snippet demonstrates invoking `buildRustPackage` with a Rust toolchain from oxalica's overlay:
2017-03-20 19:41:37 +00:00
2021-03-13 23:30:36 +00:00
```nix
2023-03-04 02:00:54 +00:00
with import < nixpkgs >
{
2021-11-02 20:30:03 +00:00
overlays = [
(import (fetchTarball "https://github.com/oxalica/rust-overlay/archive/master.tar.gz"))
];
};
2023-03-04 02:00:54 +00:00
let
rustPlatform = makeRustPlatform {
2024-03-04 23:44:39 +00:00
cargo = rust-bin.selectLatestNightlyWith (toolchain: toolchain.default);
rustc = rust-bin.selectLatestNightlyWith (toolchain: toolchain.default);
2023-03-04 02:00:54 +00:00
};
in
2020-08-11 11:21:25 +01:00
2021-11-02 20:30:03 +00:00
rustPlatform.buildRustPackage rec {
pname = "ripgrep";
version = "12.1.1";
src = fetchFromGitHub {
owner = "BurntSushi";
2021-11-04 13:21:43 +00:00
repo = "ripgrep";
2021-11-02 20:30:03 +00:00
rev = version;
2023-03-04 02:00:54 +00:00
hash = "sha256-+s5RBC3XSgb8omTbUNLywZnP6jSxZBKSS1BmXOjRF8M=";
2021-11-02 20:30:03 +00:00
};
2020-08-11 11:21:25 +01:00
2023-03-04 02:00:54 +00:00
cargoHash = "sha256-l1vL2ZdtDRxSGvP0X/l3nMw8+6WF67KPutJEzUROjg8=";
doCheck = false;
2017-03-20 19:41:37 +00:00
Nix docs: remove `with lib;` from example code
Following [Best Practices](https://nix.dev/guides/best-practices#with-scopes),
`with` is a problematic language construction and should be avoided.
Usually it is employed like a "factorization": `[ X.A X.B X.C X.D ]` is written
`with X; [ A B C D ]`.
However, as shown in the link above, the syntatical rules of `with` are not so
intuitive, and this "distributive rule" is very selective, in the sense that
`with X; [ A B C D ]` is not equivalent to `[ X.A X.B X.C X.D ]`.
However, this factorization is still useful to "squeeze" some code, especially
in lists like `meta.maintainers`.
On the other hand, it becomes less justifiable in bigger scopes. This is
especially true in cases like `with lib;` in the top of expression and in sets
like `meta = with lib; { . . . }`.
That being said, this patch removes most of example code in the current
documentation.
The exceptions are, for now
- doc/functions/generators.section.md
- doc/languages-frameworks/coq.section.md
because, well, they are way more complicated, and I couldn't parse them
mentally - yet another reason why `with` should be avoided!
2024-03-06 11:51:54 +00:00
meta = {
2024-07-20 08:08:30 +01:00
description = "Fast line-oriented regex search tool, similar to ag and ack";
2021-11-02 20:30:03 +00:00
homepage = "https://github.com/BurntSushi/ripgrep";
Nix docs: remove `with lib;` from example code
Following [Best Practices](https://nix.dev/guides/best-practices#with-scopes),
`with` is a problematic language construction and should be avoided.
Usually it is employed like a "factorization": `[ X.A X.B X.C X.D ]` is written
`with X; [ A B C D ]`.
However, as shown in the link above, the syntatical rules of `with` are not so
intuitive, and this "distributive rule" is very selective, in the sense that
`with X; [ A B C D ]` is not equivalent to `[ X.A X.B X.C X.D ]`.
However, this factorization is still useful to "squeeze" some code, especially
in lists like `meta.maintainers`.
On the other hand, it becomes less justifiable in bigger scopes. This is
especially true in cases like `with lib;` in the top of expression and in sets
like `meta = with lib; { . . . }`.
That being said, this patch removes most of example code in the current
documentation.
The exceptions are, for now
- doc/functions/generators.section.md
- doc/languages-frameworks/coq.section.md
because, well, they are way more complicated, and I couldn't parse them
mentally - yet another reason why `with` should be avoided!
2024-03-06 11:51:54 +00:00
license = with lib.licenses; [ mit unlicense ];
maintainers = with lib.maintainers; [];
2021-11-02 20:30:03 +00:00
};
}
2021-06-05 20:22:45 +01:00
```
2017-03-20 19:41:37 +00:00
2021-11-02 20:30:03 +00:00
Follow the below steps to try that snippet.
1. save the above snippet as `default.nix` in that directory
2023-03-04 02:00:54 +00:00
2. cd into that directory and run `nix-build`
2020-08-11 11:21:25 +01:00
2023-03-04 02:00:54 +00:00
Fenix also has examples with `buildRustPackage` ,
[crane ](https://github.com/ipetkov/crane ),
[naersk ](https://github.com/nix-community/naersk ),
and cross compilation in its [Examples ](https://github.com/nix-community/fenix#examples ) section.
2023-11-12 09:31:39 +00:00
2023-11-12 06:12:01 +00:00
## Using `git bisect` on the Rust compiler {#using-git-bisect-on-the-rust-compiler}
Sometimes an upgrade of the Rust compiler (`rustc`) will break a
downstream package. In these situations, being able to `git bisect`
the `rustc` version history to find the offending commit is quite
useful. Nixpkgs makes it easy to do this.
First, roll back your nixpkgs to a commit in which its `rustc` used
*the most recent one which doesn't have the problem.* You'll need
to do this because of `rustc` 's extremely aggressive
version-pinning.
Next, add the following overlay, updating the Rust version to the
one in your rolled-back nixpkgs, and replacing `/git/scratch/rust`
with the path into which you have `git clone` d the `rustc` git
repository:
```nix
(final: prev: /*lib.optionalAttrs prev.stdenv.targetPlatform.isAarch64*/ {
rust_1_72 =
lib.updateManyAttrsByPath [{
path = [ "packages" "stable" ];
update = old: old.overrideScope(final: prev: {
rustc: add a compiler wrapper
We keep running into situations where we can't get the right
combination of rustc flags through build systems into rustc.
RUSTFLAGS is the only variable supported across build systems, but if
RUSTFLAGS is set, Cargo will ignore all other ways of specifying rustc
flags, including the target-specific ones, which we need to make
dynamic musl builds work. (This is why pkgsCross.musl64.crosvm is
currently broken — it works if you unset separateDebugInfo, which
causes RUSTFLAGS not to be set.)
So, we need to do the same thing we do for C and C++ compilers, and
add a compiler wrapper so we can inject the flags we need, regardless
of the build system.
Currently the wrapper only supports a single mechanism for injecting
flags — the NIX_RUSTFLAGS environment variable. As time goes on,
we'll probably want to add additional features, like target-specific
environment variables.
2023-10-18 12:02:45 +01:00
rustc-unwrapped = prev.rustc-unwrapped.overrideAttrs (_: {
2023-11-12 06:12:01 +00:00
src = lib.cleanSource /git/scratch/rust;
# do *not* put passthru.isReleaseTarball=true here
});
});
}]
prev.rust_1_72;
})
```
If the problem you're troubleshooting only manifests when
cross-compiling you can uncomment the `lib.optionalAttrs` in the
example above, and replace `isAarch64` with the target that is
having problems. This will speed up your bisect quite a bit, since
the host compiler won't need to be rebuilt.
Now, you can start a `git bisect` in the directory where you checked
out the `rustc` source code. It is recommended to select the
endpoint commits by searching backwards from `origin/master` for the
*commits which added the release notes for the versions in
question.* If you set the endpoints to commits on the release
branches (i.e. the release tags), git-bisect will often get confused
by the complex merge-commit structures it will need to traverse.
The command loop you'll want to use for bisecting looks like this:
```bash
git bisect {good,bad} # depending on result of last build
git submodule update --init
CARGO_NET_OFFLINE=false cargo vendor \
--sync ./src/tools/cargo/Cargo.toml \
--sync ./src/tools/rust-analyzer/Cargo.toml \
--sync ./compiler/rustc_codegen_cranelift/Cargo.toml \
--sync ./src/bootstrap/Cargo.toml
nix-build $NIXPKGS -A package-broken-by-rust-changes
```
The `git submodule update --init` and `cargo vendor` commands above
require network access, so they can't be performed from within the
`rustc` derivation, unfortunately.