alioth/nixpkgs
3
0
Fork 0
forked from mirrors/nixpkgs
Code Releases Activity
nixpkgs/pkgs/development/libraries/sentencepiece/default.nix

33 lines
751 B
Nix
Raw Normal View History

sentencepiece: split into multiple outputs, optional gperftools I am using sentencepiece in a downstream application where I want to minimize the resulting closures. This commit makes changes to make sentencepiece a leaner dependency: - Split the outputs, so that the binaries/headers do not end up in the transitive closure in a library dependency. - Add the `withGPerfTools` option, which is enabled by default, to make it possible to disable the gperftools dependency. According to the sentencepiece README, this dependency gives a 10-40% performance improvement. But in many cases this is overshadowed by the neural networks that use piece identifiers as input anyway.
2020-02-25 15:06:24 +00:00
{ lib
sentencepiece: init at 0.1.84
2019-12-07 01:15:09 +00:00
, fetchFromGitHub
, stdenv
, cmake
, gperftools
sentencepiece: split into multiple outputs, optional gperftools I am using sentencepiece in a downstream application where I want to minimize the resulting closures. This commit makes changes to make sentencepiece a leaner dependency: - Split the outputs, so that the binaries/headers do not end up in the transitive closure in a library dependency. - Add the `withGPerfTools` option, which is enabled by default, to make it possible to disable the gperftools dependency. According to the sentencepiece README, this dependency gives a 10-40% performance improvement. But in many cases this is overshadowed by the neural networks that use piece identifiers as input anyway.
2020-02-25 15:06:24 +00:00
, withGPerfTools ? true
sentencepiece: init at 0.1.84
2019-12-07 01:15:09 +00:00
}:
stdenv.mkDerivation rec {
pname = "sentencepiece";
sentencepiece: 0.1.93 -> 0.1.94 Changelog: https://github.com/google/sentencepiece/releases/tag/v0.1.94
2020-10-24 07:00:06 +01:00
version = "0.1.94";
sentencepiece: init at 0.1.84
2019-12-07 01:15:09 +00:00
src = fetchFromGitHub {
owner = "google";
repo = pname;
rev = "v${version}";
sentencepiece: 0.1.93 -> 0.1.94 Changelog: https://github.com/google/sentencepiece/releases/tag/v0.1.94
2020-10-24 07:00:06 +01:00
sha256 = "sha256:11cqw4hx33gw2jmrg11jyp7fj9pwzwjwzqcn24jfsbgh6n8gks5x";
sentencepiece: init at 0.1.84
2019-12-07 01:15:09 +00:00
};
sentencepiece: split into multiple outputs, optional gperftools I am using sentencepiece in a downstream application where I want to minimize the resulting closures. This commit makes changes to make sentencepiece a leaner dependency: - Split the outputs, so that the binaries/headers do not end up in the transitive closure in a library dependency. - Add the `withGPerfTools` option, which is enabled by default, to make it possible to disable the gperftools dependency. According to the sentencepiece README, this dependency gives a 10-40% performance improvement. But in many cases this is overshadowed by the neural networks that use piece identifiers as input anyway.
2020-02-25 15:06:24 +00:00
nativeBuildInputs = [ cmake ] ++ lib.optional withGPerfTools gperftools;
outputs = [ "bin" "dev" "out" ];
sentencepiece: init at 0.1.84
2019-12-07 01:15:09 +00:00
meta = with stdenv.lib; {
sentencepiece: set platforms to unix to support Darwin - The sentencepiece library builds fine on Darwin as well. - Remove superfluous `enableParallelBuilding = true`. - Make the value of homepage a string.
2020-02-21 14:38:07 +00:00
homepage = "https://github.com/google/sentencepiece";
sentencepiece: init at 0.1.84
2019-12-07 01:15:09 +00:00
description = "Unsupervised text tokenizer for Neural Network-based text generation";
license = licenses.asl20;
sentencepiece: set platforms to unix to support Darwin - The sentencepiece library builds fine on Darwin as well. - Remove superfluous `enableParallelBuilding = true`. - Make the value of homepage a string.
2020-02-21 14:38:07 +00:00
platforms = platforms.unix;
sentencepiece: add myself as a maintainer
2020-03-09 11:55:48 +00:00
maintainers = with maintainers; [ danieldk pashashocky ];
sentencepiece: init at 0.1.84
2019-12-07 01:15:09 +00:00
};
}
Copy permalink