Eelco Dolstra
3f80fadec4
testing{-python}.nix: Remove log pretty-printing cruft
...
This completes the removal of the nested log feature, which previously
got removed from Nix, Hydra, stdenv and GNU Make. In particular, this
means that the output of VM builds no longer contains a copy of
jQuery.
2020-05-07 15:56:30 +02:00
Eelco Dolstra
78f2a83029
test-driver.py: Fix deadlock when the log queue gets full
...
If a program (e.g. nixos-install) writes more than 1000 lines to
stderr during execute(), then process_serial_output() deadlocks
waiting for the queue to be processed. So use an unbounded queue
instead.
We should probably get rid of the structured log output (log.xml),
since then we don't need the log queue anymore.
2020-05-07 15:25:24 +02:00
Florian Klink
3cdd558a6f
nixosTests: drop nr_tests and failed_tests variables
...
With the tests now bailing out early on a failing subtest, we don't need
to keep a list of failed tests, or the number of total tests
2020-05-01 01:22:42 +02:00
Jacek Galowicz
b139bc0d87
nixosTests: Reraise exception in subtests
2020-05-01 01:22:42 +02:00
Silvan Mosberger
85e866db6f
nixos/lib/test-driver: Fix require_unit_state hardcoded formatting
2020-04-06 23:55:04 +02:00
Martin Milata
d4cbe042ef
test-driver.py: use temporary dir for vde1.ctl
...
Send SIGTERM instead of SIGKILL to vde_switch to give it chance to
delete the directories.
2020-03-29 00:03:59 +01:00
Rouven Czerwinski
1685cd7fa7
nixos/test: update test-driver.py for mypy 0.770
2020-03-27 01:57:48 -07:00
Jacek Galowicz
d772206c49
nixosTests: Make VLAN argument optional in python test driver
2020-02-14 19:05:03 +01:00
Jacek Galowicz
798fcaafa4
nixos/test: Add copy_from_host and copy_from_host_via_shell to python
...
test driver
2020-02-07 13:24:16 +01:00
Jacek Galowicz
f63ef280df
nixosTests: Drop invalid utf characters in command output
2020-01-26 17:11:59 +01:00
Florian Klink
764aba4c1b
Merge pull request #77587 from singron/fix-shared
...
test-driver.py: Share the shared dir between VMs
2020-01-19 22:07:31 +01:00
Eric Culp
6795a4002c
test-driver.py: Use /tmp/shared for copy_from_vm
...
The docstring says it uses a directory shared among all vms, although
that doesn't seem necessary for the functionality. However, it does need
to be consistent between the guest and host.
2020-01-19 10:33:46 -08:00
Florian Klink
ed0b5b6133
Merge pull request #77662 from marijanp/verbose-python-test-driver
...
nixos/test: added verbose output for failed tests
2020-01-17 13:50:49 +01:00
Erik Arvstedt
5bdb653baf
test-driver.py: fix decoding of VM output
...
The codec format 'unicode_escape' was introduced in 52ee102
to handle
undecodable bytes in boot menus.
This made the problem worse as unicode chars outside of iso-8859-1
produce garbled output and valid utf-8 strings (such as "\x" ) trigger
decoding errors.
Fix this by using the default 'utf-8' codec and by explicitly ignoring
decoding errors.
2020-01-14 15:52:44 -08:00
Marijan Petričević
61c61f80e5
nixos/test: added verbose output for failed tests
2020-01-14 09:33:10 +01:00
Eric Culp
21f567bdd9
test-driver.py: Share the shared dir between VMs
...
This changes the python test driver to match the behavior of the perl
test driver. I.e. the directory mounted into /tmp/shared should be the
same for all machines.
This probably fixes many tests, but I found this while investigating
failures in nixos/tests/ceph-multi-node.nix.
2020-01-12 15:49:17 -08:00
Jacek Galowicz
e05ae69904
nixos/test: Use retry() in all looping functions that need timeouts
2019-12-03 16:59:43 +01:00
Michael Raskin
ad38a08ecb
test-driver.py: add Machine.copy_from_vm
2019-11-25 11:35:48 +01:00
Michael Raskin
ef5bc381f9
test-driver.py: Fix the shared directory reference
2019-11-25 11:33:47 +01:00
Robin Gloster
ba03a1b731
nixos/tests: fail on failing subtests
...
This was the behaviour in the perl test driver too and a regression.
Also cleaned up unused imports
2019-11-25 01:08:06 +01:00
Florian Klink
758efb9348
Merge pull request #73190 from flokli/ceph-tests-python
...
WIP: nixos/ceph: port tests to python
2019-11-21 20:13:41 +01:00
Jacek Galowicz
4dba4db1db
nixos/test: let python driver evaluate test code in global scope so the
...
user can define and use functions
2019-11-20 19:08:18 +01:00
Jacek Galowicz
72dd1c6a74
nixos/test: If qemu monitor returns 0, simply return (like perl script does)
2019-11-20 17:38:20 +01:00
Jacek Galowicz
67e2042861
nixos/test: Fix child environment of python driver
2019-11-20 17:37:12 +01:00
Jörg Thalheim
03e6ca15e2
test-driver: add mypy support
...
It's a good idea to expand this in future to test code as well,
so we get type checking there as well.
2019-11-11 13:49:48 +00:00
Florian Klink
a8e9a93493
nixos/tests: fix succeed() with multiple commands
...
we previously immediately returned the first commands output, and didn't
execute any of the other commands.
Now, return the last commands output.
This should be documented in the method docstring.
2019-11-11 13:45:11 +01:00
Leonhard Markert
c7becac738
nixos/tests: correct arguments to get_unit_info
2019-11-08 15:01:42 +01:00
Marijan Petricevic
5854aaf680
nixos/tests: improve get_unit_info expressiveness on failure
2019-11-08 11:20:54 +01:00
worldofpeace
1e7ddf233a
Merge pull request #72943 from marijanp/port-test-driver-python
...
Port remaining test-driver functions to python
2019-11-07 20:23:27 +00:00
worldofpeace
6ed6d1af6a
Merge pull request #72947 from tfc/boot-test-port-fix
...
Boot test port fix
2019-11-07 17:32:43 +00:00
Jacek Galowicz
52ee1026b0
nixos/test: Handle undecodable bytes
...
This threw exceptions in boot menus
2019-11-07 10:00:39 +01:00
worldofpeace
3780b9e69c
Merge pull request #72835 from tfc/nixos-integration-test-ports
...
Nixos integration test ports
2019-11-07 01:05:36 +00:00
Marijan
9915a8ca45
nixos/tests: implemented python test-driver version of forwardPort
2019-11-06 22:43:37 +01:00
Marijan
01f79dfc9e
nixos/tests: implemented python test-driver version of dumpTTYContents
2019-11-06 22:43:37 +01:00
Jacek Galowicz
cf138b4e6b
nixos/tests: Fix subprocess launch call for VM monitor
...
This crashed in the create-script case
2019-11-06 21:48:08 +01:00
Daniel Schaefer
afbfef93a7
nixos/tests: Ignore shutdown/crash if not booted
...
Condition seems to be inverted. Crash and shutdown only make sense, when
the machine is booted; i.e. we return immediately otherwise.
In the Perl test driver this is:
return unless $self->{booted};
2019-11-06 16:06:43 +01:00
Jacek Galowicz
45b339b736
nixos/tests: Implement python test-driver version of getWindowNames and waitForWindow
2019-11-05 18:07:05 +01:00
Jacek Galowicz
9c54658226
nixos/tests: Implement python test-driver version of requireActiveUnit
2019-11-05 18:07:00 +01:00
Florian Klink
ac97edf013
nixos/test: use ptpython as repl
2019-11-04 23:50:27 +01:00
Jacek Galowicz
3a28fefe7d
nixos/test: Port test driver to python
...
Thanks @blitz and @jtraue for help with implementing machine methods
2019-11-04 23:50:27 +01:00
Andrew Childs
d2144755a4
nixos-test-driver: allow configuration of net frontend and backend
...
When IPXE tests were added, an option was added for configuring only
the frontend, and the backend configuration was dropped entirely. This
caused most installer tests to fail.
2019-07-22 13:44:27 +03:00
Nikolay Amiantov
81d35a9d7e
nixos-test-driver: support netRomFile
...
Needed for UEFI PXE netboot testing.
2019-07-15 19:33:26 +03:00
Samuel Dionne-Riel
3aab228d09
Revert "Add ssh backdoor to VM tests infrastructure."
...
This reverts commit d6e3db44cf
.
See #53935 for explanations. In short, it may be causing issues with
tests on the build infrastructure.
2019-01-19 13:24:39 -05:00
Samuel Dionne-Riel
2646a64fbc
Merge pull request #53827 from samueldr/feature/data-in-logs
...
tests: Logs timing in tests
2019-01-12 12:54:56 -05:00
Samuel Dionne-Riel
b28b37eb00
tests: Wait for shell for twice as long (10m)
...
See #49441 for an earlier attempt, which was subsequently reverted. I am
assuming that doubling the time will be sufficient if the machine is
overloaded since so many of the tests already pass at 5 minutes, while
still not holding back failures for needlessly long.
2019-01-11 22:40:19 -05:00
Samuel Dionne-Riel
5d93e2c01c
test-driver: Logs time taken for nests
2019-01-11 22:36:31 -05:00
Samuel Dionne-Riel
1fe0018df8
test-driver: Adds time it took to connect to guest in logs
...
This will make it possible to track whether the time is generous or not
when ran on hydra.
2019-01-11 22:36:31 -05:00
Sarah Brofeldt
95486ca306
Revert "NixOS tests: Wait for shell for 10x longer (50m)"
...
This reverts commit 9bc10e1291
.
2018-11-05 08:58:08 +00:00
Sarah Brofeldt
9bc10e1291
NixOS tests: Wait for shell for 10x longer (50m)
2018-10-30 09:22:42 +01:00
Tuomas Tynkkynen
d6e3db44cf
Add ssh backdoor to VM tests infrastructure.
...
Thanks to @dezgeg for prototype implementation, I've
cleaned it up and added documentation.
2018-09-28 10:53:08 +01:00