See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/737/display/redirect
Changes:
------------------------------------------ [...truncated 168.51 KB...] stderr_lines: <omitted> stdout: |- ==================== Test output for //tensorflow/core/util/tensor_bundle:tensor_bundle_test: [==========] Running 18 tests from 2 test suites. [----------] Global test environment set-up. [----------] 17 tests from TensorBundleTest [ RUN ] TensorBundleTest.SwapBytes [ OK ] TensorBundleTest.SwapBytes (0 ms) [ RUN ] TensorBundleTest.Basic [ OK ] TensorBundleTest.Basic (120 ms) [ RUN ] TensorBundleTest.Endianness [ OK ] TensorBundleTest.Endianness (213 ms) [ RUN ] TensorBundleTest.PartitionedVariables [ OK ] TensorBundleTest.PartitionedVariables (2 ms) [ RUN ] TensorBundleTest.EquivalentSliceTest [ OK ] TensorBundleTest.EquivalentSliceTest (2 ms) [ RUN ] TensorBundleTest.NonStandardShapes [ OK ] TensorBundleTest.NonStandardShapes (32 ms) [ RUN ] TensorBundleTest.StringTensorsOldFormat [ OK ] TensorBundleTest.StringTensorsOldFormat (0 ms) [ RUN ] TensorBundleTest.StringTensors tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:765: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (writer.Add("long_scalar", long_string_tensor)) Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate11559948317783239214; No space left on device tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:768: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (writer.Add("floats", Constant_2x3<float>(16.18))) Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate11559948317783239214; No space left on device tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:769: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (writer.Finish()) Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate11559948317783239214; No space left on device [ FAILED ] TensorBundleTest.StringTensors (47214 ms) [ RUN ] TensorBundleTest.VariantTensors [ OK ] TensorBundleTest.VariantTensors (3 ms) [ RUN ] TensorBundleTest.DirectoryStructure [ OK ] TensorBundleTest.DirectoryStructure (6 ms) [ RUN ] TensorBundleTest.SortForSequentialAccess [ OK ] TensorBundleTest.SortForSequentialAccess (5 ms) [ RUN ] TensorBundleTest.Error [ OK ] TensorBundleTest.Error (4 ms) [ RUN ] TensorBundleTest.Checksum [ OK ] TensorBundleTest.Checksum (88 ms) [ RUN ] TensorBundleTest.TruncatedTensorContents [ OK ] TensorBundleTest.TruncatedTensorContents (31 ms) [ RUN ] TensorBundleTest.HeaderEntry [ OK ] TensorBundleTest.HeaderEntry (2 ms) [ RUN ] TensorBundleTest.VersionTest [ OK ] TensorBundleTest.VersionTest (38 ms) [ RUN ] TensorBundleTest.LargeVariableLoadingTest [ OK ] TensorBundleTest.LargeVariableLoadingTest (4 ms) [----------] 17 tests from TensorBundleTest (47772 ms total)
[----------] 1 test from TensorBundleAlignmentTest [ RUN ] TensorBundleAlignmentTest.AlignmentTest [ OK ] TensorBundleAlignmentTest.AlignmentTest (2 ms) [----------] 1 test from TensorBundleAlignmentTest (2 ms total)
[----------] Global test environment tear-down [==========] 18 tests from 2 test suites ran. (47775 ms total) [ PASSED ] 17 tests. [ FAILED ] 1 test, listed below: [ FAILED ] TensorBundleTest.StringTensors
1 FAILED TEST ================================================================================ ==================== Test output for //tensorflow/core/util/tensor_bundle:tensor_bundle_test: [==========] Running 18 tests from 2 test suites. [----------] Global test environment set-up. [----------] 17 tests from TensorBundleTest [ RUN ] TensorBundleTest.SwapBytes [ OK ] TensorBundleTest.SwapBytes (0 ms) [ RUN ] TensorBundleTest.Basic [ OK ] TensorBundleTest.Basic (106 ms) [ RUN ] TensorBundleTest.Endianness [ OK ] TensorBundleTest.Endianness (118 ms) [ RUN ] TensorBundleTest.PartitionedVariables [ OK ] TensorBundleTest.PartitionedVariables (3 ms) [ RUN ] TensorBundleTest.EquivalentSliceTest [ OK ] TensorBundleTest.EquivalentSliceTest (2 ms) [ RUN ] TensorBundleTest.NonStandardShapes [ OK ] TensorBundleTest.NonStandardShapes (34 ms) [ RUN ] TensorBundleTest.StringTensorsOldFormat [ OK ] TensorBundleTest.StringTensorsOldFormat (0 ms) [ RUN ] TensorBundleTest.StringTensors tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:765: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (writer.Add("long_scalar", long_string_tensor)) Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate17765104588851234696; No space left on device tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:768: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (writer.Add("floats", Constant_2x3<float>(16.18))) Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate17765104588851234696; No space left on device tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:769: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (writer.Finish()) Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate17765104588851234696; No space left on device [ FAILED ] TensorBundleTest.StringTensors (26756 ms) [ RUN ] TensorBundleTest.VariantTensors [ OK ] TensorBundleTest.VariantTensors (8 ms) [ RUN ] TensorBundleTest.DirectoryStructure [ OK ] TensorBundleTest.DirectoryStructure (9 ms) [ RUN ] TensorBundleTest.SortForSequentialAccess [ OK ] TensorBundleTest.SortForSequentialAccess (6 ms) [ RUN ] TensorBundleTest.Error [ OK ] TensorBundleTest.Error (4 ms) [ RUN ] TensorBundleTest.Checksum [ OK ] TensorBundleTest.Checksum (12 ms) [ RUN ] TensorBundleTest.TruncatedTensorContents [ OK ] TensorBundleTest.TruncatedTensorContents (2 ms) [ RUN ] TensorBundleTest.HeaderEntry [ OK ] TensorBundleTest.HeaderEntry (1 ms) [ RUN ] TensorBundleTest.VersionTest [ OK ] TensorBundleTest.VersionTest (0 ms) [ RUN ] TensorBundleTest.LargeVariableLoadingTest [ OK ] TensorBundleTest.LargeVariableLoadingTest (3 ms) [----------] 17 tests from TensorBundleTest (27073 ms total)
[----------] 1 test from TensorBundleAlignmentTest [ RUN ] TensorBundleAlignmentTest.AlignmentTest [ OK ] TensorBundleAlignmentTest.AlignmentTest (2 ms) [----------] 1 test from TensorBundleAlignmentTest (2 ms total)
[----------] Global test environment tear-down [==========] 18 tests from 2 test suites ran. (27075 ms total) [ PASSED ] 17 tests. [ FAILED ] 1 test, listed below: [ FAILED ] TensorBundleTest.StringTensors
1 FAILED TEST ================================================================================ ==================== Test output for //tensorflow/core/util/tensor_bundle:tensor_bundle_test: [==========] Running 18 tests from 2 test suites. [----------] Global test environment set-up. [----------] 17 tests from TensorBundleTest [ RUN ] TensorBundleTest.SwapBytes [ OK ] TensorBundleTest.SwapBytes (0 ms) [ RUN ] TensorBundleTest.Basic [ OK ] TensorBundleTest.Basic (177 ms) [ RUN ] TensorBundleTest.Endianness [ OK ] TensorBundleTest.Endianness (68 ms) [ RUN ] TensorBundleTest.PartitionedVariables [ OK ] TensorBundleTest.PartitionedVariables (1 ms) [ RUN ] TensorBundleTest.EquivalentSliceTest [ OK ] TensorBundleTest.EquivalentSliceTest (1 ms) [ RUN ] TensorBundleTest.NonStandardShapes [ OK ] TensorBundleTest.NonStandardShapes (17 ms) [ RUN ] TensorBundleTest.StringTensorsOldFormat [ OK ] TensorBundleTest.StringTensorsOldFormat (0 ms) [ RUN ] TensorBundleTest.StringTensors tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:765: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (writer.Add("long_scalar", long_string_tensor)) Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate7347782163562122469; No space left on device tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:768: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (writer.Add("floats", Constant_2x3<float>(16.18))) Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate7347782163562122469; No space left on device tensorflow/core/util/tensor_bundle/tensor_bundle_test.cc:769: Failure Expected equality of these values: ::tsl::OkStatus() Which is: OK (writer.Finish()) Which is: RESOURCE_EXHAUSTED: /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/_tmp/30622ef97efb16d542aabf84c2b7b6fe/foo.data-00000-of-00001.tempstate7347782163562122469; No space left on device [ FAILED ] TensorBundleTest.StringTensors (15126 ms) [ RUN ] TensorBundleTest.VariantTensors [ OK ] TensorBundleTest.VariantTensors (15 ms) [ RUN ] TensorBundleTest.DirectoryStructure [ OK ] TensorBundleTest.DirectoryStructure (6 ms) [ RUN ] TensorBundleTest.SortForSequentialAccess [ OK ] TensorBundleTest.SortForSequentialAccess (5 ms) [ RUN ] TensorBundleTest.Error [ OK ] TensorBundleTest.Error (4 ms) [ RUN ] TensorBundleTest.Checksum [ OK ] TensorBundleTest.Checksum (21 ms) [ RUN ] TensorBundleTest.TruncatedTensorContents [ OK ] TensorBundleTest.TruncatedTensorContents (3 ms) [ RUN ] TensorBundleTest.HeaderEntry [ OK ] TensorBundleTest.HeaderEntry (2 ms) [ RUN ] TensorBundleTest.VersionTest [ OK ] TensorBundleTest.VersionTest (1 ms) [ RUN ] TensorBundleTest.LargeVariableLoadingTest [ OK ] TensorBundleTest.LargeVariableLoadingTest (4 ms) [----------] 17 tests from TensorBundleTest (15458 ms total)
[----------] 1 test from TensorBundleAlignmentTest [ RUN ] TensorBundleAlignmentTest.AlignmentTest [ OK ] TensorBundleAlignmentTest.AlignmentTest (2 ms) [----------] 1 test from TensorBundleAlignmentTest (2 ms total)
[----------] Global test environment tear-down [==========] 18 tests from 2 test suites ran. (15460 ms total) [ PASSED ] 17 tests. [ FAILED ] 1 test, listed below: [ FAILED ] TensorBundleTest.StringTensors
1 FAILED TEST ================================================================================ stdout_lines: <omitted> ...ignoring
TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages] *** Sunday 26 March 2023 02:56:59 +0100 (6:52:34.724) 7:46:54.782 ********** fatal: [localhost]: FAILED! => changed=false msg: 'The container "tf-py3.8" has been paused (409 Client Error for http+docker://localhost/v1.41/containers/tf-py3.8/exec: Conflict ("Container b9fa8cc82fcbcbbe82ab960070266bcec4b648873c9bd44ec11f06e2f5606dc0 is not running"))'
PLAY RECAP ********************************************************************* localhost : ok=34 changed=25 unreachable=0 failed=1 skipped=8 rescued=0 ignored=1
Sunday 26 March 2023 02:57:09 +0100 (0:00:10.371) 7:47:05.153 ********** =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow git tests ------ 24754.72s tensorflow_in_container : (Python 3.8) build TensorFlow git ---------- 2889.81s tensorflow_in_container : (Python 3.8) start build container ---------- 224.97s tensorflow_in_container : (Python 3.8) build Python package ------------ 97.35s tensorflow : Fetch TensorFlow from git --------------------------------- 22.72s tensorflow_in_container : (Python 3.8) collect list of installed Python packages -- 10.37s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.63s tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build --- 2.10s Gathering Facts --------------------------------------------------------- 1.65s tensorflow_in_container : (Python 3.8) build Python versioned container --- 1.46s Create cache dirs ------------------------------------------------------- 1.38s Cleanup after previous build -------------------------------------------- 1.28s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.24s tensorflow : Save git commit hash to file ------------------------------- 1.15s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.87s tensorflow_in_container : (Python 3.8) cleanup Bazel install directory --- 0.85s tensorflow_in_container : (Python 3.8) create link for pip cache -------- 0.83s tensorflow_in_container : (Python 3.8) create link for bazel cache ------ 0.82s tensorflow_in_container : (Python 3.8) copy upper constraints ----------- 0.72s tensorflow_in_container : (Python 3.8) create script to run tests ------- 0.72s Build step 'Execute shell' marked build as failure