See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/484/display/redirect
Changes:
------------------------------------------ [...truncated 14.18 KB...] changed: [localhost]
TASK [tensorflow_in_container : Show list of installed Python packages for build] *** Friday 07 July 2023 01:11:27 +0100 (0:00:02.163) 0:01:23.190 *********** ok: [localhost] => pip_list_output.stdout: |- Package Version Location Installer ----------------------- -------------------- -------------------------------------- --------- absl-py 1.0.0 /usr/local/lib/python3.8/dist-packages pip astor 0.8.1 /usr/local/lib/python3.8/dist-packages pip astroid 2.11.7 /usr/local/lib/python3.8/dist-packages pip astunparse 1.6.3 /usr/local/lib/python3.8/dist-packages pip auditwheel 5.3.0 /usr/local/lib/python3.8/dist-packages pip bleach 6.0.0 /usr/local/lib/python3.8/dist-packages pip cachetools 5.3.1 /usr/local/lib/python3.8/dist-packages pip certifi 2019.11.28 /usr/lib/python3/dist-packages cffi 1.15.1 /usr/local/lib/python3.8/dist-packages pip chardet 3.0.4 /usr/lib/python3/dist-packages colorama 0.4.6 /usr/local/lib/python3.8/dist-packages pip cryptography 41.0.1 /usr/local/lib/python3.8/dist-packages pip Cython 0.29.35 /usr/local/lib/python3.8/dist-packages pip dbus-python 1.2.16 /usr/lib/python3/dist-packages dill 0.3.6 /usr/local/lib/python3.8/dist-packages pip docutils 0.20.1 /usr/local/lib/python3.8/dist-packages pip flatbuffers 23.1.21 /usr/local/lib/python3.8/dist-packages pip future 0.18.3 /usr/local/lib/python3.8/dist-packages pip gast 0.4.0 /usr/local/lib/python3.8/dist-packages pip google-auth 2.20.0 /usr/local/lib/python3.8/dist-packages pip google-auth-oauthlib 1.0.0 /usr/local/lib/python3.8/dist-packages pip google-pasta 0.2.0 /usr/local/lib/python3.8/dist-packages pip grpcio 1.49.1 /usr/local/lib/python3.8/dist-packages pip h5py 3.8.0 /usr/local/lib/python3.8/dist-packages pip idna 2.8 /usr/lib/python3/dist-packages importlib-metadata 6.6.0 /usr/local/lib/python3.8/dist-packages pip importlib-resources 5.12.0 /usr/local/lib/python3.8/dist-packages pip isort 5.12.0 /usr/local/lib/python3.8/dist-packages pip jaraco.classes 3.2.3 /usr/local/lib/python3.8/dist-packages pip jax 0.3.25 /usr/local/lib/python3.8/dist-packages pip jeepney 0.8.0 /usr/local/lib/python3.8/dist-packages pip junitparser 2.2.0 /usr/local/lib/python3.8/dist-packages pip Keras-Applications 1.0.8 /usr/local/lib/python3.8/dist-packages pip keras-nightly 2.14.0.dev2023061907 /usr/local/lib/python3.8/dist-packages pip Keras-Preprocessing 1.1.2 /usr/local/lib/python3.8/dist-packages pip keyring 23.13.1 /usr/local/lib/python3.8/dist-packages pip lazy-object-proxy 1.9.0 /usr/local/lib/python3.8/dist-packages pip lit 16.0.5.post0 /usr/local/lib/python3.8/dist-packages pip lxml 4.9.2 /usr/local/lib/python3.8/dist-packages pip Markdown 3.4.3 /usr/local/lib/python3.8/dist-packages pip MarkupSafe 2.1.3 /usr/local/lib/python3.8/dist-packages pip mccabe 0.7.0 /usr/local/lib/python3.8/dist-packages pip more-itertools 9.1.0 /usr/local/lib/python3.8/dist-packages pip numpy 1.23.5 /usr/local/lib/python3.8/dist-packages pip oauthlib 3.2.2 /usr/local/lib/python3.8/dist-packages pip opt-einsum 3.3.0 /usr/local/lib/python3.8/dist-packages pip packaging 21.3 /usr/local/lib/python3.8/dist-packages pip pip 23.1.2 /usr/local/lib/python3.8/dist-packages pip pkginfo 1.9.6 /usr/local/lib/python3.8/dist-packages pip platformdirs 3.5.3 /usr/local/lib/python3.8/dist-packages pip portpicker 1.5.2 /usr/local/lib/python3.8/dist-packages pip protobuf 4.23.2 /usr/local/lib/python3.8/dist-packages pip psutil 5.9.5 /usr/local/lib/python3.8/dist-packages pip pyasn1 0.5.0 /usr/local/lib/python3.8/dist-packages pip pyasn1-modules 0.3.0 /usr/local/lib/python3.8/dist-packages pip pycparser 2.21 /usr/local/lib/python3.8/dist-packages pip pyelftools 0.29 /usr/local/lib/python3.8/dist-packages pip Pygments 2.15.1 /usr/local/lib/python3.8/dist-packages pip PyGObject 3.36.0 /usr/lib/python3/dist-packages pylint 2.13.9 /usr/local/lib/python3.8/dist-packages pip pyparsing 3.0.9 /usr/local/lib/python3.8/dist-packages pip python-apt 2.0.1+ubuntu0.20.4.1 /usr/lib/python3/dist-packages PyYAML 6.0 /usr/local/lib/python3.8/dist-packages pip readme-renderer 37.3 /usr/local/lib/python3.8/dist-packages pip requests 2.22.0 /usr/lib/python3/dist-packages requests-oauthlib 1.3.1 /usr/local/lib/python3.8/dist-packages pip requests-toolbelt 1.0.0 /usr/local/lib/python3.8/dist-packages pip requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages rfc3986 2.0.0 /usr/local/lib/python3.8/dist-packages pip rsa 4.9 /usr/local/lib/python3.8/dist-packages pip scipy 1.9.3 /usr/local/lib/python3.8/dist-packages pip SecretStorage 3.3.3 /usr/local/lib/python3.8/dist-packages pip setuptools 45.2.0 /usr/lib/python3/dist-packages six 1.15.0 /usr/local/lib/python3.8/dist-packages pip tb-nightly 2.14.0a20230618 /usr/local/lib/python3.8/dist-packages pip tensorboard-data-server 0.7.1 /usr/local/lib/python3.8/dist-packages pip termcolor 1.1.0 /usr/local/lib/python3.8/dist-packages pip tf-estimator-nightly 2.14.0.dev2023061908 /usr/local/lib/python3.8/dist-packages pip tomli 2.0.1 /usr/local/lib/python3.8/dist-packages pip tqdm 4.65.0 /usr/local/lib/python3.8/dist-packages pip twine 3.6.0 /usr/local/lib/python3.8/dist-packages pip typing-extensions 3.7.4.3 /usr/local/lib/python3.8/dist-packages pip urllib3 1.25.8 /usr/lib/python3/dist-packages webencodings 0.5.1 /usr/local/lib/python3.8/dist-packages pip Werkzeug 2.3.6 /usr/local/lib/python3.8/dist-packages pip wheel 0.38.4 /usr/local/lib/python3.8/dist-packages pip wrapt 1.12.1 /usr/local/lib/python3.8/dist-packages pip zipp 3.15.0 /usr/local/lib/python3.8/dist-packages pip
TASK [tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git] *** Friday 07 July 2023 01:11:27 +0100 (0:00:00.041) 0:01:23.232 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) build Python package] ************* Friday 07 July 2023 02:12:41 +0100 (1:01:13.778) 1:02:37.010 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) cleanup Bazel install directory] *** Friday 07 July 2023 02:15:49 +0100 (0:03:07.936) 1:05:44.947 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) create script to run tests] ******* Friday 07 July 2023 02:15:50 +0100 (0:00:00.835) 1:05:45.782 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) run TensorFlow-oneDNN-ACL git tests] *** Friday 07 July 2023 02:15:51 +0100 (0:00:00.716) 1:05:46.498 *********** [WARNING]: Failure using method (v2_runner_on_failed) in callback plugin (<ansible_collections.community.general.plugins.callback.yaml.CallbackModule object at 0xffffae9baf40>): 'utf-8' codec can't encode character '\udcff' in position 121909829: surrogates not allowed
TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages] *** Friday 07 July 2023 04:42:05 +0100 (2:26:14.787) 3:32:01.286 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) save list of installed Python packages] *** Friday 07 July 2023 04:42:08 +0100 (0:00:02.045) 3:32:03.331 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) save tests output to file] ******** Friday 07 July 2023 04:42:08 +0100 (0:00:00.711) 3:32:04.043 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) save tests stderr output to file] *** Friday 07 July 2023 04:42:12 +0100 (0:00:03.293) 3:32:07.336 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) Extract number of tests run] ****** Friday 07 July 2023 04:42:13 +0100 (0:00:01.670) 3:32:09.007 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.8) Show number of tests run] ********* Friday 07 July 2023 04:42:18 +0100 (0:00:04.413) 3:32:13.420 *********** ok: [localhost] => ut_tests_line: 'Executed 3788 out of 3789 tests: 3546 tests pass'
TASK [tensorflow_in_container : (Python 3.8) Extract failed tests] ************* Friday 07 July 2023 04:42:18 +0100 (0:00:00.046) 3:32:13.466 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.8) Show which tests failed] ********** Friday 07 July 2023 04:42:19 +0100 (0:00:01.003) 3:32:14.469 *********** ok: [localhost] => tests_failed: 'FAILED: '
TASK [tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one] *** Friday 07 July 2023 04:42:19 +0100 (0:00:00.046) 3:32:14.516 *********** fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- + for wheel in /tf/pkg/*.whl + echo 'Checking and renaming /tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-linux_aarch64.whl...' + python3 -m auditwheel repair --plat manylinux2014_aarch64 /tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-linux_aarch64.whl --wheel-dir /tf/pkg + tee check.txt
real 2m48.873s user 2m15.763s sys 0m18.680s ++ grep --extended-regexp --only-matching '/tf/pkg/\S+.whl' check.txt + new_wheel=/tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + [[ /tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl != /\t\f/\p\k\g/\t\e\n\s\o\r\f\l\o\w_\a\a\r\c\h\6\4-\2.\1\4.\0-\c\p\3\8-\c\p\3\8-\l\i\n\u\x_\a\a\r\c\h\6\4.\w\h\l ]] + rm /tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-linux_aarch64.whl + wheel=/tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + TF_WHEEL=/tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + bats /usertools/wheel_verification.bats --timing stderr_lines: <omitted> stdout: |- Checking and renaming /tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-linux_aarch64.whl... INFO:auditwheel.main_repair:Repairing tensorflow_aarch64-2.14.0-cp38-cp38-linux_aarch64.whl INFO:auditwheel.wheeltools:Previous filename tags: linux_aarch64 INFO:auditwheel.wheeltools:New filename tags: manylinux_2_17_aarch64, manylinux2014_aarch64 INFO:auditwheel.wheeltools:Previous WHEEL info tags: cp38-cp38-linux_aarch64 INFO:auditwheel.wheeltools:New WHEEL info tags: cp38-cp38-manylinux_2_17_aarch64, cp38-cp38-manylinux2014_aarch64 INFO:auditwheel.main_repair: Fixed-up wheel written to /tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 1..6 ok 1 Wheel is manylinux2014 (manylinux_2_17) compliant in 67911ms # Size of /tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl is 249 / 580 megabytes. ok 2 Wheel conforms to upstream size limitations in 15ms not ok 3 Wheel is installable in 24078ms # (in test file /usertools/wheel_verification.bats, line 61) # `python3 -m pip install "$TF_WHEEL"' failed # Collecting setuptools # Using cached setuptools-68.0.0-py3-none-any.whl (804 kB) # Collecting wheel # Using cached wheel-0.40.0-py3-none-any.whl (64 kB) # Installing collected packages: setuptools, wheel # Attempting uninstall: setuptools # Found existing installation: setuptools 44.0.0 # Uninstalling setuptools-44.0.0: # Successfully uninstalled setuptools-44.0.0 # Successfully installed setuptools-68.0.0 wheel-0.40.0 # Processing ./tensorflow_aarch64-2.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl # ERROR: Package 'tensorflow-aarch64' requires a different Python: 3.8.10 not in '>=3.9' not ok 4 TensorFlow is importable in 42ms # (in test file /usertools/wheel_verification.bats, line 66) # `python3 -c 'import tensorflow as tf; t1=tf.constant([1,2,3,4]); t2=tf.constant([5,6,7,8]); print(tf.add(t1,t2).shape)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' not ok 5 TensorFlow has Keras in 41ms # (in test file /usertools/wheel_verification.bats, line 72) # `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "_v2.keras" in tf.keras.__name__ else 1)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' not ok 6 TensorFlow has Estimator in 41ms # (in test file /usertools/wheel_verification.bats, line 78) # `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "_v2.estimator" in tf.estimator.__name__ else 1)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=42 changed=29 unreachable=0 failed=1 skipped=8 rescued=0 ignored=1
Friday 07 July 2023 04:46:41 +0100 (0:04:22.094) 3:36:36.610 *********** =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow-oneDNN-ACL git tests 8774.79s tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git 3673.78s tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one - 262.09s tensorflow_in_container : (Python 3.8) build Python package ----------- 187.94s Cleanup after previous build ------------------------------------------- 35.09s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 22.03s tensorflow_in_container : (Python 3.8) Extract number of tests run ------ 4.41s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.99s tensorflow_in_container : (Python 3.8) start build container ------------ 3.61s tensorflow_in_container : (Python 3.8) save tests output to file -------- 3.29s tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build --- 2.16s tensorflow_in_container : (Python 3.8) collect list of installed Python packages --- 2.05s tensorflow_in_container : (Python 3.8) save tests stderr output to file --- 1.67s Gathering Facts --------------------------------------------------------- 1.65s tensorflow_in_container : (Python 3.8) build Python versioned container --- 1.62s Create cache dirs ------------------------------------------------------- 1.42s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.24s tensorflow : Save git commit hash to file ------------------------------- 1.13s tensorflow_in_container : (Python 3.8) Extract failed tests ------------- 1.00s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.87s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/485/display/redirect
Changes:
------------------------------------------ [...truncated 1.59 MB...] Stats over 11 runs: max = 900.2s, min = 10.9s, avg = 100.7s, dev = 252.9s /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/distribute/input_lib_type_spec_test_2gpu/shard_3_of_10/test_attempts/attempt_1.log //tensorflow/compiler/tests:fft_test_cpu PASSED in 29.0s Stats over 12 runs: max = 29.0s, min = 10.8s, avg = 19.2s, dev = 6.9s //tensorflow/compiler/xla/service:triangular_solve_expander_test PASSED in 3.9s Stats over 12 runs: max = 3.9s, min = 2.0s, avg = 2.7s, dev = 0.5s //tensorflow/python/data/experimental/kernel_tests:group_by_reducer_test PASSED in 20.7s Stats over 12 runs: max = 20.7s, min = 6.2s, avg = 13.0s, dev = 4.6s //tensorflow/python/data/kernel_tests:choose_from_datasets_test PASSED in 13.7s Stats over 12 runs: max = 13.7s, min = 7.5s, avg = 9.5s, dev = 1.8s //tensorflow/python/data/kernel_tests:memory_cleanup_test_cpu PASSED in 13.8s Stats over 12 runs: max = 13.8s, min = 9.6s, avg = 11.0s, dev = 1.3s //tensorflow/python/distribute:multi_process_runner_test_2gpu PASSED in 228.7s Stats over 12 runs: max = 228.7s, min = 15.7s, avg = 53.3s, dev = 58.8s //tensorflow/python/distribute:multi_process_runner_test_cpu PASSED in 229.0s Stats over 12 runs: max = 229.0s, min = 17.9s, avg = 55.1s, dev = 58.4s //tensorflow/python/eager/polymorphic_function:polymorphic_function_test_cpu PASSED in 22.5s Stats over 15 runs: max = 22.5s, min = 17.1s, avg = 19.3s, dev = 1.7s //tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test_cpu PASSED in 80.7s Stats over 15 runs: max = 80.7s, min = 72.6s, avg = 76.1s, dev = 2.0s //tensorflow/python/kernel_tests/nn_ops:rnn_cell_test_cpu PASSED in 52.1s Stats over 15 runs: max = 52.1s, min = 10.6s, avg = 17.2s, dev = 10.1s //tensorflow/compiler/tests:ftrl_test_cpu PASSED in 11.6s Stats over 16 runs: max = 11.6s, min = 3.6s, avg = 6.4s, dev = 2.5s //tensorflow/compiler/tests:ternary_ops_test_cpu PASSED in 14.0s Stats over 16 runs: max = 14.0s, min = 6.9s, avg = 9.7s, dev = 1.6s //tensorflow/compiler/tests:ternary_ops_test_cpu_mlir_bridge_test PASSED in 14.7s Stats over 16 runs: max = 14.7s, min = 6.4s, avg = 10.2s, dev = 2.1s //tensorflow/python/data/experimental/kernel_tests/service:dynamic_sharding_test PASSED in 13.8s Stats over 16 runs: max = 13.8s, min = 4.0s, avg = 8.0s, dev = 2.5s //tensorflow/python/data/experimental/kernel_tests/service:worker_tags_test PASSED in 28.2s Stats over 16 runs: max = 28.2s, min = 4.8s, avg = 15.5s, dev = 6.2s //tensorflow/python/data/kernel_tests:snapshot_test PASSED in 26.3s Stats over 16 runs: max = 26.3s, min = 9.3s, avg = 17.5s, dev = 4.9s //tensorflow/python/kernel_tests/control_flow:control_flow_ops_py_test_cpu PASSED in 26.6s Stats over 16 runs: max = 26.6s, min = 5.4s, avg = 10.0s, dev = 5.4s //tensorflow/python/kernel_tests/linalg:matrix_exponential_op_test PASSED in 14.0s Stats over 16 runs: max = 14.0s, min = 6.9s, avg = 10.4s, dev = 2.1s //tensorflow/python/kernel_tests/signal:dct_ops_test_cpu PASSED in 16.2s Stats over 16 runs: max = 16.2s, min = 8.3s, avg = 12.7s, dev = 2.4s //tensorflow/python/ops:image_ops_test_cpu PASSED in 23.7s Stats over 16 runs: max = 23.7s, min = 11.9s, avg = 15.7s, dev = 3.0s //tensorflow/python/data/experimental/kernel_tests/service:distributed_save_ft_test PASSED in 59.7s Stats over 17 runs: max = 59.7s, min = 4.8s, avg = 19.1s, dev = 20.1s //tensorflow/python/data/kernel_tests:map_test PASSED in 43.0s Stats over 19 runs: max = 43.0s, min = 16.3s, avg = 24.5s, dev = 6.5s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 9.7s Stats over 20 runs: max = 9.7s, min = 3.9s, avg = 7.2s, dev = 2.1s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 9.7s Stats over 20 runs: max = 9.7s, min = 3.8s, avg = 5.7s, dev = 1.8s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 23.2s Stats over 20 runs: max = 23.2s, min = 4.9s, avg = 10.2s, dev = 4.2s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 13.2s Stats over 20 runs: max = 13.2s, min = 4.3s, avg = 6.9s, dev = 2.2s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 14.4s Stats over 20 runs: max = 14.4s, min = 7.6s, avg = 9.7s, dev = 1.3s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 15.5s Stats over 20 runs: max = 15.5s, min = 12.9s, avg = 14.2s, dev = 0.7s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 15.0s Stats over 20 runs: max = 15.0s, min = 11.0s, avg = 13.0s, dev = 1.3s //tensorflow/compiler/xla/tests:prng_test_cpu PASSED in 9.1s Stats over 20 runs: max = 9.1s, min = 7.6s, avg = 8.2s, dev = 0.4s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 49.6s Stats over 20 runs: max = 49.6s, min = 8.1s, avg = 19.4s, dev = 12.4s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 29.6s Stats over 20 runs: max = 29.6s, min = 13.8s, avg = 21.4s, dev = 5.8s //tensorflow/python/kernel_tests:metrics_test PASSED in 42.2s Stats over 20 runs: max = 42.2s, min = 6.2s, avg = 19.3s, dev = 9.6s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 9.7s Stats over 20 runs: max = 9.7s, min = 7.1s, avg = 8.6s, dev = 0.7s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 15.9s Stats over 20 runs: max = 15.9s, min = 4.1s, avg = 7.7s, dev = 3.2s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 48.3s Stats over 20 runs: max = 48.3s, min = 4.7s, avg = 18.3s, dev = 13.1s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 195.4s Stats over 20 runs: max = 195.4s, min = 65.9s, avg = 114.1s, dev = 34.3s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 9.9s Stats over 20 runs: max = 9.9s, min = 4.3s, avg = 7.4s, dev = 2.0s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 17.0s Stats over 20 runs: max = 17.0s, min = 9.1s, avg = 13.5s, dev = 2.4s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 197.2s Stats over 20 runs: max = 197.2s, min = 33.5s, avg = 99.1s, dev = 45.6s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 22.1s Stats over 20 runs: max = 22.1s, min = 4.2s, avg = 9.8s, dev = 4.9s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 29.4s Stats over 20 runs: max = 29.4s, min = 8.7s, avg = 17.6s, dev = 6.4s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 19.6s Stats over 20 runs: max = 19.6s, min = 14.3s, avg = 16.0s, dev = 1.4s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 75.2s Stats over 20 runs: max = 75.2s, min = 9.9s, avg = 34.6s, dev = 21.0s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 20.1s Stats over 20 runs: max = 20.1s, min = 9.4s, avg = 12.2s, dev = 2.9s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 27.7s Stats over 24 runs: max = 27.7s, min = 4.8s, avg = 17.2s, dev = 5.8s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 23.5s Stats over 24 runs: max = 23.5s, min = 7.5s, avg = 14.9s, dev = 4.5s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 24.3s Stats over 24 runs: max = 24.3s, min = 3.9s, avg = 10.8s, dev = 5.0s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 12.4s Stats over 25 runs: max = 12.4s, min = 9.0s, avg = 10.1s, dev = 0.9s //tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 41.7s Stats over 25 runs: max = 41.7s, min = 8.7s, avg = 13.8s, dev = 8.5s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 11.2s Stats over 30 runs: max = 11.2s, min = 8.0s, avg = 9.4s, dev = 1.0s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 13.8s Stats over 30 runs: max = 13.8s, min = 12.6s, avg = 13.2s, dev = 0.4s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 8.9s Stats over 30 runs: max = 8.9s, min = 7.7s, avg = 8.2s, dev = 0.3s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 8.9s Stats over 30 runs: max = 8.9s, min = 7.7s, avg = 8.3s, dev = 0.3s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 24.7s Stats over 30 runs: max = 24.7s, min = 4.2s, avg = 11.2s, dev = 5.6s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 10.0s Stats over 31 runs: max = 10.0s, min = 8.8s, avg = 9.3s, dev = 0.3s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 12.4s Stats over 32 runs: max = 12.4s, min = 9.9s, avg = 10.8s, dev = 0.6s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 19.0s Stats over 32 runs: max = 19.0s, min = 4.0s, avg = 9.1s, dev = 3.9s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 14.1s Stats over 40 runs: max = 14.1s, min = 9.7s, avg = 11.5s, dev = 1.0s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 14.6s Stats over 40 runs: max = 14.6s, min = 8.1s, avg = 10.4s, dev = 1.4s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 12.4s Stats over 40 runs: max = 12.4s, min = 8.6s, avg = 10.5s, dev = 1.0s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 13.7s Stats over 40 runs: max = 13.7s, min = 8.6s, avg = 10.9s, dev = 1.8s //tensorflow/core/kernels:stochastic_cast_op_test PASSED in 1.6s Stats over 48 runs: max = 1.6s, min = 0.4s, avg = 0.6s, dev = 0.3s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 55.1s Stats over 50 runs: max = 55.1s, min = 26.7s, avg = 38.3s, dev = 7.0s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 50.7s Stats over 50 runs: max = 50.7s, min = 3.9s, avg = 15.6s, dev = 9.1s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 38.6s Stats over 50 runs: max = 38.6s, min = 3.3s, avg = 11.4s, dev = 7.8s //tensorflow/compiler/tests:unary_ops_test_cpu PASSED in 25.3s Stats over 50 runs: max = 25.3s, min = 3.5s, avg = 6.7s, dev = 3.9s //tensorflow/compiler/tests:unary_ops_test_cpu_mlir_bridge_test PASSED in 22.1s Stats over 50 runs: max = 22.1s, min = 3.4s, avg = 6.6s, dev = 4.0s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 11.6s Stats over 50 runs: max = 11.6s, min = 8.1s, avg = 10.0s, dev = 0.9s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 17.0s Stats over 50 runs: max = 17.0s, min = 11.1s, avg = 13.4s, dev = 1.4s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 15.2s Stats over 50 runs: max = 15.2s, min = 10.3s, avg = 12.0s, dev = 1.1s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 15.5s Stats over 50 runs: max = 15.5s, min = 5.0s, avg = 9.3s, dev = 2.6s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 13.5s Stats over 50 runs: max = 13.5s, min = 3.7s, avg = 5.5s, dev = 2.4s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 10.8s Stats over 50 runs: max = 10.8s, min = 3.8s, avg = 5.9s, dev = 2.3s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 32.7s Stats over 50 runs: max = 32.7s, min = 8.6s, avg = 16.2s, dev = 5.6s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 9.7s Stats over 50 runs: max = 9.7s, min = 3.7s, avg = 5.1s, dev = 1.6s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 16.3s Stats over 50 runs: max = 16.3s, min = 3.9s, avg = 5.6s, dev = 2.6s
Executed 3787 out of 3788 tests: 3786 tests pass, 1 fails to build and 1 fails locally. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages] *** Saturday 08 July 2023 04:36:38 +0100 (2:20:22.206) 3:26:32.955 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save list of installed Python packages] *** Saturday 08 July 2023 04:36:40 +0100 (0:00:01.945) 3:26:34.901 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests output to file] ******** Saturday 08 July 2023 04:36:40 +0100 (0:00:00.695) 3:26:35.596 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests stderr output to file] *** Saturday 08 July 2023 04:36:41 +0100 (0:00:00.702) 3:26:36.298 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Extract number of tests run] ****** Saturday 08 July 2023 04:36:42 +0100 (0:00:00.707) 3:26:37.006 ********* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show number of tests run] ********* Saturday 08 July 2023 04:36:42 +0100 (0:00:00.082) 3:26:37.089 ********* ok: [localhost] => ut_tests_line: 'Executed 3787 out of 3788 tests: 3786 tests pass, 1 fails to build and 1 fails locally.'
TASK [tensorflow_in_container : (Python 3.9) Extract failed tests] ************* Saturday 08 July 2023 04:36:42 +0100 (0:00:00.041) 3:26:37.131 ********* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show which tests failed] ********** Saturday 08 July 2023 04:36:42 +0100 (0:00:00.071) 3:26:37.202 ********* ok: [localhost] => tests_failed: - 'FAILED: //tensorflow/compiler/xla/service/gpu:fusion_merger_test (Summary)' - 'FAILED: Build did NOT complete successfully'
TASK [tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one] *** Saturday 08 July 2023 04:36:42 +0100 (0:00:00.040) 3:26:37.243 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Get list of wheel files] ********** Saturday 08 July 2023 04:42:04 +0100 (0:05:21.742) 3:31:58.985 ********* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Get filename of latest wheel] ***** Saturday 08 July 2023 04:42:04 +0100 (0:00:00.610) 3:31:59.596 ********* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) move manylinux2014 wheel outside] *** Saturday 08 July 2023 04:42:04 +0100 (0:00:00.060) 3:31:59.656 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Remove manylinux2014 wheel] ******* Saturday 08 July 2023 04:42:07 +0100 (0:00:02.612) 3:32:02.269 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) stop build container] ************* Saturday 08 July 2023 04:42:07 +0100 (0:00:00.375) 3:32:02.645 ********* fatal: [localhost]: FAILED! => changed=false msg: 'Error removing container 31149e22ba413f42ccbbc6cb05e7ea70f58aa748153a53fe65aa9fba8831a2cb: UnixHTTPConnectionPool(host=''localhost'', port=None): Read timed out. (read timeout=600)'
PLAY RECAP ********************************************************************* localhost : ok=47 changed=32 unreachable=0 failed=1 skipped=8 rescued=0 ignored=1
Saturday 08 July 2023 04:52:38 +0100 (0:10:30.424) 3:42:33.069 ********* =============================================================================== tensorflow_in_container : (Python 3.9) run TensorFlow-oneDNN-ACL git tests 8422.21s tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git 3760.22s tensorflow_in_container : (Python 3.9) stop build container ----------- 630.42s tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 321.74s tensorflow_in_container : (Python 3.9) build Python package ----------- 130.55s Cleanup after previous build ------------------------------------------- 30.97s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 21.68s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.94s tensorflow_in_container : (Python 3.9) start build container ------------ 3.63s tensorflow_in_container : (Python 3.9) move manylinux2014 wheel outside --- 2.61s tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 2.04s tensorflow_in_container : (Python 3.9) collect list of installed Python packages --- 1.95s Gathering Facts --------------------------------------------------------- 1.69s tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.65s Create cache dirs ------------------------------------------------------- 1.42s tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.23s tensorflow : Save git commit hash to file ------------------------------- 1.10s tensorflow_in_container : (Python 3.9) cleanup Bazel install directory --- 0.91s tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 0.88s tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.82s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/486/display/redirect
Changes:
------------------------------------------ [...truncated 1.56 MB...] Stats over 10 runs: max = 60.0s, min = 31.6s, avg = 39.1s, dev = 7.4s //tensorflow/compiler/tests:fft_test_cpu PASSED in 25.4s Stats over 12 runs: max = 25.4s, min = 13.6s, avg = 18.6s, dev = 4.6s //tensorflow/compiler/xla/service:triangular_solve_expander_test PASSED in 7.6s Stats over 12 runs: max = 7.6s, min = 3.3s, avg = 5.1s, dev = 1.2s //tensorflow/python/data/experimental/kernel_tests:group_by_reducer_test PASSED in 18.5s Stats over 12 runs: max = 18.5s, min = 6.5s, avg = 12.0s, dev = 3.7s //tensorflow/python/data/kernel_tests:choose_from_datasets_test PASSED in 14.4s Stats over 12 runs: max = 14.4s, min = 9.2s, avg = 10.9s, dev = 1.6s //tensorflow/python/data/kernel_tests:memory_cleanup_test_cpu PASSED in 11.6s Stats over 12 runs: max = 11.6s, min = 6.3s, avg = 9.2s, dev = 1.3s //tensorflow/python/distribute:multi_process_runner_test_2gpu PASSED in 227.8s Stats over 12 runs: max = 227.8s, min = 15.9s, avg = 54.4s, dev = 58.2s //tensorflow/python/distribute:multi_process_runner_test_cpu PASSED in 234.6s Stats over 12 runs: max = 234.6s, min = 22.7s, avg = 59.9s, dev = 58.6s //tensorflow/python/eager/polymorphic_function:polymorphic_function_test_cpu PASSED in 21.4s Stats over 15 runs: max = 21.4s, min = 15.5s, avg = 17.9s, dev = 1.7s //tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test_cpu PASSED in 83.7s Stats over 15 runs: max = 83.7s, min = 75.2s, avg = 79.1s, dev = 2.5s //tensorflow/python/kernel_tests/nn_ops:rnn_cell_test_cpu PASSED in 65.2s Stats over 15 runs: max = 65.2s, min = 14.8s, avg = 21.9s, dev = 12.7s //tensorflow/compiler/tests:ftrl_test_cpu PASSED in 10.7s Stats over 16 runs: max = 10.7s, min = 5.3s, avg = 7.9s, dev = 1.4s //tensorflow/compiler/tests:ternary_ops_test_cpu PASSED in 11.2s Stats over 16 runs: max = 11.2s, min = 4.3s, avg = 7.6s, dev = 2.2s //tensorflow/compiler/tests:ternary_ops_test_cpu_mlir_bridge_test PASSED in 18.5s Stats over 16 runs: max = 18.5s, min = 12.5s, avg = 13.8s, dev = 1.6s //tensorflow/python/data/experimental/kernel_tests/service:dynamic_sharding_test PASSED in 19.2s Stats over 16 runs: max = 19.2s, min = 4.7s, avg = 11.8s, dev = 4.5s //tensorflow/python/data/experimental/kernel_tests/service:worker_tags_test PASSED in 21.7s Stats over 16 runs: max = 21.7s, min = 4.5s, avg = 14.2s, dev = 5.4s //tensorflow/python/data/kernel_tests:snapshot_test PASSED in 32.1s Stats over 16 runs: max = 32.1s, min = 13.9s, avg = 21.7s, dev = 5.4s //tensorflow/python/kernel_tests/control_flow:control_flow_ops_py_test_cpu PASSED in 32.4s Stats over 16 runs: max = 32.4s, min = 7.8s, avg = 12.5s, dev = 5.6s //tensorflow/python/kernel_tests/linalg:matrix_exponential_op_test PASSED in 13.7s Stats over 16 runs: max = 13.7s, min = 8.0s, avg = 10.0s, dev = 1.4s //tensorflow/python/kernel_tests/signal:dct_ops_test_cpu PASSED in 16.1s Stats over 16 runs: max = 16.1s, min = 9.4s, avg = 13.0s, dev = 2.1s //tensorflow/python/ops:image_ops_test_cpu PASSED in 19.6s Stats over 16 runs: max = 19.6s, min = 7.5s, avg = 12.8s, dev = 3.1s //tensorflow/python/data/experimental/kernel_tests/service:distributed_save_ft_test PASSED in 53.1s Stats over 17 runs: max = 53.1s, min = 6.2s, avg = 19.1s, dev = 18.3s //tensorflow/python/data/kernel_tests:map_test PASSED in 37.3s Stats over 19 runs: max = 37.3s, min = 10.9s, avg = 19.8s, dev = 6.9s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 8.7s Stats over 20 runs: max = 8.7s, min = 3.4s, avg = 5.3s, dev = 1.9s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 9.6s Stats over 20 runs: max = 9.6s, min = 4.4s, avg = 6.5s, dev = 1.5s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 14.3s Stats over 20 runs: max = 14.3s, min = 6.7s, avg = 8.5s, dev = 1.7s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 21.8s Stats over 20 runs: max = 21.8s, min = 5.9s, avg = 10.1s, dev = 3.4s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 16.4s Stats over 20 runs: max = 16.4s, min = 7.7s, avg = 11.9s, dev = 2.9s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 16.5s Stats over 20 runs: max = 16.5s, min = 11.7s, avg = 14.0s, dev = 1.3s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 13.5s Stats over 20 runs: max = 13.5s, min = 9.6s, avg = 11.5s, dev = 1.3s //tensorflow/compiler/xla/tests:prng_test_cpu PASSED in 11.2s Stats over 20 runs: max = 11.2s, min = 8.2s, avg = 9.4s, dev = 0.8s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 40.1s Stats over 20 runs: max = 40.1s, min = 7.2s, avg = 16.5s, dev = 10.6s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 26.3s Stats over 20 runs: max = 26.3s, min = 19.2s, avg = 24.0s, dev = 2.0s //tensorflow/python/kernel_tests:metrics_test PASSED in 48.3s Stats over 20 runs: max = 48.3s, min = 10.9s, avg = 24.4s, dev = 10.7s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 9.5s Stats over 20 runs: max = 9.5s, min = 3.8s, avg = 5.5s, dev = 2.1s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 16.7s Stats over 20 runs: max = 16.7s, min = 4.6s, avg = 9.8s, dev = 2.9s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 40.8s Stats over 20 runs: max = 40.8s, min = 4.0s, avg = 13.9s, dev = 11.6s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 183.0s Stats over 20 runs: max = 183.0s, min = 40.8s, avg = 88.8s, dev = 37.6s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 11.9s Stats over 20 runs: max = 11.9s, min = 8.2s, avg = 10.3s, dev = 1.0s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 15.6s Stats over 20 runs: max = 15.6s, min = 6.0s, avg = 11.8s, dev = 2.8s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 290.2s Stats over 20 runs: max = 290.2s, min = 60.2s, avg = 145.8s, dev = 68.2s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 26.3s Stats over 20 runs: max = 26.3s, min = 8.1s, avg = 14.6s, dev = 5.4s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 23.7s Stats over 20 runs: max = 23.7s, min = 7.2s, avg = 15.0s, dev = 5.6s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 21.4s Stats over 20 runs: max = 21.4s, min = 14.7s, avg = 17.5s, dev = 1.7s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 102.9s Stats over 20 runs: max = 102.9s, min = 8.2s, avg = 46.8s, dev = 31.4s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 20.1s Stats over 20 runs: max = 20.1s, min = 10.0s, avg = 15.0s, dev = 2.7s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 21.5s Stats over 24 runs: max = 21.5s, min = 8.5s, avg = 14.9s, dev = 3.2s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 19.1s Stats over 24 runs: max = 19.1s, min = 4.4s, avg = 9.4s, dev = 4.0s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 11.6s Stats over 25 runs: max = 11.6s, min = 9.4s, avg = 10.5s, dev = 0.5s //tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 37.3s Stats over 25 runs: max = 37.3s, min = 8.0s, avg = 12.4s, dev = 7.2s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test FLAKY, failed in 1 out of 25 in 900.1s Stats over 25 runs: max = 900.1s, min = 6.4s, avg = 55.3s, dev = 172.5s /home/buildslave/.cache/bazel/_bazel_buildslave/fbac33eb30dbfb6b11b15a7ff5ac830d/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/data/experimental/kernel_tests/service/local_workers_test/shard_9_of_24/test_attempts/attempt_1.log //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 9.8s Stats over 30 runs: max = 9.8s, min = 7.8s, avg = 8.8s, dev = 0.5s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 14.1s Stats over 30 runs: max = 14.1s, min = 12.0s, avg = 12.9s, dev = 0.5s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 12.3s Stats over 30 runs: max = 12.3s, min = 10.1s, avg = 11.3s, dev = 0.7s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 8.8s Stats over 30 runs: max = 8.8s, min = 7.9s, avg = 8.3s, dev = 0.2s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 31.9s Stats over 30 runs: max = 31.9s, min = 4.2s, avg = 12.2s, dev = 6.9s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 12.2s Stats over 31 runs: max = 12.2s, min = 9.5s, avg = 10.7s, dev = 0.9s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 10.9s Stats over 32 runs: max = 10.9s, min = 8.1s, avg = 9.4s, dev = 0.8s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 18.8s Stats over 32 runs: max = 18.8s, min = 4.1s, avg = 8.0s, dev = 3.8s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 15.6s Stats over 40 runs: max = 15.6s, min = 9.0s, avg = 11.4s, dev = 1.2s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 11.1s Stats over 40 runs: max = 11.1s, min = 8.2s, avg = 9.7s, dev = 1.1s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 11.4s Stats over 40 runs: max = 11.4s, min = 9.1s, avg = 9.9s, dev = 0.6s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 13.7s Stats over 40 runs: max = 13.7s, min = 9.2s, avg = 11.4s, dev = 1.2s //tensorflow/core/kernels:stochastic_cast_op_test PASSED in 3.5s Stats over 48 runs: max = 3.5s, min = 0.7s, avg = 1.5s, dev = 0.6s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 91.0s Stats over 50 runs: max = 91.0s, min = 30.2s, avg = 49.9s, dev = 16.9s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 39.0s Stats over 50 runs: max = 39.0s, min = 3.2s, avg = 10.7s, dev = 7.9s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 41.0s Stats over 50 runs: max = 41.0s, min = 3.7s, avg = 11.4s, dev = 7.6s //tensorflow/compiler/tests:unary_ops_test_cpu PASSED in 16.9s Stats over 50 runs: max = 16.9s, min = 3.7s, avg = 7.6s, dev = 2.8s //tensorflow/compiler/tests:unary_ops_test_cpu_mlir_bridge_test PASSED in 46.9s Stats over 50 runs: max = 46.9s, min = 3.7s, avg = 8.8s, dev = 7.8s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 10.5s Stats over 50 runs: max = 10.5s, min = 7.7s, avg = 9.1s, dev = 0.6s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 13.8s Stats over 50 runs: max = 13.8s, min = 10.0s, avg = 12.1s, dev = 1.3s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 17.1s Stats over 50 runs: max = 17.1s, min = 11.9s, avg = 13.6s, dev = 1.0s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 15.7s Stats over 50 runs: max = 15.7s, min = 5.2s, avg = 8.8s, dev = 2.5s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 10.3s Stats over 50 runs: max = 10.3s, min = 3.8s, avg = 5.8s, dev = 1.6s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 11.3s Stats over 50 runs: max = 11.3s, min = 3.9s, avg = 6.8s, dev = 2.2s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 29.7s Stats over 50 runs: max = 29.7s, min = 7.7s, avg = 15.2s, dev = 5.4s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 15.1s Stats over 50 runs: max = 15.1s, min = 3.6s, avg = 6.4s, dev = 2.3s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 15.4s Stats over 50 runs: max = 15.4s, min = 4.1s, avg = 6.9s, dev = 3.4s
Executed 3787 out of 3788 tests: 3786 tests pass, 1 fails to build and 1 fails locally. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages] *** Sunday 09 July 2023 04:37:04 +0100 (2:21:51.829) 3:26:59.790 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save list of installed Python packages] *** Sunday 09 July 2023 04:37:06 +0100 (0:00:01.984) 3:27:01.774 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests output to file] ******** Sunday 09 July 2023 04:37:07 +0100 (0:00:00.688) 3:27:02.462 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests stderr output to file] *** Sunday 09 July 2023 04:37:08 +0100 (0:00:00.697) 3:27:03.160 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Extract number of tests run] ****** Sunday 09 July 2023 04:37:08 +0100 (0:00:00.705) 3:27:03.865 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show number of tests run] ********* Sunday 09 July 2023 04:37:08 +0100 (0:00:00.083) 3:27:03.948 *********** ok: [localhost] => ut_tests_line: 'Executed 3787 out of 3788 tests: 3786 tests pass, 1 fails to build and 1 fails locally.'
TASK [tensorflow_in_container : (Python 3.9) Extract failed tests] ************* Sunday 09 July 2023 04:37:08 +0100 (0:00:00.041) 3:27:03.990 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show which tests failed] ********** Sunday 09 July 2023 04:37:08 +0100 (0:00:00.072) 3:27:04.063 *********** ok: [localhost] => tests_failed: - 'FAILED: //tensorflow/compiler/xla/service/gpu:fusion_merger_test (Summary)' - 'FAILED: Build did NOT complete successfully'
TASK [tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one] *** Sunday 09 July 2023 04:37:08 +0100 (0:00:00.042) 3:27:04.105 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Get list of wheel files] ********** Sunday 09 July 2023 04:42:14 +0100 (0:05:05.952) 3:32:10.058 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Get filename of latest wheel] ***** Sunday 09 July 2023 04:42:15 +0100 (0:00:00.589) 3:32:10.647 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) move manylinux2014 wheel outside] *** Sunday 09 July 2023 04:42:15 +0100 (0:00:00.061) 3:32:10.709 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Remove manylinux2014 wheel] ******* Sunday 09 July 2023 04:42:18 +0100 (0:00:02.521) 3:32:13.231 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) stop build container] ************* Sunday 09 July 2023 04:42:18 +0100 (0:00:00.374) 3:32:13.605 *********** fatal: [localhost]: FAILED! => changed=false msg: 'Error removing container 5395fea7779bb20787f2b6dd5ef9d8958a4f30b0c4efedd476b5dc1043426a06: UnixHTTPConnectionPool(host=''localhost'', port=None): Read timed out. (read timeout=600)'
PLAY RECAP ********************************************************************* localhost : ok=47 changed=32 unreachable=0 failed=1 skipped=8 rescued=0 ignored=1
Sunday 09 July 2023 04:52:50 +0100 (0:10:31.830) 3:42:45.435 *********** =============================================================================== tensorflow_in_container : (Python 3.9) run TensorFlow-oneDNN-ACL git tests 8511.83s tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git 3687.05s tensorflow_in_container : (Python 3.9) stop build container ----------- 631.83s tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 305.95s tensorflow_in_container : (Python 3.9) build Python package ----------- 130.75s Cleanup after previous build ------------------------------------------- 31.69s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 30.14s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.99s tensorflow_in_container : (Python 3.9) start build container ------------ 3.62s Gathering Facts --------------------------------------------------------- 2.71s tensorflow_in_container : (Python 3.9) move manylinux2014 wheel outside --- 2.52s tensorflow_in_container : (Python 3.9) collect list of installed Python packages --- 1.98s tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 1.95s tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.66s Create cache dirs ------------------------------------------------------- 1.42s tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.25s tensorflow : Save git commit hash to file ------------------------------- 1.11s tensorflow_in_container : (Python 3.9) cleanup Bazel install directory --- 0.87s tensorflow_in_container : (Python 3.9) create link for pip cache -------- 0.85s tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.80s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/487/display/redirect
Changes:
------------------------------------------ [...truncated 1.55 MB...] //tensorflow/python/saved_model:load_test_cpu PASSED in 57.4s Stats over 10 runs: max = 57.4s, min = 38.5s, avg = 42.4s, dev = 5.3s //tensorflow/compiler/tests:fft_test_cpu PASSED in 22.3s Stats over 12 runs: max = 22.3s, min = 9.8s, avg = 15.5s, dev = 4.5s //tensorflow/compiler/xla/service:triangular_solve_expander_test PASSED in 4.8s Stats over 12 runs: max = 4.8s, min = 2.2s, avg = 3.4s, dev = 0.8s //tensorflow/python/data/experimental/kernel_tests:group_by_reducer_test PASSED in 17.8s Stats over 12 runs: max = 17.8s, min = 6.3s, avg = 10.7s, dev = 3.6s //tensorflow/python/data/kernel_tests:choose_from_datasets_test PASSED in 14.7s Stats over 12 runs: max = 14.7s, min = 9.3s, avg = 11.1s, dev = 1.4s //tensorflow/python/data/kernel_tests:memory_cleanup_test_cpu PASSED in 11.5s Stats over 12 runs: max = 11.5s, min = 7.7s, avg = 9.8s, dev = 1.2s //tensorflow/python/distribute:multi_process_runner_test_2gpu PASSED in 228.8s Stats over 12 runs: max = 228.8s, min = 17.3s, avg = 56.2s, dev = 58.1s //tensorflow/python/distribute:multi_process_runner_test_cpu PASSED in 226.0s Stats over 12 runs: max = 226.0s, min = 15.8s, avg = 51.2s, dev = 58.5s //tensorflow/python/eager/polymorphic_function:polymorphic_function_test_cpu PASSED in 23.1s Stats over 15 runs: max = 23.1s, min = 16.6s, avg = 19.5s, dev = 2.0s //tensorflow/python/kernel_tests/linalg:linear_operator_circulant_test_cpu PASSED in 80.4s Stats over 15 runs: max = 80.4s, min = 69.2s, avg = 73.7s, dev = 3.2s //tensorflow/python/kernel_tests/nn_ops:rnn_cell_test_cpu PASSED in 54.2s Stats over 15 runs: max = 54.2s, min = 11.7s, avg = 17.4s, dev = 10.6s //tensorflow/compiler/tests:ftrl_test_cpu PASSED in 10.4s Stats over 16 runs: max = 10.4s, min = 7.1s, avg = 8.4s, dev = 0.9s //tensorflow/compiler/tests:ternary_ops_test_cpu PASSED in 13.7s Stats over 16 runs: max = 13.7s, min = 4.3s, avg = 8.4s, dev = 2.9s //tensorflow/compiler/tests:ternary_ops_test_cpu_mlir_bridge_test PASSED in 13.1s Stats over 16 runs: max = 13.1s, min = 3.9s, avg = 9.6s, dev = 2.6s //tensorflow/python/data/experimental/kernel_tests/service:dynamic_sharding_test PASSED in 15.6s Stats over 16 runs: max = 15.6s, min = 8.3s, avg = 12.6s, dev = 2.3s //tensorflow/python/data/experimental/kernel_tests/service:worker_tags_test PASSED in 31.8s Stats over 16 runs: max = 31.8s, min = 8.0s, avg = 14.9s, dev = 5.6s //tensorflow/python/data/kernel_tests:snapshot_test PASSED in 44.3s Stats over 16 runs: max = 44.3s, min = 13.9s, avg = 32.2s, dev = 7.4s //tensorflow/python/kernel_tests/control_flow:control_flow_ops_py_test_cpu PASSED in 28.5s Stats over 16 runs: max = 28.5s, min = 5.5s, avg = 11.2s, dev = 5.0s //tensorflow/python/kernel_tests/linalg:matrix_exponential_op_test PASSED in 13.4s Stats over 16 runs: max = 13.4s, min = 7.7s, avg = 9.4s, dev = 1.4s //tensorflow/python/kernel_tests/signal:dct_ops_test_cpu PASSED in 14.7s Stats over 16 runs: max = 14.7s, min = 8.7s, avg = 12.1s, dev = 1.9s //tensorflow/python/ops:image_ops_test_cpu PASSED in 23.7s Stats over 16 runs: max = 23.7s, min = 10.9s, avg = 15.4s, dev = 3.2s //tensorflow/python/data/experimental/kernel_tests/service:distributed_save_ft_test PASSED in 78.2s Stats over 17 runs: max = 78.2s, min = 4.4s, avg = 23.8s, dev = 26.4s //tensorflow/python/data/kernel_tests:map_test PASSED in 56.2s Stats over 19 runs: max = 56.2s, min = 8.8s, avg = 18.5s, dev = 10.0s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu PASSED in 9.3s Stats over 20 runs: max = 9.3s, min = 4.3s, avg = 6.7s, dev = 1.4s //tensorflow/compiler/tests:pooling_ops_3d_test_cpu_mlir_bridge_test PASSED in 9.4s Stats over 20 runs: max = 9.4s, min = 3.6s, avg = 5.7s, dev = 1.8s //tensorflow/compiler/tests:pooling_ops_test_cpu PASSED in 15.3s Stats over 20 runs: max = 15.3s, min = 5.2s, avg = 8.1s, dev = 2.3s //tensorflow/compiler/tests:pooling_ops_test_cpu_mlir_bridge_test PASSED in 17.6s Stats over 20 runs: max = 17.6s, min = 4.2s, avg = 7.9s, dev = 3.8s //tensorflow/compiler/xla/tests:convolution_dimension_numbers_test_cpu PASSED in 9.7s Stats over 20 runs: max = 9.7s, min = 7.5s, avg = 8.1s, dev = 0.6s //tensorflow/compiler/xla/tests:dot_operation_single_threaded_runtime_test_cpu PASSED in 13.8s Stats over 20 runs: max = 13.8s, min = 10.4s, avg = 11.8s, dev = 0.9s //tensorflow/compiler/xla/tests:dot_operation_test_cpu PASSED in 11.0s Stats over 20 runs: max = 11.0s, min = 9.7s, avg = 10.3s, dev = 0.4s //tensorflow/compiler/xla/tests:prng_test_cpu PASSED in 10.1s Stats over 20 runs: max = 10.1s, min = 7.2s, avg = 8.0s, dev = 0.6s //tensorflow/compiler/xla/tests:reduce_window_test_cpu PASSED in 40.9s Stats over 20 runs: max = 40.9s, min = 7.5s, avg = 17.0s, dev = 10.7s //tensorflow/python/autograph/tests:loop_control_flow_test PASSED in 28.0s Stats over 20 runs: max = 28.0s, min = 16.2s, avg = 22.7s, dev = 3.6s //tensorflow/python/kernel_tests:metrics_test PASSED in 43.8s Stats over 20 runs: max = 43.8s, min = 7.4s, avg = 19.1s, dev = 9.9s //tensorflow/python/kernel_tests/array_ops:matrix_band_part_op_test_cpu PASSED in 9.3s Stats over 20 runs: max = 9.3s, min = 3.9s, avg = 6.2s, dev = 2.1s //tensorflow/python/kernel_tests/data_structures:barrier_ops_test PASSED in 18.3s Stats over 20 runs: max = 18.3s, min = 8.5s, avg = 11.3s, dev = 2.7s //tensorflow/python/kernel_tests/linalg:eig_op_test PASSED in 43.6s Stats over 20 runs: max = 43.6s, min = 4.9s, avg = 15.5s, dev = 12.1s //tensorflow/python/kernel_tests/linalg:linalg_grad_test_cpu PASSED in 93.5s Stats over 20 runs: max = 93.5s, min = 29.8s, avg = 56.0s, dev = 18.8s //tensorflow/python/kernel_tests/linalg:norm_op_test_cpu PASSED in 10.4s Stats over 20 runs: max = 10.4s, min = 4.6s, avg = 8.1s, dev = 2.0s //tensorflow/python/kernel_tests/linalg:normalize_op_test_cpu PASSED in 16.4s Stats over 20 runs: max = 16.4s, min = 6.7s, avg = 11.7s, dev = 2.8s //tensorflow/python/kernel_tests/linalg:qr_op_test_cpu PASSED in 179.3s Stats over 20 runs: max = 179.3s, min = 38.8s, avg = 108.2s, dev = 43.1s //tensorflow/python/kernel_tests/linalg:self_adjoint_eig_op_test_cpu PASSED in 28.0s Stats over 20 runs: max = 28.0s, min = 4.9s, avg = 13.1s, dev = 6.6s //tensorflow/python/kernel_tests/math_ops:batch_matmul_op_test_cpu PASSED in 25.7s Stats over 20 runs: max = 25.7s, min = 8.2s, avg = 16.6s, dev = 6.1s //tensorflow/python/kernel_tests/math_ops:matmul_op_test_cpu PASSED in 21.3s Stats over 20 runs: max = 21.3s, min = 18.6s, avg = 20.4s, dev = 0.6s //tensorflow/python/kernel_tests/math_ops:tensordot_op_test_cpu PASSED in 76.7s Stats over 20 runs: max = 76.7s, min = 10.3s, avg = 33.8s, dev = 22.8s //tensorflow/python/kernel_tests/nn_ops:embedding_ops_test_cpu PASSED in 18.2s Stats over 20 runs: max = 18.2s, min = 10.2s, avg = 13.5s, dev = 2.4s //tensorflow/python/data/experimental/kernel_tests/service:local_workers_test PASSED in 23.3s Stats over 24 runs: max = 23.3s, min = 7.3s, avg = 17.5s, dev = 3.6s //tensorflow/python/data/kernel_tests:interleave_test PASSED in 19.8s Stats over 24 runs: max = 19.8s, min = 6.7s, avg = 11.7s, dev = 3.6s //tensorflow/python/data/kernel_tests:sample_from_datasets_test PASSED in 20.5s Stats over 24 runs: max = 20.5s, min = 4.3s, avg = 9.9s, dev = 4.9s //tensorflow/compiler/xla/tests:array_elementwise_ops_test_cpu PASSED in 11.9s Stats over 25 runs: max = 11.9s, min = 8.0s, avg = 9.6s, dev = 1.1s //tensorflow/compiler/xla/tests:select_and_scatter_test_cpu PASSED in 37.5s Stats over 25 runs: max = 37.5s, min = 7.8s, avg = 12.6s, dev = 7.4s //tensorflow/compiler/xla/tests:convolution_variants_test_cpu PASSED in 9.3s Stats over 30 runs: max = 9.3s, min = 7.7s, avg = 8.3s, dev = 0.5s //tensorflow/compiler/xla/tests:iota_test_cpu PASSED in 13.6s Stats over 30 runs: max = 13.6s, min = 12.0s, avg = 12.7s, dev = 0.4s //tensorflow/compiler/xla/tests:params_test_cpu PASSED in 10.9s Stats over 30 runs: max = 10.9s, min = 8.0s, avg = 8.7s, dev = 0.5s //tensorflow/compiler/xla/tests:reshape_test_cpu PASSED in 8.3s Stats over 30 runs: max = 8.3s, min = 7.6s, avg = 8.0s, dev = 0.2s //tensorflow/python/kernel_tests/nn_ops:conv_ops_3d_test_cpu PASSED in 21.8s Stats over 30 runs: max = 21.8s, min = 4.4s, avg = 11.4s, dev = 5.4s //tensorflow/compiler/xla/tests:reduce_test_cpu PASSED in 9.3s Stats over 31 runs: max = 9.3s, min = 7.9s, avg = 8.6s, dev = 0.4s //tensorflow/compiler/xla/tests:scalar_computations_test_cpu PASSED in 11.0s Stats over 32 runs: max = 11.0s, min = 8.0s, avg = 8.9s, dev = 0.7s //tensorflow/python/data/experimental/kernel_tests/service:data_service_ops_test PASSED in 25.8s Stats over 32 runs: max = 25.8s, min = 6.7s, avg = 12.2s, dev = 4.5s //tensorflow/compiler/xla/tests:batch_normalization_test_cpu PASSED in 11.1s Stats over 40 runs: max = 11.1s, min = 8.1s, avg = 10.2s, dev = 0.6s //tensorflow/compiler/xla/tests:bfloat16_test_cpu PASSED in 12.6s Stats over 40 runs: max = 12.6s, min = 9.5s, avg = 11.3s, dev = 0.8s //tensorflow/compiler/xla/tests:conv_depthwise_backprop_filter_test_cpu PASSED in 11.7s Stats over 40 runs: max = 11.7s, min = 8.9s, avg = 9.8s, dev = 0.6s //tensorflow/compiler/xla/tests:slice_test_cpu PASSED in 12.8s Stats over 40 runs: max = 12.8s, min = 8.6s, avg = 10.2s, dev = 0.9s //tensorflow/core/kernels:stochastic_cast_op_test PASSED in 1.7s Stats over 48 runs: max = 1.7s, min = 0.4s, avg = 0.6s, dev = 0.3s //tensorflow/compiler/mlir/quantization/tensorflow/python:quantize_model_test PASSED in 62.0s Stats over 50 runs: max = 62.0s, min = 21.0s, avg = 34.3s, dev = 9.6s //tensorflow/compiler/tests:sort_ops_test_cpu PASSED in 43.8s Stats over 50 runs: max = 43.8s, min = 3.5s, avg = 11.8s, dev = 8.7s //tensorflow/compiler/tests:sort_ops_test_cpu_mlir_bridge_test PASSED in 41.9s Stats over 50 runs: max = 41.9s, min = 3.4s, avg = 11.5s, dev = 8.1s //tensorflow/compiler/tests:unary_ops_test_cpu PASSED in 24.3s Stats over 50 runs: max = 24.3s, min = 3.6s, avg = 8.1s, dev = 4.0s //tensorflow/compiler/tests:unary_ops_test_cpu_mlir_bridge_test PASSED in 24.7s Stats over 50 runs: max = 24.7s, min = 3.6s, avg = 6.6s, dev = 4.5s //tensorflow/compiler/xla/tests:conv_depthwise_test_cpu PASSED in 12.7s Stats over 50 runs: max = 12.7s, min = 8.2s, avg = 10.0s, dev = 0.9s //tensorflow/compiler/xla/tests:convolution_test_1d_no_vmodule_cpu PASSED in 14.9s Stats over 50 runs: max = 14.9s, min = 10.0s, avg = 12.5s, dev = 1.2s //tensorflow/compiler/xla/tests:convolution_test_cpu PASSED in 14.4s Stats over 50 runs: max = 14.4s, min = 9.1s, avg = 11.6s, dev = 1.1s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_dense_mat_mul_grad_test_cpu PASSED in 11.6s Stats over 50 runs: max = 11.6s, min = 4.6s, avg = 7.7s, dev = 1.9s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_grad_test_cpu PASSED in 10.2s Stats over 50 runs: max = 10.2s, min = 3.6s, avg = 5.0s, dev = 1.6s //tensorflow/python/kernel_tests/linalg/sparse:csr_sparse_matrix_sparse_mat_mul_grad_test_cpu PASSED in 10.0s Stats over 50 runs: max = 10.0s, min = 3.7s, avg = 5.4s, dev = 1.8s //tensorflow/python/kernel_tests/math_ops:cwise_ops_binary_test_cpu PASSED in 32.4s Stats over 50 runs: max = 32.4s, min = 8.0s, avg = 15.5s, dev = 5.9s //tensorflow/python/kernel_tests/math_ops:cwise_ops_test_cpu PASSED in 10.9s Stats over 50 runs: max = 10.9s, min = 3.8s, avg = 5.8s, dev = 1.8s //tensorflow/python/kernel_tests/math_ops:cwise_ops_unary_test_cpu PASSED in 14.4s Stats over 50 runs: max = 14.4s, min = 3.7s, avg = 6.0s, dev = 2.8s
Executed 3787 out of 3788 tests: 3786 tests pass, 1 fails to build and 1 fails locally. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted> ...ignoring
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages] *** Monday 10 July 2023 04:35:07 +0100 (2:19:15.878) 3:25:01.766 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save list of installed Python packages] *** Monday 10 July 2023 04:35:09 +0100 (0:00:02.044) 3:25:03.810 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests output to file] ******** Monday 10 July 2023 04:35:09 +0100 (0:00:00.686) 3:25:04.497 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests stderr output to file] *** Monday 10 July 2023 04:35:10 +0100 (0:00:00.700) 3:25:05.198 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Extract number of tests run] ****** Monday 10 July 2023 04:35:11 +0100 (0:00:00.707) 3:25:05.905 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show number of tests run] ********* Monday 10 July 2023 04:35:11 +0100 (0:00:00.080) 3:25:05.986 *********** ok: [localhost] => ut_tests_line: 'Executed 3787 out of 3788 tests: 3786 tests pass, 1 fails to build and 1 fails locally.'
TASK [tensorflow_in_container : (Python 3.9) Extract failed tests] ************* Monday 10 July 2023 04:35:11 +0100 (0:00:00.040) 3:25:06.027 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show which tests failed] ********** Monday 10 July 2023 04:35:11 +0100 (0:00:00.071) 3:25:06.099 *********** ok: [localhost] => tests_failed: - 'FAILED: //tensorflow/compiler/xla/service/gpu:fusion_merger_test (Summary)' - 'FAILED: Build did NOT complete successfully'
TASK [tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one] *** Monday 10 July 2023 04:35:11 +0100 (0:00:00.042) 3:25:06.141 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Get list of wheel files] ********** Monday 10 July 2023 04:40:33 +0100 (0:05:21.401) 3:30:27.542 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Get filename of latest wheel] ***** Monday 10 July 2023 04:40:33 +0100 (0:00:00.605) 3:30:28.148 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) move manylinux2014 wheel outside] *** Monday 10 July 2023 04:40:33 +0100 (0:00:00.060) 3:30:28.209 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Remove manylinux2014 wheel] ******* Monday 10 July 2023 04:40:36 +0100 (0:00:02.527) 3:30:30.736 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) stop build container] ************* Monday 10 July 2023 04:40:36 +0100 (0:00:00.374) 3:30:31.111 *********** fatal: [localhost]: FAILED! => changed=false msg: 'Error removing container 831ffaeddd9ebd17732a49a09af84f7121ed20ce42cde90e5a74e9ebf8cf10e8: UnixHTTPConnectionPool(host=''localhost'', port=None): Read timed out. (read timeout=600)'
PLAY RECAP ********************************************************************* localhost : ok=47 changed=32 unreachable=0 failed=1 skipped=8 rescued=0 ignored=1
Monday 10 July 2023 04:51:12 +0100 (0:10:35.469) 3:41:06.580 *********** =============================================================================== tensorflow_in_container : (Python 3.9) run TensorFlow-oneDNN-ACL git tests 8355.88s tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git 3733.35s tensorflow_in_container : (Python 3.9) stop build container ----------- 635.47s tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 321.40s tensorflow_in_container : (Python 3.9) build Python package ----------- 129.41s Cleanup after previous build ------------------------------------------- 32.00s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 22.59s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.96s tensorflow_in_container : (Python 3.9) start build container ------------ 3.84s Gathering Facts --------------------------------------------------------- 2.66s tensorflow_in_container : (Python 3.9) move manylinux2014 wheel outside --- 2.53s tensorflow_in_container : (Python 3.9) collect list of installed Python packages --- 2.04s tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 1.99s tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.67s Create cache dirs ------------------------------------------------------- 1.42s tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.22s tensorflow : Save git commit hash to file ------------------------------- 1.13s tensorflow_in_container : (Python 3.9) cleanup Bazel install directory --- 0.89s tensorflow_in_container : (Python 3.9) create link for pip cache -------- 0.86s tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 0.83s Build step 'Execute shell' marked build as failure
ldcg-ai-ml@op-lists.linaro.org
-
ci_notify＠linaro.org