See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/484/display/redirect
Changes:
------------------------------------------ [...truncated 14.18 KB...] changed: [localhost]
TASK [tensorflow_in_container : Show list of installed Python packages for build] *** Friday 07 July 2023 01:11:27 +0100 (0:00:02.163) 0:01:23.190 *********** ok: [localhost] => pip_list_output.stdout: |- Package Version Location Installer ----------------------- -------------------- -------------------------------------- --------- absl-py 1.0.0 /usr/local/lib/python3.8/dist-packages pip astor 0.8.1 /usr/local/lib/python3.8/dist-packages pip astroid 2.11.7 /usr/local/lib/python3.8/dist-packages pip astunparse 1.6.3 /usr/local/lib/python3.8/dist-packages pip auditwheel 5.3.0 /usr/local/lib/python3.8/dist-packages pip bleach 6.0.0 /usr/local/lib/python3.8/dist-packages pip cachetools 5.3.1 /usr/local/lib/python3.8/dist-packages pip certifi 2019.11.28 /usr/lib/python3/dist-packages cffi 1.15.1 /usr/local/lib/python3.8/dist-packages pip chardet 3.0.4 /usr/lib/python3/dist-packages colorama 0.4.6 /usr/local/lib/python3.8/dist-packages pip cryptography 41.0.1 /usr/local/lib/python3.8/dist-packages pip Cython 0.29.35 /usr/local/lib/python3.8/dist-packages pip dbus-python 1.2.16 /usr/lib/python3/dist-packages dill 0.3.6 /usr/local/lib/python3.8/dist-packages pip docutils 0.20.1 /usr/local/lib/python3.8/dist-packages pip flatbuffers 23.1.21 /usr/local/lib/python3.8/dist-packages pip future 0.18.3 /usr/local/lib/python3.8/dist-packages pip gast 0.4.0 /usr/local/lib/python3.8/dist-packages pip google-auth 2.20.0 /usr/local/lib/python3.8/dist-packages pip google-auth-oauthlib 1.0.0 /usr/local/lib/python3.8/dist-packages pip google-pasta 0.2.0 /usr/local/lib/python3.8/dist-packages pip grpcio 1.49.1 /usr/local/lib/python3.8/dist-packages pip h5py 3.8.0 /usr/local/lib/python3.8/dist-packages pip idna 2.8 /usr/lib/python3/dist-packages importlib-metadata 6.6.0 /usr/local/lib/python3.8/dist-packages pip importlib-resources 5.12.0 /usr/local/lib/python3.8/dist-packages pip isort 5.12.0 /usr/local/lib/python3.8/dist-packages pip jaraco.classes 3.2.3 /usr/local/lib/python3.8/dist-packages pip jax 0.3.25 /usr/local/lib/python3.8/dist-packages pip jeepney 0.8.0 /usr/local/lib/python3.8/dist-packages pip junitparser 2.2.0 /usr/local/lib/python3.8/dist-packages pip Keras-Applications 1.0.8 /usr/local/lib/python3.8/dist-packages pip keras-nightly 2.14.0.dev2023061907 /usr/local/lib/python3.8/dist-packages pip Keras-Preprocessing 1.1.2 /usr/local/lib/python3.8/dist-packages pip keyring 23.13.1 /usr/local/lib/python3.8/dist-packages pip lazy-object-proxy 1.9.0 /usr/local/lib/python3.8/dist-packages pip lit 16.0.5.post0 /usr/local/lib/python3.8/dist-packages pip lxml 4.9.2 /usr/local/lib/python3.8/dist-packages pip Markdown 3.4.3 /usr/local/lib/python3.8/dist-packages pip MarkupSafe 2.1.3 /usr/local/lib/python3.8/dist-packages pip mccabe 0.7.0 /usr/local/lib/python3.8/dist-packages pip more-itertools 9.1.0 /usr/local/lib/python3.8/dist-packages pip numpy 1.23.5 /usr/local/lib/python3.8/dist-packages pip oauthlib 3.2.2 /usr/local/lib/python3.8/dist-packages pip opt-einsum 3.3.0 /usr/local/lib/python3.8/dist-packages pip packaging 21.3 /usr/local/lib/python3.8/dist-packages pip pip 23.1.2 /usr/local/lib/python3.8/dist-packages pip pkginfo 1.9.6 /usr/local/lib/python3.8/dist-packages pip platformdirs 3.5.3 /usr/local/lib/python3.8/dist-packages pip portpicker 1.5.2 /usr/local/lib/python3.8/dist-packages pip protobuf 4.23.2 /usr/local/lib/python3.8/dist-packages pip psutil 5.9.5 /usr/local/lib/python3.8/dist-packages pip pyasn1 0.5.0 /usr/local/lib/python3.8/dist-packages pip pyasn1-modules 0.3.0 /usr/local/lib/python3.8/dist-packages pip pycparser 2.21 /usr/local/lib/python3.8/dist-packages pip pyelftools 0.29 /usr/local/lib/python3.8/dist-packages pip Pygments 2.15.1 /usr/local/lib/python3.8/dist-packages pip PyGObject 3.36.0 /usr/lib/python3/dist-packages pylint 2.13.9 /usr/local/lib/python3.8/dist-packages pip pyparsing 3.0.9 /usr/local/lib/python3.8/dist-packages pip python-apt 2.0.1+ubuntu0.20.4.1 /usr/lib/python3/dist-packages PyYAML 6.0 /usr/local/lib/python3.8/dist-packages pip readme-renderer 37.3 /usr/local/lib/python3.8/dist-packages pip requests 2.22.0 /usr/lib/python3/dist-packages requests-oauthlib 1.3.1 /usr/local/lib/python3.8/dist-packages pip requests-toolbelt 1.0.0 /usr/local/lib/python3.8/dist-packages pip requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages rfc3986 2.0.0 /usr/local/lib/python3.8/dist-packages pip rsa 4.9 /usr/local/lib/python3.8/dist-packages pip scipy 1.9.3 /usr/local/lib/python3.8/dist-packages pip SecretStorage 3.3.3 /usr/local/lib/python3.8/dist-packages pip setuptools 45.2.0 /usr/lib/python3/dist-packages six 1.15.0 /usr/local/lib/python3.8/dist-packages pip tb-nightly 2.14.0a20230618 /usr/local/lib/python3.8/dist-packages pip tensorboard-data-server 0.7.1 /usr/local/lib/python3.8/dist-packages pip termcolor 1.1.0 /usr/local/lib/python3.8/dist-packages pip tf-estimator-nightly 2.14.0.dev2023061908 /usr/local/lib/python3.8/dist-packages pip tomli 2.0.1 /usr/local/lib/python3.8/dist-packages pip tqdm 4.65.0 /usr/local/lib/python3.8/dist-packages pip twine 3.6.0 /usr/local/lib/python3.8/dist-packages pip typing-extensions 3.7.4.3 /usr/local/lib/python3.8/dist-packages pip urllib3 1.25.8 /usr/lib/python3/dist-packages webencodings 0.5.1 /usr/local/lib/python3.8/dist-packages pip Werkzeug 2.3.6 /usr/local/lib/python3.8/dist-packages pip wheel 0.38.4 /usr/local/lib/python3.8/dist-packages pip wrapt 1.12.1 /usr/local/lib/python3.8/dist-packages pip zipp 3.15.0 /usr/local/lib/python3.8/dist-packages pip
TASK [tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git] *** Friday 07 July 2023 01:11:27 +0100 (0:00:00.041) 0:01:23.232 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) build Python package] ************* Friday 07 July 2023 02:12:41 +0100 (1:01:13.778) 1:02:37.010 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) cleanup Bazel install directory] *** Friday 07 July 2023 02:15:49 +0100 (0:03:07.936) 1:05:44.947 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) create script to run tests] ******* Friday 07 July 2023 02:15:50 +0100 (0:00:00.835) 1:05:45.782 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) run TensorFlow-oneDNN-ACL git tests] *** Friday 07 July 2023 02:15:51 +0100 (0:00:00.716) 1:05:46.498 *********** [WARNING]: Failure using method (v2_runner_on_failed) in callback plugin (<ansible_collections.community.general.plugins.callback.yaml.CallbackModule object at 0xffffae9baf40>): 'utf-8' codec can't encode character '\udcff' in position 121909829: surrogates not allowed
TASK [tensorflow_in_container : (Python 3.8) collect list of installed Python packages] *** Friday 07 July 2023 04:42:05 +0100 (2:26:14.787) 3:32:01.286 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) save list of installed Python packages] *** Friday 07 July 2023 04:42:08 +0100 (0:00:02.045) 3:32:03.331 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) save tests output to file] ******** Friday 07 July 2023 04:42:08 +0100 (0:00:00.711) 3:32:04.043 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) save tests stderr output to file] *** Friday 07 July 2023 04:42:12 +0100 (0:00:03.293) 3:32:07.336 *********** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.8) Extract number of tests run] ****** Friday 07 July 2023 04:42:13 +0100 (0:00:01.670) 3:32:09.007 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.8) Show number of tests run] ********* Friday 07 July 2023 04:42:18 +0100 (0:00:04.413) 3:32:13.420 *********** ok: [localhost] => ut_tests_line: 'Executed 3788 out of 3789 tests: 3546 tests pass'
TASK [tensorflow_in_container : (Python 3.8) Extract failed tests] ************* Friday 07 July 2023 04:42:18 +0100 (0:00:00.046) 3:32:13.466 *********** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.8) Show which tests failed] ********** Friday 07 July 2023 04:42:19 +0100 (0:00:01.003) 3:32:14.469 *********** ok: [localhost] => tests_failed: 'FAILED: '
TASK [tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one] *** Friday 07 July 2023 04:42:19 +0100 (0:00:00.046) 3:32:14.516 *********** fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- + for wheel in /tf/pkg/*.whl + echo 'Checking and renaming /tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-linux_aarch64.whl...' + python3 -m auditwheel repair --plat manylinux2014_aarch64 /tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-linux_aarch64.whl --wheel-dir /tf/pkg + tee check.txt
real 2m48.873s user 2m15.763s sys 0m18.680s ++ grep --extended-regexp --only-matching '/tf/pkg/\S+.whl' check.txt + new_wheel=/tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + [[ /tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl != /\t\f/\p\k\g/\t\e\n\s\o\r\f\l\o\w_\a\a\r\c\h\6\4-\2.\1\4.\0-\c\p\3\8-\c\p\3\8-\l\i\n\u\x_\a\a\r\c\h\6\4.\w\h\l ]] + rm /tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-linux_aarch64.whl + wheel=/tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + TF_WHEEL=/tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl + bats /usertools/wheel_verification.bats --timing stderr_lines: <omitted> stdout: |- Checking and renaming /tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-linux_aarch64.whl... INFO:auditwheel.main_repair:Repairing tensorflow_aarch64-2.14.0-cp38-cp38-linux_aarch64.whl INFO:auditwheel.wheeltools:Previous filename tags: linux_aarch64 INFO:auditwheel.wheeltools:New filename tags: manylinux_2_17_aarch64, manylinux2014_aarch64 INFO:auditwheel.wheeltools:Previous WHEEL info tags: cp38-cp38-linux_aarch64 INFO:auditwheel.wheeltools:New WHEEL info tags: cp38-cp38-manylinux_2_17_aarch64, cp38-cp38-manylinux2014_aarch64 INFO:auditwheel.main_repair: Fixed-up wheel written to /tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl 1..6 ok 1 Wheel is manylinux2014 (manylinux_2_17) compliant in 67911ms # Size of /tf/pkg/tensorflow_aarch64-2.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl is 249 / 580 megabytes. ok 2 Wheel conforms to upstream size limitations in 15ms not ok 3 Wheel is installable in 24078ms # (in test file /usertools/wheel_verification.bats, line 61) # `python3 -m pip install "$TF_WHEEL"' failed # Collecting setuptools # Using cached setuptools-68.0.0-py3-none-any.whl (804 kB) # Collecting wheel # Using cached wheel-0.40.0-py3-none-any.whl (64 kB) # Installing collected packages: setuptools, wheel # Attempting uninstall: setuptools # Found existing installation: setuptools 44.0.0 # Uninstalling setuptools-44.0.0: # Successfully uninstalled setuptools-44.0.0 # Successfully installed setuptools-68.0.0 wheel-0.40.0 # Processing ./tensorflow_aarch64-2.14.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl # ERROR: Package 'tensorflow-aarch64' requires a different Python: 3.8.10 not in '>=3.9' not ok 4 TensorFlow is importable in 42ms # (in test file /usertools/wheel_verification.bats, line 66) # `python3 -c 'import tensorflow as tf; t1=tf.constant([1,2,3,4]); t2=tf.constant([5,6,7,8]); print(tf.add(t1,t2).shape)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' not ok 5 TensorFlow has Keras in 41ms # (in test file /usertools/wheel_verification.bats, line 72) # `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "_v2.keras" in tf.keras.__name__ else 1)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' not ok 6 TensorFlow has Estimator in 41ms # (in test file /usertools/wheel_verification.bats, line 78) # `python3 -c 'import sys; import tensorflow as tf; sys.exit(0 if "_v2.estimator" in tf.estimator.__name__ else 1)'' failed # Traceback (most recent call last): # File "<string>", line 1, in <module> # ModuleNotFoundError: No module named 'tensorflow' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=42 changed=29 unreachable=0 failed=1 skipped=8 rescued=0 ignored=1
Friday 07 July 2023 04:46:41 +0100 (0:04:22.094) 3:36:36.610 *********** =============================================================================== tensorflow_in_container : (Python 3.8) run TensorFlow-oneDNN-ACL git tests 8774.79s tensorflow_in_container : (Python 3.8) build TensorFlow-oneDNN-ACL git 3673.78s tensorflow_in_container : (Python 3.8) Convert wheel to manylinux2014 compatible one - 262.09s tensorflow_in_container : (Python 3.8) build Python package ----------- 187.94s Cleanup after previous build ------------------------------------------- 35.09s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 22.03s tensorflow_in_container : (Python 3.8) Extract number of tests run ------ 4.41s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.99s tensorflow_in_container : (Python 3.8) start build container ------------ 3.61s tensorflow_in_container : (Python 3.8) save tests output to file -------- 3.29s tensorflow_in_container : (Python 3.8) collect list of installed Python packages for build --- 2.16s tensorflow_in_container : (Python 3.8) collect list of installed Python packages --- 2.05s tensorflow_in_container : (Python 3.8) save tests stderr output to file --- 1.67s Gathering Facts --------------------------------------------------------- 1.65s tensorflow_in_container : (Python 3.8) build Python versioned container --- 1.62s Create cache dirs ------------------------------------------------------- 1.42s tensorflow_in_container : (Python 3.8) create buildslave bazel cache dir --- 1.24s tensorflow : Save git commit hash to file ------------------------------- 1.13s tensorflow_in_container : (Python 3.8) Extract failed tests ------------- 1.00s tensorflow_in_container : (Python 3.8) create link for bazelisk cache --- 0.87s Build step 'Execute shell' marked build as failure