See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/530/display/redirect
Changes:
------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on ldcg-aarch64-02 (aarch64 leg-aarch64) in workspace https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/ws/ [ldcg-python-manylinux-tensorflow-onednn-nightly] $ /bin/bash /tmp/jenkins9182788812863326314.sh + cd https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/ws/ + rm -rf '*.sh' configs wheels cache_upload + mkdir wheels cache_upload + git clone --depth 1 https://git.linaro.org/ci/job/configs.git Cloning into 'configs'... + cd configs + git log --pretty=oneline -1 38ce7429e931af6de53a3119459d3bfc1bfabec5 tcwg_bmk-fujitsu_speed-cpu2017speed--gnu.yaml: Disable fujitsu jobs using gnu + cd .. + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' true = true ']' + echo ' - "git"' + '[' true = true ']' + sed -i -e /onednn_build/s/false/true/ configs/ldcg-python-manylinux-tensorflow/ansible/vars/vars.yml + '[' true = true ']' + sed -i -e /onednn_enable_opt/s/false/true/ -e /extra_test_options/s/0/1/ configs/ldcg-python-manylinux-tensorflow/ansible/vars/vars.yml + '[' '' = true ']' + '[' true = true ']' + sed -i -e /clang_build/s/false/true/ configs/ldcg-python-manylinux-tensorflow/ansible/vars/vars.yml + ansible-galaxy collection install community.docker Starting galaxy collection install process Nothing to do. All requested collections are already installed. If you want to reinstall them, consider using `--force`. + cd configs/ldcg-python-manylinux-tensorflow/ansible/ + sed -i -es+/tmp/workspace+https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/ws/+g vars/vars.yml + ansible-playbook playbooks/build-tf-dual-abi.yml [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all'
PLAY [Build TensorFlow in Dual ABI container] **********************************
TASK [Gathering Facts] ********************************************************* Friday 18 August 2023 01:10:05 +0100 (0:00:00.042) 0:00:00.042 ********* ok: [localhost]
TASK [Cleanup after previous build] ******************************************** Friday 18 August 2023 01:10:06 +0100 (0:00:01.631) 0:00:01.673 ********* changed: [localhost] => (item=disk-cache) changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels) ok: [localhost] => (item=tensorflow)
TASK [Create cache dirs] ******************************************************* Friday 18 August 2023 01:10:43 +0100 (0:00:36.729) 0:00:38.403 ********* changed: [localhost] => (item=disk-cache) ok: [localhost] => (item=bazel-cache) changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels)
TASK [Set dual abi variable] *************************************************** Friday 18 August 2023 01:10:45 +0100 (0:00:01.436) 0:00:39.839 ********* ok: [localhost]
TASK [Go through each TensorFlow version] ************************************** Friday 18 August 2023 01:10:45 +0100 (0:00:00.031) 0:00:39.870 ********* skipping: [localhost] => (item={'key': '2.14', 'value': {'tensorflow_version': '2.14.0-rc0', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 23.5.26', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'protobuf_version': '>=3.20.3,<5.0.0dev,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.14.0rc0', 'tensorboard_version': '==2.14.0', 'tensorflow_estimator_version': '==2.14.0rc0', 'image_prefix': '2.14', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test', '//tensorflow/core/grappler/optimizers:remapper_test', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/xla/service/gpu:fusion_merger_test', '//tensorflow/python/kernel_tests/proto:decode_proto_op_test', '//tensorflow/python/util/protobuf:protobuf_compare_test', '//tensorflow/tools/api/tests:api_compatibility_test'], 'unit_tests_gcc_exclude': ['//tensorflow/compiler/mlir/lite/debug:debug_test'], 'unit_tests_clang_exclude': ['//tensorflow/compiler/mlir/lite/quantization/lite:quantize_model_test', '//tensorflow/compiler/mlir/lite/quantization/lite:quantize_weights_test', '//tensorflow/compiler/mlir/lite/sparsity:sparsify_model_test', '//tensorflow/compiler/xla/service/cpu/tests:cpu_eigen_dot_operation_test', '//tensorflow/core/kernels/image:resize_bicubic_op_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.9', '3.10', '3.11']}}) skipping: [localhost] => (item={'key': '2.13', 'value': {'tensorflow_version': '2.13.0', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 23.1.21', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'protobuf_version': '>=3.20.3,<5.0.0dev,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.13.1', 'tensorboard_version': '==2.13.0', 'tensorflow_estimator_version': '==2.13.0', 'image_prefix': '2.13', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test', '//tensorflow/core/grappler/optimizers:remapper_test', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/python/kernel_tests/proto:decode_proto_op_test', '//tensorflow/python/util/protobuf:protobuf_compare_test', '//tensorflow/tools/api/tests:api_compatibility_test'], 'unit_tests_gcc_exclude': '', 'unit_tests_clang_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.8', '3.9', '3.10', '3.11']}}) skipping: [localhost] => (item={'key': '2.12', 'value': {'tensorflow_version': '2.12.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 2.0, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'protobuf_version': '>=3.20.3,<5.0.0dev,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.12.0', 'tensorboard_version': '==2.12.3', 'tensorflow_estimator_version': '==2.12.0', 'image_prefix': '2.12', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/python/kernel_tests/proto:decode_proto_op_test', '//tensorflow/python/util/protobuf:protobuf_compare_test', '//tensorflow/tools/api/tests:api_compatibility_test', '//tensorflow/tsl/framework/convolution:spatial_convolutions_test'], 'unit_tests_gcc_exclude': '', 'unit_tests_clang_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.8', '3.9', '3.10', '3.11']}})
TASK [tensorflow : Set TensorFlow and other package versions] ****************** Friday 18 August 2023 01:10:45 +0100 (0:00:00.159) 0:00:40.029 ********* ok: [localhost]
TASK [tensorflow : Set build dir for TensorFlow-oneDNN-ACL git] **************** Friday 18 August 2023 01:10:45 +0100 (0:00:00.082) 0:00:40.112 ********* ok: [localhost]
TASK [tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build] *** Friday 18 August 2023 01:10:45 +0100 (0:00:00.039) 0:00:40.152 ********* changed: [localhost]
TASK [tensorflow : Fetch TensorFlow] ******************************************* Friday 18 August 2023 01:10:49 +0100 (0:00:03.973) 0:00:44.125 ********* included: https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/ws/configs/ldcg-python-manylinux-tensorflow/ansible/roles/tensorflow/tasks/fetch.yml for localhost
TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL git source] ********************* Friday 18 August 2023 01:10:49 +0100 (0:00:00.089) 0:00:44.215 ********* skipping: [localhost]
TASK [tensorflow : Unpack TensorFlow-oneDNN-ACL git source] ******************** Friday 18 August 2023 01:10:49 +0100 (0:00:00.034) 0:00:44.250 ********* skipping: [localhost]
TASK [tensorflow : Rename source dir for oneDNN build] ************************* Friday 18 August 2023 01:10:49 +0100 (0:00:00.031) 0:00:44.282 ********* skipping: [localhost]
TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL from git] *********************** Friday 18 August 2023 01:10:49 +0100 (0:00:00.034) 0:00:44.317 ********* changed: [localhost]
TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL from git at commit] ************* Friday 18 August 2023 01:11:11 +0100 (0:00:21.581) 0:01:05.898 ********* skipping: [localhost]
TASK [tensorflow : Set world write access to source] *************************** Friday 18 August 2023 01:11:11 +0100 (0:00:00.031) 0:01:05.930 ********* changed: [localhost]
TASK [tensorflow : Get oneline version of git log for this checkout] *********** Friday 18 August 2023 01:11:11 +0100 (0:00:00.371) 0:01:06.301 ********* changed: [localhost]
TASK [tensorflow : Show git log] *********************************************** Friday 18 August 2023 01:11:12 +0100 (0:00:00.593) 0:01:06.895 ********* ok: [localhost] => git_log.stdout: 46d8a64491ddf2d0fac477a8187f8d8a52c24f25 Trace additional CUPTI events.
TASK [tensorflow : Record git commit hash to variable] ************************* Friday 18 August 2023 01:11:12 +0100 (0:00:00.039) 0:01:06.934 ********* ok: [localhost]
TASK [tensorflow : Save git commit hash to file] ******************************* Friday 18 August 2023 01:11:12 +0100 (0:00:00.058) 0:01:06.992 ********* changed: [localhost]
TASK [Build Bazel] ************************************************************* Friday 18 August 2023 01:11:13 +0100 (0:00:01.105) 0:01:08.098 ********* skipping: [localhost]
TASK [Build TensorFlow for each Python version] ******************************** Friday 18 August 2023 01:11:13 +0100 (0:00:00.031) 0:01:08.130 ********* skipping: [localhost] => (item=3.9) skipping: [localhost] => (item=3.10) skipping: [localhost] => (item=3.11)
TASK [Build TensorFlow for each Python version (dual abi)] ********************* Friday 18 August 2023 01:11:13 +0100 (0:00:00.046) 0:01:08.177 *********
TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Friday 18 August 2023 01:11:13 +0100 (0:00:00.340) 0:01:08.517 ********* changed: [localhost]
TASK [tensorflow_in_container : Remove TensorFlow-oneDNN-ACL git sources from previous build] *** Friday 18 August 2023 01:11:14 +0100 (0:00:00.891) 0:01:09.409 ********* skipping: [localhost]
TASK [Fetch TensorFlow] ******************************************************** Friday 18 August 2023 01:11:14 +0100 (0:00:00.032) 0:01:09.442 ********* skipping: [localhost]
TASK [(Python 3.9) patch TensorFlow tree] ************************************** Friday 18 August 2023 01:11:14 +0100 (0:00:00.033) 0:01:09.475 *********
TASK [tensorflow : Create linklibs shell script] ******************************* Friday 18 August 2023 01:11:14 +0100 (0:00:00.140) 0:01:09.615 ********* changed: [localhost]
TASK [tensorflow : Create readme file about unit tests] ************************ Friday 18 August 2023 01:11:15 +0100 (0:00:00.693) 0:01:10.309 ********* changed: [localhost]
TASK [tensorflow : Add to the copied files] ************************************ Friday 18 August 2023 01:11:16 +0100 (0:00:00.696) 0:01:11.005 ********* changed: [localhost]
TASK [tensorflow : Add to the long_description in setup.py] ******************** Friday 18 August 2023 01:11:16 +0100 (0:00:00.595) 0:01:11.601 ********* changed: [localhost]
TASK [tensorflow : Use nightly package requirements] *************************** Friday 18 August 2023 01:11:17 +0100 (0:00:00.585) 0:01:12.186 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper constraints] *********** Friday 18 August 2023 01:11:17 +0100 (0:00:00.401) 0:01:12.587 ********* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python versioned container] *** Friday 18 August 2023 01:11:18 +0100 (0:00:00.717) 0:01:13.305 ********* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) start build container] ************ Friday 18 August 2023 01:11:20 +0100 (0:00:01.624) 0:01:14.930 ********* fatal: [localhost]: FAILED! => changed=false msg: 'Error removing container 1959623cc330a327c81350b213fee8561d13a69c1272297e4b9a6bb0987b5e64: UnixHTTPConnectionPool(host=''localhost'', port=None): Read timed out. (read timeout=600)'
PLAY RECAP ********************************************************************* localhost : ok=22 changed=14 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0
Friday 18 August 2023 01:21:53 +0100 (0:10:32.951) 0:11:47.882 ********* =============================================================================== tensorflow_in_container : (Python 3.9) start build container ---------- 632.95s Cleanup after previous build ------------------------------------------- 36.73s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 21.58s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.97s Gathering Facts --------------------------------------------------------- 1.63s tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.62s Create cache dirs ------------------------------------------------------- 1.44s tensorflow : Save git commit hash to file ------------------------------- 1.11s tensorflow_in_container : Reset checkout to clean state ----------------- 0.89s tensorflow_in_container : (Python 3.9) copy upper constraints ----------- 0.72s tensorflow : Create readme file about unit tests ------------------------ 0.70s tensorflow : Create linklibs shell script ------------------------------- 0.69s tensorflow : Add to the copied files ------------------------------------ 0.60s tensorflow : Get oneline version of git log for this checkout ----------- 0.59s tensorflow : Add to the long_description in setup.py -------------------- 0.59s tensorflow : Use nightly package requirements --------------------------- 0.40s tensorflow : Set world write access to source --------------------------- 0.37s Build TensorFlow for each Python version (dual abi) --------------------- 0.34s Go through each TensorFlow version -------------------------------------- 0.16s (Python 3.9) patch TensorFlow tree -------------------------------------- 0.14s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/531/display/redirect
Changes:
------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on ldcg-aarch64-02 (aarch64 leg-aarch64) in workspace https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/ws/ [ldcg-python-manylinux-tensorflow-onednn-nightly] $ /bin/bash /tmp/jenkins4854806300221407512.sh + cd https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/ws/ + rm -rf '*.sh' configs wheels cache_upload + mkdir wheels cache_upload + git clone --depth 1 https://git.linaro.org/ci/job/configs.git Cloning into 'configs'... + cd configs + git log --pretty=oneline -1 a5f21f440091e6fbb7da8daffeb5dac2ec62b8b0 tcwg/round-robin.yaml.inc: Fix early exits + cd .. + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' true = true ']' + echo ' - "git"' + '[' true = true ']' + sed -i -e /onednn_build/s/false/true/ configs/ldcg-python-manylinux-tensorflow/ansible/vars/vars.yml + '[' true = true ']' + sed -i -e /onednn_enable_opt/s/false/true/ -e /extra_test_options/s/0/1/ configs/ldcg-python-manylinux-tensorflow/ansible/vars/vars.yml + '[' '' = true ']' + '[' true = true ']' + sed -i -e /clang_build/s/false/true/ configs/ldcg-python-manylinux-tensorflow/ansible/vars/vars.yml + ansible-galaxy collection install community.docker Starting galaxy collection install process Nothing to do. All requested collections are already installed. If you want to reinstall them, consider using `--force`. + cd configs/ldcg-python-manylinux-tensorflow/ansible/ + sed -i -es+/tmp/workspace+https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/ws/+g vars/vars.yml + ansible-playbook playbooks/build-tf-dual-abi.yml [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all'
PLAY [Build TensorFlow in Dual ABI container] **********************************
TASK [Gathering Facts] ********************************************************* Saturday 19 August 2023 01:10:05 +0100 (0:00:00.040) 0:00:00.040 ******* ok: [localhost]
TASK [Cleanup after previous build] ******************************************** Saturday 19 August 2023 01:10:07 +0100 (0:00:02.625) 0:00:02.665 ******* changed: [localhost] => (item=disk-cache) changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels) ok: [localhost] => (item=tensorflow)
TASK [Create cache dirs] ******************************************************* Saturday 19 August 2023 01:10:09 +0100 (0:00:01.616) 0:00:04.282 ******* changed: [localhost] => (item=disk-cache) ok: [localhost] => (item=bazel-cache) changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels)
TASK [Set dual abi variable] *************************************************** Saturday 19 August 2023 01:10:10 +0100 (0:00:01.377) 0:00:05.659 ******* ok: [localhost]
TASK [Go through each TensorFlow version] ************************************** Saturday 19 August 2023 01:10:10 +0100 (0:00:00.032) 0:00:05.692 ******* skipping: [localhost] => (item={'key': '2.14', 'value': {'tensorflow_version': '2.14.0-rc0', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 23.5.26', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'protobuf_version': '>=3.20.3,<5.0.0dev,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.14.0rc0', 'tensorboard_version': '==2.14.0', 'tensorflow_estimator_version': '==2.14.0rc0', 'image_prefix': '2.14', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test', '//tensorflow/core/grappler/optimizers:remapper_test', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/xla/service/gpu:fusion_merger_test', '//tensorflow/python/kernel_tests/proto:decode_proto_op_test', '//tensorflow/python/util/protobuf:protobuf_compare_test', '//tensorflow/tools/api/tests:api_compatibility_test'], 'unit_tests_gcc_exclude': ['//tensorflow/compiler/mlir/lite/debug:debug_test'], 'unit_tests_clang_exclude': ['//tensorflow/compiler/mlir/lite/quantization/lite:quantize_model_test', '//tensorflow/compiler/mlir/lite/quantization/lite:quantize_weights_test', '//tensorflow/compiler/mlir/lite/sparsity:sparsify_model_test', '//tensorflow/compiler/xla/service/cpu/tests:cpu_eigen_dot_operation_test', '//tensorflow/core/kernels/image:resize_bicubic_op_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.9', '3.10', '3.11']}}) skipping: [localhost] => (item={'key': '2.13', 'value': {'tensorflow_version': '2.13.0', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 23.1.21', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'protobuf_version': '>=3.20.3,<5.0.0dev,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.13.1', 'tensorboard_version': '==2.13.0', 'tensorflow_estimator_version': '==2.13.0', 'image_prefix': '2.13', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test', '//tensorflow/core/grappler/optimizers:remapper_test', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/python/kernel_tests/proto:decode_proto_op_test', '//tensorflow/python/util/protobuf:protobuf_compare_test', '//tensorflow/tools/api/tests:api_compatibility_test'], 'unit_tests_gcc_exclude': '', 'unit_tests_clang_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.8', '3.9', '3.10', '3.11']}}) skipping: [localhost] => (item={'key': '2.12', 'value': {'tensorflow_version': '2.12.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 2.0, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'protobuf_version': '>=3.20.3,<5.0.0dev,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.12.0', 'tensorboard_version': '==2.12.3', 'tensorflow_estimator_version': '==2.12.0', 'image_prefix': '2.12', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/python/kernel_tests/proto:decode_proto_op_test', '//tensorflow/python/util/protobuf:protobuf_compare_test', '//tensorflow/tools/api/tests:api_compatibility_test', '//tensorflow/tsl/framework/convolution:spatial_convolutions_test'], 'unit_tests_gcc_exclude': '', 'unit_tests_clang_exclude': '', 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.8', '3.9', '3.10', '3.11']}})
TASK [tensorflow : Set TensorFlow and other package versions] ****************** Saturday 19 August 2023 01:10:10 +0100 (0:00:00.180) 0:00:05.873 ******* ok: [localhost]
TASK [tensorflow : Set build dir for TensorFlow-oneDNN-ACL git] **************** Saturday 19 August 2023 01:10:10 +0100 (0:00:00.085) 0:00:05.958 ******* ok: [localhost]
TASK [tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build] *** Saturday 19 August 2023 01:10:10 +0100 (0:00:00.040) 0:00:05.999 ******* changed: [localhost]
TASK [tensorflow : Fetch TensorFlow] ******************************************* Saturday 19 August 2023 01:10:15 +0100 (0:00:04.055) 0:00:10.055 ******* included: https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/ws/configs/ldcg-python-manylinux-tensorflow/ansible/roles/tensorflow/tasks/fetch.yml for localhost
TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL git source] ********************* Saturday 19 August 2023 01:10:15 +0100 (0:00:00.090) 0:00:10.145 ******* skipping: [localhost]
TASK [tensorflow : Unpack TensorFlow-oneDNN-ACL git source] ******************** Saturday 19 August 2023 01:10:15 +0100 (0:00:00.035) 0:00:10.181 ******* skipping: [localhost]
TASK [tensorflow : Rename source dir for oneDNN build] ************************* Saturday 19 August 2023 01:10:15 +0100 (0:00:00.032) 0:00:10.213 ******* skipping: [localhost]
TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL from git] *********************** Saturday 19 August 2023 01:10:15 +0100 (0:00:00.034) 0:00:10.248 ******* changed: [localhost]
TASK [tensorflow : Fetch TensorFlow-oneDNN-ACL from git at commit] ************* Saturday 19 August 2023 01:10:38 +0100 (0:00:23.430) 0:00:33.678 ******* skipping: [localhost]
TASK [tensorflow : Set world write access to source] *************************** Saturday 19 August 2023 01:10:38 +0100 (0:00:00.032) 0:00:33.711 ******* changed: [localhost]
TASK [tensorflow : Get oneline version of git log for this checkout] *********** Saturday 19 August 2023 01:10:39 +0100 (0:00:00.370) 0:00:34.081 ******* changed: [localhost]
TASK [tensorflow : Show git log] *********************************************** Saturday 19 August 2023 01:10:39 +0100 (0:00:00.576) 0:00:34.658 ******* ok: [localhost] => git_log.stdout: a9d44e0001d6feba6b21c14a9fc670864c50d89f Fix GitHub export for quantized variable ops tests
TASK [tensorflow : Record git commit hash to variable] ************************* Saturday 19 August 2023 01:10:39 +0100 (0:00:00.038) 0:00:34.697 ******* ok: [localhost]
TASK [tensorflow : Save git commit hash to file] ******************************* Saturday 19 August 2023 01:10:39 +0100 (0:00:00.059) 0:00:34.756 ******* changed: [localhost]
TASK [Build Bazel] ************************************************************* Saturday 19 August 2023 01:10:40 +0100 (0:00:01.129) 0:00:35.886 ******* skipping: [localhost]
TASK [Build TensorFlow for each Python version] ******************************** Saturday 19 August 2023 01:10:40 +0100 (0:00:00.031) 0:00:35.917 ******* skipping: [localhost] => (item=3.9) skipping: [localhost] => (item=3.10) skipping: [localhost] => (item=3.11)
TASK [Build TensorFlow for each Python version (dual abi)] ********************* Saturday 19 August 2023 01:10:40 +0100 (0:00:00.046) 0:00:35.964 *******
TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Saturday 19 August 2023 01:10:41 +0100 (0:00:00.369) 0:00:36.333 ******* changed: [localhost]
TASK [tensorflow_in_container : Remove TensorFlow-oneDNN-ACL git sources from previous build] *** Saturday 19 August 2023 01:10:41 +0100 (0:00:00.640) 0:00:36.974 ******* skipping: [localhost]
TASK [Fetch TensorFlow] ******************************************************** Saturday 19 August 2023 01:10:42 +0100 (0:00:00.031) 0:00:37.005 ******* skipping: [localhost]
TASK [(Python 3.9) patch TensorFlow tree] ************************************** Saturday 19 August 2023 01:10:42 +0100 (0:00:00.032) 0:00:37.038 *******
TASK [tensorflow : Create linklibs shell script] ******************************* Saturday 19 August 2023 01:10:42 +0100 (0:00:00.112) 0:00:37.150 ******* changed: [localhost]
TASK [tensorflow : Create readme file about unit tests] ************************ Saturday 19 August 2023 01:10:42 +0100 (0:00:00.691) 0:00:37.842 ******* changed: [localhost]
TASK [tensorflow : Add to the copied files] ************************************ Saturday 19 August 2023 01:10:43 +0100 (0:00:00.695) 0:00:38.537 ******* changed: [localhost]
TASK [tensorflow : Add to the long_description in setup.py] ******************** Saturday 19 August 2023 01:10:44 +0100 (0:00:00.554) 0:00:39.092 ******* changed: [localhost]
TASK [tensorflow : Use nightly package requirements] *************************** Saturday 19 August 2023 01:10:44 +0100 (0:00:00.584) 0:00:39.676 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper constraints] *********** Saturday 19 August 2023 01:10:45 +0100 (0:00:00.398) 0:00:40.075 ******* changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python versioned container] *** Saturday 19 August 2023 01:10:45 +0100 (0:00:00.713) 0:00:40.789 ******* ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) start build container] ************ Saturday 19 August 2023 01:10:47 +0100 (0:00:01.937) 0:00:42.727 ******* fatal: [localhost]: FAILED! => changed=false msg: 'Error removing container 9e0b5506890b3869cdf3ba96f1031b6f865757e2667b4573469dcf8daf9645bd: UnixHTTPConnectionPool(host=''localhost'', port=None): Read timed out. (read timeout=600)'
PLAY RECAP ********************************************************************* localhost : ok=22 changed=14 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0
Saturday 19 August 2023 01:21:19 +0100 (0:10:31.649) 0:11:14.377 ******* =============================================================================== tensorflow_in_container : (Python 3.9) start build container ---------- 631.65s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 23.43s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 4.06s Gathering Facts --------------------------------------------------------- 2.63s tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.94s Cleanup after previous build -------------------------------------------- 1.62s Create cache dirs ------------------------------------------------------- 1.38s tensorflow : Save git commit hash to file ------------------------------- 1.13s tensorflow_in_container : (Python 3.9) copy upper constraints ----------- 0.71s tensorflow : Create readme file about unit tests ------------------------ 0.70s tensorflow : Create linklibs shell script ------------------------------- 0.69s tensorflow_in_container : Reset checkout to clean state ----------------- 0.64s tensorflow : Add to the long_description in setup.py -------------------- 0.58s tensorflow : Get oneline version of git log for this checkout ----------- 0.58s tensorflow : Add to the copied files ------------------------------------ 0.55s tensorflow : Use nightly package requirements --------------------------- 0.40s tensorflow : Set world write access to source --------------------------- 0.37s Build TensorFlow for each Python version (dual abi) --------------------- 0.37s Go through each TensorFlow version -------------------------------------- 0.18s (Python 3.9) patch TensorFlow tree -------------------------------------- 0.11s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/532/display/redirect
Changes:
------------------------------------------ [...truncated 12.57 KB...] changed: [localhost]
TASK [tensorflow : Add to the long_description in setup.py] ******************** Tuesday 22 August 2023 01:10:42 +0100 (0:00:00.580) 0:00:37.346 ******** changed: [localhost]
TASK [tensorflow : Use nightly package requirements] *************************** Tuesday 22 August 2023 01:10:42 +0100 (0:00:00.548) 0:00:37.895 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper constraints] *********** Tuesday 22 August 2023 01:10:43 +0100 (0:00:00.402) 0:00:38.297 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python versioned container] *** Tuesday 22 August 2023 01:10:43 +0100 (0:00:00.716) 0:00:39.013 ******** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) start build container] ************ Tuesday 22 August 2023 01:10:45 +0100 (0:00:01.574) 0:00:40.587 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir] *** Tuesday 22 August 2023 01:27:54 +0100 (0:17:09.060) 0:17:49.648 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazel cache] ****** Tuesday 22 August 2023 01:27:55 +0100 (0:00:01.212) 0:17:50.861 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazelisk cache] *** Tuesday 22 August 2023 01:27:56 +0100 (0:00:00.869) 0:17:51.730 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for pip cache] ******** Tuesday 22 August 2023 01:27:57 +0100 (0:00:00.795) 0:17:52.526 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build] *** Tuesday 22 August 2023 01:27:58 +0100 (0:00:00.779) 0:17:53.306 ******** changed: [localhost]
TASK [tensorflow_in_container : Show list of installed Python packages for build] *** Tuesday 22 August 2023 01:28:00 +0100 (0:00:02.010) 0:17:55.316 ******** ok: [localhost] => pip_list_output.stdout: |- Package Version Location Installer ----------------------- -------------------- -------------------------------------- --------- absl-py 1.0.0 /usr/local/lib/python3.9/dist-packages pip astor 0.8.1 /usr/local/lib/python3.9/dist-packages pip astroid 2.11.7 /usr/local/lib/python3.9/dist-packages pip astunparse 1.6.3 /usr/local/lib/python3.9/dist-packages pip auditwheel 5.3.0 /usr/local/lib/python3.9/dist-packages pip bleach 6.0.0 /usr/local/lib/python3.9/dist-packages pip cachetools 5.3.1 /usr/local/lib/python3.9/dist-packages pip certifi 2019.11.28 /usr/lib/python3/dist-packages cffi 1.15.1 /usr/local/lib/python3.9/dist-packages pip chardet 3.0.4 /usr/lib/python3/dist-packages colorama 0.4.6 /usr/local/lib/python3.9/dist-packages pip cryptography 41.0.3 /usr/local/lib/python3.9/dist-packages pip Cython 3.0.0 /usr/local/lib/python3.9/dist-packages pip dbus-python 1.2.16 /usr/lib/python3/dist-packages dill 0.3.7 /usr/local/lib/python3.9/dist-packages pip docutils 0.20.1 /usr/local/lib/python3.9/dist-packages pip flatbuffers 23.5.26 /usr/local/lib/python3.9/dist-packages pip future 0.18.3 /usr/local/lib/python3.9/dist-packages pip gast 0.4.0 /usr/local/lib/python3.9/dist-packages pip google-auth 2.22.0 /usr/local/lib/python3.9/dist-packages pip google-auth-oauthlib 1.0.0 /usr/local/lib/python3.9/dist-packages pip google-pasta 0.2.0 /usr/local/lib/python3.9/dist-packages pip grpcio 1.49.1 /usr/local/lib/python3.9/dist-packages pip h5py 3.8.0 /usr/local/lib/python3.9/dist-packages pip idna 2.8 /usr/lib/python3/dist-packages importlib-metadata 6.8.0 /usr/local/lib/python3.9/dist-packages pip isort 5.12.0 /usr/local/lib/python3.9/dist-packages pip jaraco.classes 3.3.0 /usr/local/lib/python3.9/dist-packages pip jax 0.3.25 /usr/local/lib/python3.9/dist-packages pip jeepney 0.8.0 /usr/local/lib/python3.9/dist-packages pip junitparser 2.2.0 /usr/local/lib/python3.9/dist-packages pip Keras-Applications 1.0.8 /usr/local/lib/python3.9/dist-packages pip keras-nightly 2.15.0.dev2023081707 /usr/local/lib/python3.9/dist-packages pip Keras-Preprocessing 1.1.2 /usr/local/lib/python3.9/dist-packages pip keyring 24.2.0 /usr/local/lib/python3.9/dist-packages pip lazy-object-proxy 1.9.0 /usr/local/lib/python3.9/dist-packages pip lit 16.0.6 /usr/local/lib/python3.9/dist-packages pip lxml 4.9.3 /usr/local/lib/python3.9/dist-packages pip Markdown 3.4.4 /usr/local/lib/python3.9/dist-packages pip MarkupSafe 2.1.3 /usr/local/lib/python3.9/dist-packages pip mccabe 0.7.0 /usr/local/lib/python3.9/dist-packages pip more-itertools 10.1.0 /usr/local/lib/python3.9/dist-packages pip numpy 1.23.5 /usr/local/lib/python3.9/dist-packages pip oauthlib 3.2.2 /usr/local/lib/python3.9/dist-packages pip opt-einsum 3.3.0 /usr/local/lib/python3.9/dist-packages pip packaging 21.3 /usr/local/lib/python3.9/dist-packages pip pip 23.2.1 /usr/local/lib/python3.9/dist-packages pip pkginfo 1.9.6 /usr/local/lib/python3.9/dist-packages pip platformdirs 3.10.0 /usr/local/lib/python3.9/dist-packages pip portpicker 1.5.2 /usr/local/lib/python3.9/dist-packages pip protobuf 4.23.4 /usr/local/lib/python3.9/dist-packages pip psutil 5.9.5 /usr/local/lib/python3.9/dist-packages pip pyasn1 0.5.0 /usr/local/lib/python3.9/dist-packages pip pyasn1-modules 0.3.0 /usr/local/lib/python3.9/dist-packages pip pycparser 2.21 /usr/local/lib/python3.9/dist-packages pip pyelftools 0.29 /usr/local/lib/python3.9/dist-packages pip Pygments 2.16.1 /usr/local/lib/python3.9/dist-packages pip PyGObject 3.36.0 /usr/lib/python3/dist-packages pylint 2.13.9 /usr/local/lib/python3.9/dist-packages pip pyparsing 3.1.1 /usr/local/lib/python3.9/dist-packages pip python-apt 2.0.1+ubuntu0.20.4.1 /usr/lib/python3/dist-packages PyYAML 6.0.1 /usr/local/lib/python3.9/dist-packages pip readme-renderer 40.0 /usr/local/lib/python3.9/dist-packages pip requests 2.22.0 /usr/lib/python3/dist-packages requests-oauthlib 1.3.1 /usr/local/lib/python3.9/dist-packages pip requests-toolbelt 1.0.0 /usr/local/lib/python3.9/dist-packages pip requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages rfc3986 2.0.0 /usr/local/lib/python3.9/dist-packages pip rsa 4.9 /usr/local/lib/python3.9/dist-packages pip scipy 1.9.3 /usr/local/lib/python3.9/dist-packages pip SecretStorage 3.3.3 /usr/local/lib/python3.9/dist-packages pip setuptools 45.2.0 /usr/lib/python3/dist-packages six 1.15.0 /usr/local/lib/python3.9/dist-packages pip tb-nightly 2.15.0a20230817 /usr/local/lib/python3.9/dist-packages pip tensorboard-data-server 0.7.1 /usr/local/lib/python3.9/dist-packages pip termcolor 1.1.0 /usr/local/lib/python3.9/dist-packages pip tf-estimator-nightly 2.15.0.dev2023081708 /usr/local/lib/python3.9/dist-packages pip tomli 2.0.1 /usr/local/lib/python3.9/dist-packages pip tqdm 4.66.1 /usr/local/lib/python3.9/dist-packages pip twine 3.6.0 /usr/local/lib/python3.9/dist-packages pip typing-extensions 3.7.4.3 /usr/local/lib/python3.9/dist-packages pip urllib3 1.25.8 /usr/lib/python3/dist-packages webencodings 0.5.1 /usr/local/lib/python3.9/dist-packages pip Werkzeug 2.3.7 /usr/local/lib/python3.9/dist-packages pip wheel 0.38.4 /usr/local/lib/python3.9/dist-packages pip wrapt 1.12.1 /usr/local/lib/python3.9/dist-packages pip zipp 3.16.2 /usr/local/lib/python3.9/dist-packages pip
TASK [tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git] *** Tuesday 22 August 2023 01:28:00 +0100 (0:00:00.041) 0:17:55.357 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python package] ************* Tuesday 22 August 2023 02:17:31 +0100 (0:49:31.725) 1:07:27.083 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) cleanup Bazel install directory] *** Tuesday 22 August 2023 02:19:23 +0100 (0:01:51.602) 1:09:18.685 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create script to run tests] ******* Tuesday 22 August 2023 02:19:24 +0100 (0:00:00.875) 1:09:19.561 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) run TensorFlow-oneDNN-ACL git tests] *** Tuesday 22 August 2023 02:19:25 +0100 (0:00:00.705) 1:09:20.267 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages] *** Tuesday 22 August 2023 04:41:06 +0100 (2:21:40.961) 3:31:01.229 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save list of installed Python packages] *** Tuesday 22 August 2023 04:41:07 +0100 (0:00:01.872) 3:31:03.101 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests output to file] ******** Tuesday 22 August 2023 04:41:08 +0100 (0:00:00.694) 3:31:03.796 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests stderr output to file] *** Tuesday 22 August 2023 04:41:09 +0100 (0:00:00.697) 3:31:04.494 ******** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Extract number of tests run] ****** Tuesday 22 August 2023 04:41:10 +0100 (0:00:00.701) 3:31:05.196 ******** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show number of tests run] ********* Tuesday 22 August 2023 04:41:10 +0100 (0:00:00.083) 3:31:05.279 ******** ok: [localhost] => ut_tests_line: 'Executed 3915 out of 3915 tests: 3915 tests pass.'
TASK [tensorflow_in_container : (Python 3.9) Extract failed tests] ************* Tuesday 22 August 2023 04:41:10 +0100 (0:00:00.041) 3:31:05.320 ******** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show which tests failed] ********** Tuesday 22 August 2023 04:41:10 +0100 (0:00:00.072) 3:31:05.393 ******** ok: [localhost] => tests_failed: []
TASK [tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one] *** Tuesday 22 August 2023 04:41:10 +0100 (0:00:00.040) 3:31:05.434 ******** fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- + for wheel in /tf/pkg/*.whl + echo 'Checking and renaming /tf/pkg/tensorflow_aarch64-2.15.0-cp39-cp39-linux_aarch64.whl...' + python3 -m auditwheel repair --plat manylinux2014_aarch64 /tf/pkg/tensorflow_aarch64-2.15.0-cp39-cp39-linux_aarch64.whl --wheel-dir /tf/pkg + tee check.txt
real 2m13.583s user 1m56.740s sys 0m16.728s stderr_lines: <omitted> stdout: |- Checking and renaming /tf/pkg/tensorflow_aarch64-2.15.0-cp39-cp39-linux_aarch64.whl... INFO:auditwheel.main_repair:Repairing tensorflow_aarch64-2.15.0-cp39-cp39-linux_aarch64.whl Traceback (most recent call last): File "/usr/lib/python3.9/runpy.py", line 197, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/lib/python3.9/runpy.py", line 87, in _run_code exec(code, run_globals) File "/usr/local/lib/python3.9/dist-packages/auditwheel/__main__.py", line 6, in <module> sys.exit(main()) File "/usr/local/lib/python3.9/dist-packages/auditwheel/main.py", line 59, in main rval = args.func(args, p) File "/usr/local/lib/python3.9/dist-packages/auditwheel/main_repair.py", line 173, in execute out_wheel = repair_wheel( File "/usr/local/lib/python3.9/dist-packages/auditwheel/repair.py", line 80, in repair_wheel raise ValueError( ValueError: Cannot repair wheel, because required library "_pywrap_tensorflow_internal.so" could not be located stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=42 changed=29 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0
Tuesday 22 August 2023 04:43:24 +0100 (0:02:14.491) 3:33:19.925 ******** =============================================================================== tensorflow_in_container : (Python 3.9) run TensorFlow-oneDNN-ACL git tests 8500.96s tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git 2971.73s tensorflow_in_container : (Python 3.9) start build container --------- 1029.06s tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 134.49s tensorflow_in_container : (Python 3.9) build Python package ----------- 111.60s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 21.77s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.95s Gathering Facts --------------------------------------------------------- 2.63s tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 2.01s tensorflow_in_container : (Python 3.9) collect list of installed Python packages --- 1.87s Cleanup after previous build -------------------------------------------- 1.61s tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.57s Create cache dirs ------------------------------------------------------- 1.38s tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.21s tensorflow : Save git commit hash to file ------------------------------- 1.13s tensorflow_in_container : (Python 3.9) cleanup Bazel install directory --- 0.88s tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 0.87s tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.80s tensorflow_in_container : (Python 3.9) create link for pip cache -------- 0.78s tensorflow_in_container : (Python 3.9) copy upper constraints ----------- 0.72s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/533/display/redirect
Changes:
------------------------------------------ [...truncated 12.59 KB...] changed: [localhost]
TASK [tensorflow : Add to the long_description in setup.py] ******************** Wednesday 23 August 2023 01:11:18 +0100 (0:00:00.584) 0:01:13.651 ****** changed: [localhost]
TASK [tensorflow : Use nightly package requirements] *************************** Wednesday 23 August 2023 01:11:19 +0100 (0:00:00.547) 0:01:14.199 ****** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper constraints] *********** Wednesday 23 August 2023 01:11:19 +0100 (0:00:00.399) 0:01:14.599 ****** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python versioned container] *** Wednesday 23 August 2023 01:11:20 +0100 (0:00:00.715) 0:01:15.315 ****** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) start build container] ************ Wednesday 23 August 2023 01:11:22 +0100 (0:00:01.485) 0:01:16.801 ****** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir] *** Wednesday 23 August 2023 01:11:34 +0100 (0:00:12.099) 0:01:28.901 ****** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazel cache] ****** Wednesday 23 August 2023 01:11:35 +0100 (0:00:01.207) 0:01:30.109 ****** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazelisk cache] *** Wednesday 23 August 2023 01:11:36 +0100 (0:00:00.872) 0:01:30.981 ****** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for pip cache] ******** Wednesday 23 August 2023 01:11:37 +0100 (0:00:00.807) 0:01:31.788 ****** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build] *** Wednesday 23 August 2023 01:11:37 +0100 (0:00:00.813) 0:01:32.601 ****** changed: [localhost]
TASK [tensorflow_in_container : Show list of installed Python packages for build] *** Wednesday 23 August 2023 01:11:39 +0100 (0:00:01.920) 0:01:34.522 ****** ok: [localhost] => pip_list_output.stdout: |- Package Version Location Installer ----------------------- -------------------- -------------------------------------- --------- absl-py 1.0.0 /usr/local/lib/python3.9/dist-packages pip astor 0.8.1 /usr/local/lib/python3.9/dist-packages pip astroid 2.11.7 /usr/local/lib/python3.9/dist-packages pip astunparse 1.6.3 /usr/local/lib/python3.9/dist-packages pip auditwheel 5.3.0 /usr/local/lib/python3.9/dist-packages pip bleach 6.0.0 /usr/local/lib/python3.9/dist-packages pip cachetools 5.3.1 /usr/local/lib/python3.9/dist-packages pip certifi 2019.11.28 /usr/lib/python3/dist-packages cffi 1.15.1 /usr/local/lib/python3.9/dist-packages pip chardet 3.0.4 /usr/lib/python3/dist-packages colorama 0.4.6 /usr/local/lib/python3.9/dist-packages pip cryptography 41.0.3 /usr/local/lib/python3.9/dist-packages pip Cython 3.0.0 /usr/local/lib/python3.9/dist-packages pip dbus-python 1.2.16 /usr/lib/python3/dist-packages dill 0.3.7 /usr/local/lib/python3.9/dist-packages pip docutils 0.20.1 /usr/local/lib/python3.9/dist-packages pip flatbuffers 23.5.26 /usr/local/lib/python3.9/dist-packages pip future 0.18.3 /usr/local/lib/python3.9/dist-packages pip gast 0.4.0 /usr/local/lib/python3.9/dist-packages pip google-auth 2.22.0 /usr/local/lib/python3.9/dist-packages pip google-auth-oauthlib 1.0.0 /usr/local/lib/python3.9/dist-packages pip google-pasta 0.2.0 /usr/local/lib/python3.9/dist-packages pip grpcio 1.49.1 /usr/local/lib/python3.9/dist-packages pip h5py 3.8.0 /usr/local/lib/python3.9/dist-packages pip idna 2.8 /usr/lib/python3/dist-packages importlib-metadata 6.8.0 /usr/local/lib/python3.9/dist-packages pip isort 5.12.0 /usr/local/lib/python3.9/dist-packages pip jaraco.classes 3.3.0 /usr/local/lib/python3.9/dist-packages pip jax 0.3.25 /usr/local/lib/python3.9/dist-packages pip jeepney 0.8.0 /usr/local/lib/python3.9/dist-packages pip junitparser 2.2.0 /usr/local/lib/python3.9/dist-packages pip Keras-Applications 1.0.8 /usr/local/lib/python3.9/dist-packages pip keras-nightly 2.15.0.dev2023081707 /usr/local/lib/python3.9/dist-packages pip Keras-Preprocessing 1.1.2 /usr/local/lib/python3.9/dist-packages pip keyring 24.2.0 /usr/local/lib/python3.9/dist-packages pip lazy-object-proxy 1.9.0 /usr/local/lib/python3.9/dist-packages pip lit 16.0.6 /usr/local/lib/python3.9/dist-packages pip lxml 4.9.3 /usr/local/lib/python3.9/dist-packages pip Markdown 3.4.4 /usr/local/lib/python3.9/dist-packages pip MarkupSafe 2.1.3 /usr/local/lib/python3.9/dist-packages pip mccabe 0.7.0 /usr/local/lib/python3.9/dist-packages pip more-itertools 10.1.0 /usr/local/lib/python3.9/dist-packages pip numpy 1.23.5 /usr/local/lib/python3.9/dist-packages pip oauthlib 3.2.2 /usr/local/lib/python3.9/dist-packages pip opt-einsum 3.3.0 /usr/local/lib/python3.9/dist-packages pip packaging 21.3 /usr/local/lib/python3.9/dist-packages pip pip 23.2.1 /usr/local/lib/python3.9/dist-packages pip pkginfo 1.9.6 /usr/local/lib/python3.9/dist-packages pip platformdirs 3.10.0 /usr/local/lib/python3.9/dist-packages pip portpicker 1.5.2 /usr/local/lib/python3.9/dist-packages pip protobuf 4.23.4 /usr/local/lib/python3.9/dist-packages pip psutil 5.9.5 /usr/local/lib/python3.9/dist-packages pip pyasn1 0.5.0 /usr/local/lib/python3.9/dist-packages pip pyasn1-modules 0.3.0 /usr/local/lib/python3.9/dist-packages pip pycparser 2.21 /usr/local/lib/python3.9/dist-packages pip pyelftools 0.29 /usr/local/lib/python3.9/dist-packages pip Pygments 2.16.1 /usr/local/lib/python3.9/dist-packages pip PyGObject 3.36.0 /usr/lib/python3/dist-packages pylint 2.13.9 /usr/local/lib/python3.9/dist-packages pip pyparsing 3.1.1 /usr/local/lib/python3.9/dist-packages pip python-apt 2.0.1+ubuntu0.20.4.1 /usr/lib/python3/dist-packages PyYAML 6.0.1 /usr/local/lib/python3.9/dist-packages pip readme-renderer 40.0 /usr/local/lib/python3.9/dist-packages pip requests 2.22.0 /usr/lib/python3/dist-packages requests-oauthlib 1.3.1 /usr/local/lib/python3.9/dist-packages pip requests-toolbelt 1.0.0 /usr/local/lib/python3.9/dist-packages pip requests-unixsocket 0.2.0 /usr/lib/python3/dist-packages rfc3986 2.0.0 /usr/local/lib/python3.9/dist-packages pip rsa 4.9 /usr/local/lib/python3.9/dist-packages pip scipy 1.9.3 /usr/local/lib/python3.9/dist-packages pip SecretStorage 3.3.3 /usr/local/lib/python3.9/dist-packages pip setuptools 45.2.0 /usr/lib/python3/dist-packages six 1.15.0 /usr/local/lib/python3.9/dist-packages pip tb-nightly 2.15.0a20230817 /usr/local/lib/python3.9/dist-packages pip tensorboard-data-server 0.7.1 /usr/local/lib/python3.9/dist-packages pip termcolor 1.1.0 /usr/local/lib/python3.9/dist-packages pip tf-estimator-nightly 2.15.0.dev2023081708 /usr/local/lib/python3.9/dist-packages pip tomli 2.0.1 /usr/local/lib/python3.9/dist-packages pip tqdm 4.66.1 /usr/local/lib/python3.9/dist-packages pip twine 3.6.0 /usr/local/lib/python3.9/dist-packages pip typing-extensions 3.7.4.3 /usr/local/lib/python3.9/dist-packages pip urllib3 1.25.8 /usr/lib/python3/dist-packages webencodings 0.5.1 /usr/local/lib/python3.9/dist-packages pip Werkzeug 2.3.7 /usr/local/lib/python3.9/dist-packages pip wheel 0.38.4 /usr/local/lib/python3.9/dist-packages pip wrapt 1.12.1 /usr/local/lib/python3.9/dist-packages pip zipp 3.16.2 /usr/local/lib/python3.9/dist-packages pip
TASK [tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git] *** Wednesday 23 August 2023 01:11:39 +0100 (0:00:00.040) 0:01:34.563 ****** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python package] ************* Wednesday 23 August 2023 01:28:10 +0100 (0:16:30.457) 0:18:05.020 ****** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) cleanup Bazel install directory] *** Wednesday 23 August 2023 01:30:06 +0100 (0:01:56.691) 0:20:01.711 ****** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create script to run tests] ******* Wednesday 23 August 2023 01:30:07 +0100 (0:00:00.891) 0:20:02.603 ****** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) run TensorFlow-oneDNN-ACL git tests] *** Wednesday 23 August 2023 01:30:08 +0100 (0:00:00.709) 0:20:03.312 ****** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages] *** Wednesday 23 August 2023 02:45:42 +0100 (1:15:34.084) 1:35:37.396 ****** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save list of installed Python packages] *** Wednesday 23 August 2023 02:45:44 +0100 (0:00:01.949) 1:35:39.346 ****** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests output to file] ******** Wednesday 23 August 2023 02:45:45 +0100 (0:00:00.684) 1:35:40.030 ****** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) save tests stderr output to file] *** Wednesday 23 August 2023 02:45:45 +0100 (0:00:00.693) 1:35:40.724 ****** changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Extract number of tests run] ****** Wednesday 23 August 2023 02:45:46 +0100 (0:00:00.695) 1:35:41.420 ****** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show number of tests run] ********* Wednesday 23 August 2023 02:45:46 +0100 (0:00:00.079) 1:35:41.499 ****** ok: [localhost] => ut_tests_line: 'Executed 3919 out of 3919 tests: 3919 tests pass.'
TASK [tensorflow_in_container : (Python 3.9) Extract failed tests] ************* Wednesday 23 August 2023 02:45:46 +0100 (0:00:00.043) 1:35:41.542 ****** ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) Show which tests failed] ********** Wednesday 23 August 2023 02:45:46 +0100 (0:00:00.068) 1:35:41.611 ****** ok: [localhost] => tests_failed: []
TASK [tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one] *** Wednesday 23 August 2023 02:45:46 +0100 (0:00:00.043) 1:35:41.655 ****** fatal: [localhost]: FAILED! => changed=true rc: 1 stderr: |- + for wheel in /tf/pkg/*.whl + echo 'Checking and renaming /tf/pkg/tensorflow_aarch64-2.15.0-cp39-cp39-linux_aarch64.whl...' + python3 -m auditwheel repair --plat manylinux2014_aarch64 /tf/pkg/tensorflow_aarch64-2.15.0-cp39-cp39-linux_aarch64.whl --wheel-dir /tf/pkg + tee check.txt
real 2m13.830s user 1m56.542s sys 0m16.507s stderr_lines: <omitted> stdout: |- Checking and renaming /tf/pkg/tensorflow_aarch64-2.15.0-cp39-cp39-linux_aarch64.whl... INFO:auditwheel.main_repair:Repairing tensorflow_aarch64-2.15.0-cp39-cp39-linux_aarch64.whl Traceback (most recent call last): File "/usr/lib/python3.9/runpy.py", line 197, in _run_module_as_main return _run_code(code, main_globals, None, File "/usr/lib/python3.9/runpy.py", line 87, in _run_code exec(code, run_globals) File "/usr/local/lib/python3.9/dist-packages/auditwheel/__main__.py", line 6, in <module> sys.exit(main()) File "/usr/local/lib/python3.9/dist-packages/auditwheel/main.py", line 59, in main rval = args.func(args, p) File "/usr/local/lib/python3.9/dist-packages/auditwheel/main_repair.py", line 173, in execute out_wheel = repair_wheel( File "/usr/local/lib/python3.9/dist-packages/auditwheel/repair.py", line 80, in repair_wheel raise ValueError( ValueError: Cannot repair wheel, because required library "_pywrap_tensorflow_internal.so" could not be located stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=42 changed=29 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0
Wednesday 23 August 2023 02:48:01 +0100 (0:02:14.646) 1:37:56.302 ****** =============================================================================== tensorflow_in_container : (Python 3.9) run TensorFlow-oneDNN-ACL git tests 4534.08s tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git - 990.46s tensorflow_in_container : (Python 3.9) Convert wheel to manylinux2014 compatible one - 134.65s tensorflow_in_container : (Python 3.9) build Python package ----------- 116.69s Cleanup after previous build ------------------------------------------- 37.35s tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 22.36s tensorflow_in_container : (Python 3.9) start build container ----------- 12.10s tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 3.87s Gathering Facts --------------------------------------------------------- 2.64s tensorflow_in_container : (Python 3.9) collect list of installed Python packages --- 1.95s tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 1.92s tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.49s Create cache dirs ------------------------------------------------------- 1.44s tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.21s tensorflow : Save git commit hash to file ------------------------------- 1.14s tensorflow_in_container : (Python 3.9) cleanup Bazel install directory --- 0.89s tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 0.87s tensorflow_in_container : (Python 3.9) create link for pip cache -------- 0.81s tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.81s tensorflow_in_container : (Python 3.9) copy upper constraints ----------- 0.72s Build step 'Execute shell' marked build as failure
ldcg-ai-ml@op-lists.linaro.org
-
ci_notify＠linaro.org