See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/884/display/redirect

Changes:

------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on ldcg-aarch64-02 (aarch64 leg-aarch64) in workspace https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/ [ldcg-python-manylinux-tensorflow-nightly] $ /bin/bash /tmp/jenkins17638679784524789252.sh + dual_abi=false + cd https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/ + rm -rf '*.sh' configs wheels cache_upload + mkdir wheels cache_upload + git clone --depth 1 https://git.linaro.org/ci/job/configs.git Cloning into 'configs'... + cd configs + git log --pretty=oneline -1 d1a64d69b954d6e5268576f005e9a7abf75e8d73 tcwg_gdb: Increase job frequency + cd .. + '[' '' = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' true = true ']' + echo ' - "git"' + dual_abi=true + '[' false = true ']' + '[' '' = true ']' + '[' '' = true ']' + '[' false = true ']' + '[' true == true ']' + ansible-galaxy collection install community.docker Starting galaxy collection install process Nothing to do. All requested collections are already installed. If you want to reinstall them, consider using `--force`. + cd configs/ldcg-python-manylinux-tensorflow/ansible/ + sed -i -es+/tmp/workspace+https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/+g vars/vars.yml + ansible-playbook playbooks/build-tf-dual-abi.yml [WARNING]: provided hosts list is empty, only localhost is available. Note that the implicit localhost does not match 'all'

PLAY [Build TensorFlow in Dual ABI container] **********************************

TASK [Gathering Facts] ********************************************************* Wednesday 09 August 2023 19:10:05 +0100 (0:00:00.039) 0:00:00.039 ****** ok: [localhost]

TASK [Cleanup after previous build] ******************************************** Wednesday 09 August 2023 19:10:07 +0100 (0:00:01.656) 0:00:01.695 ****** changed: [localhost] => (item=disk-cache) changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels) ok: [localhost] => (item=tensorflow)

TASK [Create cache dirs] ******************************************************* Wednesday 09 August 2023 19:10:40 +0100 (0:00:33.221) 0:00:34.917 ****** changed: [localhost] => (item=disk-cache) ok: [localhost] => (item=bazel-cache) changed: [localhost] => (item=wheels) changed: [localhost] => (item=ml_wheels)

TASK [Set dual abi variable] *************************************************** Wednesday 09 August 2023 19:10:42 +0100 (0:00:01.426) 0:00:36.344 ****** ok: [localhost]

TASK [Go through each TensorFlow version] ************************************** Wednesday 09 August 2023 19:10:42 +0100 (0:00:00.032) 0:00:36.377 ****** skipping: [localhost] => (item={'key': '2.13', 'value': {'tensorflow_version': '2.13.0', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 23.1.21', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'protobuf_version': '>=3.20.3,<5.0.0dev,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.13.1', 'tensorboard_version': '==2.13.0', 'tensorflow_estimator_version': '==2.13.0', 'image_prefix': '2.13', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test', '//tensorflow/core/grappler/optimizers:remapper_test', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/python/kernel_tests/proto:decode_proto_op_test', '//tensorflow/python/util/protobuf:protobuf_compare_test', '//tensorflow/tools/api/tests:api_compatibility_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.8', '3.9', '3.10', '3.11']}}) skipping: [localhost] => (item={'key': '2.12', 'value': {'tensorflow_version': '2.12.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 2.0, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.8.0', 'numpy_version': '~=1.23.5', 'protobuf_version': '>=3.20.3,<5.0.0dev,!=4.21.0,!=4.21.1,!=4.21.2,!=4.21.3,!=4.21.4,!=4.21.5', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.9.3', 'keras_version': '==2.12.0', 'tensorboard_version': '==2.12.3', 'tensorflow_estimator_version': '==2.12.0', 'image_prefix': '2.12', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': True, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/python/kernel_tests/proto:decode_proto_op_test', '//tensorflow/python/util/protobuf:protobuf_compare_test', '//tensorflow/tools/api/tests:api_compatibility_test', '//tensorflow/tsl/framework/convolution:spatial_convolutions_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': 'NOT_USED', 'python_versions': ['3.8', '3.9', '3.10', '3.11']}}) skipping: [localhost] => (item={'key': '2.11', 'value': {'tensorflow_version': '2.11.1', 'bazel_version': 'bazelisk', 'flatbuffers_version': '>= 1.12, < 3.0', 'gast_version': '==0.4.0', 'grpcio_version': '>= 1.37.0, < 2.0', 'h5py_version': '~=3.6.0', 'numpy_version': '~=1.21.6', 'protobuf_version': '>=3.9.2,<3.20', 'absl_version': '>=1.0.0', 'scipy_version': '~=1.7.3', 'keras_version': '==2.11.0', 'tensorboard_version': '==2.11.2', 'tensorflow_estimator_version': '==2.11.0', 'image_prefix': '', 'python_install_packages': ['packaging', 'portpicker', 'keras', 'tensorboard', 'tensorflow-estimator'], 'run_unit_tests': True, 'run_serial_unit_tests': False, 'onednn_ut_exclude': ['//tensorflow/compiler/mlir/tfr/examples/mnist:mnist_ops_test', '//tensorflow/core/grappler/optimizers:auto_mixed_precision_test_cpu', '//tensorflow/core/grappler/optimizers:remapper_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:atrous_conv2d_test_cpu', '//tensorflow/python/kernel_tests/nn_ops:conv_ops_test_cpu'], 'unit_tests_exclude': ['//tensorflow/lite/...', '//tensorflow/compiler/mlir/lite/tests:const-fold.mlir.test', '//tensorflow/core/distributed_runtime/integration_test:c_api_session_coordination_test_cpu', '//tensorflow/python/client:session_list_devices_test', '//tensorflow/python/data/kernel_tests:iterator_test_cpu', '//tensorflow/python/training:server_lib_test'], 'serial_unit_tests_exclude': '', 'unit_tests_filter_flags': '-no_oss,-oss_serial,-gpu,-tpu,-benchmark-test,-v1only,-no_aarch64', 'python_versions': ['cp37-cp37m', 'cp38-cp38', 'cp39-cp39', 'cp310-cp310']}})

TASK [tensorflow : Set TensorFlow and other package versions] ****************** Wednesday 09 August 2023 19:10:42 +0100 (0:00:00.154) 0:00:36.531 ****** ok: [localhost]

TASK [tensorflow : Set build dir for TensorFlow git] *************************** Wednesday 09 August 2023 19:10:42 +0100 (0:00:00.080) 0:00:36.611 ****** ok: [localhost]

TASK [tensorflow : Remove TensorFlow git sources from previous build] ********** Wednesday 09 August 2023 19:10:42 +0100 (0:00:00.040) 0:00:36.652 ****** changed: [localhost]

TASK [tensorflow : Fetch TensorFlow] ******************************************* Wednesday 09 August 2023 19:10:46 +0100 (0:00:03.896) 0:00:40.549 ****** included: https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/ws/configs/ldcg-python-manylinux-tensorflow/ansible/roles/tensorflow/tasks/fetch.yml for localhost

TASK [tensorflow : Fetch TensorFlow git source] ******************************** Wednesday 09 August 2023 19:10:46 +0100 (0:00:00.088) 0:00:40.638 ****** skipping: [localhost]

TASK [tensorflow : Unpack TensorFlow git source] ******************************* Wednesday 09 August 2023 19:10:46 +0100 (0:00:00.035) 0:00:40.673 ****** skipping: [localhost]

TASK [tensorflow : Rename source dir for oneDNN build] ************************* Wednesday 09 August 2023 19:10:46 +0100 (0:00:00.033) 0:00:40.706 ****** skipping: [localhost]

TASK [tensorflow : Fetch TensorFlow from git] ********************************** Wednesday 09 August 2023 19:10:46 +0100 (0:00:00.033) 0:00:40.740 ****** changed: [localhost]

TASK [tensorflow : Fetch TensorFlow from git at commit] ************************ Wednesday 09 August 2023 19:11:09 +0100 (0:00:22.930) 0:01:03.671 ****** skipping: [localhost]

TASK [tensorflow : Set world write access to source] *************************** Wednesday 09 August 2023 19:11:09 +0100 (0:00:00.031) 0:01:03.703 ****** changed: [localhost]

TASK [tensorflow : Get oneline version of git log for this checkout] *********** Wednesday 09 August 2023 19:11:09 +0100 (0:00:00.370) 0:01:04.074 ****** changed: [localhost]

TASK [tensorflow : Show git log] *********************************************** Wednesday 09 August 2023 19:11:10 +0100 (0:00:00.583) 0:01:04.658 ****** ok: [localhost] => git_log.stdout: ba411b667a8259ec52a76fb3d1add529d634ef23 [xla] Use latency-hiding-scheduler-preparation to prepare for the latency hiding scheduler for the GPU.

TASK [tensorflow : Record git commit hash to variable] ************************* Wednesday 09 August 2023 19:11:10 +0100 (0:00:00.038) 0:01:04.696 ****** ok: [localhost]

TASK [tensorflow : Save git commit hash to file] ******************************* Wednesday 09 August 2023 19:11:10 +0100 (0:00:00.058) 0:01:04.755 ****** changed: [localhost]

TASK [Build Bazel] ************************************************************* Wednesday 09 August 2023 19:11:11 +0100 (0:00:01.152) 0:01:05.907 ****** skipping: [localhost]

TASK [Build TensorFlow for each Python version] ******************************** Wednesday 09 August 2023 19:11:11 +0100 (0:00:00.031) 0:01:05.939 ****** skipping: [localhost] => (item=3.9) skipping: [localhost] => (item=3.10) skipping: [localhost] => (item=3.11)

TASK [Build TensorFlow for each Python version (dual abi)] ********************* Wednesday 09 August 2023 19:11:11 +0100 (0:00:00.073) 0:01:06.012 ******

TASK [tensorflow_in_container : Reset checkout to clean state] ***************** Wednesday 09 August 2023 19:11:12 +0100 (0:00:00.341) 0:01:06.354 ****** changed: [localhost]

TASK [tensorflow_in_container : Remove TensorFlow git sources from previous build] *** Wednesday 09 August 2023 19:11:12 +0100 (0:00:00.646) 0:01:07.001 ****** skipping: [localhost]

TASK [Fetch TensorFlow] ******************************************************** Wednesday 09 August 2023 19:11:12 +0100 (0:00:00.032) 0:01:07.033 ****** skipping: [localhost]

TASK [(Python 3.9) patch TensorFlow tree] ************************************** Wednesday 09 August 2023 19:11:12 +0100 (0:00:00.032) 0:01:07.066 ******

TASK [tensorflow : Create linklibs shell script] ******************************* Wednesday 09 August 2023 19:11:12 +0100 (0:00:00.109) 0:01:07.176 ****** changed: [localhost]

TASK [tensorflow : Create readme file about unit tests] ************************ Wednesday 09 August 2023 19:11:13 +0100 (0:00:00.694) 0:01:07.870 ****** changed: [localhost]

TASK [tensorflow : Add to the copied files] ************************************ Wednesday 09 August 2023 19:11:14 +0100 (0:00:00.699) 0:01:08.569 ****** changed: [localhost]

TASK [tensorflow : Add to the long_description in setup.py] ******************** Wednesday 09 August 2023 19:11:14 +0100 (0:00:00.556) 0:01:09.125 ****** changed: [localhost]

TASK [tensorflow : Use nightly package requirements] *************************** Wednesday 09 August 2023 19:11:15 +0100 (0:00:00.586) 0:01:09.712 ****** changed: [localhost]

TASK [tensorflow_in_container : (Python 3.9) copy upper constraints] *********** Wednesday 09 August 2023 19:11:15 +0100 (0:00:00.399) 0:01:10.112 ****** changed: [localhost]

TASK [tensorflow_in_container : (Python 3.9) build Python versioned container] *** Wednesday 09 August 2023 19:11:16 +0100 (0:00:00.716) 0:01:10.829 ****** ok: [localhost]

TASK [tensorflow_in_container : (Python 3.9) start build container] ************ Wednesday 09 August 2023 19:11:18 +0100 (0:00:01.534) 0:01:12.363 ****** fatal: [localhost]: FAILED! => changed=false msg: 'Error removing container e7dbabadc438c2a6faf78adac6b1a31bd9f5ad5e25cd17d98b650edd8cfc2b20: UnixHTTPConnectionPool(host=''localhost'', port=None): Read timed out. (read timeout=600)'

PLAY RECAP ********************************************************************* localhost : ok=22 changed=14 unreachable=0 failed=1 skipped=8 rescued=0 ignored=0

Wednesday 09 August 2023 19:21:50 +0100 (0:10:32.296) 0:11:44.659 ****** =============================================================================== tensorflow_in_container : (Python 3.9) start build container ---------- 632.30s Cleanup after previous build ------------------------------------------- 33.22s tensorflow : Fetch TensorFlow from git --------------------------------- 22.93s tensorflow : Remove TensorFlow git sources from previous build ---------- 3.90s Gathering Facts --------------------------------------------------------- 1.66s tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.53s Create cache dirs ------------------------------------------------------- 1.43s tensorflow : Save git commit hash to file ------------------------------- 1.15s tensorflow_in_container : (Python 3.9) copy upper constraints ----------- 0.72s tensorflow : Create readme file about unit tests ------------------------ 0.70s tensorflow : Create linklibs shell script ------------------------------- 0.69s tensorflow_in_container : Reset checkout to clean state ----------------- 0.65s tensorflow : Add to the long_description in setup.py -------------------- 0.59s tensorflow : Get oneline version of git log for this checkout ----------- 0.58s tensorflow : Add to the copied files ------------------------------------ 0.56s tensorflow : Use nightly package requirements --------------------------- 0.40s tensorflow : Set world write access to source --------------------------- 0.37s Build TensorFlow for each Python version (dual abi) --------------------- 0.34s Go through each TensorFlow version -------------------------------------- 0.15s (Python 3.9) patch TensorFlow tree -------------------------------------- 0.11s Build step 'Execute shell' marked build as failure