New subject: Jenkins build is back to normal : Tensorflow oneDNN Python package (manylinux2014 nightly) #834

16 Jun 2024


      See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-onednn-nightly/833/display/redirect
Changes:
------------------------------------------
[...truncated 8.40 KiB...]
Sunday 16 June 2024  01:11:38 +0100 (0:00:00.079)       0:01:33.266 *********** 
changed: [localhost]
TASK [tensorflow : Use nightly package requirements] ***************************
Sunday 16 June 2024  01:11:39 +0100 (0:00:00.691)       0:01:33.957 *********** 
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds] ***
Sunday 16 June 2024  01:11:39 +0100 (0:00:00.645)       0:01:34.603 *********** 
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) build Python versioned container] ***
Sunday 16 June 2024  01:11:40 +0100 (0:00:00.687)       0:01:35.291 *********** 
ok: [localhost]
TASK [tensorflow_in_container : (Python 3.9) start build container] ************
Sunday 16 June 2024  01:11:42 +0100 (0:00:01.734)       0:01:37.026 *********** 
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir] ***
Sunday 16 June 2024  01:11:47 +0100 (0:00:05.454)       0:01:42.481 *********** 
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazel cache] ******
Sunday 16 June 2024  01:11:49 +0100 (0:00:01.235)       0:01:43.716 *********** 
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for bazelisk cache] ***
Sunday 16 June 2024  01:11:49 +0100 (0:00:00.899)       0:01:44.616 *********** 
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) create link for pip cache] ********
Sunday 16 June 2024  01:11:50 +0100 (0:00:00.861)       0:01:45.478 *********** 
changed: [localhost]
TASK [tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build] ***
Sunday 16 June 2024  01:11:51 +0100 (0:00:00.857)       0:01:46.336 *********** 
changed: [localhost]
TASK [tensorflow_in_container Sunday 16 June 2024 ok: [localhost] => pip_list_output.stdout: |- Package             Version ------------------- auditwheel          5.4.0 certifi             2019.11.28 cffi                1.16.0 chardet             3.0.4 cryptography        42.0.5 Cython              3.0.9 dbus-python         1.2.16 docutils            0.20.1 idna                2.8 importlib-metadata  7.0.1 jaraco.classes      3.3.1 jeepney             0.8.0 keyring             24.3.1 markdown-it-py      3.0.0 mdurl               0.1.2 more-itertools      10.2.0 nh3                 0.2.15 pip                 24.0 pkginfo             1.10.0 portpicker          1.6.0 psutil              5.9.8 pycparser           2.21 pyelftools          0.30 Pygments            2.17.2 PyGObject           3.36.0 python-apt readme_renderer     43.0 requests            2.22.0 requests-toolbelt   1.0.0 requests-unixsocket 0.2.0 rfc3986             2.0.0 rich                13.7.1 SecretStorage       3.3.3 setuptools          69.1.1 six                 1.14.0 twine               4.0.2 urllib3             2.2.1 wheel               0.42.0 zipp                3.17.0

: Show list of installed Python packages for build] *** 01:11:54 +0100 (0:00:03.279)       0:01:49.615 *********** Location                               Installer -------------------- -------------------------------------- --------- /usr/local/lib/python3.9/dist-packages pip /usr/lib/python3/dist-packages /usr/local/lib/python3.9/dist-packages pip /usr/lib/python3/dist-packages /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/lib/python3/dist-packages /usr/local/lib/python3.9/dist-packages pip /usr/lib/python3/dist-packages /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/lib/python3/dist-packages 2.0.1+ubuntu0.20.4.1 /usr/lib/python3/dist-packages /usr/local/lib/python3.9/dist-packages pip /usr/lib/python3/dist-packages /usr/local/lib/python3.9/dist-packages pip /usr/lib/python3/dist-packages /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/lib/python3/dist-packages /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip /usr/local/lib/python3.9/dist-packages pip
TASK [tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git] ***
Sunday 16 June 2024  01:11:54 +0100 (0:00:00.037)       0:01:49.653 *********** 
fatal: [localhost]: FAILED! => changed=true 
  rc: 1
  stderr: |-
    Extracting Bazel installation...
    Starting local Bazel server and connecting to it...
    INFO: Invocation ID: d8965d29-38fd-466e-a52f-f1776b7bd719
    INFO: Reading 'startup' options from /tf/tensorflow/.bazelrc: --windows_enable_symlinks
    INFO: Options provided by the client:
      Inherited 'common' options: --isatty=0 --terminal_columns=80
    INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc:
      Inherited 'common' options: --experimental_repo_remote_exec
    INFO: Reading rc options for 'build' from /tf/tensorflow/.bazelrc:
      'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --features=-force_no_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false --incompatible_enforce_config_setting_visibility
    INFO: Reading rc options for 'build' from /usertools/aarch64_clang.bazelrc:
      'build' options: --action_env=CACHEBUSTER=20220325 --action_env PYTHON_BIN_PATH=/usr/local/bin/python3 --python_path=/usr/local/bin/python3 --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 --linkopt=-fuse-ld=lld --linkopt=-lm --linkopt=-Wl,--undefined-version --host_linkopt=-fuse-ld=lld --host_linkopt=-lm --host_linkopt=-Wl,--undefined-version --distinct_host_configuration=false --copt=-Wno-gnu-offsetof-extensions --profile=/tf/pkg/profile.json.gz --crosstool_top=@ml2014_clang_aarch64_config_aarch64//crosstool:toolchain --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3
    INFO: Found applicable config definition build:short_logs in file /tf/tensorflow/.bazelrc: --output_filter=DONT_MATCH_ANYTHING
    INFO: Found applicable config definition build:v2 in file /tf/tensorflow/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1
    INFO: Found applicable config definition build:sigbuild_local_cache in file /usertools/aarch64_clang.bazelrc: --disk_cache=/tf/cache
    INFO: Found applicable config definition build:mkl_aarch64_threadpool in file /tf/tensorflow/.bazelrc: --define=build_with_mkl_aarch64=true -c opt
    INFO: Found applicable config definition build:linux in file /tf/tensorflow/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --experimental_guard_against_concurrent_changes
    INFO: Found applicable config definition build:dynamic_kernels in file /tf/tensorflow/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    Loading:
    INFO: Repository llvm-raw instantiated at:
      /tf/tensorflow/WORKSPACE:91:14: in <toplevel>
      /tf/tensorflow/tensorflow/workspace3.bzl:63:9: in workspace
      /tf/tensorflow/third_party/llvm/workspace.bzl:10:20: in repo
      /tf/tensorflow/third_party/repo.bzl:136:21: in tf_http_archive
    Repository rule _tf_http_archive defined at:
      /tf/tensorflow/third_party/repo.bzl:89:35: in <toplevel>
    WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-pr... failed: class java.io.FileNotFoundException GET returned 404 Not Found
    ERROR: An error occurred during the fetch of repository 'llvm-raw':
       Traceback (most recent call last):
            File "/tf/tensorflow/third_party/repo.bzl", line 83, column 30, in _tf_http_archive_impl
                    ctx.patch(patch_file, strip = 1)
    Error in patch: Error applying patch /tf/tensorflow/third_party/llvm/typo.patch: Incorrect Chunk: the chunk content doesn't match the target
    **Original Position**: 1051
**Original Content**:
            ":CAPIDebugObjects",
            ":CAPIIRObjects",
            ":CAPIInterfacesObjects",
            ":CAPITransformObjects",
        ],
    )
**Revised Content**:
            ":CAPIDebugObjects",
            ":CAPIIRObjects",
            ":CAPIInterfacesObjects",
            ":CAPITransformsObjects",
        ],
    )
ERROR: /tf/tensorflow/WORKSPACE:91:14: fetching _tf_http_archive rule //external:llvm-raw: Traceback (most recent call last):
            File "/tf/tensorflow/third_party/repo.bzl", line 83, column 30, in _tf_http_archive_impl
                    ctx.patch(patch_file, strip = 1)
    Error in patch: Error applying patch /tf/tensorflow/third_party/llvm/typo.patch: Incorrect Chunk: the chunk content doesn't match the target
    **Original Position**: 1051
**Original Content**:
            ":CAPIDebugObjects",
            ":CAPIIRObjects",
            ":CAPIInterfacesObjects",
            ":CAPITransformObjects",
        ],
    )
**Revised Content**:
            ":CAPIDebugObjects",
            ":CAPIIRObjects",
            ":CAPIInterfacesObjects",
            ":CAPITransformsObjects",
        ],
    )
ERROR: Error computing the main repository mapping: no such package '@llvm-raw//utils/bazel': Error applying patch /tf/tensorflow/third_party/llvm/typo.patch: Incorrect Chunk: the chunk content doesn't match the target
    **Original Position**: 1051
**Original Content**:
            ":CAPIDebugObjects",
            ":CAPIIRObjects",
            ":CAPIInterfacesObjects",
            ":CAPITransformObjects",
        ],
    )
**Revised Content**:
            ":CAPIDebugObjects",
            ":CAPIIRObjects",
            ":CAPIInterfacesObjects",
            ":CAPITransformsObjects",
        ],
    )
  stderr_lines: <omitted>
  stdout: ''
  stdout_lines: <omitted>
PLAY RECAP *********************************************************************
localhost                  : ok=25   changed=17   unreachable=0    failed=1    skipped=6    rescued=0    ignored=0
Sunday 16 June 2024  01:13:21 +0100 (0:01:26.392)       0:03:16.045 *********** 
=============================================================================== 
tensorflow_in_container : (Python 3.9) build TensorFlow-oneDNN-ACL git -- 86.39s
Cleanup after previous build ------------------------------------------- 57.36s
tensorflow : Fetch TensorFlow-oneDNN-ACL from git ---------------------- 22.00s
tensorflow : Remove TensorFlow-oneDNN-ACL git sources from previous build --- 6.88s
tensorflow_in_container : (Python 3.9) start build container ------------ 5.45s
tensorflow_in_container : (Python 3.9) collect list of installed Python packages for build --- 3.28s
tensorflow_in_container : (Python 3.9) build Python versioned container --- 1.73s
Gathering Facts --------------------------------------------------------- 1.70s
Create cache dirs ------------------------------------------------------- 1.45s
tensorflow_in_container : (Python 3.9) create buildslave bazel cache dir --- 1.24s
tensorflow : Save git commit hash to file ------------------------------- 1.14s
tensorflow_in_container : (Python 3.9) create link for bazel cache ------ 0.90s
tensorflow_in_container : (Python 3.9) create link for bazelisk cache --- 0.86s
tensorflow_in_container : (Python 3.9) create link for pip cache -------- 0.86s
tensorflow : Create linklibs shell script ------------------------------- 0.69s
tensorflow_in_container : (Python 3.9) copy upper constraints for hermetic builds --- 0.69s
tensorflow_in_container : Reset checkout to clean state ----------------- 0.66s
tensorflow : Use nightly package requirements --------------------------- 0.65s
tensorflow : Get oneline version of git log for this checkout ----------- 0.58s
Build TensorFlow for each Python version (dual abi) --------------------- 0.43s
Build step 'Execute shell' marked build as failure

Build failed in Jenkins: Tensorflow oneDNN Python package (manylinux2014 nightly) #833