See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/596/display/redirect
Changes:
------------------------------------------ [...truncated 68.73 KB...] I1209 19:58:18.627937 281473537231968 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testOpView): 1.26s [ OK ] PrintModelAnalysisTest.testOpView [ RUN ] PrintModelAnalysisTest.testPprof 2022-12-09 19:58:19.626075: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-09 19:58:19.626131: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-09 19:58:19.629318: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-09 19:58:19.629351: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-09 19:58:19.629612: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. Note: code view ignores account_displayed_op_only 2022-12-09 19:58:21.902135: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-09 19:58:21.902216: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-09 19:58:21.905243: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-09 19:58:21.905281: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-09 19:58:21.905541: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. Note: code view ignores account_displayed_op_only 2022-12-09 19:58:24.212908: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-09 19:58:24.212977: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-09 19:58:24.216059: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-09 19:58:24.216097: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-09 19:58:24.216354: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. Note: code view ignores account_displayed_op_only 2022-12-09 19:58:26.483016: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-09 19:58:26.483088: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-09 19:58:26.485899: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-09 19:58:26.485938: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-09 19:58:26.486194: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. Note: code view ignores account_displayed_op_only 2022-12-09 19:58:28.788121: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-09 19:58:28.788201: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-09 19:58:28.791224: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-09 19:58:28.791270: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-09 19:58:28.791532: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. Note: code view ignores account_displayed_op_only 2022-12-09 19:58:31.067390: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-09 19:58:31.067461: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-09 19:58:31.070351: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-09 19:58:31.070395: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-09 19:58:31.070657: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. Note: code view ignores account_displayed_op_only 2022-12-09 19:58:33.340198: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-09 19:58:33.340272: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-09 19:58:33.343320: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-09 19:58:33.343357: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-09 19:58:33.343612: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. pprof doesn't support -select=op_types 2022-12-09 19:58:35.570601: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-09 19:58:35.570670: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-09 19:58:35.573659: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-09 19:58:35.573698: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-09 19:58:35.573959: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. pprof doesn't support -select=device 2022-12-09 19:58:37.802085: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-09 19:58:37.802158: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-09 19:58:37.804966: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-09 19:58:37.805005: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-09 19:58:37.805266: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. pprof doesn't support -select=input_shapes INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testPprof): 20.41s I1209 19:58:39.038385 281473537231968 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testPprof): 20.41s [ OK ] PrintModelAnalysisTest.testPprof [ RUN ] PrintModelAnalysisTest.testSelectEverything 2022-12-09 19:58:39.122806: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-09 19:58:39.122849: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-09 19:58:39.123068: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-09 19:58:39.123103: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-09 19:58:39.123134: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testSelectEverything): 0.1s I1209 19:58:39.137048 281473537231968 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testSelectEverything): 0.1s [ OK ] PrintModelAnalysisTest.testSelectEverything [ RUN ] PrintModelAnalysisTest.testSelectEverythingDetail INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testSelectEverythingDetail): 0.0s I1209 19:58:39.137931 281473537231968 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testSelectEverythingDetail): 0.0s [ SKIPPED ] PrintModelAnalysisTest.testSelectEverythingDetail [ RUN ] PrintModelAnalysisTest.testSelectOption 2022-12-09 19:58:39.228722: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-09 19:58:39.228759: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-09 19:58:39.228949: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-09 19:58:39.228978: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-09 19:58:39.229005: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testSelectOption): 0.13s I1209 19:58:39.264664 281473537231968 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testSelectOption): 0.13s [ OK ] PrintModelAnalysisTest.testSelectOption [ RUN ] PrintModelAnalysisTest.testSimpleCodeView 2022-12-09 19:58:39.343501: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-09 19:58:39.343533: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-09 19:58:39.343792: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-09 19:58:39.343816: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-09 19:58:39.343840: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testSimpleCodeView): 0.2s I1209 19:58:39.466821 281473537231968 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testSimpleCodeView): 0.2s [ OK ] PrintModelAnalysisTest.testSimpleCodeView [ RUN ] PrintModelAnalysisTest.testTimeline 2022-12-09 19:58:40.453316: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-09 19:58:40.453388: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-09 19:58:40.456344: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-09 19:58:40.456380: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-09 19:58:40.456637: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down.
Run pprof -png --nodecount=100 --sample_index=1 </root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d81iok9wut/micros_pprof.pb.gz>
Run pprof -png --nodecount=100 --sample_index=1 </root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d81iok9wut/bytes_pprof.pb.gz>
Run pprof -png --nodecount=100 --sample_index=1 </root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d81iok9wut/accelerator_micros_pprof.pb.gz>
Run pprof -png --nodecount=100 --sample_index=1 </root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d81iok9wut/cpu_micros_pprof.pb.gz>
Run pprof -png --nodecount=100 --sample_index=1 </root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d81iok9wut/params_pprof.pb.gz>
Run pprof -png --nodecount=100 --sample_index=1 </root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d81iok9wut/float_ops_pprof.pb.gz> generating trace file.
****************************************************** Timeline file is written to /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d81iok9wut/timeline_0. Open a Chrome browser, enter URL chrome://tracing and load the timeline file. ****************************************************** INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testTimeline): 1.27s I1209 19:58:40.739365 281473537231968 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testTimeline): 1.27s [ OK ] PrintModelAnalysisTest.testTimeline [ RUN ] PrintModelAnalysisTest.testTraceLoopBytes INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testTraceLoopBytes): 0.0s I1209 19:58:40.740524 281473537231968 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testTraceLoopBytes): 0.0s [ SKIPPED ] PrintModelAnalysisTest.testTraceLoopBytes [ RUN ] PrintModelAnalysisTest.testTrackPersistentBytes INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testTrackPersistentBytes): 0.0s I1209 19:58:40.741106 281473537231968 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testTrackPersistentBytes): 0.0s [ SKIPPED ] PrintModelAnalysisTest.testTrackPersistentBytes [ RUN ] PrintModelAnalysisTest.test_session [ SKIPPED ] PrintModelAnalysisTest.test_session ---------------------------------------------------------------------- Ran 18 tests in 26.785s
OK (skipped=8) ================================================================================ ==================== Test output for //tensorflow/python/eager/benchmarks/resnet50:resnet50_graph_test_cpu (shard 3 of 4): 2022-12-09 19:58:41.808445: E tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Cannot register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay Running tests under Python 3.8.15: /tmp/workspace/venv-cp38-cp38/bin/python3 ---------------------------------------------------------------------- Ran 0 tests in 0.000s
OK ================================================================================ ==================== Test output for //tensorflow/python/eager/benchmarks/resnet50:resnet50_graph_test_cpu (shard 1 of 4): 2022-12-09 19:58:52.028262: E tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Cannot register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay Running tests under Python 3.8.15: /tmp/workspace/venv-cp38-cp38/bin/python3 [ RUN ] ResNet50GraphTest.testApply WARNING:tensorflow:From /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/eager/benchmarks/resnet50/resnet50_graph_test_cpu.runfiles/org_tensorflow/tensorflow/python/eager/benchmarks/resnet50/resnet50_graph_test.py:26: is_gpu_available (from tensorflow.python.framework.test_util) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.config.list_physical_devices('GPU')` instead. W1209 19:58:55.292058 281473183599712 deprecation.py:364] From /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/eager/benchmarks/resnet50/resnet50_graph_test_cpu.runfiles/org_tensorflow/tensorflow/python/eager/benchmarks/resnet50/resnet50_graph_test.py:26: is_gpu_available (from tensorflow.python.framework.test_util) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.config.list_physical_devices('GPU')` instead. 2022-12-09 19:58:59.614843: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:357] MLIR V1 optimization pass is not enabled INFO:tensorflow:time(__main__.ResNet50GraphTest.testApply): 6.65s I1209 19:59:01.944850 281473183599712 test_util.py:2457] time(__main__.ResNet50GraphTest.testApply): 6.65s [ OK ] ResNet50GraphTest.testApply ---------------------------------------------------------------------- Ran 1 test in 6.655s
OK ================================================================================ ==================== Test output for //tensorflow/python/eager/benchmarks/resnet50:resnet50_graph_test_cpu (shard 2 of 4): 2022-12-09 19:59:03.004452: E tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Cannot register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay Running tests under Python 3.8.15: /tmp/workspace/venv-cp38-cp38/bin/python3 [ RUN ] ResNet50GraphTest.test_session [ SKIPPED ] ResNet50GraphTest.test_session ---------------------------------------------------------------------- Ran 1 test in 0.001s
OK (skipped=1) ================================================================================ ==================== Test output for //tensorflow/python/eager/benchmarks/resnet50:resnet50_graph_test_cpu (shard 4 of 4): 2022-12-09 19:59:07.244648: E tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Cannot register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay Running tests under Python 3.8.15: /tmp/workspace/venv-cp38-cp38/bin/python3 ---------------------------------------------------------------------- Ran 0 tests in 0.000s
OK ================================================================================ ==================== Test output for //tensorflow/python/debug/lib:source_remote_test: Traceback (most recent call last): File "/root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/debug/lib/source_remote_test.runfiles/org_tensorflow/tensorflow/python/debug/lib/source_remote_test.py", line 20, in <module> import grpc File "/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/__init__.py", line 22, in <module> from grpc import _compression File "/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/_compression.py", line 20, in <module> from grpc._cython import cygrpc ImportError: /tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/_cython/cygrpc.cpython-38-aarch64-linux-gnu.so: undefined symbol: _ZTVNSt7__cxx1119basic_ostringstreamIcSt11char_traitsIcESaIcEEE ================================================================================ ==================== Test output for //tensorflow/python/debug/lib:source_remote_test: Traceback (most recent call last): File "/root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/debug/lib/source_remote_test.runfiles/org_tensorflow/tensorflow/python/debug/lib/source_remote_test.py", line 20, in <module> import grpc File "/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/__init__.py", line 22, in <module> from grpc import _compression File "/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/_compression.py", line 20, in <module> from grpc._cython import cygrpc ImportError: /tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/_cython/cygrpc.cpython-38-aarch64-linux-gnu.so: undefined symbol: _ZTVNSt7__cxx1119basic_ostringstreamIcSt11char_traitsIcESaIcEEE ================================================================================ ==================== Test output for //tensorflow/python/debug/lib:source_remote_test: Traceback (most recent call last): File "/root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/debug/lib/source_remote_test.runfiles/org_tensorflow/tensorflow/python/debug/lib/source_remote_test.py", line 20, in <module> import grpc File "/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/__init__.py", line 22, in <module> from grpc import _compression File "/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/_compression.py", line 20, in <module> from grpc._cython import cygrpc ImportError: /tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/_cython/cygrpc.cpython-38-aarch64-linux-gnu.so: undefined symbol: _ZTVNSt7__cxx1119basic_ostringstreamIcSt11char_traitsIcESaIcEEE ================================================================================ //tensorflow/python/profiler:model_analyzer_test_cpu PASSED in 34.3s //tensorflow/python/training:localhost_cluster_performance_test_cpu PASSED in 5.4s //tensorflow/python/training:sync_replicas_optimizer_test PASSED in 7.3s //tensorflow/python/debug/lib:source_remote_test FAILED in 3 out of 3 in 0.2s Stats over 3 runs: max = 0.2s, min = 0.2s, avg = 0.2s, dev = 0.0s /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/debug/lib/source_remote_test/test.log /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/debug/lib/source_remote_test/test_attempts/attempt_1.log /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/debug/lib/source_remote_test/test_attempts/attempt_2.log //tensorflow/python/eager/benchmarks/resnet50:resnet50_graph_test_cpu PASSED in 11.0s Stats over 4 runs: max = 11.0s, min = 4.2s, avg = 7.4s, dev = 3.2s
Executed 5 out of 5 tests: 4 tests pass and 1 fails locally. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=56 changed=33 unreachable=0 failed=1 skipped=18 rescued=0 ignored=0
Friday 09 December 2022 19:59:11 +0000 (0:01:25.473) 1:48:35.617 ******* =============================================================================== tensorflow : Run unit tests on TensorFlow git for cp38-cp38 ---------- 3761.30s tensorflow : build TensorFlow git for cp38-cp38 ---------------------- 2141.01s python : build wheels of Python package h5py~=3.6.0 ------------------- 257.76s tensorflow : Run oss_serial unit tests on TensorFlow git for cp38-cp38 -- 85.47s install bazel build requirements --------------------------------------- 47.83s tensorflow : populate cp38-cp38 virtualenv ----------------------------- 42.91s python : install numpy build requirements ------------------------------ 32.79s python : install h5py build requirements ------------------------------- 27.00s fetch tensorflow from git ---------------------------------------------- 24.10s python : install scipy-1.7.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl Python package -- 14.61s python : create cp38-cp38 virtualenv ----------------------------------- 13.00s python : build wheels of Python package scipy --------------------------- 9.56s install tensorflow build requirements ----------------------------------- 7.57s python : build wheels of Python package Keras_Preprocessing ------------- 6.47s Gathering Facts --------------------------------------------------------- 4.61s python : build wheels of Python package numpy>=1.20 --------------------- 4.59s python : build wheels of Python package grpcio -------------------------- 4.18s tensorflow : Extract number of tests run -------------------------------- 3.80s python : enable EPEL ---------------------------------------------------- 3.10s python : install h5py-3.6.0-cp38-cp38-linux_aarch64.whl Python package --- 2.49s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/597/display/redirect
Changes:
------------------------------------------ [...truncated 68.86 KB...] Note: code view ignores account_displayed_op_only 2022-12-10 19:59:00.100883: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-10 19:59:00.100957: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-10 19:59:00.104048: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-10 19:59:00.104084: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-10 19:59:00.104349: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. Note: code view ignores account_displayed_op_only 2022-12-10 19:59:02.368393: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-10 19:59:02.368456: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-10 19:59:02.371521: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-10 19:59:02.371564: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-10 19:59:02.371829: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. Note: code view ignores account_displayed_op_only 2022-12-10 19:59:04.660757: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-10 19:59:04.660844: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-10 19:59:04.664099: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-10 19:59:04.664137: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-10 19:59:04.664402: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. Note: code view ignores account_displayed_op_only 2022-12-10 19:59:06.935802: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-10 19:59:06.935872: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-10 19:59:06.938934: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-10 19:59:06.938973: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-10 19:59:06.939247: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. Note: code view ignores account_displayed_op_only 2022-12-10 19:59:09.205518: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-10 19:59:09.205592: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-10 19:59:09.208687: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-10 19:59:09.208725: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-10 19:59:09.208991: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. pprof doesn't support -select=op_types 2022-12-10 19:59:11.431372: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-10 19:59:11.431462: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-10 19:59:11.434499: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-10 19:59:11.434537: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-10 19:59:11.434803: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. pprof doesn't support -select=device 2022-12-10 19:59:13.670498: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-10 19:59:13.670574: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-10 19:59:13.673723: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-10 19:59:13.673761: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-10 19:59:13.674030: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. pprof doesn't support -select=input_shapes INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testPprof): 20.36s I1210 19:59:14.906911 281473616858208 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testPprof): 20.36s [ OK ] PrintModelAnalysisTest.testPprof [ RUN ] PrintModelAnalysisTest.testSelectEverything 2022-12-10 19:59:14.990918: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-10 19:59:14.990965: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-10 19:59:14.991176: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-10 19:59:14.991211: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-10 19:59:14.991247: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testSelectEverything): 0.1s I1210 19:59:15.005051 281473616858208 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testSelectEverything): 0.1s [ OK ] PrintModelAnalysisTest.testSelectEverything [ RUN ] PrintModelAnalysisTest.testSelectEverythingDetail INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testSelectEverythingDetail): 0.0s I1210 19:59:15.005916 281473616858208 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testSelectEverythingDetail): 0.0s [ SKIPPED ] PrintModelAnalysisTest.testSelectEverythingDetail [ RUN ] PrintModelAnalysisTest.testSelectOption 2022-12-10 19:59:15.096750: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-10 19:59:15.096790: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-10 19:59:15.096963: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-10 19:59:15.096994: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-10 19:59:15.097026: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testSelectOption): 0.13s I1210 19:59:15.132599 281473616858208 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testSelectOption): 0.13s [ OK ] PrintModelAnalysisTest.testSelectOption [ RUN ] PrintModelAnalysisTest.testSimpleCodeView 2022-12-10 19:59:15.211160: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-10 19:59:15.211194: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-10 19:59:15.211367: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-10 19:59:15.211391: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-10 19:59:15.211416: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testSimpleCodeView): 0.2s I1210 19:59:15.333733 281473616858208 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testSimpleCodeView): 0.2s [ OK ] PrintModelAnalysisTest.testSimpleCodeView [ RUN ] PrintModelAnalysisTest.testTimeline 2022-12-10 19:59:16.318170: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-10 19:59:16.318225: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-10 19:59:16.321248: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-10 19:59:16.321288: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-10 19:59:16.321555: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down.
Run pprof -png --nodecount=100 --sample_index=1 </root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d8gl8h9m91/micros_pprof.pb.gz>
Run pprof -png --nodecount=100 --sample_index=1 </root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d8gl8h9m91/bytes_pprof.pb.gz>
Run pprof -png --nodecount=100 --sample_index=1 </root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d8gl8h9m91/accelerator_micros_pprof.pb.gz>
Run pprof -png --nodecount=100 --sample_index=1 </root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d8gl8h9m91/cpu_micros_pprof.pb.gz>
Run pprof -png --nodecount=100 --sample_index=1 </root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d8gl8h9m91/params_pprof.pb.gz>
Run pprof -png --nodecount=100 --sample_index=1 </root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d8gl8h9m91/float_ops_pprof.pb.gz> generating trace file.
****************************************************** Timeline file is written to /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d8gl8h9m91/timeline_0. Open a Chrome browser, enter URL chrome://tracing and load the timeline file. ****************************************************** INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testTimeline): 1.27s I1210 19:59:16.604079 281473616858208 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testTimeline): 1.27s [ OK ] PrintModelAnalysisTest.testTimeline [ RUN ] PrintModelAnalysisTest.testTraceLoopBytes INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testTraceLoopBytes): 0.0s I1210 19:59:16.604915 281473616858208 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testTraceLoopBytes): 0.0s [ SKIPPED ] PrintModelAnalysisTest.testTraceLoopBytes [ RUN ] PrintModelAnalysisTest.testTrackPersistentBytes INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testTrackPersistentBytes): 0.0s I1210 19:59:16.605495 281473616858208 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testTrackPersistentBytes): 0.0s [ SKIPPED ] PrintModelAnalysisTest.testTrackPersistentBytes [ RUN ] PrintModelAnalysisTest.test_session [ SKIPPED ] PrintModelAnalysisTest.test_session ---------------------------------------------------------------------- Ran 18 tests in 26.733s
OK (skipped=8) ================================================================================ ==================== Test output for //tensorflow/python/training:localhost_cluster_performance_test_cpu: 2022-12-10 19:59:17.805608: E tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Cannot register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay Running tests under Python 3.8.15: /tmp/workspace/venv-cp38-cp38/bin/python3 [ RUN ] CreateLocalClusterTest.testCreateLocalCluster INFO:tensorflow:time(__main__.CreateLocalClusterTest.testCreateLocalCluster): 0.0s I1210 19:59:22.174821 281473733184608 test_util.py:2457] time(__main__.CreateLocalClusterTest.testCreateLocalCluster): 0.0s [ SKIPPED ] CreateLocalClusterTest.testCreateLocalCluster [ RUN ] CreateLocalClusterTest.test_session [ SKIPPED ] CreateLocalClusterTest.test_session ---------------------------------------------------------------------- Ran 2 tests in 0.001s
OK (skipped=2) ================================================================================ ==================== Test output for //tensorflow/python/eager/benchmarks/resnet50:resnet50_graph_test_cpu (shard 2 of 4): 2022-12-10 19:59:23.005754: E tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Cannot register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay Running tests under Python 3.8.15: /tmp/workspace/venv-cp38-cp38/bin/python3 [ RUN ] ResNet50GraphTest.test_session [ SKIPPED ] ResNet50GraphTest.test_session ---------------------------------------------------------------------- Ran 1 test in 0.001s
OK (skipped=1) ================================================================================ ==================== Test output for //tensorflow/python/eager/benchmarks/resnet50:resnet50_graph_test_cpu (shard 1 of 4): 2022-12-10 19:59:33.159076: E tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Cannot register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay Running tests under Python 3.8.15: /tmp/workspace/venv-cp38-cp38/bin/python3 [ RUN ] ResNet50GraphTest.testApply WARNING:tensorflow:From /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/eager/benchmarks/resnet50/resnet50_graph_test_cpu.runfiles/org_tensorflow/tensorflow/python/eager/benchmarks/resnet50/resnet50_graph_test.py:26: is_gpu_available (from tensorflow.python.framework.test_util) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.config.list_physical_devices('GPU')` instead. W1210 19:59:36.410743 281473068125280 deprecation.py:364] From /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/eager/benchmarks/resnet50/resnet50_graph_test_cpu.runfiles/org_tensorflow/tensorflow/python/eager/benchmarks/resnet50/resnet50_graph_test.py:26: is_gpu_available (from tensorflow.python.framework.test_util) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.config.list_physical_devices('GPU')` instead. 2022-12-10 19:59:40.722663: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:357] MLIR V1 optimization pass is not enabled INFO:tensorflow:time(__main__.ResNet50GraphTest.testApply): 6.66s I1210 19:59:43.069267 281473068125280 test_util.py:2457] time(__main__.ResNet50GraphTest.testApply): 6.66s [ OK ] ResNet50GraphTest.testApply ---------------------------------------------------------------------- Ran 1 test in 6.660s
OK ================================================================================ ==================== Test output for //tensorflow/python/eager/benchmarks/resnet50:resnet50_graph_test_cpu (shard 3 of 4): 2022-12-10 19:59:44.124490: E tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Cannot register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay Running tests under Python 3.8.15: /tmp/workspace/venv-cp38-cp38/bin/python3 ---------------------------------------------------------------------- Ran 0 tests in 0.000s
OK ================================================================================ ==================== Test output for //tensorflow/python/eager/benchmarks/resnet50:resnet50_graph_test_cpu (shard 4 of 4): 2022-12-10 19:59:48.352960: E tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Cannot register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay Running tests under Python 3.8.15: /tmp/workspace/venv-cp38-cp38/bin/python3 ---------------------------------------------------------------------- Ran 0 tests in 0.000s
OK ================================================================================ ==================== Test output for //tensorflow/python/debug/lib:source_remote_test: Traceback (most recent call last): File "/root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/debug/lib/source_remote_test.runfiles/org_tensorflow/tensorflow/python/debug/lib/source_remote_test.py", line 20, in <module> import grpc File "/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/__init__.py", line 22, in <module> from grpc import _compression File "/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/_compression.py", line 20, in <module> from grpc._cython import cygrpc ImportError: /tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/_cython/cygrpc.cpython-38-aarch64-linux-gnu.so: undefined symbol: _ZTVNSt7__cxx1119basic_ostringstreamIcSt11char_traitsIcESaIcEEE ================================================================================ ==================== Test output for //tensorflow/python/debug/lib:source_remote_test: Traceback (most recent call last): File "/root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/debug/lib/source_remote_test.runfiles/org_tensorflow/tensorflow/python/debug/lib/source_remote_test.py", line 20, in <module> import grpc File "/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/__init__.py", line 22, in <module> from grpc import _compression File "/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/_compression.py", line 20, in <module> from grpc._cython import cygrpc ImportError: /tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/_cython/cygrpc.cpython-38-aarch64-linux-gnu.so: undefined symbol: _ZTVNSt7__cxx1119basic_ostringstreamIcSt11char_traitsIcESaIcEEE ================================================================================ ==================== Test output for //tensorflow/python/debug/lib:source_remote_test: Traceback (most recent call last): File "/root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/debug/lib/source_remote_test.runfiles/org_tensorflow/tensorflow/python/debug/lib/source_remote_test.py", line 20, in <module> import grpc File "/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/__init__.py", line 22, in <module> from grpc import _compression File "/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/_compression.py", line 20, in <module> from grpc._cython import cygrpc ImportError: /tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/_cython/cygrpc.cpython-38-aarch64-linux-gnu.so: undefined symbol: _ZTVNSt7__cxx1119basic_ostringstreamIcSt11char_traitsIcESaIcEEE ================================================================================ //tensorflow/python/profiler:model_analyzer_test_cpu PASSED in 34.2s //tensorflow/python/training:localhost_cluster_performance_test_cpu PASSED in 5.3s //tensorflow/python/training:sync_replicas_optimizer_test PASSED in 7.3s //tensorflow/python/debug/lib:source_remote_test FAILED in 3 out of 3 in 0.2s Stats over 3 runs: max = 0.2s, min = 0.2s, avg = 0.2s, dev = 0.0s /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/debug/lib/source_remote_test/test.log /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/debug/lib/source_remote_test/test_attempts/attempt_1.log /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/debug/lib/source_remote_test/test_attempts/attempt_2.log //tensorflow/python/eager/benchmarks/resnet50:resnet50_graph_test_cpu PASSED in 11.0s Stats over 4 runs: max = 11.0s, min = 4.2s, avg = 7.4s, dev = 3.1s
Executed 5 out of 5 tests: 4 tests pass and 1 fails locally. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=56 changed=33 unreachable=0 failed=1 skipped=18 rescued=0 ignored=0
Saturday 10 December 2022 19:59:53 +0000 (0:01:25.431) 1:49:20.446 ***** =============================================================================== tensorflow : Run unit tests on TensorFlow git for cp38-cp38 ---------- 3771.17s tensorflow : build TensorFlow git for cp38-cp38 ---------------------- 2170.74s python : build wheels of Python package h5py~=3.6.0 ------------------- 259.33s tensorflow : Run oss_serial unit tests on TensorFlow git for cp38-cp38 -- 85.43s install bazel build requirements --------------------------------------- 55.25s tensorflow : populate cp38-cp38 virtualenv ----------------------------- 43.75s python : install numpy build requirements ------------------------------ 37.31s fetch tensorflow from git ---------------------------------------------- 23.39s python : install h5py build requirements ------------------------------- 20.96s python : install scipy-1.7.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl Python package -- 14.41s python : create cp38-cp38 virtualenv ----------------------------------- 13.54s python : build wheels of Python package scipy --------------------------- 8.49s install tensorflow build requirements ----------------------------------- 7.58s python : build wheels of Python package Keras_Preprocessing ------------- 4.82s Gathering Facts --------------------------------------------------------- 4.61s python : build wheels of Python package numpy>=1.20 --------------------- 4.37s python : build wheels of Python package grpcio -------------------------- 4.10s tensorflow : Extract number of tests run -------------------------------- 3.96s python : enable EPEL ---------------------------------------------------- 3.12s python : install h5py-3.6.0-cp38-cp38-linux_aarch64.whl Python package --- 2.48s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/598/display/redirect
Changes:
------------------------------------------ [...truncated 68.58 KB...] I1211 19:58:56.756863 281473359432800 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testOpView): 1.26s [ OK ] PrintModelAnalysisTest.testOpView [ RUN ] PrintModelAnalysisTest.testPprof 2022-12-11 19:58:57.756545: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-11 19:58:57.756598: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-11 19:58:57.759602: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-11 19:58:57.759638: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-11 19:58:57.759899: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. Note: code view ignores account_displayed_op_only 2022-12-11 19:59:00.058527: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-11 19:59:00.058611: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-11 19:59:00.061915: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-11 19:59:00.061959: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-11 19:59:00.062574: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. Note: code view ignores account_displayed_op_only 2022-12-11 19:59:02.380982: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-11 19:59:02.381053: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-11 19:59:02.384272: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-11 19:59:02.384310: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-11 19:59:02.384906: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. Note: code view ignores account_displayed_op_only 2022-12-11 19:59:04.667284: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-11 19:59:04.667350: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-11 19:59:04.670568: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-11 19:59:04.670611: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-11 19:59:04.671211: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. Note: code view ignores account_displayed_op_only 2022-12-11 19:59:06.974136: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-11 19:59:06.974208: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-11 19:59:06.977405: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-11 19:59:06.977442: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-11 19:59:06.978047: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. Note: code view ignores account_displayed_op_only 2022-12-11 19:59:09.263537: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-11 19:59:09.263605: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-11 19:59:09.266816: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-11 19:59:09.266852: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-11 19:59:09.267447: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. Note: code view ignores account_displayed_op_only 2022-12-11 19:59:11.549319: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-11 19:59:11.549386: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-11 19:59:11.552690: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-11 19:59:11.552734: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-11 19:59:11.553339: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. pprof doesn't support -select=op_types 2022-12-11 19:59:13.791713: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-11 19:59:13.791810: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-11 19:59:13.795087: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-11 19:59:13.795123: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-11 19:59:13.795737: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. pprof doesn't support -select=device 2022-12-11 19:59:16.052462: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-11 19:59:16.052540: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-11 19:59:16.055702: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-11 19:59:16.055739: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-11 19:59:16.056347: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. pprof doesn't support -select=input_shapes INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testPprof): 20.54s I1211 19:59:17.295704 281473359432800 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testPprof): 20.54s [ OK ] PrintModelAnalysisTest.testPprof [ RUN ] PrintModelAnalysisTest.testSelectEverything 2022-12-11 19:59:17.380310: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-11 19:59:17.380350: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-11 19:59:17.380571: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-11 19:59:17.380607: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-11 19:59:17.380647: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testSelectEverything): 0.1s I1211 19:59:17.394619 281473359432800 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testSelectEverything): 0.1s [ OK ] PrintModelAnalysisTest.testSelectEverything [ RUN ] PrintModelAnalysisTest.testSelectEverythingDetail INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testSelectEverythingDetail): 0.0s I1211 19:59:17.395530 281473359432800 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testSelectEverythingDetail): 0.0s [ SKIPPED ] PrintModelAnalysisTest.testSelectEverythingDetail [ RUN ] PrintModelAnalysisTest.testSelectOption 2022-12-11 19:59:17.486310: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-11 19:59:17.486346: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-11 19:59:17.486549: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-11 19:59:17.486580: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-11 19:59:17.486616: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testSelectOption): 0.13s I1211 19:59:17.522653 281473359432800 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testSelectOption): 0.13s [ OK ] PrintModelAnalysisTest.testSelectOption [ RUN ] PrintModelAnalysisTest.testSimpleCodeView 2022-12-11 19:59:17.602222: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-11 19:59:17.602258: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-11 19:59:17.602457: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-11 19:59:17.602482: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-11 19:59:17.602513: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down. INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testSimpleCodeView): 0.2s I1211 19:59:17.725699 281473359432800 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testSimpleCodeView): 0.2s [ OK ] PrintModelAnalysisTest.testSimpleCodeView [ RUN ] PrintModelAnalysisTest.testTimeline 2022-12-11 19:59:18.720218: I tensorflow/tsl/profiler/lib/profiler_session.cc:104] Profiler session initializing. 2022-12-11 19:59:18.720258: I tensorflow/tsl/profiler/lib/profiler_session.cc:119] Profiler session started. 2022-12-11 19:59:18.723365: I tensorflow/tsl/profiler/lib/profiler_session.cc:70] Profiler session collecting data. 2022-12-11 19:59:18.723395: W tensorflow/core/profiler/convert/xplane_to_step_stats.cc:75] GPU trace was not collected. 2022-12-11 19:59:18.723987: I tensorflow/tsl/profiler/lib/profiler_session.cc:131] Profiler session tear down.
Run pprof -png --nodecount=100 --sample_index=1 </root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d8wny5gj8c/micros_pprof.pb.gz>
Run pprof -png --nodecount=100 --sample_index=1 </root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d8wny5gj8c/bytes_pprof.pb.gz>
Run pprof -png --nodecount=100 --sample_index=1 </root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d8wny5gj8c/accelerator_micros_pprof.pb.gz>
Run pprof -png --nodecount=100 --sample_index=1 </root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d8wny5gj8c/cpu_micros_pprof.pb.gz>
Run pprof -png --nodecount=100 --sample_index=1 </root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d8wny5gj8c/params_pprof.pb.gz>
Run pprof -png --nodecount=100 --sample_index=1 </root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d8wny5gj8c/float_ops_pprof.pb.gz> generating trace file.
****************************************************** Timeline file is written to /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/_tmp/dcf093cbc7470acfb208aeb32aa5e8d8wny5gj8c/timeline_0. Open a Chrome browser, enter URL chrome://tracing and load the timeline file. ****************************************************** INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testTimeline): 1.28s I1211 19:59:19.009835 281473359432800 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testTimeline): 1.28s [ OK ] PrintModelAnalysisTest.testTimeline [ RUN ] PrintModelAnalysisTest.testTraceLoopBytes INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testTraceLoopBytes): 0.0s I1211 19:59:19.010908 281473359432800 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testTraceLoopBytes): 0.0s [ SKIPPED ] PrintModelAnalysisTest.testTraceLoopBytes [ RUN ] PrintModelAnalysisTest.testTrackPersistentBytes INFO:tensorflow:time(__main__.PrintModelAnalysisTest.testTrackPersistentBytes): 0.0s I1211 19:59:19.011501 281473359432800 test_util.py:2457] time(__main__.PrintModelAnalysisTest.testTrackPersistentBytes): 0.0s [ SKIPPED ] PrintModelAnalysisTest.testTrackPersistentBytes [ RUN ] PrintModelAnalysisTest.test_session [ SKIPPED ] PrintModelAnalysisTest.test_session ---------------------------------------------------------------------- Ran 18 tests in 26.937s
OK (skipped=8) ================================================================================ ==================== Test output for //tensorflow/python/eager/benchmarks/resnet50:resnet50_graph_test_cpu (shard 4 of 4): 2022-12-11 19:59:20.199474: E tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Cannot register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay Running tests under Python 3.8.15: /tmp/workspace/venv-cp38-cp38/bin/python3 ---------------------------------------------------------------------- Ran 0 tests in 0.000s
OK ================================================================================ ==================== Test output for //tensorflow/python/eager/benchmarks/resnet50:resnet50_graph_test_cpu (shard 3 of 4): 2022-12-11 19:59:30.333585: E tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Cannot register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay Running tests under Python 3.8.15: /tmp/workspace/venv-cp38-cp38/bin/python3 ---------------------------------------------------------------------- Ran 0 tests in 0.000s
OK ================================================================================ ==================== Test output for //tensorflow/python/eager/benchmarks/resnet50:resnet50_graph_test_cpu (shard 1 of 4): 2022-12-11 19:59:34.568880: E tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Cannot register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay Running tests under Python 3.8.15: /tmp/workspace/venv-cp38-cp38/bin/python3 [ RUN ] ResNet50GraphTest.testApply WARNING:tensorflow:From /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/eager/benchmarks/resnet50/resnet50_graph_test_cpu.runfiles/org_tensorflow/tensorflow/python/eager/benchmarks/resnet50/resnet50_graph_test.py:26: is_gpu_available (from tensorflow.python.framework.test_util) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.config.list_physical_devices('GPU')` instead. W1211 19:59:37.810560 281473502432352 deprecation.py:364] From /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/eager/benchmarks/resnet50/resnet50_graph_test_cpu.runfiles/org_tensorflow/tensorflow/python/eager/benchmarks/resnet50/resnet50_graph_test.py:26: is_gpu_available (from tensorflow.python.framework.test_util) is deprecated and will be removed in a future version. Instructions for updating: Use `tf.config.list_physical_devices('GPU')` instead. 2022-12-11 19:59:42.123661: I tensorflow/compiler/mlir/mlir_graph_optimization_pass.cc:357] MLIR V1 optimization pass is not enabled INFO:tensorflow:time(__main__.ResNet50GraphTest.testApply): 6.65s I1211 19:59:44.458314 281473502432352 test_util.py:2457] time(__main__.ResNet50GraphTest.testApply): 6.65s [ OK ] ResNet50GraphTest.testApply ---------------------------------------------------------------------- Ran 1 test in 6.650s
OK ================================================================================ ==================== Test output for //tensorflow/python/eager/benchmarks/resnet50:resnet50_graph_test_cpu (shard 2 of 4): 2022-12-11 19:59:45.519576: E tensorflow/tsl/lib/monitoring/collection_registry.cc:81] Cannot register 2 metrics with the same name: /tensorflow/core/bfc_allocator_delay Running tests under Python 3.8.15: /tmp/workspace/venv-cp38-cp38/bin/python3 [ RUN ] ResNet50GraphTest.test_session [ SKIPPED ] ResNet50GraphTest.test_session ---------------------------------------------------------------------- Ran 1 test in 0.001s
OK (skipped=1) ================================================================================ ==================== Test output for //tensorflow/python/debug/lib:source_remote_test: Traceback (most recent call last): File "/root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/debug/lib/source_remote_test.runfiles/org_tensorflow/tensorflow/python/debug/lib/source_remote_test.py", line 20, in <module> import grpc File "/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/__init__.py", line 22, in <module> from grpc import _compression File "/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/_compression.py", line 20, in <module> from grpc._cython import cygrpc ImportError: /tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/_cython/cygrpc.cpython-38-aarch64-linux-gnu.so: undefined symbol: _ZTVNSt7__cxx1119basic_ostringstreamIcSt11char_traitsIcESaIcEEE ================================================================================ ==================== Test output for //tensorflow/python/debug/lib:source_remote_test: Traceback (most recent call last): File "/root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/debug/lib/source_remote_test.runfiles/org_tensorflow/tensorflow/python/debug/lib/source_remote_test.py", line 20, in <module> import grpc File "/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/__init__.py", line 22, in <module> from grpc import _compression File "/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/_compression.py", line 20, in <module> from grpc._cython import cygrpc ImportError: /tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/_cython/cygrpc.cpython-38-aarch64-linux-gnu.so: undefined symbol: _ZTVNSt7__cxx1119basic_ostringstreamIcSt11char_traitsIcESaIcEEE ================================================================================ ==================== Test output for //tensorflow/python/debug/lib:source_remote_test: Traceback (most recent call last): File "/root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/bin/tensorflow/python/debug/lib/source_remote_test.runfiles/org_tensorflow/tensorflow/python/debug/lib/source_remote_test.py", line 20, in <module> import grpc File "/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/__init__.py", line 22, in <module> from grpc import _compression File "/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/_compression.py", line 20, in <module> from grpc._cython import cygrpc ImportError: /tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages/grpc/_cython/cygrpc.cpython-38-aarch64-linux-gnu.so: undefined symbol: _ZTVNSt7__cxx1119basic_ostringstreamIcSt11char_traitsIcESaIcEEE ================================================================================ //tensorflow/python/profiler:model_analyzer_test_cpu PASSED in 34.6s //tensorflow/python/training:localhost_cluster_performance_test_cpu PASSED in 5.4s //tensorflow/python/training:sync_replicas_optimizer_test PASSED in 7.3s //tensorflow/python/debug/lib:source_remote_test FAILED in 3 out of 3 in 0.2s Stats over 3 runs: max = 0.2s, min = 0.2s, avg = 0.2s, dev = 0.0s /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/debug/lib/source_remote_test/test.log /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/debug/lib/source_remote_test/test_attempts/attempt_1.log /root/.cache/bazel/_bazel_root/db210f68f81d95ddcca9ae96b16ed72c/execroot/org_tensorflow/bazel-out/aarch64-opt/testlogs/tensorflow/python/debug/lib/source_remote_test/test_attempts/attempt_2.log //tensorflow/python/eager/benchmarks/resnet50:resnet50_graph_test_cpu PASSED in 10.9s Stats over 4 runs: max = 10.9s, min = 4.2s, avg = 7.4s, dev = 3.2s
Executed 5 out of 5 tests: 4 tests pass and 1 fails locally. There were tests whose specified size is too big. Use the --test_verbose_timeout_warnings command line option to see which ones these are. stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=56 changed=33 unreachable=0 failed=1 skipped=18 rescued=0 ignored=0
Sunday 11 December 2022 19:59:50 +0000 (0:01:25.260) 1:49:16.856 ******* =============================================================================== tensorflow : Run unit tests on TensorFlow git for cp38-cp38 ---------- 3785.08s tensorflow : build TensorFlow git for cp38-cp38 ---------------------- 2181.99s python : build wheels of Python package h5py~=3.6.0 ------------------- 255.41s tensorflow : Run oss_serial unit tests on TensorFlow git for cp38-cp38 -- 85.26s install bazel build requirements --------------------------------------- 47.48s tensorflow : populate cp38-cp38 virtualenv ----------------------------- 43.35s python : install numpy build requirements ------------------------------ 27.75s fetch tensorflow from git ---------------------------------------------- 22.92s python : install scipy-1.7.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl Python package -- 14.31s python : create cp38-cp38 virtualenv ----------------------------------- 13.07s python : install h5py build requirements ------------------------------- 12.91s python : build wheels of Python package scipy --------------------------- 8.34s install tensorflow build requirements ----------------------------------- 7.70s python : build wheels of Python package numpy>=1.20 --------------------- 6.31s python : build wheels of Python package grpcio -------------------------- 6.20s Gathering Facts --------------------------------------------------------- 4.63s tensorflow : Extract number of tests run -------------------------------- 3.91s python : build wheels of Python package Keras_Preprocessing ------------- 3.67s python : enable EPEL ---------------------------------------------------- 3.14s python : install h5py-3.6.0-cp38-cp38-linux_aarch64.whl Python package --- 2.49s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/599/display/redirect
Changes:
------------------------------------------ [...truncated 36.41 KB...]
TASK [build and install wheels of binary Python packages for TensorFlow 1.15] *** Monday 12 December 2022 18:19:12 +0000 (0:00:15.346) 0:08:40.222 ******* skipping: [localhost] => (item=Keras_Applications)
TASK [tensorflow : Reset checkout to clean state] ****************************** Monday 12 December 2022 18:19:12 +0000 (0:00:00.042) 0:08:40.265 ******* changed: [localhost]
TASK [tensorflow : remove TensorFlow git sources from previous build] ********** Monday 12 December 2022 18:19:13 +0000 (0:00:00.846) 0:08:41.112 ******* skipping: [localhost]
TASK [fetch tensorflow git source] ********************************************* Monday 12 December 2022 18:19:13 +0000 (0:00:00.042) 0:08:41.154 ******* skipping: [localhost]
TASK [unpack tensorflow git source] ******************************************** Monday 12 December 2022 18:19:13 +0000 (0:00:00.042) 0:08:41.196 ******* skipping: [localhost]
TASK [tensorflow : Rename source dir for oneDNN build] ************************* Monday 12 December 2022 18:19:13 +0000 (0:00:00.036) 0:08:41.233 ******* skipping: [localhost]
TASK [fetch tensorflow from git] *********************************************** Monday 12 December 2022 18:19:13 +0000 (0:00:00.042) 0:08:41.276 ******* skipping: [localhost]
TASK [tensorflow : Get oneline version of git log for this checkout] *********** Monday 12 December 2022 18:19:13 +0000 (0:00:00.037) 0:08:41.313 ******* skipping: [localhost]
TASK [tensorflow : Show git log] *********************************************** Monday 12 December 2022 18:19:13 +0000 (0:00:00.036) 0:08:41.350 ******* skipping: [localhost]
TASK [tensorflow : Record git commit hash to variable] ************************* Monday 12 December 2022 18:19:13 +0000 (0:00:00.039) 0:08:41.389 ******* skipping: [localhost]
TASK [tensorflow : Save git commit hash to file] ******************************* Monday 12 December 2022 18:19:13 +0000 (0:00:00.036) 0:08:41.426 ******* skipping: [localhost]
TASK [tensorflow : Create linklibs shell script] ******************************* Monday 12 December 2022 18:19:13 +0000 (0:00:00.036) 0:08:41.463 ******* changed: [localhost]
TASK [tensorflow : create readme file about unit tests] ************************ Monday 12 December 2022 18:19:14 +0000 (0:00:00.456) 0:08:41.920 ******* changed: [localhost]
TASK [tensorflow : add to the copied files] ************************************ Monday 12 December 2022 18:19:14 +0000 (0:00:00.468) 0:08:42.389 ******* changed: [localhost]
TASK [tensorflow : add to the long_description in setup.py] ******************** Monday 12 December 2022 18:19:15 +0000 (0:00:00.472) 0:08:42.861 ******* changed: [localhost]
TASK [tensorflow : use nightly package requirements] *************************** Monday 12 December 2022 18:19:15 +0000 (0:00:00.465) 0:08:43.327 ******* changed: [localhost]
TASK [tensorflow : Get python site-packages location] ************************** Monday 12 December 2022 18:19:15 +0000 (0:00:00.261) 0:08:43.588 ******* changed: [localhost]
TASK [tensorflow : Configure default TensorFlow settings] ********************** Monday 12 December 2022 18:19:16 +0000 (0:00:00.624) 0:08:44.213 ******* changed: [localhost]
TASK [tensorflow : Set Python bin path] **************************************** Monday 12 December 2022 18:19:16 +0000 (0:00:00.480) 0:08:44.693 ******* changed: [localhost]
TASK [tensorflow : build TensorFlow git for cp38-cp38] ************************* Monday 12 December 2022 18:19:17 +0000 (0:00:00.483) 0:08:45.176 ******* fatal: [localhost]: FAILED! => changed=true cmd: |- set -xe; source /tmp/workspace/venv-cp38-cp38/bin/activate; source ./linklibs.sh; bazel clean --expunge; bazel build --config=nonccl --copt="-mtune=generic" --copt="-march=armv8-a" --copt="-O3" \ //tensorflow/tools/pip_package:build_pip_package --verbose_failures; mkdir tensorflow-pkg; bazel-bin/tensorflow/tools/pip_package/build_pip_package --cpu --project_name tensorflow_aarch64 ./tensorflow-pkg delta: '0:33:42.794576' end: '2022-12-12 18:53:00.354157' msg: non-zero return code rc: 1 start: '2022-12-12 18:19:17.559581' stderr: |- + source /tmp/workspace/venv-cp38-cp38/bin/activate ++ deactivate nondestructive ++ '[' -n '' ']' ++ '[' -n '' ']' ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r ++ '[' -n '' ']' ++ unset VIRTUAL_ENV ++ '[' '!' nondestructive = nondestructive ']' ++ VIRTUAL_ENV=/tmp/workspace/venv-cp38-cp38 ++ export VIRTUAL_ENV ++ _OLD_VIRTUAL_PATH=/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ++ PATH=/tmp/workspace/venv-cp38-cp38/bin:/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ++ export PATH ++ '[' -n '' ']' ++ '[' -z '' ']' ++ _OLD_VIRTUAL_PS1= ++ '[' 'x(venv-cp38-cp38) ' '!=' x ']' ++ PS1='(venv-cp38-cp38) ' ++ export PS1 ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r + source ./linklibs.sh + bazel clean --expunge 2022/12/12 18:19:17 Downloading https://releases.bazel.build/5.3.0/release/bazel-5.3.0-linux-arm64... Extracting Bazel installation... Starting local Bazel server and connecting to it... INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.tf_configure.bazelrc: Inherited 'build' options: --action_env PYTHON_BIN_PATH=/tmp/workspace/venv-cp38-cp38/bin/python3 --action_env PYTHON_LIB_PATH=/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages --python_path=/tmp/workspace/venv-cp38-cp38/bin/python3 INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'build' options: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/common,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Found applicable config definition build:short_logs in file /tmp/workspace/tensorflow-git/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tmp/workspace/tensorflow-git/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:linux in file /tmp/workspace/tensorflow-git/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tmp/workspace/tensorflow-git/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS INFO: Starting clean (this may take a while). Consider using --async if the clean takes more than several minutes. + bazel build --config=nonccl --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3 //tensorflow/tools/pip_package:build_pip_package --verbose_failures Starting local Bazel server and connecting to it... INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.bazelrc: 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.tf_configure.bazelrc: 'build' options: --action_env PYTHON_BIN_PATH=/tmp/workspace/venv-cp38-cp38/bin/python3 --action_env PYTHON_LIB_PATH=/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages --python_path=/tmp/workspace/venv-cp38-cp38/bin/python3 INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.bazelrc: 'build' options: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/common,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Found applicable config definition build:short_logs in file /tmp/workspace/tensorflow-git/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tmp/workspace/tensorflow-git/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:nonccl in file /tmp/workspace/tensorflow-git/.bazelrc: --define=no_nccl_support=true INFO: Found applicable config definition build:linux in file /tmp/workspace/tensorflow-git/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tmp/workspace/tensorflow-git/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/tensorflow/r... failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-pr... failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/protocolbuff... failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded currently loading: tensorflow/tools/pip_package Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured) WARNING: Download from https://mirror.bazel.build/github.com/bazelbuild/rules_cc/archive/081771d4a0... failed: class java.io.FileNotFoundException GET returned 404 Not Found WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/google/snapp... failed: class java.io.FileNotFoundException GET returned 404 Not Found WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/pybind/pybin... failed: class java.io.FileNotFoundException GET returned 404 Not Found WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/google/ruy/a... failed: class java.io.FileNotFoundException GET returned 404 Not Found WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/openxla/stab... failed: class java.io.FileNotFoundException GET returned 404 Not Found Analyzing: target //tensorflow/tools/pip_package:build_pip_package (284 packages loaded, 4162 targets configured) WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/google/XNNPA... failed: class java.io.FileNotFoundException GET returned 404 Not Found Analyzing: target //tensorflow/tools/pip_package:build_pip_package (286 packages loaded, 4162 targets configured) Analyzing: target //tensorflow/tools/pip_package:build_pip_package (287 packages loaded, 4162 targets configured) INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (570 packages loaded, 31279 targets configured). INFO: Found 1 target... [0 / 233] [Prepa] Creating source manifest for //tensorflow/python/debug/lib:grpc_tensorflow_server ... (26 actions, 0 running) [972 / 5,438] Compiling re2/dfa.cc; 6s local ... (37 actions, 36 running) [1,328 / 9,039] Compiling mlir/tools/mlir-tblgen/OpDefinitionsGen.cpp; 15s local ... (56 actions, 55 running) [2,431 / 9,893] Compiling llvm/utils/TableGen/AsmMatcherEmitter.cpp; 16s local ... (56 actions, 55 running) [3,304 / 10,703] Compiling llvm/utils/TableGen/GlobalISelEmitter.cpp; 36s local ... (56 actions, 55 running) [3,696 / 10,762] Compiling tensorflow/core/ir/ops.cc; 33s local ... (56 actions, 55 running) [4,030 / 10,762] Compiling mlir/lib/Dialect/SPIRV/IR/SPIRVDialect.cpp; 53s local ... (56 actions, 55 running) [4,489 / 10,765] Compiling mlir/lib/Dialect/SPIRV/IR/SPIRVDialect.cpp; 85s local ... (56 actions, 55 running) [5,346 / 12,408] Compiling stablehlo/dialect/StablehloOps.cpp; 108s local ... (56 actions, 55 running) [6,636 / 12,470] Compiling tensorflow/compiler/xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 137s local ... (56 actions, 55 running) [7,689 / 13,350] Compiling tensorflow/compiler/xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 185s local ... (56 actions, 55 running) [8,055 / 13,350] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 236s local ... (56 actions, 55 running) [8,376 / 13,350] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 300s local ... (56 actions, 55 running) [8,786 / 13,350] Compiling mlir/lib/Conversion/SPIRVToLLVM/SPIRVToLLVM.cpp; 36s local ... (56 actions, 55 running) [9,174 / 13,350] Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 111s local ... (56 actions, 55 running) [9,925 / 13,364] Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 122s local ... (56 actions, 55 running) [10,356 / 13,364] Compiling tensorflow/compiler/xla/hlo/evaluator/hlo_evaluator.cc; 48s local ... (56 actions, 55 running) [10,910 / 13,364] Compiling tensorflow/core/kernels/list_kernels.cc; 88s local ... (56 actions, 55 running) [11,454 / 13,364] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops_n_z.cc; 167s local ... (56 actions, 55 running) [11,708 / 13,364] Compiling tensorflow/core/kernels/argmax_op.cc; 209s local ... (56 actions, 55 running) [12,082 / 13,364] Compiling tensorflow/core/kernels/matmul_op_real.cc; 396s local ... (56 actions, 55 running) [12,520 / 13,364] Compiling tensorflow/core/kernels/conv_ops.cc; 411s local ... (56 actions, 55 running) [13,447 / 13,449] [Prepa] Executing genrule //tensorflow:tf_python_api_gen_v2 ERROR: /tmp/workspace/tensorflow-git/tensorflow/tools/pip_package/BUILD:278:10: Middleman _middlemen/tensorflow_Stools_Spip_Upackage_Sbuild_Upip_Upackage-runfiles failed: missing input file 'external/pybind11_abseil/pybind11_abseil/LICENSE', owner: '@pybind11_abseil//pybind11_abseil:LICENSE' ERROR: /tmp/workspace/tensorflow-git/tensorflow/tools/pip_package/BUILD:278:10: Middleman _middlemen/tensorflow_Stools_Spip_Upackage_Sbuild_Upip_Upackage-runfiles failed: 1 input file(s) do not exist Target //tensorflow/tools/pip_package:build_pip_package failed to build ERROR: /tmp/workspace/tensorflow-git/tensorflow/tools/pip_package/BUILD:278:10 Middleman _middlemen/tensorflow_Stools_Spip_Upackage_Sbuild_Upip_Upackage-runfiles failed: 1 input file(s) do not exist INFO: Elapsed time: 2000.923s, Critical Path: 566.39s INFO: 13449 processes: 1685 internal, 11764 local. FAILED: Build did NOT complete successfully FAILED: Build did NOT complete successfully stderr_lines: <omitted> stdout: '' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=50 changed=30 unreachable=0 failed=1 skipped=18 rescued=0 ignored=0
Monday 12 December 2022 18:53:00 +0000 (0:33:43.097) 0:42:28.274 ******* =============================================================================== tensorflow : build TensorFlow git for cp38-cp38 ---------------------- 2023.10s python : build wheels of Python package h5py~=3.6.0 ------------------- 255.76s install bazel build requirements --------------------------------------- 51.53s tensorflow : populate cp38-cp38 virtualenv ----------------------------- 44.96s python : install numpy build requirements ------------------------------ 32.97s fetch tensorflow from git ---------------------------------------------- 23.88s python : install h5py build requirements ------------------------------- 21.57s python : install scipy-1.7.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl Python package -- 15.35s python : create cp38-cp38 virtualenv ----------------------------------- 14.67s python : build wheels of Python package scipy -------------------------- 10.12s install tensorflow build requirements ----------------------------------- 7.64s python : build wheels of Python package numpy>=1.20 --------------------- 6.45s python : build wheels of Python package Keras_Preprocessing ------------- 4.67s Gathering Facts --------------------------------------------------------- 4.62s python : build wheels of Python package grpcio -------------------------- 4.55s python : enable EPEL ---------------------------------------------------- 3.11s python : install h5py-3.6.0-cp38-cp38-linux_aarch64.whl Python package --- 2.50s bazel : fetch Bazelisk v1.12.0 binary from Github ----------------------- 2.35s python : install Keras_Preprocessing-1.1.2-py2.py3-none-any.whl Python package --- 2.13s python : install numpy-1.23.5-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl Python package --- 2.03s Build step 'Execute shell' marked build as failure
See https://ci.linaro.org/job/ldcg-python-manylinux-tensorflow-nightly/600/display/redirect
Changes:
------------------------------------------ [...truncated 37.26 KB...] Monday 12 December 2022 20:15:35 +0000 (0:00:00.052) 0:08:14.197 ******* changed: [localhost]
TASK [build and install wheels of binary Python packages for TensorFlow 1.15] *** Monday 12 December 2022 20:15:50 +0000 (0:00:14.352) 0:08:28.550 ******* skipping: [localhost] => (item=Keras_Applications)
TASK [tensorflow : Reset checkout to clean state] ****************************** Monday 12 December 2022 20:15:50 +0000 (0:00:00.045) 0:08:28.595 ******* changed: [localhost]
TASK [tensorflow : remove TensorFlow git sources from previous build] ********** Monday 12 December 2022 20:15:50 +0000 (0:00:00.847) 0:08:29.442 ******* skipping: [localhost]
TASK [fetch tensorflow git source] ********************************************* Monday 12 December 2022 20:15:50 +0000 (0:00:00.044) 0:08:29.487 ******* skipping: [localhost]
TASK [unpack tensorflow git source] ******************************************** Monday 12 December 2022 20:15:51 +0000 (0:00:00.043) 0:08:29.530 ******* skipping: [localhost]
TASK [tensorflow : Rename source dir for oneDNN build] ************************* Monday 12 December 2022 20:15:51 +0000 (0:00:00.038) 0:08:29.569 ******* skipping: [localhost]
TASK [fetch tensorflow from git] *********************************************** Monday 12 December 2022 20:15:51 +0000 (0:00:00.042) 0:08:29.612 ******* skipping: [localhost]
TASK [tensorflow : Get oneline version of git log for this checkout] *********** Monday 12 December 2022 20:15:51 +0000 (0:00:00.038) 0:08:29.650 ******* skipping: [localhost]
TASK [tensorflow : Show git log] *********************************************** Monday 12 December 2022 20:15:51 +0000 (0:00:00.039) 0:08:29.689 ******* skipping: [localhost]
TASK [tensorflow : Record git commit hash to variable] ************************* Monday 12 December 2022 20:15:51 +0000 (0:00:00.038) 0:08:29.728 ******* skipping: [localhost]
TASK [tensorflow : Save git commit hash to file] ******************************* Monday 12 December 2022 20:15:51 +0000 (0:00:00.037) 0:08:29.766 ******* skipping: [localhost]
TASK [tensorflow : Create linklibs shell script] ******************************* Monday 12 December 2022 20:15:51 +0000 (0:00:00.039) 0:08:29.805 ******* changed: [localhost]
TASK [tensorflow : create readme file about unit tests] ************************ Monday 12 December 2022 20:15:51 +0000 (0:00:00.457) 0:08:30.262 ******* changed: [localhost]
TASK [tensorflow : add to the copied files] ************************************ Monday 12 December 2022 20:15:52 +0000 (0:00:00.469) 0:08:30.731 ******* changed: [localhost]
TASK [tensorflow : add to the long_description in setup.py] ******************** Monday 12 December 2022 20:15:52 +0000 (0:00:00.472) 0:08:31.204 ******* changed: [localhost]
TASK [tensorflow : use nightly package requirements] *************************** Monday 12 December 2022 20:15:53 +0000 (0:00:00.465) 0:08:31.670 ******* changed: [localhost]
TASK [tensorflow : Get python site-packages location] ************************** Monday 12 December 2022 20:15:53 +0000 (0:00:00.263) 0:08:31.933 ******* changed: [localhost]
TASK [tensorflow : Configure default TensorFlow settings] ********************** Monday 12 December 2022 20:15:54 +0000 (0:00:00.625) 0:08:32.558 ******* changed: [localhost]
TASK [tensorflow : Set Python bin path] **************************************** Monday 12 December 2022 20:15:54 +0000 (0:00:00.473) 0:08:33.032 ******* changed: [localhost]
TASK [tensorflow : build TensorFlow git for cp38-cp38] ************************* Monday 12 December 2022 20:15:55 +0000 (0:00:00.477) 0:08:33.510 ******* fatal: [localhost]: FAILED! => changed=true cmd: |- set -xe; source /tmp/workspace/venv-cp38-cp38/bin/activate; source ./linklibs.sh; bazel clean --expunge; bazel build --config=nonccl --copt="-mtune=generic" --copt="-march=armv8-a" --copt="-O3" \ //tensorflow/tools/pip_package:build_pip_package --verbose_failures; mkdir tensorflow-pkg; bazel-bin/tensorflow/tools/pip_package/build_pip_package --cpu --project_name tensorflow_aarch64 ./tensorflow-pkg delta: '0:33:56.707278' end: '2022-12-12 20:49:51.941956' msg: non-zero return code rc: 1 start: '2022-12-12 20:15:55.234678' stderr: |- + source /tmp/workspace/venv-cp38-cp38/bin/activate ++ deactivate nondestructive ++ '[' -n '' ']' ++ '[' -n '' ']' ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r ++ '[' -n '' ']' ++ unset VIRTUAL_ENV ++ '[' '!' nondestructive = nondestructive ']' ++ VIRTUAL_ENV=/tmp/workspace/venv-cp38-cp38 ++ export VIRTUAL_ENV ++ _OLD_VIRTUAL_PATH=/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ++ PATH=/tmp/workspace/venv-cp38-cp38/bin:/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ++ export PATH ++ '[' -n '' ']' ++ '[' -z '' ']' ++ _OLD_VIRTUAL_PS1= ++ '[' 'x(venv-cp38-cp38) ' '!=' x ']' ++ PS1='(venv-cp38-cp38) ' ++ export PS1 ++ '[' -n /bin/bash -o -n '' ']' ++ hash -r + source ./linklibs.sh + bazel clean --expunge 2022/12/12 20:15:55 Downloading https://releases.bazel.build/5.3.0/release/bazel-5.3.0-linux-arm64... Extracting Bazel installation... Starting local Bazel server and connecting to it... INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.tf_configure.bazelrc: Inherited 'build' options: --action_env PYTHON_BIN_PATH=/tmp/workspace/venv-cp38-cp38/bin/python3 --action_env PYTHON_LIB_PATH=/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages --python_path=/tmp/workspace/venv-cp38-cp38/bin/python3 INFO: Reading rc options for 'clean' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'build' options: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/common,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Found applicable config definition build:short_logs in file /tmp/workspace/tensorflow-git/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tmp/workspace/tensorflow-git/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:linux in file /tmp/workspace/tensorflow-git/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tmp/workspace/tensorflow-git/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS INFO: Starting clean (this may take a while). Consider using --async if the clean takes more than several minutes. + bazel build --config=nonccl --copt=-mtune=generic --copt=-march=armv8-a --copt=-O3 //tensorflow/tools/pip_package:build_pip_package --verbose_failures Starting local Bazel server and connecting to it... INFO: Options provided by the client: Inherited 'common' options: --isatty=0 --terminal_columns=80 INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.bazelrc: Inherited 'common' options: --experimental_repo_remote_exec INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.bazelrc: 'build' options: --define framework_shared_object=true --define tsl_protobuf_header_only=true --define=use_fast_cpp_protos=true --define=allow_oversize_protos=true --spawn_strategy=standalone -c opt --announce_rc --define=grpc_no_ares=true --noincompatible_remove_legacy_whole_archive --enable_platform_specific_config --define=with_xla_support=true --config=short_logs --config=v2 --define=no_aws_support=true --define=no_hdfs_support=true --experimental_cc_shared_library --experimental_link_static_libraries_once=false INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.tf_configure.bazelrc: 'build' options: --action_env PYTHON_BIN_PATH=/tmp/workspace/venv-cp38-cp38/bin/python3 --action_env PYTHON_LIB_PATH=/tmp/workspace/venv-cp38-cp38/lib/python3.8/site-packages --python_path=/tmp/workspace/venv-cp38-cp38/bin/python3 INFO: Reading rc options for 'build' from /tmp/workspace/tensorflow-git/.bazelrc: 'build' options: --deleted_packages=tensorflow/compiler/mlir/tfrt,tensorflow/compiler/mlir/tfrt/benchmarks,tensorflow/compiler/mlir/tfrt/jit/python_binding,tensorflow/compiler/mlir/tfrt/jit/transforms,tensorflow/compiler/mlir/tfrt/python_tests,tensorflow/compiler/mlir/tfrt/tests,tensorflow/compiler/mlir/tfrt/tests/ir,tensorflow/compiler/mlir/tfrt/tests/analysis,tensorflow/compiler/mlir/tfrt/tests/jit,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_tfrt,tensorflow/compiler/mlir/tfrt/tests/lhlo_to_jitrt,tensorflow/compiler/mlir/tfrt/tests/tf_to_corert,tensorflow/compiler/mlir/tfrt/tests/tf_to_tfrt_data,tensorflow/compiler/mlir/tfrt/tests/saved_model,tensorflow/compiler/mlir/tfrt/transforms/lhlo_gpu_to_tfrt_gpu,tensorflow/core/runtime_fallback,tensorflow/core/runtime_fallback/conversion,tensorflow/core/runtime_fallback/kernel,tensorflow/core/runtime_fallback/opdefs,tensorflow/core/runtime_fallback/runtime,tensorflow/core/runtime_fallback/util,tensorflow/core/tfrt/common,tensorflow/core/tfrt/eager,tensorflow/core/tfrt/eager/backends/cpu,tensorflow/core/tfrt/eager/backends/gpu,tensorflow/core/tfrt/eager/core_runtime,tensorflow/core/tfrt/eager/cpp_tests/core_runtime,tensorflow/core/tfrt/gpu,tensorflow/core/tfrt/run_handler_thread_pool,tensorflow/core/tfrt/runtime,tensorflow/core/tfrt/saved_model,tensorflow/core/tfrt/graph_executor,tensorflow/core/tfrt/saved_model/tests,tensorflow/core/tfrt/tpu,tensorflow/core/tfrt/utils INFO: Found applicable config definition build:short_logs in file /tmp/workspace/tensorflow-git/.bazelrc: --output_filter=DONT_MATCH_ANYTHING INFO: Found applicable config definition build:v2 in file /tmp/workspace/tensorflow-git/.bazelrc: --define=tf_api_version=2 --action_env=TF2_BEHAVIOR=1 INFO: Found applicable config definition build:nonccl in file /tmp/workspace/tensorflow-git/.bazelrc: --define=no_nccl_support=true INFO: Found applicable config definition build:linux in file /tmp/workspace/tensorflow-git/.bazelrc: --host_copt=-w --copt=-Wno-all --copt=-Wno-extra --copt=-Wno-deprecated --copt=-Wno-deprecated-declarations --copt=-Wno-ignored-attributes --copt=-Wno-array-bounds --copt=-Wunused-result --copt=-Werror=unused-result --copt=-Wswitch --copt=-Werror=switch --copt=-Wno-error=unused-but-set-variable --define=PREFIX=/usr --define=LIBDIR=$(PREFIX)/lib --define=INCLUDEDIR=$(PREFIX)/include --define=PROTOBUF_INCLUDE_PATH=$(PREFIX)/include --cxxopt=-std=c++17 --host_cxxopt=-std=c++17 --config=dynamic_kernels --distinct_host_configuration=false --experimental_guard_against_concurrent_changes INFO: Found applicable config definition build:dynamic_kernels in file /tmp/workspace/tensorflow-git/.bazelrc: --define=dynamic_loaded_kernels=true --copt=-DAUTOLOAD_DYNAMIC_KERNELS Loading: Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/tensorflow/r... failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/llvm/llvm-pr... failed: class java.io.FileNotFoundException GET returned 404 Not Found Loading: 0 packages loaded WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/protocolbuff... failed: class java.io.FileNotFoundException GET returned 404 Not Found Analyzing: target //tensorflow/tools/pip_package:build_pip_package (1 packages loaded, 0 targets configured) WARNING: Download from https://mirror.bazel.build/github.com/bazelbuild/rules_cc/archive/081771d4a0... failed: class java.io.FileNotFoundException GET returned 404 Not Found WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/pybind/pybin... failed: class java.io.FileNotFoundException GET returned 404 Not Found WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/google/ruy/a... failed: class java.io.FileNotFoundException GET returned 404 Not Found WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/google/snapp... failed: class java.io.FileNotFoundException GET returned 404 Not Found Analyzing: target //tensorflow/tools/pip_package:build_pip_package (283 packages loaded, 4162 targets configured) WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/openxla/stab... failed: class java.io.FileNotFoundException GET returned 404 Not Found WARNING: Download from https://storage.googleapis.com/mirror.tensorflow.org/github.com/google/XNNPA... failed: class java.io.FileNotFoundException GET returned 404 Not Found Analyzing: target //tensorflow/tools/pip_package:build_pip_package (285 packages loaded, 4162 targets configured) Analyzing: target //tensorflow/tools/pip_package:build_pip_package (568 packages loaded, 29586 targets configured) INFO: Analyzed target //tensorflow/tools/pip_package:build_pip_package (570 packages loaded, 31275 targets configured). INFO: Found 1 target... [0 / 244] [Prepa] BazelWorkspaceStatusAction stable-status.txt ... (21 actions, 0 running) [326 / 2,022] Compiling src/google/protobuf/text_format.cc; 8s local ... (51 actions, 50 running) [837 / 2,747] Compiling src/google/protobuf/descriptor.cc; 21s local ... (56 actions, 55 running) [1,991 / 10,880] Compiling src/google/protobuf/descriptor.cc; 20s local ... (56 actions, 55 running) [3,343 / 12,018] Compiling tensorflow/compiler/xla/service/cpu/runtime_single_threaded_matmul.cc; 21s local ... (56 actions, 55 running) [4,478 / 13,306] Compiling tensorflow/compiler/xla/service/cpu/runtime_single_threaded_matmul.cc; 44s local ... (55 actions, 54 running) [4,781 / 13,306] Compiling tensorflow/compiler/xla/service/cpu/runtime_single_threaded_matmul.cc; 70s local ... (56 actions, 55 running) [5,688 / 13,330] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 93s local ... (56 actions, 55 running) [5,943 / 13,330] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 128s local ... (56 actions, 55 running) [6,122 / 13,330] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 169s local ... (56 actions, 55 running) [6,354 / 13,330] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 215s local ... (56 actions, 55 running) [6,750 / 13,330] Compiling tensorflow/compiler/xla/service/cpu/runtime_matmul.cc; 268s local ... (56 actions, 55 running) [8,318 / 13,330] Compiling llvm/lib/Passes/PassBuilder.cpp; 64s local ... (56 actions, 55 running) [8,668 / 13,330] Compiling llvm/lib/Target/X86/X86ISelLowering.cpp; 117s local ... (56 actions, 55 running) [8,967 / 13,330] Compiling mlir/lib/Dialect/LLVMIR/IR/LLVMDialect.cpp; 163s local ... (56 actions, 55 running) [9,634 / 13,330] Compiling tensorflow/compiler/xla/mlir_hlo/mhlo/IR/hlo_ops.cc; 168s local ... (56 actions, 55 running) [10,226 / 13,330] Compiling tensorflow/compiler/xla/service/memory_space_assignment.cc; 44s local ... (56 actions, 55 running) [10,798 / 13,330] Compiling tensorflow/core/util/batch_util.cc; 60s local ... (56 actions, 55 running) [11,381 / 13,330] Compiling tensorflow/core/kernels/rnn/lstm_ops.cc; 67s local ... (56 actions, 55 running) [11,760 / 13,330] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops_n_z.cc; 183s local ... (56 actions, 55 running) [12,018 / 13,330] Compiling tensorflow/core/kernels/conv_grad_filter_ops.cc; 196s local ... (56 actions, 55 running) [12,420 / 13,330] Compiling tensorflow/core/kernels/conv_ops.cc; 408s local ... (56 actions, 55 running) [13,307 / 13,449] Compiling tensorflow/compiler/mlir/tensorflow/ir/tf_ops.cc; 204s local ... (56 actions, 55 running) ERROR: /tmp/workspace/tensorflow-git/tensorflow/tools/pip_package/BUILD:278:10: Middleman _middlemen/tensorflow_Stools_Spip_Upackage_Sbuild_Upip_Upackage-runfiles failed: missing input file 'external/pybind11_abseil/pybind11_abseil/LICENSE', owner: '@pybind11_abseil//pybind11_abseil:LICENSE' ERROR: /tmp/workspace/tensorflow-git/tensorflow/tools/pip_package/BUILD:278:10: Middleman _middlemen/tensorflow_Stools_Spip_Upackage_Sbuild_Upip_Upackage-runfiles failed: 1 input file(s) do not exist Target //tensorflow/tools/pip_package:build_pip_package failed to build ERROR: /tmp/workspace/tensorflow-git/tensorflow/tools/pip_package/BUILD:278:10 Middleman _middlemen/tensorflow_Stools_Spip_Upackage_Sbuild_Upip_Upackage-runfiles failed: 1 input file(s) do not exist INFO: Elapsed time: 2014.800s, Critical Path: 558.02s INFO: 13449 processes: 1685 internal, 11764 local. FAILED: Build did NOT complete successfully FAILED: Build did NOT complete successfully stderr_lines: <omitted> stdout: '' stdout_lines: <omitted>
PLAY RECAP ********************************************************************* localhost : ok=50 changed=30 unreachable=0 failed=1 skipped=18 rescued=0 ignored=0
Monday 12 December 2022 20:49:52 +0000 (0:33:57.014) 0:42:30.524 ******* =============================================================================== tensorflow : build TensorFlow git for cp38-cp38 ---------------------- 2037.01s python : build wheels of Python package h5py~=3.6.0 ------------------- 254.31s install bazel build requirements --------------------------------------- 52.35s tensorflow : populate cp38-cp38 virtualenv ----------------------------- 42.98s python : install numpy build requirements ------------------------------ 32.96s fetch tensorflow from git ---------------------------------------------- 23.95s python : install h5py build requirements ------------------------------- 18.25s python : create cp38-cp38 virtualenv ----------------------------------- 15.71s python : install scipy-1.7.3-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl Python package -- 14.35s python : build wheels of Python package scipy --------------------------- 8.38s install tensorflow build requirements ----------------------------------- 7.72s Gathering Facts --------------------------------------------------------- 4.61s python : build wheels of Python package numpy>=1.20 --------------------- 4.49s python : build wheels of Python package grpcio -------------------------- 4.21s python : build wheels of Python package Keras_Preprocessing ------------- 3.64s python : enable EPEL ---------------------------------------------------- 3.08s python : install h5py-3.6.0-cp38-cp38-linux_aarch64.whl Python package --- 2.49s python : install Keras_Preprocessing-1.1.2-py2.py3-none-any.whl Python package --- 2.12s python : install numpy-1.23.5-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl Python package --- 2.04s python : install grpcio-1.51.1-cp38-cp38-manylinux_2_17_aarch64.whl Python package --- 2.02s Build step 'Execute shell' marked build as failure
ldcg-ai-ml@op-lists.linaro.org