Merge branch 'master' into gaurides/fbnv2v3_fp32postops

CONTRIBUTING.md

@@ -30,43 +30,44 @@ Before sending your pull requests, make sure you do the following:
 
 **2. Valid?**
 
-- If the PR passes all the quality checks then we go ahead and assign a
-  reviewer.
-- If the PR didn't meet the validation criteria, we request for additional
-  changes to be made to PR to pass quality checks and send it back or on a rare
-  occassion we may reject it.
+-   If the PR passes all the quality checks then we go ahead and assign a
+    reviewer.
+-   If the PR didn't meet the validation criteria, we request for additional
+    changes to be made to PR to pass quality checks and send it back or on a
+    rare occasion we may reject it.
 
 **3. Review**
 
-- For Valid PR, reviewer (person familiar with the code/functionality) checks if
-  the PR looks good or needs additional changes.
-- If all looks good, reviewer would approve the PR.
-- If a change is needed, the contributor is requested to make suggested change.
-- You make the change and submit for the review again.
-- This cycle repeats itself till the PR gets approved.
-- Note: As a friendly reminder we may reach out to you if the PR is awaiting
-  your response for more than 2 weeks.
+-   For a valid PR, reviewer (person familiar with the code/functionality)
+    checks if the PR looks good or needs additional changes.
+-   If all looks good, the reviewer will approve the PR.
+-   If a change is needed, the contributor is requested to make the suggested
+    change.
+-   You make the change and submit it for the review again.
+-   This cycle repeats itself untill the PR gets approved.
+-   Note: As a friendly reminder, we may reach out to you if the PR is awaiting
+    your response for more than 2 weeks.
 
 **4. Approved**
 
-- Once the PR is approved, it gets `kokoro:force-run` label applied and it
-  initiates CI/CD tests.
-- We can't move forward if these tests fail.
-- In such situations, we may request you to make further changes to your PR for
-  the tests to pass.
-- Once the tests pass, we now bring all the code in the internal code base,
-  using a job called "copybara".
+-   Once the PR is approved, it gets `kokoro:force-run` label applied and it
+    initiates CI/CD tests.
+-   We can't move forward if these tests fail.
+-   In such situations, we may request you to make further changes to your PR
+    for the tests to pass.
+-   Once the tests pass, we now bring all the code into the internal code base,
+    using a job called "copybara".
 
 **5. Copy to Google Internal codebase and run internal CI**
 
-- Once the PR is in Google codebase, we make sure it integrates well with its
-  dependencies and the rest of the system.
-- Rarely, but If the tests fail at this stage, we cannot merge the code.
-- If needed, we may come to you to make some changes. At times, it may not be
-  you, it may be us who may have hit a snag. Please be patient while we work to
-  fix this.
-- Once the internal tests pass, we go ahead and merge the code internally as
-  well as externally on GitHub.
+-   Once the PR is in the Google codebase, we make sure it integrates well with
+    its dependencies and the rest of the system.
+-   Rarely, If the tests fail at this stage, we cannot merge the code.
+-   If needed, we may come to you to make some changes. At times, it may not be
+    you, it may be us who may have hit a snag. Please be patient while we work
+    to fix this.
+-   Once the internal tests pass, we go ahead and merge the code internally as
+    well as externally on GitHub.
 
 In a graphical form, the entire lifetime of a PR looks like
 
@@ -147,7 +148,7 @@ TensorFlow coding style.
 *   As every PR requires several CPU/GPU hours of CI testing, we discourage
     submitting PRs to fix one typo, one warning,etc. We recommend fixing the
     same issue at the file level at least (e.g.: fix all typos in a file, fix
-    all compiler warning in a file, etc.)
+    all compiler warnings in a file, etc.)
 *   Tests should follow the
     [testing best practices](https://www.tensorflow.org/community/contribute/tests)
     guide.
@@ -234,8 +235,8 @@ There are two ways to run TensorFlow unit tests.
     [Docker images](https://hub.docker.com/r/tensorflow/tensorflow/tags/), e.g.,
     `tensorflow/tensorflow:devel` and `tensorflow/tensorflow:devel-gpu` for
     development to avoid installing the packages directly on your system (in
-    which case remember to change directory from `/root` to `/tensorflow` once
-    you get into the running container so `bazel` can find the `tensorflow`
+    which case remember to change the directory from `/root` to `/tensorflow`
+    once you get into the running container so `bazel` can find the `tensorflow`
     workspace).
 
     Once you have the packages installed, you can run a specific unit test in
@@ -245,8 +246,8 @@ There are two ways to run TensorFlow unit tests.
     export flags="--config=opt -k"
     ```
 
-    If the tests are to be run on GPU, add CUDA paths to LD_LIBRARY_PATH and add
-    the `cuda` option flag
+    If the tests are to be run on the GPU, add CUDA paths to LD_LIBRARY_PATH and
+    add the `cuda` option flag
 
     ```bash
     export LD_LIBRARY_PATH="${LD_LIBRARY_PATH}:/usr/local/cuda/lib64:/usr/local/cuda/extras/CUPTI/lib64:$LD_LIBRARY_PATH"

RELEASE.md

@@ -1,3 +1,63 @@
+# Release 2.15.0
+
+## TensorFlow
+
+<INSERT SMALL BLURB ABOUT RELEASE FOCUS AREA AND POTENTIAL TOOLCHAIN CHANGES>
+
+### Breaking Changes
+
+* <DOCUMENT BREAKING CHANGES HERE>
+* <THIS SECTION SHOULD CONTAIN API, ABI AND BEHAVIORAL BREAKING CHANGES>
+
+### Known Caveats
+
+* <CAVEATS REGARDING THE RELEASE (BUT NOT BREAKING CHANGES).>
+* <ADDING/BUMPING DEPENDENCIES SHOULD GO HERE>
+* <KNOWN LACK OF SUPPORT ON SOME PLATFORM, SHOULD GO HERE>
+
+### Major Features and Improvements
+
+*   <INSERT MAJOR FEATURE HERE, USING MARKDOWN SYNTAX>
+*   <IF RELEASE CONTAINS MULTIPLE FEATURES FROM SAME AREA, GROUP THEM TOGETHER>
+
+### Bug Fixes and Other Changes
+
+* <SIMILAR TO ABOVE SECTION, BUT FOR OTHER IMPORTANT CHANGES / BUG FIXES>
+* <IF A CHANGE CLOSES A GITHUB ISSUE, IT SHOULD BE DOCUMENTED HERE>
+* <NOTES SHOULD BE GROUPED PER AREA>
+
+## Keras
+
+<INSERT SMALL BLURB ABOUT RELEASE FOCUS AREA AND POTENTIAL TOOLCHAIN CHANGES>
+
+### Breaking Changes
+
+* <DOCUMENT BREAKING CHANGES HERE>
+* <THIS SECTION SHOULD CONTAIN API, ABI AND BEHAVIORAL BREAKING CHANGES>
+
+### Known Caveats
+
+* <CAVEATS REGARDING THE RELEASE (BUT NOT BREAKING CHANGES).>
+* <ADDING/BUMPING DEPENDENCIES SHOULD GO HERE>
+* <KNOWN LACK OF SUPPORT ON SOME PLATFORM, SHOULD GO HERE>
+
+### Major Features and Improvements
+
+*   <INSERT MAJOR FEATURE HERE, USING MARKDOWN SYNTAX>
+*   <IF RELEASE CONTAINS MULTIPLE FEATURES FROM SAME AREA, GROUP THEM TOGETHER>
+
+### Bug Fixes and Other Changes
+
+* <SIMILAR TO ABOVE SECTION, BUT FOR OTHER IMPORTANT CHANGES / BUG FIXES>
+* <IF A CHANGE CLOSES A GITHUB ISSUE, IT SHOULD BE DOCUMENTED HERE>
+* <NOTES SHOULD BE GROUPED PER AREA>
+
+## Thanks to our Contributors
+
+This release contains contributions from many people at Google, as well as:
+
+<INSERT>, <NAME>, <HERE>, <USING>, <GITHUB>, <HANDLE>
+
 # Release 2.14.0
 
 <INSERT SMALL BLURB ABOUT RELEASE FOCUS AREA AND POTENTIAL TOOLCHAIN CHANGES>
@@ -44,7 +104,7 @@
 * `tf.keras`
     * `Model.compile` now support `steps_per_execution='auto'` as a parameter,
     allowing automatic tuning of steps per execution during `Model.fit`,
-    `Model.predict`, and `Model.evaluate` for a significant performance boost. 
+    `Model.predict`, and `Model.evaluate` for a significant performance boost.
 
 *   Enable JIT-compiled i64-indexed kernels on GPU for large tensors with more
     than 2**32 elements.
@@ -84,10 +144,18 @@
       cause TPUs to use float32 precision for such ops instead of bfloat16.
 
 *  `tf.experimental.dtensor`
-    * API changes for Relayout. Added a new API, `dtensor.relayout_like`, for 
-      relayouting a tensor according to the layout of another tensor. 
-    * Added `dtensor.get_default_mesh`, for retrieving the current default 
+    * API changes for Relayout. Added a new API, `dtensor.relayout_like`, for
+      relayouting a tensor according to the layout of another tensor.
+    * Added `dtensor.get_default_mesh`, for retrieving the current default
       mesh under the dtensor context.
+    * \*fft\* ops now support dtensors with any layout. Fixed bug in 'fft2d/
+      fft3d', 'ifft2d/ifft3d', 'rfft2d/rfft3d', and 'irfft2d/irfft3d' for
+      sharded input.
+
+*  `tf.experimental.strict_mode`
+    * Added a new API, `strict_mode`, which converts all deprecation warnings
+      into runtime errors with instructions on switching to a recommended 
+      substitute.
 
 *   TensorFlow Debugger (tfdbg) CLI: ncurses-based CLI for tfdbg v1 was removed.
 
@@ -96,9 +164,13 @@
     TensorFlow. This may be needed when linking TensorFlow into RTTI-enabled
     programs since mixing RTTI and non-RTTI code can cause ABI issues.
 
-    * `tf.ones`, `tf.zeros`, `tf.fill`, `tf.ones_like`, `tf.zeros_like` now
-      take an additional Layout argument that controls the output layout of
-      their results.
+* `tf.ones`, `tf.zeros`, `tf.fill`, `tf.ones_like`, `tf.zeros_like` now take an
+    additional Layout argument that controls the output layout of their results.
+
+* `tf.nest` and `tf.data` now support user defined classes implementing
+  `__tf_flatten__` and `__tf_unflatten__` methods. See [
+  nest_util code examples](https://github.com/tensorflow/tensorflow/blob/04869b4e63bfc03cb13627b3e1b879fdd0f69e34/tensorflow/python/util/nest_util.py#L97)
+  for an example.
 
 # Thanks to our Contributors
 

ci/official/any.sh

@@ -43,7 +43,7 @@ if [[ "${PIP_WHEEL}" -eq "1" ]]; then
 
   tfrun bazel "${TFCI_BAZEL_BAZELRC_ARGS[@]}" build "${TFCI_BAZEL_COMMON_ARGS[@]}" tensorflow/tools/pip_package:build_pip_package
   tfrun ./bazel-bin/tensorflow/tools/pip_package/build_pip_package build "${TFCI_BUILD_PIP_PACKAGE_ARGS[@]}"
-  tfrun ./ci/official/utilities/rename_and_verify_wheels.sh
+  tfrun ./ci/official/utilities/rename_and_verify_wheels.sh "$TFCI_GIT_DIR"
 fi
 
 if [[ "${#nonpip_targets[@]}" -ne 0 ]]; then

ci/official/envs/continuous_linux_x86_cpu_py310

@@ -0,0 +1,24 @@
+#TFCI_UPLOAD_LIB_URI="gs://tensorflow-release-packages/$RELEASE_VERSION/$KOKORO_GIT_COMMIT_tensorflow"
+#TFCI_UPLOAD_WHL_GCS_URI="gs://tensorflow-release-packages/$RELEASE_VERSION/$KOKORO_GIT_COMMIT_tensorflow"
+TFCI_BAZEL_BAZELRC_ARGS=(--bazelrc ./ci/official/bazelrcs/cpu.bazelrc)
+TFCI_BAZEL_COMMON_ARGS=(--config rbe)
+TFCI_BUILD_PIP_PACKAGE_ARGS=(--cpu)
+TFCI_CAPTURE_LOGS_ENABLE=1
+TFCI_COPYBARA_ENABLE=0
+TFCI_DOCKER_ENABLE=1
+TFCI_DOCKER_GPU_ARGS=()
+TFCI_DOCKER_IMAGE=tensorflow/build:latest-python3.10
+TFCI_DOCKER_PULL_ENABLE=1
+TFCI_GIT_DIR=$KOKORO_ARTIFACTS_DIR/github/tensorflow
+TFCI_INDEX_HTML_ENABLE=1
+TFCI_LIB_SUFFIX="-cpu-linux-x86_64"
+TFCI_NIGHTLY_UPDATE_VERSION_ENABLE=
+TFCI_NVIDIA_SMI_ENABLE=
+TFCI_UPLOAD_LIB_ENABLE=
+TFCI_UPLOAD_LIB_LATEST_ENABLE=
+TFCI_UPLOAD_LIB_LATEST_URI=
+TFCI_UPLOAD_LIB_URI=
+TFCI_UPLOAD_WHL_GCS_ENABLE=
+TFCI_UPLOAD_WHL_GCS_URI=
+TFCI_UPLOAD_WHL_PYPI_ARGS=
+TFCI_UPLOAD_WHL_PYPI_ENABLE=

ci/official/envs/continuous_linux_x86_cpu_py311

@@ -0,0 +1,24 @@
+#TFCI_UPLOAD_LIB_URI="gs://tensorflow-release-packages/$RELEASE_VERSION/$KOKORO_GIT_COMMIT_tensorflow"
+#TFCI_UPLOAD_WHL_GCS_URI="gs://tensorflow-release-packages/$RELEASE_VERSION/$KOKORO_GIT_COMMIT_tensorflow"
+TFCI_BAZEL_BAZELRC_ARGS=(--bazelrc ./ci/official/bazelrcs/cpu.bazelrc)
+TFCI_BAZEL_COMMON_ARGS=(--config rbe)
+TFCI_BUILD_PIP_PACKAGE_ARGS=(--cpu)
+TFCI_CAPTURE_LOGS_ENABLE=1
+TFCI_COPYBARA_ENABLE=0
+TFCI_DOCKER_ENABLE=1
+TFCI_DOCKER_GPU_ARGS=()
+TFCI_DOCKER_IMAGE=tensorflow/build:latest-python3.11
+TFCI_DOCKER_PULL_ENABLE=1
+TFCI_GIT_DIR=$KOKORO_ARTIFACTS_DIR/github/tensorflow
+TFCI_INDEX_HTML_ENABLE=1
+TFCI_LIB_SUFFIX="-cpu-linux-x86_64"
+TFCI_NIGHTLY_UPDATE_VERSION_ENABLE=
+TFCI_NVIDIA_SMI_ENABLE=
+TFCI_UPLOAD_LIB_ENABLE=
+TFCI_UPLOAD_LIB_LATEST_ENABLE=
+TFCI_UPLOAD_LIB_LATEST_URI=
+TFCI_UPLOAD_LIB_URI=
+TFCI_UPLOAD_WHL_GCS_ENABLE=
+TFCI_UPLOAD_WHL_GCS_URI=
+TFCI_UPLOAD_WHL_PYPI_ARGS=
+TFCI_UPLOAD_WHL_PYPI_ENABLE=

ci/official/envs/continuous_linux_x86_cpu_py39

@@ -0,0 +1,24 @@
+#TFCI_UPLOAD_LIB_URI="gs://tensorflow-release-packages/$RELEASE_VERSION/$KOKORO_GIT_COMMIT_tensorflow"
+#TFCI_UPLOAD_WHL_GCS_URI="gs://tensorflow-release-packages/$RELEASE_VERSION/$KOKORO_GIT_COMMIT_tensorflow"
+TFCI_BAZEL_BAZELRC_ARGS=(--bazelrc ./ci/official/bazelrcs/cpu.bazelrc)
+TFCI_BAZEL_COMMON_ARGS=(--config rbe)
+TFCI_BUILD_PIP_PACKAGE_ARGS=(--cpu)
+TFCI_CAPTURE_LOGS_ENABLE=1
+TFCI_COPYBARA_ENABLE=0
+TFCI_DOCKER_ENABLE=1
+TFCI_DOCKER_GPU_ARGS=()
+TFCI_DOCKER_IMAGE=tensorflow/build:latest-python3.9
+TFCI_DOCKER_PULL_ENABLE=1
+TFCI_GIT_DIR=$KOKORO_ARTIFACTS_DIR/github/tensorflow
+TFCI_INDEX_HTML_ENABLE=1
+TFCI_LIB_SUFFIX="-cpu-linux-x86_64"
+TFCI_NIGHTLY_UPDATE_VERSION_ENABLE=
+TFCI_NVIDIA_SMI_ENABLE=
+TFCI_UPLOAD_LIB_ENABLE=
+TFCI_UPLOAD_LIB_LATEST_ENABLE=
+TFCI_UPLOAD_LIB_LATEST_URI=
+TFCI_UPLOAD_LIB_URI=
+TFCI_UPLOAD_WHL_GCS_ENABLE=
+TFCI_UPLOAD_WHL_GCS_URI=
+TFCI_UPLOAD_WHL_PYPI_ARGS=
+TFCI_UPLOAD_WHL_PYPI_ENABLE=

ci/official/envs/continuous_linux_x86_cuda_py310

@@ -0,0 +1,24 @@
+#TFCI_UPLOAD_LIB_URI="gs://tensorflow-release-packages/$RELEASE_VERSION/$KOKORO_GIT_COMMIT_tensorflow"
+#TFCI_UPLOAD_WHL_GCS_URI="gs://tensorflow-release-packages/$RELEASE_VERSION/$KOKORO_GIT_COMMIT_tensorflow"
+TFCI_BAZEL_BAZELRC_ARGS=(--bazelrc ./ci/official/bazelrcs/cuda.bazelrc)
+TFCI_BAZEL_COMMON_ARGS=(--config rbe)
+TFCI_BUILD_PIP_PACKAGE_ARGS=()
+TFCI_CAPTURE_LOGS_ENABLE=1
+TFCI_COPYBARA_ENABLE=0
+TFCI_DOCKER_ENABLE=1
+TFCI_DOCKER_GPU_ARGS=(--gpus all)
+TFCI_DOCKER_IMAGE=tensorflow/build:latest-python3.10
+TFCI_DOCKER_PULL_ENABLE=1
+TFCI_GIT_DIR=$KOKORO_ARTIFACTS_DIR/github/tensorflow
+TFCI_INDEX_HTML_ENABLE=1
+TFCI_LIB_SUFFIX="-gpu-linux-x86_64"
+TFCI_NIGHTLY_UPDATE_VERSION_ENABLE=
+TFCI_NVIDIA_SMI_ENABLE=1
+TFCI_UPLOAD_LIB_ENABLE=
+TFCI_UPLOAD_LIB_LATEST_ENABLE=
+TFCI_UPLOAD_LIB_LATEST_URI=
+TFCI_UPLOAD_LIB_URI=
+TFCI_UPLOAD_WHL_GCS_ENABLE=
+TFCI_UPLOAD_WHL_GCS_URI=
+TFCI_UPLOAD_WHL_PYPI_ARGS=
+TFCI_UPLOAD_WHL_PYPI_ENABLE=

ci/official/envs/continuous_linux_x86_cuda_py311

@@ -0,0 +1,24 @@
+#TFCI_UPLOAD_LIB_URI="gs://tensorflow-release-packages/$RELEASE_VERSION/$KOKORO_GIT_COMMIT_tensorflow"
+#TFCI_UPLOAD_WHL_GCS_URI="gs://tensorflow-release-packages/$RELEASE_VERSION/$KOKORO_GIT_COMMIT_tensorflow"
+TFCI_BAZEL_BAZELRC_ARGS=(--bazelrc ./ci/official/bazelrcs/cuda.bazelrc)
+TFCI_BAZEL_COMMON_ARGS=(--config rbe)
+TFCI_BUILD_PIP_PACKAGE_ARGS=()
+TFCI_CAPTURE_LOGS_ENABLE=1
+TFCI_COPYBARA_ENABLE=0
+TFCI_DOCKER_ENABLE=1
+TFCI_DOCKER_GPU_ARGS=(--gpus all)
+TFCI_DOCKER_IMAGE=tensorflow/build:latest-python3.11
+TFCI_DOCKER_PULL_ENABLE=1
+TFCI_GIT_DIR=$KOKORO_ARTIFACTS_DIR/github/tensorflow
+TFCI_INDEX_HTML_ENABLE=1
+TFCI_LIB_SUFFIX="-gpu-linux-x86_64"
+TFCI_NIGHTLY_UPDATE_VERSION_ENABLE=
+TFCI_NVIDIA_SMI_ENABLE=1
+TFCI_UPLOAD_LIB_ENABLE=
+TFCI_UPLOAD_LIB_LATEST_ENABLE=
+TFCI_UPLOAD_LIB_LATEST_URI=
+TFCI_UPLOAD_LIB_URI=
+TFCI_UPLOAD_WHL_GCS_ENABLE=
+TFCI_UPLOAD_WHL_GCS_URI=
+TFCI_UPLOAD_WHL_PYPI_ARGS=
+TFCI_UPLOAD_WHL_PYPI_ENABLE=

ci/official/envs/continuous_linux_x86_cuda_py39

@@ -0,0 +1,24 @@
+#TFCI_UPLOAD_LIB_URI="gs://tensorflow-release-packages/$RELEASE_VERSION/$KOKORO_GIT_COMMIT_tensorflow"
+#TFCI_UPLOAD_WHL_GCS_URI="gs://tensorflow-release-packages/$RELEASE_VERSION/$KOKORO_GIT_COMMIT_tensorflow"
+TFCI_BAZEL_BAZELRC_ARGS=(--bazelrc ./ci/official/bazelrcs/cuda.bazelrc)
+TFCI_BAZEL_COMMON_ARGS=(--config rbe)
+TFCI_BUILD_PIP_PACKAGE_ARGS=()
+TFCI_CAPTURE_LOGS_ENABLE=1
+TFCI_COPYBARA_ENABLE=0
+TFCI_DOCKER_ENABLE=1
+TFCI_DOCKER_GPU_ARGS=(--gpus all)
+TFCI_DOCKER_IMAGE=tensorflow/build:latest-python3.9
+TFCI_DOCKER_PULL_ENABLE=1
+TFCI_GIT_DIR=$KOKORO_ARTIFACTS_DIR/github/tensorflow
+TFCI_INDEX_HTML_ENABLE=1
+TFCI_LIB_SUFFIX="-gpu-linux-x86_64"
+TFCI_NIGHTLY_UPDATE_VERSION_ENABLE=
+TFCI_NVIDIA_SMI_ENABLE=1
+TFCI_UPLOAD_LIB_ENABLE=
+TFCI_UPLOAD_LIB_LATEST_ENABLE=
+TFCI_UPLOAD_LIB_LATEST_URI=
+TFCI_UPLOAD_LIB_URI=
+TFCI_UPLOAD_WHL_GCS_ENABLE=
+TFCI_UPLOAD_WHL_GCS_URI=
+TFCI_UPLOAD_WHL_PYPI_ARGS=
+TFCI_UPLOAD_WHL_PYPI_ENABLE=

ci/official/envs/local_cpu

@@ -1,6 +1,7 @@
 TFCI_BAZEL_BAZELRC_ARGS=(--bazelrc ./ci/official/bazelrcs/cpu.bazelrc)
 TFCI_BAZEL_COMMON_ARGS=(--config sigbuild_remote_cache)
 TFCI_BUILD_PIP_PACKAGE_ARGS=("--cpu")
+TFCI_CAPTURE_LOGS_ENABLE=1
 TFCI_COPYBARA_ENABLE=0
 TFCI_DOCKER_ENABLE=1
 TFCI_DOCKER_GPU_ARGS=()