首页 > 其他 > 详细

Tensorflow從源碼編譯

时间:2019-02-07 21:12:10      阅读:176      评论:0      收藏:0      [点我收藏+]

TensorFlow

Install

More

Learn

API

Resources

Community

GitHub

Install

Build from source

Build a TensorFlow pip package from source and install it on Ubuntu Linux and macOS. While the instructions might work for other systems, it is only tested and supported for Ubuntu and macOS.

Note: We already provide well-tested, pre-built TensorFlow packages for Linux and macOS systems.

Setup for Linux and macOS

Install the following build tools to configure your development environment.

Install Python and the TensorFlow package dependencies

Ubuntu

mac OS

sudo apt install python-dev python-pip # or python3-dev python3-pip

Install the TensorFlow pip package dependencies (if using a virtual environment, omit the --user argument):

pip install -U --user pip six numpy wheel mock

pip install -U --user keras_applications==1.0.6 --no-deps

pip install -U --user keras_preprocessing==1.0.5 --no-deps

The dependencies are listed in the setup.py file under REQUIRED_PACKAGES.

Install Bazel

Install Bazel, the build tool used to compile TensorFlow.

Add the location of the Bazel executable to your PATH environment variable.

Install GPU support (optional, Linux only)

There is no GPU support for macOS.

Read the GPU support guide to install the drivers and additional software required to run TensorFlow on a GPU.

Note: It is easier to set up one of TensorFlow‘s GPU-enabled Docker images.

Download the TensorFlow source code

Use Git to clone the TensorFlow repository:

git clone https://github.com/tensorflow/tensorflow.git

cd tensorflow

The repo defaults to the master development branch. You can also checkout a release branch to build:

git checkout branch_name # r1.9, r1.10, etc.

Configure the build

Configure your system build by running the following at the root of your TensorFlow source tree:

./configure

This script prompts you for the location of TensorFlow dependencies and asks for additional build configuration options (compiler flags, for example). The following shows a sample run of ./configure (your session may differ):

View sample configuration session

Configuration options

For GPU support, specify the versions of CUDA and cuDNN. If your system has multiple versions of CUDA or cuDNN installed, explicitly set the version instead of relying on the default. ./configure creates symbolic links to your system‘s CUDA libraries—so if you update your CUDA library paths, this configuration step must be run again before building.

For compilation optimization flags, the default (-march=native) optimizes the generated code for your machine‘s CPU type. However, if building TensorFlow for a different CPU type, consider a more specific optimization flag. See the GCC manual for examples.

There are some preconfigured build configs available that can be added to the bazel build command, for example:

--config=mkl —Support for the Intel? MKL-DNN.

--config=monolithic —Configuration for a mostly static, monolithic build.

Note: Starting with TensorFlow 1.6, binaries use AVX instructions which may not run on older CPUs.

Run the tests (optional)

To test your copy of the source tree, run the following test for versions r1.12 and before (this may take a while):

bazel test -c opt -- //tensorflow/... -//tensorflow/compiler/... -//tensorflow/contrib/lite/...

For versions after r1.12 (like master), run the following:

bazel test -c opt -- //tensorflow/... -//tensorflow/compiler/... -//tensorflow/lite/...

Key Point: If you‘re having build problems on the latest development branch, try a release branch that is known to work.

Build the pip package

Bazel build

CPU-only

Use bazel to make the TensorFlow package builder with CPU-only support:

bazel build --config=opt //tensorflow/tools/pip_package:build_pip_package

GPU support

To make the TensorFlow package builder with GPU support:

bazel build --config=opt --config=cuda //tensorflow/tools/pip_package:build_pip_package

Bazel build options

Building TensorFlow from source can use a lot of RAM. If your system is memory-constrained, limit Bazel‘s RAM usage with: --local_resources 2048,.5,1.0.

The official TensorFlow packages are built with GCC 4 and use the older ABI. For GCC 5 and later, make your build compatible with the older ABI using: --cxxopt="-D_GLIBCXX_USE_CXX11_ABI=0". ABI compatibility ensures that custom ops built against the official TensorFlow package continue to work with the GCC 5 built package.

Build the package

The bazel build command creates an executable named build_pip_package—this is the program that builds the pip package. For example, the following builds a .whl package in the /tmp/tensorflow_pkg directory:

./bazel-bin/tensorflow/tools/pip_package/build_pip_package /tmp/tensorflow_pkg

Although it is possible to build both CUDA and non-CUDA configurations under the same source tree, it‘s recommended to run bazel clean when switching between these two configurations in the same source tree.

Install the package

The filename of the generated .whl file depends on the TensorFlow version and your platform. Use pip install to install the package, for example:

pip install /tmp/tensorflow_pkg/tensorflow-version-tags.whl

Success: TensorFlow is now installed.

Docker Linux builds

TensorFlow‘s Docker development images are an easy way to set up an environment to build Linux packages from source. These images already contain the source code and dependencies required to build TensorFlow. See the TensorFlow Docker guide for installation and the list of available image tags.

CPU-only

The following example uses the :nightly-devel image to build a CPU-only Python 2 package from the latest TensorFlow source code. See the Docker guide for available TensorFlow -devel tags.

Download the latest development image and start a Docker container that we‘ll use to build the pip package:

docker pull tensorflow/tensorflow:nightly-devel

docker run -it -w /tensorflow -v $PWD:/mnt -e HOST_PERMS="$(id -u):$(id -g)" \

tensorflow/tensorflow:nightly-devel bash

git pull # within the container, download the latest source code

The above docker run command starts a shell in the /tensorflow directory—the root of the source tree. It mounts the host‘s current directory in the container‘s /mnt directory, and passes the host user‘s information to the container through an environmental variable (used to set permissions—Docker can make this tricky).

Alternatively, to build a host copy of TensorFlow within a container, mount the host source tree at the container‘s /tensorflow directory:

docker run -it -w /tensorflow -v /path/to/tensorflow:/tensorflow -v $PWD:/mnt \

-e HOST_PERMS="$(id -u):$(id -g)" tensorflow/tensorflow:nightly-devel bash

With the source tree set up, build the TensorFlow package within the container‘s virtual environment:

Configure the build—this prompts the user to answer build configuration questions.

Build the tool used to create the pip package.

Run the tool to create the pip package.

Adjust the ownership permissions of the file for outside the container.

./configure # answer prompts or use defaults

bazel build --config=opt //tensorflow/tools/pip_package:build_pip_package

./bazel-bin/tensorflow/tools/pip_package/build_pip_package /mnt # create package

chown $HOST_PERMS /mnt/tensorflow-version-tags.whl

Install and verify the package within the container:

pip uninstall tensorflow # remove current version

pip install /mnt/tensorflow-version-tags.whl

cd /tmp # don‘t import from source directory

python -c "import tensorflow as tf; print(tf.__version__)"

Success: TensorFlow is now installed.

On your host machine, the TensorFlow pip package is in the current directory (with host user permissions):

./tensorflow-version-tags.whl

GPU support

Docker is the easiest way to build GPU support for TensorFlow since the host machine only requires the NVIDIA?

driver (the NVIDIA? CUDA? Toolkit doesn‘t have to be installed). See the GPU support guide and the

TensorFlow Docker guide to set up nvidia-docker (Linux only).

The following example downloads the TensorFlow :nightly-devel-gpu-py3 image and uses nvidia-docker to run the GPU-enabled container. This development image is configured to build a Python 3 pip package with GPU support:

docker pull tensorflow/tensorflow:nightly-devel-gpu-py3

docker run --runtime=nvidia -it -w /tensorflow -v $PWD:/mnt -e HOST_PERMS="$(id -u):$(id -g)" \

tensorflow/tensorflow:nightly-devel-gpu-py3 bash

Then, within the container‘s virtual environment, build the TensorFlow package with GPU support:

./configure # answer prompts or use defaults

bazel build --config=opt --config=cuda //tensorflow/tools/pip_package:build_pip_package

./bazel-bin/tensorflow/tools/pip_package/build_pip_package /mnt # create package

chown $HOST_PERMS /mnt/tensorflow-version-tags.whl

Install and verify the package within the container and check for a GPU:

pip uninstall tensorflow # remove current version

pip install /mnt/tensorflow-version-tags.whl

cd /tmp # don‘t import from source directory

python -c "import tensorflow as tf; print(tf.contrib.eager.num_gpus())"

Success: TensorFlow is now installed.

Tested build configurations

Linux

Version Python version Compiler Build tools

tensorflow-1.12.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.15.0

tensorflow-1.11.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.15.0

tensorflow-1.10.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.15.0

tensorflow-1.9.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.11.0

tensorflow-1.8.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.10.0

tensorflow-1.7.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.10.0

tensorflow-1.6.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.9.0

tensorflow-1.5.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.8.0

tensorflow-1.4.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.5.4

tensorflow-1.3.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.4.5

tensorflow-1.2.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.4.5

tensorflow-1.1.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.4.2

tensorflow-1.0.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.4.2

Version Python version Compiler Build tools cuDNN CUDA

tensorflow_gpu-1.12.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.15.0 7 9

tensorflow_gpu-1.11.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.15.0 7 9

tensorflow_gpu-1.10.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.15.0 7 9

tensorflow_gpu-1.9.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.11.0 7 9

tensorflow_gpu-1.8.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.10.0 7 9

tensorflow_gpu-1.7.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.9.0 7 9

tensorflow_gpu-1.6.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.9.0 7 9

tensorflow_gpu-1.5.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.8.0 7 9

tensorflow_gpu-1.4.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.5.4 6 8

tensorflow_gpu-1.3.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.4.5 6 8

tensorflow_gpu-1.2.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.4.5 5.1 8

tensorflow_gpu-1.1.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.4.2 5.1 8

tensorflow_gpu-1.0.0 2.7, 3.3-3.6 GCC 4.8 Bazel 0.4.2 5.1 8

macOS

CPU

Version Python version Compiler Build tools

tensorflow-1.12.0 2.7, 3.3-3.6 Clang from xcode Bazel 0.15.0

tensorflow-1.11.0 2.7, 3.3-3.6 Clang from xcode Bazel 0.15.0

tensorflow-1.10.0 2.7, 3.3-3.6 Clang from xcode Bazel 0.15.0

tensorflow-1.9.0 2.7, 3.3-3.6 Clang from xcode Bazel 0.11.0

tensorflow-1.8.0 2.7, 3.3-3.6 Clang from xcode Bazel 0.10.1

tensorflow-1.7.0 2.7, 3.3-3.6 Clang from xcode Bazel 0.10.1

tensorflow-1.6.0 2.7, 3.3-3.6 Clang from xcode Bazel 0.8.1

tensorflow-1.5.0 2.7, 3.3-3.6 Clang from xcode Bazel 0.8.1

tensorflow-1.4.0 2.7, 3.3-3.6 Clang from xcode Bazel 0.5.4

tensorflow-1.3.0 2.7, 3.3-3.6 Clang from xcode Bazel 0.4.5

tensorflow-1.2.0 2.7, 3.3-3.6 Clang from xcode Bazel 0.4.5

tensorflow-1.1.0 2.7, 3.3-3.6 Clang from xcode Bazel 0.4.2

tensorflow-1.0.0 2.7, 3.3-3.6 Clang from xcode Bazel 0.4.2

GPU

Version Python version Compiler Build tools cuDNN CUDA

tensorflow_gpu-1.1.0 2.7, 3.3-3.6 Clang from xcode Bazel 0.4.2 5.1 8

tensorflow_gpu-1.0.0 2.7, 3.3-3.6 Clang from xcode Bazel 0.4.2 5.1 8

Was this page helpful? Let us know how we did:

Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 3.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.

Stay connected

Blog

GitHub

Twitter

YouTube

Support

Issue tracker

Release notes

Stack Overflow

Tensorflow從源碼編譯

原文:https://www.cnblogs.com/2008nmj/p/10355527.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!