J U S T I N ' S B L O G

T U T O R I A L S

Su
eM
tp
aach
niL
eean
rig
Tensorow
Wok
rso
tatin
w
A/naconda

Date: May 20, 2017 Author: Justin  1

In this tutorial I will be going through how to install various software for machine learning development using Anaconda
Python and Ubuntu 16.04. This tutorial is mainly based on doing reinforcement learning and includes how to install alot of
OpenAI’s software. This will also include building the latest version of TensorFlow from sources.

It took me a while to convert, but now Anaconda is my go to for anything Python related. Ananconda also ensures that all
packages installed in a environment are optimized for performance and will manage package versions to avoid dependency
conflicts. Anaconda just makes managing and installing your packages so much easier.

In order to use TensorFlow with GPU support you must have a NVidia graphic card with a minimumcompute capability of 3.0.

Getting started I am going to assume you know some of the basics of using a terminal in Linux.

Install Required Packages

Open a terminal by pressing Ctrl + Alt + T
Paste each line one at a time (without the $) using Shift + Ctrl + V

$ sudo apt-get install git python-dev python3-dev build-essential swig libcurl3-dev libcupti-dev golang libjpeg-turbo8-dev make
tmux htop cmake zlib1g-dev libjpeg-dev xvfb libav-tools xorg-dev python-opengl libboost-all-dev libsdl2-dev apt-transport-https
ca-certificates curl software-properties-common openjdk-8-jdk coreutils mercurial libav-tools libsdl-image1.2-dev libsdl-mixer1.2-
dev libsdl-ttf2.0-dev libsmpeg-dev libsdl1.2-dev libportmidi-dev libswscale-dev libavformat-dev libavcodec-dev libtiff5-dev
libx11-6 libx11-dev fluid-soundfont-gm timgm6mb-soundfont xfonts-base xfonts-100dpi xfonts-75dpi xfonts-cyrillic fontconfig
fonts-freefont-ttf

Install Anaconda

I would not recommend using Python 3.6 at this time.

Anaconda Python 3.5 is probably the most common version used in python development so lets gets started by installing that.

$ wget https://repo.continuum.io/archive/Anaconda3-4.2.0-Linux-x86_64.sh

And install by:

 $ bash Anaconda3-4.2.0-Linux-x86_64.sh

When Anaconda asks if you would wish prepend the Anaconda install location to your bash type in ‘yes’, but if you accidentally
defaulted no by pressing enter you can.

$ gedit ~/.bashrc

and copy and paste this in the bottom

export PATH="/home/$USER/anaconda3/bin:$PATH"

You will have to open up a new terminal to use Anaconda. Now the best thing to do is to create a new isolated environment to
manage package versions so that you don’t have to reinstall Anaconda if you flub your python packages.

$ conda create --name ml python=3.5 anaconda

and activate the environment

$ source activate ml

We will need to build additional pylons, I mean packages. We will install pip into our conda environment but the general rule is
to always try installing a package with conda first, if that is not possible, then use pip.

(ml) $ conda install pip six libgcc swig pyopengl

Install OpenCV
OpenCV is a popular computer vision package and installing with Anaconda is a breeze.

$ (ml) $ conda install opencv

Install Nvidia Toolkit 8.0 & CudNN 6.0

Skip if not installing with GPU support

Update & Install Nvidia Drivers

You must also have the 375 (or later) NVidia drivers installed, this can easily be done from Ubuntu’s built in additional drivers
(press windows key and search additional drivers) after you update your driver packages by:

$ sudo add-apt-repository ppa:graphics-drivers/ppa

$ sudo apt update

Once installed using additional drivers restart your computer. If you experience any troubles booting linux or logging in: try
disabling fast & safe boot in your bios and modifying your grub boot options to enable nomodeset.

To install the Nvidia Toolkit download base installation .run file fromNvidia website.

$ cd ~/Downloads
 $ wget https://developer.nvidia.com/compute/cuda/8.0/Prod2/local_installers/cuda_8.0.61_375.26_linux-run
$ sudo sh cuda_8.0.61_375.26_linux.run --override --silent --toolkit

This will install cuda into: /usr/local/cuda

To install CudNN download cudNN v6.0 for Cuda 8.0 from Nvidia website and extract into /usr/local/cuda via:

$ tar -xzvf cudnn-8.0-linux-x64-v6.0.tgz

$ sudo cp cuda/include/cudnn.h /usr/local/cuda/include
$ sudo cp cuda/lib64/libcudnn* /usr/local/cuda/lib64
$ sudo chmod a+r /usr/local/cuda/include/cudnn.h /usr/local/cuda/lib64/libcudnn*

Then update your bash file:

$ gedit ~/.bashrc

This will open your bash file in a text editor which you will scroll to the bottom and add these lines:

export LD_LIBRARY_PATH="$LD_LIBRARY_PATH:/usr/local/cuda/lib64:/usr/local/cuda/extras/CUPTI/lib64"
export CUDA_HOME=/usr/local/cuda

Once you save and close the text file you can return to your original terminal and type this command to reload your .bashrc file:

$ source ~/.bashrc

Install Tensorflow From Sources

Install Bazel
Instructions also on Bazel website

$ echo "deb [arch=amd64] http://storage.googleapis.com/bazel-apt stable jdk1.8" | sudo tee /etc/apt/sources.list.d/bazel.list

$ curl https://bazel.build/bazel-release.pub.gpg | sudo apt-key add -
$ sudo apt-get update
$ sudo apt-get install bazel
$ sudo apt-get upgrade bazel

Clone Tensorflow

$ cd ~
$ git clone https://github.com/tensorflow/tensorflow

Unless you want absolute bleeding edge I highly recommend checking-out to the latest stable branch rather than master.

$ cd ~/tensorflow
$ git checkout r1.2

Configure TensorFlow Installation for Anaconda Environment

$ cd ~/tensorflow
$ source activate ml
$ (ml)./configure
The configure script is pretty good at finding the proper to use settings. Use defaults by pressing enter for all except the option
for CUDA if using a GPU. Here is how my install looked.

Please specify the location of python. [Default is /home/justin/envs/anaconda3/envs/ml/bin/python]:

Please specify optimization flags to use during compilation when bazel option "--config=opt" is specified [Default is -
march=native]:
Do you wish to use jemalloc as the malloc implementation? [Y/n]
jemalloc enabled
Do you wish to build TensorFlow with Google Cloud Platform support? [y/N] y
Google Cloud Platform support will be enabled for TensorFlow
Do you wish to build TensorFlow with Hadoop File System support? [y/N] N
No Hadoop File System support will be enabled for TensorFlow
Do you wish to build TensorFlow with the XLA just-in-time compiler (experimental)? [y/N]
No XLA support will be enabled for TensorFlow
Found possible Python library paths:
/home/justin/envs/anaconda3/envs/ml/lib/python3.5/site-packages
Please input the desired Python library path to use. Default is [/home/justin/envs/anaconda3/envs/ml/lib/python3.5/site-
packages]

Using python library path: /home/justin/envs/anaconda3/envs/ml/lib/python3.5/site-packages

Do you wish to build TensorFlow with OpenCL support? [y/N] N
No OpenCL support will be enabled for TensorFlow
Do you wish to build TensorFlow with CUDA support? [y/N] Y
CUDA support will be enabled for TensorFlow
Please specify which gcc should be used by nvcc as the host compiler. [Default is /usr/bin/gcc]:
Please specify the CUDA SDK version you want to use, e.g. 7.0. [Leave empty to use system default]:
Please specify the location where CUDA toolkit is installed. Refer to README.md for more details. [Default is /usr/local/cuda]:
Please specify the Cudnn version you want to use. [Leave empty to use system default]:
Please specify the location where cuDNN library is installed. Refer to README.md for more details. [Default is /usr/local/cuda]:
Please specify a list of comma-separated Cuda compute capabilities you want to build with.
You can find the compute capability of your device at: https://developer.nvidia.com/cuda-gpus.
Please note that each additional compute capability significantly increases your build time and binary size.
[Default is: "3.5,5.2"]: 3.5

Unless you have a Radeon graphic card you can say no to OpenCL support. (has anyone tested this? ping me if so!)

Do you wish to build TensorFlow with CUDA support?

$Y

You can find the compute capability of your device at:https://developer.nvidia.com/cuda-gpus

If all was done correctly you should see:

INFO: All external dependencies fetched successfully.

Configuration finished

Build TensorFlow
Warning Resource Intensive I recommend having at least 8GB of computer memory.

If you want to build TensorFlow with GPU support enter:

$ bazel build --config=opt --config=cuda //tensorflow/tools/pip_package:build_pip_package

For CPU only enter:

 $ bazel build --config=opt //tensorflow/tools/pip_package:build_pip_package

Build & Install Pip Package

This will build the pip package required for installing TensorFlow in your /tmp/ folder

$ bazel-bin/tensorflow/tools/pip_package/build_pip_package /tmp/tensorflow_pkg

Install Tensorflow Using Pip

$ (ml) pip install /tmp/tensorflow_pkg/tensorflow

# with no spaces after tensorflow hit tab before hitting enter to fill in blanks

Test Your Installation

Close all your terminals and open a new terminal to test. Also make sure your terminal is not in the ‘tensorflow’ directory.

$ (ml) python
$ import tensorflow as tf
$ sess = tf.InteractiveSession()
$ sess.close()

Install Docker
Docker is an open-source project that automates the deployment of applications inside software containers. It is also used by
Open AI’s Universe.

$ sudo apt-get install \

apt-transport-https \
ca-certificates \
curl \
software-properties-common

For Ubuntu 14.04:

$ sudo apt-get install \

linux-image-extra-$(uname -r) \
linux-image-extra-virtual

Followed by:

$ curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo apt-key add -

Followed by:

$ sudo add-apt-repository \
"deb [arch=amd64] https://download.docker.com/linux/ubuntu \
$(lsb_release -cs) \
stable"

And finish with:

 $ sudo apt-get update
$ sudo apt-get install docker-ce

And test installation by:

$ sudo service docker start

$ sudo docker run hello-world

You should see a message Hello from Docker! informing you that your installation appears correct. To make it so you don’t
have to use sudo to use docker you can:

$ sudo groupadd docker

$ sudo usermod -aG docker $USER
$ sudo reboot
# IF LATER YOU GET DOCKER CONNECTION ISSUES TRY:
$ sudo groupadd docker
$ sudo gpasswd -a ${USER} docker
$ sudo service docker restart
$ sudo reboot

Install OpenAI’s Gym & Universe

If you plan on doing any Reinforcement Learning you are definitely going to want OpenAI’s gym.

$ source activate ml
(ml) $ cd ~
(ml) $ git clone https://github.com/openai/gym.git
(ml) $ cd gym
(ml) $ pip install -e '.[all]'

Followed by Universe

(ml) $ cd ~
(ml) $ git clone https://github.com/openai/universe.git
(ml) $ cd universe
(ml) $ pip install -e .

We can also install Open AI’s starter agent which will train an agent using the A3C Algorithim.

(ml) $ git clone https://github.com/openai/universe-starter-agent.git

(ml) $ cd ~/universe-starter-agent
(ml) $ python train.py --num-workers 4 --env-id PongDeterministic-v0 --log-dir /tmp/vncpong --visualise

Install PyGame & Python Learning Environment

Some of Open AI’s software depends on PLE and pygame, so best install that as well.

(ml) $ hg clone https://bitbucket.org/pygame/pygame

(ml) $ cd pygame
(ml) $ python setup.py build
(ml) $ python setup.py install

(ml) $ git clone https://github.com/ntasfi/PyGame-Learning-Environment.git

 (ml) $ cd PyGame-Learning-Environment
(ml) $ pip install -e .

(ml) $ git clone https://github.com/lusob/gym-ple.git

(ml) $ cd gym-ple
(ml) $ pip install -e .

Install Baselines
Baselines allows you to easily implement DQN (and hopefully more in the future) algorithims.

(ml) $ pip install baselines

Share this:

 Twitter  Facebook  Google

Loading...

Published by Justin
View all posts by Justin

←P R E V I O U S
OpenAI – Universe Installation Guide Ubuntu 16.04

O N E T H O U SG EHT T UOP N A “ M A C H I N E L E A R N I N G T E N S O R F L O W
W / A N A C
” O N D A

Pingback: Install GPU TensorFlow From Sources w/ Ubuntu 16.04 and Cuda 8.0 – Justin's Blog
L E A V E A R E P L Y

Enter your comment here...

C A T E G O R I E S

 Tutorials (4)

F O L L O W M E O N
T W I T T E R My Tweets


© 2 J0 U1 S7 T I N ' S B L O G
W O R D P R. E S S . C O M