Deep Learning – Creating Minds
needs to be processed.
Saneev Kumar Das
Computer Science & Engineering, College of
Engineering & Technology, B.P.U.T.,Odisha, India
saneevdas.061995@gmail.com
Abstract. Deep learning is a sub-field of machine
learning which further is a super sub-field of artificial
intelligence. A computer today is equipped with highly
competent hardware as well as software to meet specific
needs of humans. This paper tries to explain how deep
learning has created a huge scope to perform similar to
human brains. Furthermore, it discusses certain
advancement in deep learning technology and provides
the reader with an in-depth knowledge about this
emerging technology of deep learning.
Kewords. Deep Learning, TensorFlow, Caffe, Neural
Networks, Convolution.
1. Introduction
Real world data when collected is basically
unstructured i.e., in technical terms unlabeled. Such
data to get structured / labeled needs high accuracy
and machine learning technology is not enough
capable to provide such high accuracy and so is the
evolution of a sub-field of machine learning called
deep learning. Deep Learning has a prime attention
in impersonating the human brain work
methodology in making decisions as well as
creating certain patterns. Machine learning is not
enough capable of processing natural data in raw
form [5]. Deep learning showed its efficiency in
image recognition[1, 4] and speech recognition[3,
12] defeating machine learning when it comes to
predict the potential drug molecule activities[13],
and while the analysis of particular data of
accelerator[11,14] reconstructing brain circuits. It
uses neural networks which are artificially created
like the human brains comprising of trillions of
neurons. Today digital data has shown an enormous
increase in the real world and so came the concept
of big data which needs high processing and in
such case the machine learning technique cant
show its efficiency. To perform big data processing
we currently need deep learning. Furthermore, we
discuss in this paper regarding the difference
between machine learning and deep learning,
implementation of deep learning and advancement
in deep learning.
2. Deep Learning Vs Machine
Learning
Based on performance, machine learning works
well in case of small data whereas deep learning
can perform efficiently when large amount of data
Based on training time, machine learning takes less
time to train the data whereas due to higher number
of parameters deep learning takes comparatively
more time to train the data.
Based on accuracy, deep learning is an expertise as
compared to machine learning reason being higher
the time to train, more is the accuracy.
Based on hardware requirements, deep learning
requires GPUs and high-ended devices whereas
machine learning can work well with low-end
machines.
Based on tasks, machine learning can perform
supervised, unsupervised as well as reinforcement
learning whereas deep learning being a sub-field
performs exclusively unsupervised learning and
reinforcement learning.
3. Implementation and Frameworks
A Python-based framework called TensorFlow is a
popularly used one. It generally is embedded with
two tools TensorBoard and TensorFlow and is
well-documented to ease the beginners.
A high-speed framework called Caffe came into
existence in order to effectively work on
convolution neural network supported by C, C++,
Python, Matlab as well as command-line. It has
also found its application in vision recognition.
Furthermore, The Microsoft Cognitive Toolkit was
introduced in order to perform similar to Caffe but
exclusively for training data coming under
reinforcement learning methodology.
A framework used by Facebook, Google, etc.,
called PyTorch based on Lua enough competent to
execute tensor computations employing popularly
known CUDA.
A Python-based framework called Keras with a
very user-friendly interface for construction of
recurrent networks as well as convolution neural
networks.
A very highly powerful framework which is
capable to modify the neural networks during the
runtime called Chainer is Python-based and
supports multi-GPU as well as CUDA.
A framework supported by C++, Python, R and
Julia called MXNet supporting long short-term
memory, recurrent as well as convolution networks.
A framework with a deep network support recently
developed with Java called Deeplearning4j works
with covolution neural network, recurrent neural
network, long short-term memory, recursive neural
tensor flow, restricted Boltzmann machine and
deep belief network.
Deep learning supports all the above frameworks.
4. Advancements in Deep Learning
In today’s era we have found large scope of deep
learning which has transformed the entire
landscape. It has found its scope in fields such as
healthcare, self-driven cars, disaster-detection, etc.
Technological advancements include performance
of deep learning in performing NLP tasks such as
speech recognition, parsing and machine translation.
Furthermore, long short-term memory is a wide
scope of deep learning. BERT i.e., bidirectional
encoder representations from transformers
introduced by Google recently is a bidirectional
language modelperforming 11 complex NLP tasks
which includes sentiment analysis, paraphrase
detection, etc. Also, video to video synthesis and
improved word embeddings are some of the recent
advancements in the deep learning field of study.
6. Kavukcuoglu, K. et al. Learning convolutional
feature hierarchies for visual recognition. In Proc.
Advances in Neural Information Processing Systems
23 1090–1098 (2010).
7. Kingma, D., Rezende, D., Mohamed, S. & Welling,
M. Semi-supervised learning with deep generative
models. In Proc. Advances in Neural Information
Processing Systems 27 3581–3589 (2014).
8. Mnih, V. et al. Human-level control through deep
reinforcement learning. Nature 518, 529–533 (2015).
9. Collobert, R., et al. Natural language processing
(almost) from scratch. J. Mach. Learn. Res. 12,
2493–2537 (2011)
10. LeCun, Y., Bottou, L., Bengio, Y. & Haffner, P.
Gradient-based learning applied to document
recognition. Proc. IEEE 86, 2278–2324 (1998).
11. Ciodaro, T., Deva, D., de Seixas, J. & Damazio, D.
Online particle detection with neural networks based
on topological calorimetry information. J. Phys. Conf.
Series 368, 012030 (2012).
12. Mikolov, T., Deoras, A., Povey, D., Burget, L. &
Cernocky, J. Strategies for training large scale neural
network language models. In Proc. Automatic
Speech Recognition and Understanding 196–201
(2011).
13. Ma, J., Sheridan, R. P., Liaw, A., Dahl, G. E. &
Svetnik, V. Deep neural nets as a method for
quantitative structure-activity relationships. J. Chem.
Inf. Model. 55, 263–274 (2015).
14. Kaggle. Higgs boson machine learning challenge.
Kaggle https://www.kaggle. com/c/higgs-boson
(2014).

5. Concluding Remarks
Deep learning is a future trend and needs lot of
further research and advancements to match up
with the on-going world and needs to solve the
limitations it comprises of. To justify the title of the
paper, human mind is invincible and can’t ever be
replaced by deep learning but deep learning can in
future perform many such tasks which are
performed on a regular basis by a human mind. The
implementation of deep learning in various sectors
show the enormous demand of deep learning in
dealing with big data.

References
1. Farabet, C., Couprie, C., Najman, L. & LeCun, Y.
Learning hierarchical features for scene labeling.
IEEE Trans. Pattern Anal. Mach. Intell. 35, 1915–
1929 (2013).
2. Szegedy, C. et al. Going deeper with convolutions.
Preprint at http://arxiv.org/ abs/1409.4842 (2014).
3. Hinton, G. et al. Deep neural networks for acoustic
modeling in speech recognition. IEEE Signal
Processing Magazine 29, 82–97 (2012).
4. Krizhevsky, A., Sutskever, I. & Hinton, G. ImageNet
classification with deep convolutional neural
networks. In Proc. Advances in Neural Information
Processing Systems 25 1090–1098 (2012).
5. Deep learning Yann LeCun, Yoshua Bengio &
Geoffrey Hinton.