1

ACKNOWLEDGEMENT
We take this opportunity to express our profound gratitude and
deep regards to our guide (Professor Abdullah Shakoor) for his
exemplary, guidance, monitoring and constant encouragement
throughout the course of this thesis. The blessing, help and guidance
given by him time to time shall carry us a long way in the journey of
life on which we are about to embark. We could not have
experienced the zeal and enthusiasm. I did without his unique of
coordination and advising.

2
Contents

Abstract.......................................................................................................................................................2

Introduction.................................................................................................................................................2

Objectives................................................................................................................................................3

Augmented Reality in Education Sector..............................................................................................3

Object Recognition through AR Enhances Possibilities........................................................................3

Verdict.................................................................................................................................................4

Motivations.................................................................................................................................................4

Scope...........................................................................................................................................................5

Functional Requirements............................................................................................................................5

Overview of Functional requirements and Modules...............................................................................5

Non-Functional Requirements.....................................................................................................................6

Application Interface...................................................................................................................................6

Login Page..................................................................................................................................................7

SignUp Page................................................................................................................................................7

References...................................................................................................................................................8

3
Abstract

Most existing Augmented Reality (AR) and Mixed Reality (MR) systems are able to understand
the 3D geometry of the surroundings but lack the ability to detect and classify complex objects in
the real world. Such capabilities can be enabled with deep Convolutional Neural Networks
(CNN), but it remains difficult to execute large networks on mobile devices. Offloading object
detection to the edge or cloud is also very challenging due to the stringent requirements on high
detection accuracy and low end-to-end latency. The long latency of existing offloading
techniques can significantly reduce the detection accuracy due to changes in the user’s view. To
address the problem, we design a system that enables high accuracy object detection for
commodity AR/MR system running at 60fps. The system employs low latency offloading
techniques, decouples the rendering pipeline from the offloading pipeline, and uses a fast object
tracking method to maintain detection accuracy. The result shows that the system can improve
the detection accuracy by 20.2%-34.8% for the object detection and human key point detection
tasks, and only requires 2.24ms latency for object tracking on the AR device. Thus, the system
leaves more time and computational resources to render virtual elements for the next frame and
enables higher quality AR/MR experiences.

Introduction
Augmented reality (AR) is an interactive experience of a real-world environment where the
objects that reside in the real world are enhanced by computer-generated perceptual information,
sometimes across multiple sensory modalities,
including visual, auditory, haptic, somatosensory and olfactory. An augogram is a computer-
generated image that is used to create AR. Augography is the science and practice of making
augograms for AR. AR can be defined as a system that fulfills three basic features: a
combination of real and virtual worlds, real-time interaction, and accurate 3D registration of
virtual and real objects. The overlaid sensory information can be constructive (i.e. additive to the
natural environment), or destructive (i.e. masking of the natural environment). This experience is
seamlessly interwoven with the physical world such that it is perceived as an immersive aspect
of the real environment. In this way, augmented reality alters one's ongoing perception of a real-
world environment, whereas virtual reality completely replaces the user's real-world environment
with a simulated one. Augmented reality is related to two largely synonymous terms: mixed
reality and computer-mediated reality.

4
Augmented reality is used to enhance natural environments or situations and offer perceptually
enriched experiences. With the help of advanced AR technologies (e.g. adding computer vision,
incorporating AR cameras into smartphone applications and object recognition) the information
about the surrounding real world of the user becomes interactive and digitally manipulated.
Information about the environment and its objects is overlaid on the real world. This information
can be virtual or real, e.g. seeing other real sensed or measured information such as
electromagnetic radio waves overlaid in exact alignment with where they actually are in space.
Augmented reality also has a lot of potential in the gathering and sharing of tacit knowledge.
Augmentation techniques are typically performed in real time and in semantic contexts with
environmental elements. Immersive perceptual information is sometimes combined with
supplemental information like scores over a live video feed of a sporting event. This combines
the benefits of both augmented reality technology and heads up display technology (HUD).

It has developed rapidly from science fiction concept to a science-based reality. AR is a type of
virtual reality where the real world is enhanced or expanded through virtual elements, usually
showcasing the elements on the view of a real world through a visual device.

Augmented reality works in different ways and used for many reasons, but in most cases virtual
objects are projected in the real world, developing an illusion that they occupy a similar space.
Augmented reality devices feature a display, a processor, a sensor, and an input device. These
devices include gaming consoles, contact lenses, eyeglasses, head-mounted displays,
smartphones, monitors, and others. Touch and sound feedback can be added to an augmented
reality system.

Objectives
Augmented Reality in Education Sector

One of the best ways to utilize the power of AR is to invest in an educational-based
application that can be used for numerous purposes that help in generating significant revenues.
You can be sure enough that an application that serves the purpose of e-learning along with the
integration of AR could be the best thing in understanding complex topics. It helps in rendering
the objects that are quite hard to imagine, which can be further turned into 3-dimensional models
for the enhanced learning experience.  This is the best way to augment learning for the ones that
are always expecting a better idea for memorizing complex concepts.

5
Object Recognition through AR Enhances Possibilities

AR offers you a convenient way to recognize objects, which let users get the best out of your
business application. The smart home appliances or gadgets can be identified, and one can get
detailed information about these electronic devices with just a single tap. One can simply use
their smartphone’s camera to scan the object, identify it, and then get detailed information about
it over the internet. There are a lot of smart applications available in the market that are capable
of delivering the same services that enhance the user experience. One can consider taking an idea
from these applications that are currently ruling the market with their best in class user
experience. It would be great if you utilize the potential of AR-based applications in numerous
sectors like healthcare, education, and information technology to build a strong revenue model.

Verdict

The aspects mentioned above clearly depict the numerous possibilities that can be unlocked with
the introduction of augmented reality in your business application. One can quickly engage users
towards their brand with the unique concept of AR.

Motivations

 Education: interactive models for learning and training purposes, from mathematics to
chemistry.

 Medicine/healthcare: to help diagnose, monitor, train, localize, etc.

 Military: for advanced navigation, marking objects in real time.

 Art / installations / visual arts / music.

 Tourism: data on destinations, sightseeing objects, navigation, and directions.

 Broadcasting: enhancing live events and event streaming by overlaying content.

6
  Industrial design: to visualize, calculate or model.

Scope

Regarding technological progress, augmented reality word is thrown around a lot these days. But
in addition to being used to catch Pokemon and adding filters to your Snapchat, augmented
reality is a new whole universe waiting to be explored.

Augmented reality is when a computer-generated image is projected into the environment of a

user. It is a way of blurring the lines between the real world and the digital world by
superimposing virtual images in the content of the real world.

Augmented Reality displays virtual images into reality by accessing the GPS, sensors, display,
camera and other components of hardware and software devices, typically smartphones.

Of location-based mobile applications increased, image recognition and tracking for Mobile
Apps 3D virtual applications, there are many mobile applications that use augmented reality.

The application of Augmented Reality is endless. Here is a look at the main industries in which
Apps Mobile Augmented creates a revolution.

Functional Requirements
Overview of Functional requirements and Modules

Login: - User enter correct Email and Password to Login in Application and go to main activity.
If user is not registered then first signup to login the application.

Signup: We can get some information of user such as name, email, password and contact.

Add Assets: We can add some objects with their brief description or name of that object, we can
add and generate the pattern of the object.

7
Start Camera: - accessing the app through the camera. The camera in work can be back camera
as well as front camera according to the convenience of the user.

Detect Object: -The camera will point towards the object and detect it(the user doesn’t have to
take the picture, the picture will be taken automatically for the history log

Gather Information: - After detecting the object, all the related information should be loaded.
Details of information is given in next section.

Collect Sensor Data: - When the object is getting detected, the mobile will store the sensory
data from the mobile (sensors like gyroscope and accelerometer)

Create AR objects: - Based on the object detected it will create an AR object and will show on
the screen

Place AR objects: - According to the collected sensor data, the object is shown besides the
object after doing following check accordingly.

Non-Functional Requirements

 Safety Requirements
 Security Requirements
 Additional Application Requirements

Application Interface

 Splash Screen

Figure 1
Login Page

Figure 2

SignUp Page

Figure 3

9
References

https://heartbeat.fritz.ai/building-a-real-time-object-detection-app-on-android-using-firebase-ml-kit-
c72c99daf46f

https://t4tutorials.com/anti-zombies-ar-game-project-code-srs-and-documentation/

https://www.researchgate.net/publication/3762513_Matrix_A_Realtime_Object_Identification_and_Re
gistration_Method_for_Augmented_Reality

https://thinkmobiles.com/blog/augmented-reality-education/

10