CH 1 5 Online Examination System With Item Anaysis

CHAPTER 1
INTRODUCTION
Background of the Study
Today, Online Examination System has become a fast-growing examination method because
of its speed and accuracy. It needs less manpower to execute the examination. Almost all
organization nowadays conducts their objective examinations by online examination system.
Moreover, it saves student’s time during examinations. With the use of online examination system,
organizations can also easily check the performance of the students. As a result, organizations need
lesser time to release examination result. It also helps the environment as it saves paper (Sanjeev
Rai, 2016).
The Online Examination System with Item Analysis is a web-based system that provides an
automated examination through a network connected computer or mobile device. The system was
developed to automate the time-consuming paper work process, to reduce the anxiety of students
every time they see a test paper, to evaluate the answers instantly, and to generate and analyse
reports for evaluation.
An examination is a formal test or approach to measuring a person’s knowledge. The problem
with the traditional way of examination is that it consumes a lot of time. Further, it is a monotonous
process both for the students and the school staff who administer the examination. Setting
questionnaires, printing questionnaires, checking of papers and posting results and reports are
some example of manual process that universities commonly do. Those manual processes take a
lot of effort and very time consuming. Currently, the administration of examinations and item
1
“Online Examination System With Item Analysis”
Pangasinan State University - Urdaneta City Campus
College of Computing
analysis are all done manually by the instructors at Pangasinan State University Urdaneta Campus.
One of the problems we encountered within the manual process is that the it is very time
consuming for the instructors and students alike. The result processing also is a problem as it takes
more time as it is done manually. Additionally, it involves a lot of paper work and the chances of
errors are high. The researchers also discovered that the chances of paper leakage are more in the
current system as compared to the proposed system. Finally, it possesses a threat to the
environment as the current system wastes a lot of paper.
To make it more effective, the Online Examination System with Item Analysis has its own
unique features. The study mainly focuses on the development of an automated examination
system that is intended to be used by Pangasinan State University Urdaneta Campus students.
This study will be very significant to students and teachers alike. The study will also benefit
the school as it would start using a more advanced form of technology. Particularly, the students
would benefit more fully, as they no longer need to buy school supplies to be used in taking quizzes
and examinations, the proposed system can be easily made available to the students since right
now all of them have gadgets in their pockets, Likewise, the proposed system would make it even
more economical for the parents. The same is true for the teacher’s workload that they would be
significantly reduced, thereby giving them ample time for the preparation of their lessons and in
the computation of their student grades.
2
Conceptual Framework
The researchers will be using the following concepts, namely: (a) Automation, (b) Online-
based examination, (c) Item analysis and (d) Record management as a basis in the conduct of
this study.
Automation can be defined as the use of instructions to create a repeated process that replaces
the user’s manual work. Software tools, frameworks and appliances conduct the tasks with
minimum administrator intervention. (Margaret Rouse, 2012) The automated processes in our
system are item checking and item analysis.
Online based examination efficiently evaluates the examinees through a fully automated
system which saves time and gives fast results (Andrew P. Barkley, 2013). The researchers used
the concept online-based examination for it will help in speeding up the process of conducting the
examination, Through the use if computers of mobile devices, examinees can easily answer the
questions that are displayed on their monitor or screen. Before taking the examination, all
computer and mobile devices will be connected to a server which prepares set of questions for the
examination and delivers it to the examinees through the use of their devices.
Item analysis is a process of examining class-wide performance on individual test items
(Haladyna, T.M. & Downing, S.M. & Rodrigues, M.C. 2002). This concept is used by the
researchers for it can help in identifying potential mistakes of the examinees in their examination.
Having the item analysis in this study, can help the students study and focus more on the topics
that are difficult for them to understand.
3
Record management also known as records and information management, is an
organizational function devoted to the management of information in an organization throughout
its life cycle, from the time of creation or inscription to its eventual disposition. This includes
identifying, classifying, storing, securing, retrieving, tracking, and destroying or permanently
preserving records (ARMA International, 2013). This concept can support the instructors manage
the academic records of the students such as their examination scores. By using computers or
mobile devices, instructors will be able to establish good management of records.
Research Paradigm
The Research paradigm presents how this project will be conducted. It shows the relationship
between input, process and its corresponding output As indicated in figure 1,. Please see the inputs
in the paradigm.
4
See Figure 1. For the research paradigm.
INPUT PROCESS OUTPUT
1. IT profiles of the
students, teachers
and the campus in
terms of computers,
Scrum
devices and network
Methodology
facilities.
2. Areas to be improved  Initiate
along the conduct of  Plan and Online Examination System
quizzes and Estimate with Item Analysis
examinations.  Implement
3. Identifying the  Review and
functional and non- Retrospect
functional
 Release
requirements of the
application.
4. Testing the usability
of the system.
-------------------------------------------------------------------------------------------------
Feedback
Figure 1. Research Paradigm of the Online Examination System with Item Analysis.
5
Statement of Objectives
The study is generally aimed to design, develop and test an Online-based Examination with item
analysis for schools and universities. Specifically, it is aimed to:
1. Identify the present IT profile of the campus in terms of:
a.) Knowledge in using mobile technology
b.) Hardware Resources
c.) Network connectivity
2. Determine the existing processes and problems of administering examinations implemented
within the campus.
3. Identify the functional and non-functional requirements of the application.
4. Develop an Online Examination System with Item Analysis using Scrum Methodology.
5. Test the usability of the developed application in terms of :
a.) Efficiency
b.) Affect
c.) Helpfulness
d.) Control
e.) Learnability
6
Scope and Delimitation
The study focuses on the development of an online and automated examination system that
was designed for PSU Urdaneta Campus.
The system can handle true or false, matching type, and multiple choice examinations. It will
provide electronic answer sheets and automated checking of answers, analyzing the test items, and
can generate a report containing the test and item analysis reports as soon as the examination is
finished. Users of the system are the instructors and students only.
The instructor serves as the administrators of the system. The instructor will provide questions
for the exam and key answers to the questions. The Administrators will upload the questionnaire
as a PDF or Word file, and also can be downloaded as well. The Instructors will base their topics
in uploaded syllabus. The instructors will set time duration of the whole length of the examination.
Finally, they will be able to record the results of the examinations and view the analysis for each
item given.
The students can input their answers with the use of their mobile device or computer, press
the finish button to submit their answers and reveal their score. Under their total score, the students
can view their answers and beside it, the key answer to the question.
As a security feature, the student will be granted access to the system through their student
identification card, password and taking a picture every examination.
7
Importance of the Study
This study, in general, can contribute in attaining better learning. Specifically, it will benefit
the following:
The University. The university is an educational institution of undergraduate and
postgraduate in various degrees for the higher education. It is the place for students to be more
proficient in their chosen career. Through this research, the university can take the advantage of
the new technology and can use to provide efficient quality education to the students enrolled.
The Instructors. The instructors play a big role in enhancing the knowledge of all the students
by giving examinations. That is why this study will help the instructors to minimize their work and
save time. Checking of answers will be done automatically. The item analyzation reports will help
the instructors know which topics the students did not understand clearly.
The Students. The students will benefit from the system by not using ball pen and paper in
examinations. In addition, the system will reduce cheating from the students during examinations.
8
Definition of Terms
The terms used in this study is defined below in order for the readers to understand the
terms used.
Functional Requirements. In this study, it can be defined as the software’s functionality like what
the system can do. These requirements reveal the functionalities of the system.
Non-Functional Requirements. In this study, it refers to the requirements that specifies criteria
that can be used to judge the operation of a system rather than a specific behavior.
Online. It this study, it can be defined as the condition of being connected to a network of
computers or other devices. The term is frequently used to describe someone who is currently
connected to the internet.
Software Usability Measurement Inventory. It this study, it can be defined as a likert-type
questionnaire which consists of fifty item question that is use to analyze the application in terms
of usability of use. Online Examination System with Item Analysis. Is a web-based system that
provides an automated examination through a network connected computer or mobile device.
Scrum Development. It this study, it can be defined as the framework of the proposed system.
The idea behind scrum is to divide the project into as many milestones as possible so that the
deliverable in incremental phases can be demonstrated to the customer much early and hence
feedback/problems/issues can be known at early stage of the project life cycle. Scrum welcome
change in requirements, even late in a project.
9
CHAPTER 2
REVIEW OF RELATED LITERATURE
This chapter contains the summary of related studies and literature which are essential for
the development of the proposed application.
Existing Processes used in Manual Examination
Improving student learning requires improving the assessment system. Teachers might
assume that it is their teaching that directs the students' learning, but students orient themselves as
learners in relation to what will be assessed (Havnes, 2002). Examination is an instrument to test
the knowledge gain by the student and what he learned during the course of study. It encourages
the students to open their books and widen their ideas to respond to a given problem by the
instructors. For instructors also, the examination gives them motivation and keeps oriented in their
goals to his work. Given problems by the instructor based on what he teaches and from the
references, they are using. It is a paper and ball pen examinations that can be identifications,
enumeration, multiple choice, and also True or False. For every month, it is hardly without no any
given examinations to the students, causing them physical and mental stress for both students and
instructors. Moreover, the paper-based examination is time and effort consuming. Checking the
results gives a hard time to the instructors, as well as to the students who are waiting to get to know
the status of their results. The manual examination system may lead to errors, more time
consumption, inefficient and wastage of valuable resources. Moreover, the ever-increasing paper-
based examinations are difficult to store securely due to space scarcity (Bhardwaj & Singh, 2011).
10
The university spent a lot of money to purchase papers. In the existing system, managing and
recording the student's papers is very tedious and very time-consuming.
Based on the aforesaid statements, the existing manual examination system is more time
consuming and, therefore, inefficient. Moreover, it takes a lot of human efforts before achieving
the desired results. Sometimes, because of passing the documents physically, certain documents
are missing or misplaced. Changing educational practice is not only changing how we think about
teaching, learning, and assessment but also - and even more - about changing the artifacts that we
rely upon in our daily practices as teachers and students (Anton Havnes, 2002). Thus, the
researchers propose a system that will help the instructor and the university in the examination
process. In addition, the system would help accelerate the process of checking and storing of the
examination results.
System Development using Scrum Methodology
Scrum is a lightweight agile project management framework with broad applicability for
managing and controlling iterative and incremental projects of all types. Scrum has garnered
increasing popularity in the agile software development due to its simplicity, proven productivity,
and ability to act as a wrapper for various engineering practices promoted by other
agile methodologies (MacLaughlin, 2017). A similar study that uses Scrum Methodology is the
Online Examination System for Alpha University by Aron Amaha et.al.,(2003). In their study,
their general objective is create a Web based application that establishes a network between the
institutes and the students that attempt to remove the existing flaws in the manual system of
conducting exams.
11
Usability Testing of the Proposed Application
Usability is a measurable characteristic that is present to a greater or lesser degree, that
describes how effectively a user can interact with a product. It can also be thought of as how easy
a product is to learn and how easy it is to use(Axup,2014).
According to Arvind Rongala (2015), usability testing is an essential technique to evaluate
a product by testing it on the end users. It is an effective method of analyzing the performance
and drawbacks of an application. This process provides integral feedback on how the real user
used a system and what they think about it.
One of the usability tools used to test the usability of an application is The Software
Usability Measurement Inventory (SUMI). It has been developed in the "Metrics for Usability
Standards in Computing" project by the Human Factors Research Group at the University College
Cork. SUMI is a questionnaire method for analyzing products or prototypes in terms of usability
and quality of use. It provides a standardized measurement of user satisfaction with software. A
similar study that uses SUMI is the SUMI Evaluation Approach of the EducaNext Portal from
Tanja Arh, Borka Jerman Blažič (2008) where their general objective is to develop software tools
and applications for effective e-learning to ease the challenge for Human-computer interaction
(HCI) researchers.
Related Studies
Shin (2010) conducted a study entitled "Comparability of Computerized Adaptive and
Paper-Pencil Tests". This study is focused on the comparison of the Paper-Pencil Tests (PPT) and
the Computerized Adaptive Tests (CAT), wherein he points out the reliability of the CAT over its
12
counterpart PPT. Likewise, Fagbola et.al., (2013) conducted a study entitled “Computer-Based
Test (CBT) System for University Academic Enterprise Examination" which also focused on the
comparison of a paper pencil examination and computer-based test/examination. The researchers
tackled the problems usually experienced in the traditional paper and pencil examination, including
examination venue capacity constraints, lack of comfort for examination candidates, delay in the
release of results, examination malpractices, cost implication of printing examination materials
and human error. Thus the previous studies initiated the need for automation of the examination
system. This inspires the researchers to conduct a study regarding the Online Examination System
with Item Analysis for Pangasinan State University’s Urdaneta Campus.
In addition, Akinsanmi et.al, (2010) developed a web application where tests in multiple-
choice formats could be taken online and graded immediately. The web application relies solely
on Microsoft developed technologies. According to the result of the said study, it proved the
validity of using this kind of web-based systems for evaluating students in the institutions with a
high rate of students. Rashad et al., (2010) also developed an online examination system that
carries out the examination and automatic grading for student's examinations. The system
facilitates the conduct of examinations, the collection of answers, automatically marking the
submissions and production of reports for the test. It supports many kinds of questions. It was used
via the internet and also suitable for both local and remote examination. The system could help
lecturers, instructors, teachers and others who are willing to create new examinations or edit
existing ones as well as students participating in the examinations.
13
Through the literature and recent studies mentioned above, the researchers adapted some
features of automated assessment examination system such as hosting the system on the internet,
multiple choice test, automated grading of the test result, security as per requirement, randomized
questions and others. The developed system can be accessed by any computer or laptop as well as
Personal Digital Assistant (PDA's)or mobile devices.
Synthesis
Based on the literature and studies above, the researchers cited some similarities and
differences between the proposed system and the previous studies regarding online computerized
examination. The researchers required the applicants to take the online examination, which is the
same to the study of Shin (2010) where he compares the positive and negative side of both Paper-
Pencil Tests (PPT) and the Computerized Adaptive Tests. The researchers also made a
computerized multiple-choice examination for the students, which is similar to the study of
Akinsanmi et al., (2010) who developed a web application where tests in multiple-choice formats
could be taken online and graded immediately. However, in the proposed system only show the
examination results automatically excluding the grade.
14
CHAPTER 3
METHODOLOGY
This chapter discusses the procedures and methods used in this project. It also includes the
research design of the project and how the data will be gathered, as well as the research
instruments.
Research Design
In this study, the researchers used the descriptive and developmental research in designing,
development, and evaluation of the Online Based Examination with System Analysis. Descriptive
research examines phenomena, a group of people, idea or theory with a particular focus on the
facts and conditions of the subject. The goals of this research are to identify the problems
encountered by the instructors, processes involved in the use of traditional class record, functional
and non-functional requirements of the proposal and to test the usability of the developed Online-
Based Examination with System Analysis. Developmental research is the study of designing,
developing and evaluating instructional programs, processes, and products that meet the criteria of
internal consistency and effectiveness. In the context of this study, the scrum software
methodology has been used to develop Online Based Examination with System Analysis. The
researchers chose Scrum as a software development methodology for it focuses on building the
application in a short period of time and the developers can plan their work precisely.
15
Population and Locale of the Study
The study was conducted at the Pangasinan State University Urdaneta Campus. The
researchers focused on the said campus and all departments of the campus because the departments
still use manual paper and pen examinations. The researchers gathered information through survey
questionnaires and determined the current forms and procedures in the manual examination
process of PSU Urdaneta Campus. Moreover, the researchers collected necessary information
through survey questionnaires from the students who experienced the manual examination in
Pangasinan State University. The Slovin’s Formula were used to determine the number of sample
population as respondents.
Table 1. Respondents of the Study
Respondents No. of Respondents Objective
Faculty 20 For Objective 1 & 2
Students of Bachelor of Secondary 45 For Objective 1 & 4
Education
Students of B.S. Information Tech. 138 For Objective 1 & 4
Students of B.S. Mathematics 40 For Objective 1 & 4
Total: 243
16
Table 1 shows the results from the consultation of the researchers with a statistician. The
statistician has advised us with the number of respondents based on the results of his computations
using the Solvin’s Formula. For the students, the statistician has calculated and advised us with
223 students. This will ensure that the feedback we get is accurate. For the faculty, the statistician
has calculated and advised us with 20 instructors. This was done so that the proponents will have
an overall knowledge of the faculty.
Data Instrumentation
For objective No.1, an IT survey questionnaire (Refer to Appendix B for a copy of the
survey questionnaire) was given to the respondents to gather information in determining the IT
profiles of the institution and of the examiners. The questionnaire was presented as a yes or no
questionnaire.
For objective No.2, casual interviews and survey questionnaire was conducted to identify
the existing processes and it’s problems. The survey questionnaire is shown in appendix C.
For objective No.3, a checklist questionnaire (Refer to Appendix D for a copy of the
checklist questionnaire) was distributed to determine the areas that need to be improved using
the proposed system.
For objective No.5, the Software Usability Measurement Inventory (SUMI) questionnaire
was used in order to determine the usability of the proposed system. (Refer to Appendix E for a
copy of the questionnaire)
17
Data Analysis
The following involves the tools that were used to interpret the data gathered to fulfill the
specific objectives of the study:
For objective No. 1, the data gathered from the IT survey questionnaire are tallied and
computed in order to identify the IT profile of the institution of the examiners which are used to
serve as a basis for recommendation of upgrades or additional hardware,or network resources (see
appendix B).
For objective No. 2, the data gathered from the casual interviews and survey
questionnaire were analyzed in order to identify and access the existing process and it’s
problems. (see appendix C).
For objective No. 3, The data gathered from the survey questionnaire was noted and
analyzed in order to add, change, and/or refine features in the proposed system to better suit to
the needs of the user (see appendix D).
For objective No. 5, the results of the SUMI test are tabulated and the average weighted
mean was computed and compared to a Likert table in Table 2 to derive the corresponding
interpretation of the result (see appendix E).
18
Table 2. Likert Scale
Numerical Statistical Range Descriptive Descriptive
Equivalent Equivalent Rating Interpretation
5 4.30-5.00 Very Strongly Agree Usable
4 3.50-4.29 Strongly Agree Usable
3 2.50-3.49 Agree Usable
2 1.70-2.49 Disagree Not Usable
1 1.00-1.69 Strongly Disagree Not Usable
The responses ranging from 1.00 to 2.49 were interpreted as not usable while those
responses ranging from 2.50 and above were interpreted as usable. (Claveria et al., 2017)
19
CHAPTER 4
RESULTS AND DISCUSSIONS
The researchers used interviews and survey questionnaires as tools to identify the present
IT profiles of the Pangasinan State University Urdaneta Campus in terms of a). knowledge in
using mobile technology, b). their network connectivity c). hardware and software resources.
As stated in the previous chapter, the researchers selected a sample of 243 respondents
residing in the campus. 223 of which are students and 20 are instructors of the campus. On this
representative sample, a survey was carried out to the three departments, Bachelor of Science in
Information Technology; Bachelor of Science in Math; Bachelor of Elementary Education and
collected data for the study.
20
IT Profile of the Pangasinan State University Campus
Table 3.1
Results of the IT Profiling questionnaire for students
YES NO
Statements
Frequency Percentage Frequency Percentage
Do you have a mobile 211 94.6% 12 5.4%

phone?
Are you proficient in using 146 65.5% 77 34.5%

mobile devices?
Do you have a personal laptop 153 68.6% 70 31.4%

or computer?
Does the campus have an open 0 0.0% 223 100.0%

network for students?
TOTAL 510 57.17% 382 42.83%
Data was gathered using the yes or no questionnaire in Appendix B
21
Table 3.2
Results of the IT Profiling questionnaire for faculty members
YES NO
Statements
Do you have a mobile 20 100% 0 0

phone?
Are you proficient in using 16 80.0% 4 20.0%

mobile devices?
Do you have a personal laptop or 19 95% 1 5%

computer
Do you have a personal router 13 65% 7 35%

that you can bring to school?
TOTAL 52 86.7% 8 13.3%
Data was gathered using the yes or no questionnaire in Appendix B
The researchers used a yes or no questionnaire to assess and identify the IT profile of the
Pangasinan State University Campus in terms of a) knowledge in mobile technology, b)
hardware resources, and c) network connectivity. Table 3.1 shows the results from the student’s
questionnaires and Table 3.2 show the results from the instructor’s questionnaire. In regards to
a) Knowledge in mobile technology, Table 3.1 shows that 65.5% of students are proficient in
using their mobile devices. Table 3.2 shows that 80.0% of instructors are proficient in using
mobile devices. This indicates that both students and instructors have proper knowledge with
using mobile technology.
22
In regards to b) Hardware resources, Table 3.1 shows that 94.6% of students have mobile
devices while 68.6% of students have personal computers or laptops. Table 3.2 shows that 100%
of instructors have a mobile phone and 95% have personal computers or laptops. This indicates
that majority of students and instructors will be able to access the developed system using their
devices. Finally, regarding c) Network connectivity, the students were asked if the campus had an
open connection for them. Table 3.1 shows that 100.0% of the students answered with “no”. For
the instructors, they were asked if they had a personal router at home that they could bring to
school. Table 3.2 shows that 65% of instructors answered with yes. This helps with the lack of
open connection for the students as the routers will be used instead.
23
Existing Processes in Taking Manual Examination in terms of Taking Examination and
Administering Examination
The researchers used interview guide and questionnaires as tools in identifying the
processes in taking Manual Examination in terms of (a) Taking Examination and (b)
Administering Examination.
Figure 2.1. Process Flow Chart of Manually Taking Examination
24
Figure 2.2 Process Flow Chart of Manually Administering Examination
25
The processes were represented using process flowchart as can be seen in Figure 2.1. It
shows how the students take their examination manually. First, the students listen to the lecture
of their instructor in order to learn the lesson. The instructor will then give time for the students
to review the past lessons that were discussed within the class. At the day of the examination, the
instructor will distribute the test paper to the students then they will take the examination. The
students will answer the test paper quietly with their pen, after taking the exam the instructor will
collect and check all the test paper and the students will wait for a few days to see the result of
the exam. If the results of the examination are too low, the instructor will teach the lessons again
to their students. This emphasizes the step-by-step process done by the students making it hassle
for them.
The processes were represented using process flowchart as can be seen in Figure 2.2. It
shows how the instructors administer examination manually. In order for the instructor to
administer the exam, the instructors need to teach lessons to the students. The instructors will
then create a questionnaire for the students’ examination where the questions are based on their
previous lessons then print the questionnaires for the students. After that, the instructor will
distribute all the test paper to the students who will take the exam. Once the examination is
finished, the instructor will collect all the test papers and check it manually. After checking the
test papers, the instructor will manually record the scores into their class records. When
everything is done, the instructors will release the results to the students for them to know their
scores. This proves that the step-by-step process done by instructors consume too much time
26
when done manually.
27
Problems in the Existing Processes of Examinations in Pangasinan State University
In order to identify the problems of the existing processes of examinations within the
campus of Pangasinan State University, the researches utilized a yes or no questionnaire for the
instructors.
The main purpose in distinguishing the problems in administering an examination is to help
the researches know the users' needs in terms of functional and non-functional requirements
through implementing the application to meet the needs and wants of the instructors within the
campus. Thus, the application satisfies the user requirements needed and improve the way how
instructors administer examinations with ease.
Table 4.
Results of the Yes or No questionnaire from Appendix C for instructors.
YES NO
Statement
Do the students pay for

15 75.0% 5 25.0%
their test paper/s?
Do you check the test

16 80.0% 4 20.0%
paper/s yourself?
Do you check the answers

on the test paper right 7 35.0% 13 65.0%
away?
28
Do you consume a lot of

time in checking the paper? 16 80.0% 4 20.0%
Are you lacking the time to

check the test papers? 15 75.0% 5 25.0%
Are the answers of the

16 80.0% 4 20.0%
students readable?
Are the given examinations

20 100% 0 0
based on the lesson?
Are you trying to teach

again the lesson when the 12 60.0% 8 40.0%
student gets low score?
Do you feel anxious when

reading the answers of the 4 20.0% 16 80.0%
students?
TOTAL 121 67.2% 59 32.8%
Table 4 shows that 80% of the instructors check the examinations themselves and that
the three major problems in administering an examination manually depicted that:
a.) 80.0% of the instructors answered that checking the test papers manually consumes too much
of their time.
b.) 65.0% of the instructors answered that they do not check the test papers right away.
c.) 75.0% of the instructors answered that they lacked the time to check the test papers.
29
Concerning the three major problems, a) instructors who check the examinations
themselves have too many test papers to manually check. This results in the instructors either
consuming too much time or letting the students check the test paper after the examination, b)
35% of these instructors do not check the examination right away. This is due to the busy
schedules of most instructors because of that, the checking of test papers are not always their top
priority. This leads to delayed results. c) Instructors who do not check the examination
themselves lack the time to check the test papers this is due to numerous reasons such as
personal affairs or busy schedules. This leads to instructors instructing their students to check the
papers themselves, which is prone to the students changing their initial answers to the right
answers or incorrectly checking the examination.
30
Functional Requirements and Non-Functional Requirements of the Online Examination
with Item Analysis System
After the analysis of the existing process in manual examinations, the researchers came up with
the functional requirements for the Online Examination with Item Analysis.
Table 5.1
Functional requirements of the Online Examination with Item Analysis rated by the students
Indicator Frequency Descriptive Rank

Count Equivalent
Users must log in with a username and password in order 201 90.13% 2
to use the system
Every examination has a timer as you answer it. 159 71.30% 5
Taking a picture before every quiz and examination as a 178 79.82% 4

security feature.
Automated calculating of scores. 208 93.27% 1
Generate required reports. 195 87.44% 3
31
Table 5.2
Functional requirements of the Online Examination with Item Analysis rated by the faculty
members
Indicator Frequency Descriptive Rank

Count Equivalent
User must log in with a username and password in order 20 100.00% 1
to use the system.
It will let instructors create exams and provide answer 20 100.00% 1

keys.
The system can analyse scores and generate a reports. 20 100.00% 1
Display the record of the students 20 100.00% 1
It can store and display the information of the students 9 45.00% 2
Back-up and restoring data 20 100.00% 1
Table 5.1 shows the functional requirements for the students. As portrayed by the table,
the first feature with the percentage of 90.13% was chosen by the majority of the students
because majority of students wanted their accounts to be secure. The second feature with the
percentage of 71.30% shows that a large portion of the students want to have a timer on their
examinations. The third feature with the percentage of 79.82% is shows again that students want
to secure their accounts. The forth feature on the table is automated calculating of scores with a
percentage of 93.27% and is rank 1 for students, this is due to the avoidance of the hassle of
32
checking papers manually and conserving time. The fifth feature with a percentage of 87.44%
shows that most students agree that this feature is needed within the system.
Table 5.2 depicts the results from the instructors. The first, second, third, fourth and sixth
indicators all have a descriptive equivalent of 100%. Showing that the instructors prefer to have
those functional requirements to make the process of administering examinations easy for the
instructors. While the fifth indicator, received a descriptive equivalent of 45.00% and is the least
important functional requirement for the instructors.
33
Developed Online Examination with Item Analysis System
The researchers developed the Online Examination with Item Analysis System
using the Scrum Methodology.
Scrum Phases:
a) Initiate Phase
The researchers conducted interviews and survey questionnaires in order to identify and
assess the existing process of administering examinations by instructors from Pangasinan State
University together with the problems they usually encounter. A backlog was created by the
researchers to list all the features and requirements to be developed.
34
Table 6
Product Backlog of the Online Examination with Item Analysis System
Backlog Item Estimated
(Days)
Login (Server Side) 4
User (Client Side) 4
Add, Edit, Delete Student Data (Server Side) 7
Display user performance (Client Side) 8
Add, Edit, Delete Subject Data (Server Side) 4
Edit user profile (Client Side) 4
Add, Edit, Delete Section Data (Server Side) 4
Electronic Answer Sheet/Automated Result Checking (Client Side) 16
Verify examinee/ class section(Server Side) 8
User Notification (Client Side) 6
test management (Server Side) 6
Log out (Client Side) 3
Modify Questionnaire/ Answer key (Server Side) 8
Generate Report (Server Side) 14
Url Connection (Server Side) 4
Total 100
Table 6 shows the product backlog, which specifies all the requirements and features of the
application to be developed.
35
b) Plan and Estimate Phase
During this phase, the researchers created spring backlogs to organize the backlog items
that will be developed in every sprint within the entire system development. The content of the
sprint backlog is a list of product backlogs along with the estimated days to finish each task.
Table 7
Sprint Planning of the development team
Estimated
Sprint Backlog Item Task
(Days)
Design UI 1
Login Coding 2
Debugging/Testing 1
Sprint 1
Design UI 1
User Profile Coding 2
Debugging/Testing 1
Design UI 3
Add, Edit, Delete Student
Coding 3
Data
Sprint 2 Debugging/Testing 1
Design UI 1
Display user performance
Coding 6
36
Debugging/Testing 1
Design UI 1
Add, Edit, Delete Subject
Coding 2
Data
Debugging/Testing 1
Sprint 3
Design UI 1
Edit user profile Coding 2
Debugging/Testing 1
Design UI 1
Add, Edit, Delete Section
Coding 2
Data
Debugging/Testing 1
Sprint 4
Design UI 2
Electronic Answer
Sheet/Automated Result Coding 8
Checking
Debugging/Testing 6
Design UI 2
Verify examinee/ Class
Coding 4
section
Debugging/Testing 2
Sprint 5
Design UI 1
User Notification Coding 4
Debugging/Testing 1
Design UI 1
Test Management Coding 4

Sprint 6
Debugging/Testing 1
Log out Design UI 1
37
Coding 1
Debugging/Testing 1
Design UI 1
Modify Questionnaire/
Sprint 7 Coding 6
Answer key
Debugging/Testing 1
Design UI 1
Sprint 8 Generate Report Coding 12
Debugging/Testing 1
Design UI 1
Sprint 9 URL Connection Coding 2
Debugging/Testing 1
Total 100
Sprint Planning of the development team
Table 7 shows the identified requirements and sub features from the product backlog which will
be accomplished within a sprint period of one hundred days. In implementing the sprint plan, the
development team will meet every week. The review will be done where the full implementation
of the sprint plan in order to review the planned activities for the whole duration of the current
sprint.
c) Implement Phase
The researchers accomplished this phase by conforming to the sprint plan via actual
coding of the application using development tools Notepad++ as Integrated Development
Environments for the server and client applications respectively. Apache web server was used to
38
support the back-end of the system's server. The working software was examined and integrated
with all of the necessary changes in order to achieve the expected quality.
d) Review and Retrospect Phase
The researchers reviewed the prototype in this phase. The following plates and screen shots
from the Online Examination with Item Analysis System for Pangasinan State University were
included in order to show the functionalities of the system.
Plate 1. Admin Login Page
This is the login page of the Online Examination System. To access the system, the admin must
input the following administrator login credential:
Username: admin
39
Password: admin
Note: The username and password is case-sensitive so the user must enter them as it is.
Plate 2. Home Page (Admin Record Maintenance)
After a success log-in, the user will see the home page of the Online Examination System. In
here, the admin can select the main functionalities of the web application such as:
1) Record Management - for adding, editing, deleting and viewing of users.
2) Academic year - for adding, editing, deleting and viewing the academic year of the school.
3) Activity log – for knowing the activity log who connected to the system.
4) Logout – for exiting the Online Examination System if the admin is done using it
40
Plate 3. Academic Year Maintenance
Plate 4. Activity Log
41
Plate 5. Student Login Page
This is the login page of the Student Portal. To access the portal, they need to input their student
id and password.
Plate 6. Home Page
After a success log-in, the student will see their performance based on the result of the test. In
here, the user can see their performance, recent test and upcoming test.
42
43
Plate 7. TAKING PICTURE
In order to show this. The student need to click the “TAKE EXAM”.
Plate 8. TAKING EXAM
In
order to take the exam, the student’s need to click the take exam to show their answer sheet and
questionnaire.
44
This after clicking the “TAKE EXAM” button this will appear.
Note: in order to less the cheating of the student we add a feature that can lock the test form of
student.
This alert will show if the wants to cheat. The student’s need to call their instructor in order to
unlock it.
45
If the student done. The system shows the total result test of the student.
Plate 9. Instructor Login Page
This is the login page of the Instructor Portal. To access the portal, they need to input their I.D
and password.
46
Plate 10. Instructor Home Page
After a success log-in, the instructor will see the home page of the record management portal. In
here, the user can see the main functionalities of the web application such as:
1) Student - for adding, editing and viewing of profile.
2) Subject - for adding, editing, deleting, and archiving of subject.
3) Section - for adding, editing, deleting, and viewing of subject.
4) Unlock form – for unlocking the student form.
5) View record – for viewing the record and managing the test.
6) Create test – for creating a test.
7) Record maintenance – for viewing the main functionalities.
8) Logout – for exiting the record management portal if the user is done using it.
47
Plate 11. Student Information
The student information functionality can ADD, IMPORT and STUDENT FORM FILE.
1. ADD – for adding a student
2. IMPORT - for importing the student list.
3. STUDENT FORM – a excel file that use in importing a student list.
Plate 12. Subject Information
The subject information functionality can ADD, EDIT, DELETE and ARCHIVE subject.
48
Plate 13. Section Information
The section information functionality can ADD, EDIT AND DELETE section data.
Plate 14. Unlock Form
There are two mode of unlocking form, Scan QR CODE and Unlock using Form.
49
Plate 15.1 SCAN QR CODE
This form will show if the instructor chooses SCAN QR CODE.
Plate 15.2. UNLOCK USING FORM
50
This form will show if the instructor chooses UNLOCK USING FORM.
Plate 16. VIEW RECORD
In this form the instructor can see the record information. In order to view the record of a subject,
the user need to click the “VIEW” label in the left of subject name.
Plate 17. RECORD DETAILS
51
After clicking the view, the record of the subject will show.
Plate 18. TEST MAINTENANCE
This is the data show if the user’s click the “VIEW” that will see in the left of test name. that
contains Status, Test Details and Reports.
1. STATUS – this function show if the test is currently online or offline.
2. TEST DETAILS – this function show the details of the test.
3. REPORTS – for generating a reports of student test result.
52
Plate 19. TEST DETAILS
This Form is sample of test details. The details you can see is the passing rate, time, student
answer sheet and questionnaire.
Plate 20. REPORTS
This is the sample reports. The reports can you see here:
53
Sample. This will show if the instructor “CLICK” the name of student. It contains result, the
student answer, answer key and the remarks.
54
Plate 21. CLASS LIST
This form can show if the instructor click the “CLASS LIST” in the left of subject name. The
functionality that can show here is REMOVE, SELECT, IMPORT AND REMOVE CLASS
LIST.
Plate 22. CREATE TEST
In order to create a test, the instructor need to set a SUBJECT, UPLOAD, SET DETAILS and
OVERVIEW.
First. The user’s need to select a subject.
55
Second. The user’s need to select a question file which is save as pdf file.
Third. The user’s need to set the details of the questionnaire like Type of Test, passing rate and
set time.
56
Last. If the user’s completely done it will show the overview before processing the test.
Usability of Online Examination with Item Analysis for Pangasinan State University
The respondents were given survey questionnaires to measure the usability of the
developed system, the researchers used a survey questionnaire which is based on SUMI to
obtain the respondent's responses if the required specifications are met and in order for the
developer to find out if there are any additional functionalities that may improve the system. The
usability of the developed system was evaluated in terms of: (a) Efficiency (b) Affect (c)
Helpfulness (d) Control and (e) Learnability.
57
Table 8.1
Result of the survey questionnaire in Appendix E
EFFICIENCY 1 2 3 4 5 MEAN
1. This system inputs data fast and accurate. 0 6 46 112 59 4.00
2. The system responds appropriately. 3 2 6 121 91 4.32
3. This system computes the result accurately. 0 0 2 39 182 4.81
4. The system checks the questions correctly. 0 0 0 38 185 4.85
5. The system is a great help to my work. 3 21 64 74 61 3.75
6. The system is not slow. 12 15 82 56 58 3.79
7. The system analyses the items correctly. 0 13 29 122 59 4.01
8. The system shows the result immediately. 0 0 0 41 182 4.82
AFFECT
1. I like using this system. 0 0 108 78 37 3.68
2. It is user-friendly and interactive. 0 0 71 112 40 3.86
3. Working with this system is satisfying. 1 0 123 43 56 3.69
4. The pages in this system is very attractive. 0 0 64 62 97 4.15
5. I would like to use this system every time take an 0 0 13 187 23 4.04
examination.
6. I would recommend this system to other students 1 0 115 68 39 3.65
and instructors.
7. Using this system is not frustrating. 0 1 56 9 67 4.04
8. The system helped me overcome any problems I 0 0 106 40 77 4.17

have had.
HELPFULNESS
58
1. The instruction and prompts are helpful. 0 0 113 68 42 3.68
Using this system is a not waste of time. 0 0 114 97 12 3.54
2. I find that the help information presented is clear 0 0 15 173 35 4.09

and understandable.
3. There is enough information in the screen when it’s 0 0 119 83 21 3.56
needed.
The system helps me find what I am looking for. 0 0 100 53 70 3.87
This system did not give me a headache on 0 0 92 110 21 3.68

occasion.
4. Error prevention messages are adequate. 0 0 26 107 90 4.29
The system doesn’t have any annoying features. 0 0 44 132 47 4.01
CONTROL
1. This system didn’t stop unexpectedly on different 0 0 52 112 59 4.03

conditions.
2. There are familiar commands or operation to do a 0 0 100 93 30 3.67
task.
3. If the system stops, it`s easy to restart. 0 0 81 126 16 3.71
4. I feel in control when I’m using this system. 0 0 53 122 48 3.98
5. I can understand and act on the information 0 0 58 104 61 4.01

provided by the system.
Answering the questions can be performed in 0 0 61 99 63 4.01
straightforward manner using this system.
6. I can easily navigate this system. 0 0 106 48 69 3.83
7. It is easy to learn to use all that is offered in this 0 0 117 19 87 3.87

system.
LEARNABILITY
1. Learning this software initially is easy. 0 0 75 91 57 3.92
59
2. It is easy to learn the system menus and functions. 0 3 108 52 60 3.76
Remembering where I am on this system is easy. 0 12 59 108 44 3.82
This system doesn’t need more introductory 2 3 87 52 79 3.91

explanations before you use it.
3. Doesn’t need a tutorial to familiarize yourself to 0 0 94 80 49 3.80
the system.
4. It displays the menus and buttons quite logical for 0 0 102 66 55 3.79
me.
5. The software allows the user to be economical of 0 7 75 85 66 3.85
keystroke.
6. Learning how to use this new system is very easy. 3 2 84 71 63 3.85
7. TOTAL 18 57 229 603 822 4.29
As shown in Table 8.1, the usability testing results for the developed application in terms
of efficiency is interpreted as fast in terms of input and speed with the mean of 4.29. This proves
that the application is fast, efficient, and simple to use. In terms affect, the application scored a
mean of 3.91 from the respondents. The results indicate that the application has good effects
when used by user and is user friendly. In terms helpfulness, the application received a mean of
3.82. This results also show that the developed system is very responsive and beneficial towards
the intended user. Next, the application scored a mean of 3.93 in terms of control. This indicates
that the application allows the user to control or command the application and operations are
placed properly. Lastly, the application received a mean of 3.84 in terms of learnability. This
means that the organization of the menus or information lists is logical. Likewise, the result
implies accuracy of the application in terms of learnability and learning to operate is initially
easy for the user.

60
Collecting all the means from the table and calculating the average, the application scored
a grand mean of 3.95. According to the Likert Scale in Table 8.2, the grand mean indicates that
the application is usable and meets the requirements of the end users.
Table 8.2
Likert Scale
Numerical Statistical Range Descriptive Descriptive
Equivalent Equivalent Rating Interpretation
5 4.30-5.00 Very Strongly Agree Usable
4 3.50-4.29 Strongly Agree Usable
3 2.50-3.49 Agree Usable
2 1.70-2.49 Disagree Not Usable
1 1.00-1.69 Strongly Disagree Not Usable
The responses ranging from 1.00 to 2.49 were interpreted as not usable while those
responses ranging from 2.50 and above were interpreted as usable. (Claveria et al., 2017)
61
CHAPTER 5
SUMMARY, CONCLUSION, AND RECOMMENDATIONS
This chapter contains the summary, conclusions and recommendations acquired based
from the study as well as the features of the developed system.
SUMMARY
PSU Urdaneta city Campus is one of the nine campuses of Pangasinan State University
across the province of the Pangasinan. This campus is the subject of the study.
This study’s main objective is to make the process of examination administering and item
analysis become easier and time efficient than the current manual process. This study aimed to
determine the status of existing processes of administering/taking examinations in PSU in terms
of efficiency, affect, helpfulness, control and learnability; to determine the functional and non-
functional requirements of administering examinations in Pangasinan State University; Develop a
fully-functional online examination system for Pangasinan State University using Scrum
methodology;
The researchers gathered information about how the university administers examinations through
surveys and also interviews for both the students and instructors in the university in order to
identify the constraints of the existing manual process of administering/taking examinations.
Through the surveys and questionnaires administered, the researchers found out that PSU
Urdaneta Campus must have a system that will benefit both students and instructors for taking
and administering examinations in the campus. In regards to this, the researchers developed a
62
“Online Examination System with Item Analysis” for the University using Scrum methodology.
In order examine the usability of the system, the researchers created a survey questionnaire based
on Software Usability Measurement Inventory (SUMI) focusing on: a) efficiency, b) affect, c)
helpfulness, d) control, and e) learnability to test the application’s usability was used. The result
of the survey showed that the system is usable and will be beneficial for the campus to have.
CONCLUSION
Based on the information gathered throughout the data gathering and analysis
phase, the researchers have noticed that there was a need for improvement of the existing process
of examinations in Pangasinan State University, and therefore, the researchers made the following
conclusions:
1. In line with the first statement of objectives of IT profiling, the researcher discovered that
most of the instructors have adequate knowledge in using mobile technology such cellular
phones and laptops. Both the instructors and students have adequate hardware resources for
the use of the developed system. Finally, the campus overall has adequate network
connectivity.
2. The manual process of administering examinations implemented within the campus has
proven to be problematic. Such problems are unnecessary time consumption when checking,
unreadable handwriting of the students, and delayed distribution of results.
63
3. Scrum methodology is proven to be effective and efficient software development
methodology for building similar applications because it uses sprints that deliver the
application with lesser amount of time.
4. The developed system is usable in terms of efficiency, affect, helpfulness, control and
learnability as shown in the results of the usability testing.
RECOMMENDATIONS
The following are highly recommended to resolve the problems of the instructors and
students upon the use of the existing processes of the campus in knowledge in using mobile
devices, network connectivity, and hardware and software resources:
1) The campus administration may consider conducting lectures and seminars to improve the
knowledge of the instructors in terms of mobile technology to fully utilize the developed
system.
2) The campus administration may also consider adding more network connections within the
campus that are open for the students.
3) The identified problems within the existing process will be solved through the use of the
Online Examination with Item Analysis System.
4) Scrum Software Methodology is highly recommended for developing similar applications.
64
5) The implementation of the developed system is recommended by the researchers since it has
been proven by the usability testing to be usable in terms of efficiency, affect, helpfulness,
control, and learnab ility.
65
Bibliography
A. Unpublished Books
Paragas, et.al (2012). ”Automated Admission System for PSU Urdaneta”. Pangasinan State
University, Urdaneta City
B. Websites/Electronic Sources
Assessment | Definition Assessment (n. d.) Retrieved April 16, 2017 from
http://www.merriam-webster.com/dictionary/assessment
Ayo, et.al (2007). ). Computer Based Test (Cbt) System for University Retrieved
February 19, 2017 from http//:www.ijstr.org
Balasaheb, J. S. et.al, (2014). “Web Based College Admission System” Retrieved
May 21, 2017 from https://www.ijedr.org/papers/IJEDR1501061.pdf
Brown, W.J (January 27, 2014). How IT Can Support Student Recruitment (and
Why It Should) Retrieved May 21, 2017 from https://er.educause.edu/articles/2014/1/
how-it-can-support-student-recruitment-and-why-t-should
Collins, W. et.al, (2012).British Dictionary definitions for Internet Retrieved May 21,
2017 from http://www.dictionary.com/browse/internet?s=t
Fagbola, et.al, (August 8, 2013). Computer Based Test (Cbt) System for University
Academic Enterprise examination Retrieved March 16, 2017 from
http://www.ijstr.org/final-print/aug 2013/Computer- based-Test-Cbt-System-
ForUniversity-Academic-Enterprise-Examination.pdf
Geddes C. (November 17, 2014).Advantages of Online Admissions for International
Schools Retrieved May 21, 2017 from https://www.infosnap.com/about/blog/
advantages -online-admissions-international-schools/
Gurendo, D. (June 10, 2015).Software Development Life Cycle (SDLC).Scum model step-
by-step Retrieved March 20, 2017 from https://xbsoftware.com/blog/softwar
e-development-life-cycle-sdlc-scrum-step-step/
Harcourt H.M. (2016). Admission - definition of admission by The Free Dictionary
Retrieved May 21, 2017 from http://www.thefreedictionary.com/admission
66
Herold, B. (February 5, 2016). Technology in Education: An overview Retrieved

February 19, 2017 from http://www.edweek.org/ew/issues/technology-
ineducation/
Javin, P. (2016).Difference Between Functional and Non-functional Requirements in
Software Development Retrieved May 25, 2017 from http://javarevisited .blogsp
ot.kr/2015/01/difference-between-functional-and-nonfunctional-requirements-soft
ware-development.html
Maclaughlin, M. (2017). What is Scrum Development? Retrieved May 25, 2017 from
http://www.selectbs.com/process-maturity/what-is-scrum-development
Northrop, B. (November 20, 2011). Usability Testing on Agile Projects retrieved May 21,
2017 from http://www.summa.com/blog/2011/11/20/usability-testing-on -agile-
projects-part-1
Random House Inc. (2017).Technology | Define Technology Retrieved May 21, 2017
from http://www.dictionary.com/browse/technology?s=t
Rouse, M. (2016).IT automation Retrieved February 19, 2017 from
http://searchitoperations.techtarget.com/definition/ITautomation
Seetaram, (September 11, 2017).Fundamental Concept of Test Automation Retrieved
February 19, 2017 from http://selftechy.com/2011/09/17/fundamental-conceptsof-
test-automation
Shin (2010). Comparability of Computerized Adaptive and Paper-Pencil Tests Retrieved
February 19, 2017 from http://dx.doi.org/10.7575/aiac.ijels.v.2n.4p.36
The importance of assessment in education (n. d.) Retrieved March 22, 2017 from
http://www.study.com/-academy/lesson/-the-importance-ofass-essment-in-education-
.html
University of the Philippines Admission Requirements (n. d.) Retrieved March 16, 2017
from http://www.up.edu.ph/admissions/
Valentino J. (September 8, 2016). Automating the admissions process for colleges and
universities Retrieved May 21, 2017 from http://www.incontextmag.com/articles
/2016/ automating-the-admissions-process-for-colleges-and-universities.html
67
What is Automation?-ISA (n. d.) Retrieved February 19, 2017 from

http://www.isa.org/about-isa/what-is-automation/
What is technology? Definition and meaning (n. d.) Retrieved February 19, 2017 from
http://ww.businessdictionary.com/definition /technology.html
What is The Internet (n. d.) Retrieved February 17, 2017 from
http://www.internetsociety.org/internet/what-internet
Yannakoudakis, H. (2013) “Automated assessment of English-learner writing” Retrieved
February 19, 2017 from http://www.cl.cam.ac.uk/techreports/UCAM-C-TR842.html
68

CH 1 5 Online Examination System With Item Anaysis

Загружено:

Сведения о документе

Оригинальное название

Авторское право

Доступные форматы

Поделиться этим документом

Поделиться или встроить документ

Параметры публикации

Этот документ был вам полезен?

Это неприемлемый материал?

Авторское право:

Доступные форматы

CH 1 5 Online Examination System With Item Anaysis

Загружено:

Авторское право:

Доступные форматы

CHAPTER 1

Background of the Study

organization nowadays conducts their objective examinations by online examination system.

reports for evaluation.

An examination is a formal test or approach to measuring a person’s knowledge. The problem

environment as the current system wastes a lot of paper.

the computation of their student grades.

system are item checking and item analysis.

Item analysis is a process of examining class-wide performance on individual test items

that are difficult for them to understand.

Record management also known as records and information management, is an

organizational function devoted to the management of information in an organization throughout

identifying, classifying, storing, securing, retrieving, tracking, and destroying or permanently

mobile devices, instructors will be able to establish good management of records.

See Figure 1. For the research paradigm.

INPUT PROCESS OUTPUT

analysis for schools and universities. Specifically, it is aimed to:

1. Identify the present IT profile of the campus in terms of:

a.) Knowledge in using mobile technology

b.) Hardware Resources

c.) Network connectivity

2. Determine the existing processes and problems of administering examinations implemented

within the campus.

3. Identify the functional and non-functional requirements of the application.

5. Test the usability of the developed application in terms of :

Scope and Delimitation

was designed for PSU Urdaneta Campus.

identification card, password and taking a picture every examination.

Importance of the Study

The University. The university is an educational institution of undergraduate and

connected to the internet.

Software Usability Measurement Inventory. It this study, it can be defined as a likert-type

provides an automated examination through a network connected computer or mobile device.

change in requirements, even late in a project.

REVIEW OF RELATED LITERATURE

the development of the proposed application.

Existing Processes used in Manual Examination

recording the student's papers is very tedious and very time-consuming.

System Development using Scrum Methodology

Usability Testing of the Proposed Application

Usability is a measurable characteristic that is present to a greater or lesser degree, that

a product is to learn and how easy it is to use(Axup,2014).

According to Arvind Rongala (2015), usability testing is an essential technique to evaluate

used a system and what they think about it.

Shin (2010) conducted a study entitled "Comparability of Computerized Adaptive and

comparison of a paper pencil examination and computer-based test/examination. The researchers

release of results, examination malpractices, cost implication of printing examination materials

with Item Analysis for Pangasinan State University’s Urdaneta Campus.

existing ones as well as students participating in the examinations.

Personal Digital Assistant (PDA's)or mobile devices.

examination results automatically excluding the grade.

Population and Locale of the Study

Table 1. Respondents of the Study

Respondents No. of Respondents Objective

Faculty 20 For Objective 1 & 2

Students of Bachelor of Secondary 45 For Objective 1 & 4

Students of B.S. Information Tech. 138 For Objective 1 & 4

Students of B.S. Mathematics 40 For Objective 1 & 4

an overall knowledge of the faculty.

the proposed system.

copy of the questionnaire)

specific objectives of the study:

problems. (see appendix C).