Академический Документы
Профессиональный Документы
Культура Документы
Ministry of Finance
Government of Mongolia
Ulaanbaatar, Mongolia
July 2008
1
Glocom Inc. (USA) Expert on Strategic Planning, ADB Capacity Building Project for
Governance Reforms, Ministry of Finance, Government of Mongolia. Earlier, Dr.
Tarun Das worked as Economic Adviser, Ministry of Finance and Planning
Commission, Government of India and Professor (Public Policy), Institute for
Integrated Learning in Management (IILM), New Delhi, India.
Table of Contents
PART-4 215-310
Acknowledgements 218-219
Annexes 272-310
PART-1 1-70
Contents 2
Acknowledgements 3
Project Team 4
PART-2 71-158
Chapter-2: Strategic Business Planning 73-100
1.
Chapter-3: Output Costing and Output Budgeting 101-115
PART-3 158-214
Chapter-6: Financial Planning 160-191
Acknowledgements
Subsequently, the term of ADB Project was extended until the end of
December 2008 and the term of the international consultant was extended
for two months in intermittent basis during April 2008 to October 2008. As
per the work plan approved by Mr. Bazarsuren Batjargal, Director General,
Fiscal Policy and Coordination Department of the Ministry of Finance, the
international Strategic Planning Expert completed his first term during 22
April to 21 May 2008 and second term during 9 June 2008 to 8 July 2008.
This Part of the Terminal Report (Part-4) summarizes the outputs and
recommendations of the International Strategic Planning Expert during his
last term for two person months.
This final report and the previous background reports have been produced
with the help of many people. I would like to thank everyone who has given
time in meetings and discussions and in the provision of basic data and
information.
suggestions and constructive comments and providing all possible help for
the preparation of my reports. He also co-authored many of our reports.
The Reports would not have been possible without the active participation
and help by a wide range of stakeholders in the Line Ministries. I would like
to express my sincere thanks to numerous officers, national and international
consultants in the line ministries, particularly the Ministry of Finance (MOF),
Ministry of Education, Culture and Science (MOECS), Ministry of Health
(MOH), Ministry of Justice and Internal Affairs (MOJIA), Ministry of Road,
Transport and Tourism (MORTT) and the Ministry of the Social Welfare and
Labour (MOSWL) for their enthusiastic cooperation, keen interest, useful
discussions and for providing all relevant information and documents,
sometimes at a very short notice.
It is needless to mention that the authors are solely responsible for the views
expressed in the paper and for any errors and omissions.
Tarun Das ,
International Strategic Planning Expert
Ulaanbaatar, Mongolia
The 7th July 2008.
Project Team
Aimag – province – Mongolia is divided into 21 Aimags and the Ulaanbaatar capital city
Soum or District – county – Aimags are divided into 3-27 Soums (Total 331 Soums)
District – The capital city (Ulaanbaatar) is divided into 9 districts
Bags – the smallest administrative units (19-121) of Aimags (Total 1543 bags)
Khoroos – the smallest administrative unit in the capital city (Total 121 Khoroos)
Administrative System- comprises Local Representative Meeting in the capital city/ Aimags, and
Soums/ Districts; and Citizen’s meeting in the Bags/ Khoroos.
A. Terminal Reports
22. PPP on Output Costing and Output Budgeting: Part-1: Current Status
and Action Plan, pp.1-39, for the Workshop held at the Corporate Hotel
on 29-30 Nov 2007.
24. PPP on Output Costing and Output Budgeting: Part-3: Output Costing
Framework, pp.1-42, presented at the Workshop held at the Corporate
Hotel on 29-30 Nov 2007.
26. PPP on Output Costing and Output Budgeting: Part-4B: Case Studies,
pp.1-24, presented at the Workshop held at the Corporate Hotel on
29-30 November 2007.
41. Accrual Accounting Rules for the Govt Finance Statistics, pp.1-36,
February 2008.
42. Glossary for Accrual Accounting and GFS, and Glossary for Financial
Statistics, pp.1-38, February 2008.
46. Benchmarks Setting and Best Practices for Output Costing and Output
Budgeting- Part-1: Basic Concepts, pp.1-31, Dec 2007.
47. Benchmarks Setting and Best Practices for Output Costing and Output
Budgeting- Part-2: Practical Applications for Mongolia, pp.1-36,
December 2007.
58. Program Assessment Rating Tool- Methodology and Application for Mongolia,
pp.1-50, ADB Capacity Building Projects on Governance R Reforms,
Ministry of Finance, Government of Mongolia, Ulaanbaatar, July 2008.
61. A Balance Sheet for the Mongolia Development Fund for the years
2007-2008 (pp.1-5), June 2007.
69. ADB Project and World Bank ECTAC Project Coordination Plan, pp.1-3,
August 2007.
78. Roll Out Plan for the ADB Project on Capacity Building on Governance
Reforms, pp.1-3, December 2007.
86. Monthly Progress Report for June 2007, pp.1-2, June 2007.
87. Monthly Progress Report for July 2007, pp.1-2, July 2007.
88. Monthly Progress Report for Aug 2007, pp.1-2, August 2007.
89. Monthly Progress Report for Sept 2007, pp.1-2, September 2007.
90. Quarterly Progress Report for July-Sep 2007, pp.1-3, Sep 2007.
91. Monthly Progress Report for Oct 2007, pp.1-2, Oct 2007.
92. Monthly Progress Report for Nov 2007, pp.1-2, Nov 2007.
93. Monthly Progress Report for Dec 2007, pp.1-2, Dec 2007.
94. Monthly Progress Report for Jan 2008, pp.1-2, Jan 2008.
95. Monthly Progress Report for Feb 2008, pp.1-2, Feb 2008.
96. Monthly Progress Report for Mar 2008, pp.1-2, Mar 2008.
97. Terminal Progress Report- Compliance Report on the ADB Terms of
Reference for the Strategic Planning Expert, pp.1-9, March 2008.
98. Monthly Progress Report for April-May 2008, pp.1-2, May 2008.
99. Monthly Progress Report for June-July 2008, pp.1-2, July 2008.
100. Terminal Progress Report- Compliance report on the ADB TOR for the
Strategic Planning Expert- An Update, pp.1-10, July 2008.
Chapter-9
Broadly speaking, ADB Project has been highly successful and major
tasks have been fulfilled. The International and National Consultants on
Strategic Planning under the ADB Project have already prepared detailed
Manuals and Guidelines in both English and Mongolian on Strategic Planning,
Output Budgeting, Accrual Accounting, Benchmarks Setting, Ex-ante Financial
Planning, Performance Evaluation and Program Assessment Rating Tool (PART)
for the budgetary bodies.
Significant progress has been made for improving the technical capabilities of the
staff engaged in budget formulation, strengthening Information Technology (IT)
system and creating general awareness of all stakeholders about the usefulness
and necessity of modern techniques for budgeting on the basis of accrual
accounting, benchmarks and performance parameters.
Medium Term Strategic Plans (2008-2010) have been prepared for selected line
ministries. Program Budgeting has been introduced in the 2008 budget in four
pilot line ministries viz. Ministry of Health (MOH), Ministry of Education, Culture
and Science (MOECS), Ministry of Social Welfare and Labour (MOSWL) and
Ministry of Food and Agriculture (MOFA) as a prelude to the ultimate adoption of
performance based accrual output budgeting (AOB). They have also provided
necessary training for upgrading skill of the budget personnel.
3. Unfinished Agenda
Despite these efforts and good results during the last few years, there is still
unfinished Agenda as regards the following:
(1) Line ministries are yet to prepare fully the Performance Based
Accrual Output Budgeting (PBAOB) which is required under the
PSMFA (2002). World Bank ECTAC Project Team has produced
Program Budgets for the MOH, MOECS, MOSWL and MOFA for
the budget year 2008. But, Program Budgeting is only a first
step towards the Accrual Output Budgeting2.
(2) Most of the budgetary entities including the Aimags are yet to
prepare Strategic Business Plans and move towards Accrual
Output Budgeting due to constraints on financial resources,
technical man power and supporting ICT system.
2
This aspect is explained in details in my Comments on the IMF TA Mission Team, June 2008, reproduced
in Annex- in this Report.
Ministry of Finance taking the lead role. The details of the Action Plan are
explained in Annex-1.
In order to reap the full benefits and to bring the ADB Capacity Building Project to
its logical conclusion, it is strongly recommended that the ADB Capacity
Building Project on Governance Reforms needs to be extended for 12
months until the end of December 2009 to accomplish the following tasks:
3. To align and integrate fully the output budgeting and accrual accounting
methodology with the IT systems for budgeting and accounting;
The completion of the above mentioned tasks will require engagement of the
following experts during January to December 2009:
Chapter-10
“Would you tell me please, which way I ought to go from here?” asked Alice.
“That depends a great deal on where you want to get to,” said the cat.
“I don’t much care where ….,” said Alice.
“Then it does not matter which way you go,” said the cat.
(i) Budget transparency is the key issue. In Australia, for example, there
is a requirement for three-year forward estimates and for reporting of
budgetary versus actual budgetary allocations for the previous year. Under
the Public Sector Management and Finance Act (PSMFA, 27 June 2002)
government of Mongolia has also adopted the same requirement 3.
3
Articles 26.1, 26.2 and 26.3 of the Public Sector Management and Finance Act (PSMFA, 27 June 2002).
4
Articles 26.1, 26.2 and 26.3 of the Public Sector Management and Finance Act (PSMFA, 27 June 2002).
Performance Monitoring
Track the progress, expenditure, and value for
money for achieving outcomes.
This assessment allows an agency to take a detailed look at their current business
activities and how they wanted to perform in the budget review year. Agencies will be
asked to provide a brief description 6 of their Strategic Business Plan with vision, mission,
objectives and goals. They will also be asked to provide summary of their program
budgets, which is being reviewed, with budgeted resources, outputs and outcomes.
Agencies will be required to provide details of workforce size, their functions and skills,
workload volume and contributions to the strategic planning. Template-1 attached to
this chapter provides detailed Template for Review of Baseline Scenario and
Budget Profile.
Strategic Review:
How well an Agency manages its external environment by delivering
relevant and effective services.
Operational Review:
How well an Agency manages its internal environment by using its
resources efficiently and prudently.
5
Annex-1 of this chapter provides the detailed Template for Review of Baseline Scenario, Strategic Plan
and Budget Profile.
6
Agencies are not supposed to hand over the original copies of the Strategic Business Plan (SBP) and
Budget document which they had earlier supplied to the MOF. They are required to make a summary of the
SBP and budgeted programs.
Both desktop and field scans are required to determine the following aspects:
whether best practice techniques were attempted;
whether the practice was documented; and
Whether it was widely applied within the agency.
The desktop scan involves checking the existing material on strategic plans
and program/ output budgets already submitted by the Agency to the
Ministry of Finance, whereas field scans involve conducting surveys and
interviewing key stakeholders (clients, community groups, staff and
management), to obtain their views on how internal management tools are
working in practice.
There are 8 possible strategic review areas and 8 operational review areas as
indicated in Table-2.
For each of these 16 areas, it is necessary to test whether the agency has
applied any typical best practice management techniques. For example,
when examining “Clients”, agencies would be asked whether they have
applied any of the following types of management practices e.g. client needs
analysis, client segmentation, clients’ satisfaction surveys, grievances and
complaints handling and so on. When examining “Controls and Cost and
Asset Management”, agencies would be asked if they use the following
practices e.g. financial information system, management information system,
asset management plan and corporate overhead costs analysis, etc.
Template-2 attached to this chapter provides a detailed Template for
Strategic & Operational Evaluation
3 Systematic approach has been implemented in some areas and results are
under examination.
4 Approach has been implemented in some areas and results/outcomes have
been used to improve the planning and budgeting.
5 Approach used in most of the areas and results/outcomes have been used
to improve the planning and budgeting.
Then a “Borda Index” (i.e. sum of all ranks for all factors) can be estimated. This will
provide a composite index for rating performance of agencies. There are 32 (=16X2)
sub-areas. So a maximum 160 marks can be scored by an Agency. Total score can
be expressed as a percentage of 160 marks. Percentage can also be calculated
separately for strategic performance and operational performance. Then, total marks
for each category can be expressed as a percentage of 80 marks. It is most unlikely
that an Agency will be able to score 100% marks. On the basis of percentage of
marks, the strategic performance or operational performance, or the combined
strategic and operational performance of an Agency could be rated as follows:
Under efficiency evaluation, budgeted outputs are compared with actual outputs, and
the following marks are assigned to each program.
0 If actual output falls short of budgeted output by more than 10 per cent.
1 If actual output falls short of budgeted output by more than 7.5 per cent
but less than 10 per cent.
2 If actual output falls short of budgeted output by more than 5 per cent but
less than 7.5 per cent.
3 If actual output falls short of budgeted output by more than 2.5 per cent
but less than 5 per cent.
4 If actual output falls short of budgeted output by less than 2.5 per cent.
2 If actual outcome falls short of budgeted outcome by more than 5 per cent but
less than 7.5 per cent.
3 If actual outcome falls short of budgeted outcome by more than 2.5 per cent
but less than 5 per cent.
4 If actual outcome falls short of budgeted outcome by less than 2.5%.
5 If actual outcome is at least equal to the budgeted outcome.
After assigning marks for all sub-programs, actual marks obtained for all programs of
an Agency will be expressed as a percentage of total possible marks. The following
Box indicates the calculation of marks for an agency for compliance and efficiency
evaluation.
Template-3 attached to this chapter (for details see the main report on Budget
Performance Evaluation Methodology and Systems prepared by Tarun Das in May
2008) provides the templates for the compliance and efficiency evaluation for the
program budget of the Ministry of Education, Culture and science (MoECS) for the
budget year 2008. However, it may be noted here that MOECS Program budget has
confused between outputs and outcomes8. In the MOECS Program budget,
immediate results of the Programs are called “outcomes”. But, these are, in fact,
“outputs” of the program, and not “outcomes”.
To reiterate the exact definitions, outputs are the immediate or end results of a
project, whereas outcomes are the long term impact of the project on the society
after the completion of the project. For example, literacy rate is an outcome, number
of students is an output and number of teachers is an input. So, I have replaced
outcomes by outputs in the Template. While preparing the next Program
Budget, the line ministries and the World Bank ECTAC Team may please
keep this distinction in mind.
8
For definitions of inputs, outputs and outcomes, consult Tarun Das and E.
Sandagdorj (2007a). Also consult the Budgets of the Australian Government for any
Portfolio.
(1) Strategic Plan and Baseline Profile Evaluation- Annex-1 provides 20 basic
questions each carrying 5 marks. Total marks obtained will be expresses as a
percentage which will be the score for strategic plan evaluation.
For overall assessment a weight of 30 per cent will be given for strategic plan and
baseline evaluation (Annex-1), a weight of 20 percent will be given for strategic and
operational performance evaluation (Annex-2) and 50 per cent will be given for
budget compliance and effectiveness evaluation.
Translating Performance Scores into Ratings: Finally, the overall performance scores will be
converted into qualitative ratings using the scoring bands given in the following table:
There will be another category called “Results Not Demonstrated” when an Agency
does not have performance measures that have been agreed by MOF either for
baselines or for the assessment year.
1. Department of Fiscal Policy and Co- 2. Pilot Line Ministries/ Agencies are
ordination (DFP&C) of the MOF prepares selected by MOF for BPE by the 5th May.
detailed guidelines and manual on Budget
Performance Evaluation (BPE), and
circulates the Document (along with
Annexes) among line ministries/ Agencies
3. Pilot Line Ministries/ Agencies prepare
after approval by the Cabinet Committee
replies and assign marks to the Templates
no later than the 30th April.
given in Annex-1 to annex-3 and submits the
draft reply to the DFP&C (by 1st July 2008).
9. Budget Performance Evaluation 8. The State Great Hural shall debate and
Report (BPER) published, publicly approve the State Budget no later than the
released and put on government website 1st of December.
no latter than 15 December.
10. MOF and line ministries/ Agencies 11. DFP&C of the MOF revise the
conduct multi-stakeholders feedback Manual and Guidelines for Budget
seminars on the Report by 31 January. Performance Evaluation no latter than
the 31st March.
Selected References
Das, Tarun and E. Sandagdorj (2007b) Output Costing and Output Budgeting-
Basic Concepts and Methodology, pp.1-51, ADB Capacity Building Project on
Governance Reforms, Ministry of Finance, Mongolia, Ulaanbaatar, October 2007.
Das, Tarun and E. Sandagdorj (2007e) Benchmarks Setting and Best Practices
for Output Costing and Output Budgeting- Part-1: Basic Concepts, pp.1-31, ADB
Capacity Building Project on Governance Reforms, Ministry of Finance, Mongolia,
Ulaanbaatar, Dec 2007.
Das, Tarun and E. Sandagdorj (2007f) Benchmarks Setting and Best Practices
for Output Costing and Output Budgeting- Part-2: Practical Applications for Mongolia,
pp.1-36, ADB Capacity Building Project on Governance Reforms, Ministry of Finance,
Mongolia, Ulaanbaatar, Dec 2007.
Hatry, Harry P. (1977) How Effective are your Community Services?, The Urban
Institute, Washington, D.C.
Meyers, Roy T. (1996) Is There a Key to the Normative Budgeting Lock, The World
Bank, Washington, D.C.
Schick, Allen (1995) Federal Budget: Politics, Policy and Process, Brookings
Institution.
Steiner, George; Simon and Schuster (1997) Strategic Planning: What Every
Manager Must Know.
USA (1993) Government Performance and Results Act (GPRA) of 1993, Office of Management
and Budget (OMB).
Template -1
Location _______________________________________________
1. Do you have a Strategic Business Plan for your Agency? If Yes, answer the
following questions. Answers should be brief and to the point. It may be noted
that each question carries 5 marks and answers will be evaluated by the
Ministry of Finance.
Q1. Which is the period of your latest SBP? Does the SBP contain all the
components of a standard SBP as recommended by the MOF viz. Minister’s
Foreword, GM’s Statement? Vision, Mission, Values, Priorities, Clients, Strategic
Goals and Objectives, SWOT Analysis, Strategic Outcomes. Outputs, Processes and
Activities, Medium Term Budget estimate, Organisational Structure, System for
Monitoring and Evaluation? If some components are missing, indicate those
components and give reasons for not developing those components.
Q2. Does any of the Millennium Development Goals (MDGs) concern your Agency?
If yes, indicate the MDGs which relate to your Agency. Have you considered these
MDGs and suggested measures to achieve those goals in your Strategic Business
Plan? If yes, give details.
Q3. Does your Agency have a Master Plan? If yes, for which period? Have you
linked SBP to the Master Plan? Give a brief account of these linkages.
Q4. Indicate briefly Vision, Mission, Values, Priorities, Strategic Goals and
Objectives.
Q5. Reproduce the SWOT Table from the Agency’s SBP, if you have one.
Q6. Who are your clients? Is the Client base growing, shrinking or stable? Do they
need differentiated products, services, locations and quality? Are there significant
groups of potential clients who are not currently being reached? If yes, why? How
do you add value for clients and how can you serve them better?
Q8. Provide a list of the broad output groups indicated in your SBP. If the total
number exceeds 25, list the most important 25 outputs or output groups.
Q9. How well do your current information and communications technology (ICT)
systems assist in meeting your mission and long term goals? How is your Agency
developing and strengthening the ICT and the skills and capabilities of the
workforce to meet these needs? Are there any critical management issues which
also need to be addressed?
Q10. List and rank the highest priority strategic initiatives and operational priorities
required for the success of your Agency. Identify any new proposals, anticipated
outputs and link them to your strategic plans.
Q11. Does your Agency have a system for continual monitoring and annual
evaluation of performance parameters recognized in your SBP and Annual Budget?
Are the annual Performance Evaluation Reports used consistently to justify funding
requests, management actions and legislative proposals? If yes, describe the
evaluation system and illustrate your reply on the basis of latest budget.
Q12. Do your senior agency managers meet at least quarterly to examine reports on
financial and performance information for all outputs/ programs of the Agency?
(Evaluation: 5 marks if meetings held at least once in a quarter, 3 marks if
meetings held at least once in six months, 2 marks if meeting held at least once in
a year, 0 marks if no such review meeting is held in a year).
Q13. Does your Agency have well designed plans to improve program performance
and efficiency each year? If yes, provide evidence.
Q14. Does the latest Annual Budget and performance documents incorporate
performance measures identified in the SBP and Master Plan? If yes, provide
evidence.
Q15. Does your Agency have a proper costing methodology? Does the methodology
report the full cost of all outputs accurately in the budget and performance
documents? If yes, describe the methodology.
As in Part-1 and Part-2, each question carries 5 marks and replies will be
evaluated by the MOF.
Q16. Do you have Performance Evaluation Reports at least for the middle level and
senior level officers? Are these Evaluation Reports used for placements, promotions
and training for officers? Are these Reports also used to direct program
improvements and hold managers accountable for those improvements? Provide
evidence for your answer.
Q18. Has your Agency analyzed the existing organizational structure from service
and cost perspectives and is implementing a plan to effectively develop, train,
deploy, restructure, recruit and retain employees? If yes, provide a brief account of
the plan.
Q19. Does your Agency used competitive sourcing, E-Gov solutions, as necessary;
and has processes to address future changes in business needs?
Q20. Does your Agency have succession strategies, including structured leadership
and talent pool development programs, and is able to close leadership competency
gaps?
9
Grades are determined as per the following Table:
Rating of AgencyRange of Performance Scores
(in percentage)Effective (EF)85 – 100Moderately Effective (ME)70 – 84Adequate
(AD)50 – 69Ineffective (IN)0 - 49
Template -2
On the basis of factual information, rank the following activities of your Agency on a
scale of 0 to 5. The rankings must be based on the following score card.
10
Grades are determined as per the following Table:
Rating of AgencyRange of Performance Scores
(in percentage)Effective (EF)85 – 100Moderately Effective (ME)70 – 84Adequate
(AD)50 – 69Ineffective (IN)0 - 49
11
the Agency?
14.2 Does the Agency have a definite plan for
ICT upgradation?
15. Controls and 15.1 Does the Agency have computerized
metrics government finance information system for
accounting and auditing?
15.2 Does the Agency have general
management information system (MIS)?
16. Expenditure and 16.1 Does the Agency have a definite plan
asset management and program for asset management?
16.2 Does the Agency conduct regular
analysis for management of agency
overheads?
Grading of Agency for Operational Performance Evaluation
Overall grading:
17. If the grade is ineffective, analyze reasons for that and suggest
measures for improvement?
Template -3
Here we present an example from the Program Budget for the Ministry of
Education, Culture and Science for the budget year 2008. However, it may
be noted here that MOECS Program budget has confused between outputs
and outcomes12. Immediate results of the Programs are called “outcomes”.
But, these are, in fact, “outputs” of the program, and not “outcomes”.
To reiterate the exact definitions, outputs are the immediate or end results of a
project, whereas outcomes are the long term impact of the project on the society
after the completion of the project. For example, literacy rate is an outcome, number
of students is an output and number of teachers is an input. So, I have replaced
outcomes by outputs in this Template. While preparing the next Program
Budget, the line ministries and the World Bank ECTAC Team may please
keep this distinction in mind.
Actual
Program/ Output Budgeted Performance Marks
Number of children to be
covered : 96901
Number of children to be
covered: 1239
12
For definitions of inputs, outputs and outcomes, consult Tarun Das and E.
Sandagdorj (2007a).
education: 7.4%
Annex-4:
For overall assessment, a weight of 30 per cent will be given for strategic plan and
baseline evaluation (Annex-1), a weight of 20 percent will be given for strategic and
operational performance evaluation (Annex-2) and 50 per cent will be given for
budget compliance and effectiveness evaluation.
Chapter-11
Program Budgeting and
Program Assessment Rating Tool (PART)
The traditional input budgeting is in fact the proverbial "black box" of annual
spending, where funds are allocated by traditional line-item budgets to
agencies, but it does not indicate what the money actually achieves. Thus
under line-item budgeting, while the budget and audit officers know what
inputs are being purchased, they have no knowledge of what activities are
being performed for what purposes, and ultimately what outputs or outcomes
are being purchased. A common first step for many countries towards
opening the black box of spending is to adopt a program classification of
spending, and introduce program budgeting. Program Budget seeks to
manage fiscal resources more effectively by identifying and prioritizing
institutional goals and providing funds towards those programs which best
support these goals and objectives.
Budgetary allocations for the separate output groups are not binding.
Instead, parliamentary appropriations for departmental outputs are ‘global’,
just as they were under the former program budgeting regime 15. In other
words, parliament approves for each department one aggregate sum to cover
all the outputs for which the department is responsible, but has the flexibility
to reallocate funds between outputs during the year in response to
unanticipated events and as per legal requirements for accounting and
auditing.
Although AOB has its roots in program budgeting, it differs from the program
budgeting in many respects. First of all, it incorporates private business and
competitive market environment in government activities to ensure
efficiency. Essentially, it builds a market-type superstructure upon program
budgeting foundations (WAT 1996a). In this respect, it differs considerably
from the forms of performance budgeting which operate in other countries
and do not generally regard agency profit results as a key performance
measure. To take an example, in the USA under the system of ‘performance
based program budgeting’ the annual budget for each agency passed by the
legislature includes only output and outcome targets, but no prices. The
United Kingdom has developed since 1998 a system of Public Service
Agreements and Service Delivery Agreements between the Government and
agencies linked to the budget. In Australia, New South Wales is the only
state not to have adopted accrual output budgeting.
13
Output groups under Accrual Output Budgeting in Australia are defined in such a way that they
more truly reflect the concept of an output than that under the program budgeting practice. For
example, departments are not permitted to use ‘corporate services’ as an output group, although
corporate services programs were common under program budgeting.
14
The Commonwealth refers to ‘Outcomes’ rather than output groups, meaning the same thing.
15
The Commonwealth submits appropriations to Parliament in a form grouped into ‘outcomes’.
However, this allocation is not binding, and is purely for information (DOFA, 1998; 1999c).
So-called ‘capital charging’ has also been introduced by most of the states in
the Australian AOB system. Capital charging is a private-sector idea to
include it as a part of the output cost to reflect return on capital. Its first
application to the public sector appears to have been by the British National
Health Service (NHS). New Zealand subsequently extended capital charging
to the whole budget sector. The idea is that, in addition to depreciation, a
type of ‘interest’ charge is levied upon departments for the use of the capital,
particularly in physical assets. The rate of the capital charge is supposed to
reflect the opportunity cost of capital provided to Departments, and it is
expected that that the Agencies to which the government provides capital
should earn at least a ‘normal’ rate of return. Proponents of capital charging
argue that it would reduce wasteful capital expenditure and encourage the
identification and sale of idle and surplus assets.
The above analysis suggests that the ‘market’ principle of funding based on
output prices can only be selectively applied in the public sector. In addition
to the distinctive ‘market’ aspects of AOB, the system has led to a renewed
effort to improve and extend performance measures and indicators.
Considerable work is being undertaken in the Australia, Canada, New
Zealand, UK and USA to articulate the linkages between outputs and
outcomes, and strategy. Moreover, it has been associated with a major drive
to shift public sector accounting in Australia onto an accrual basis: a step
16
The Commonwealth differs from the states in that it provides loans to the departments as well
as equity injections (DOFA 1998; 1999c).
which arguably has many benefits in other areas, including fiscal policy
(Robinson, 2002).
8. Program budget also acts as a tool for granting greater autonomy and
responsibility consistent with transparency and accountability.
17
For definitions, relative merits and demerits of these different models, see the main report on An
Introduction to Program Budgeting, Program Assessment Rating Tool (PART) and Program Evaluation
Review Technique (PERT) prepared by Tarun Das in May 2008.
(a) May create confusion if programs are not properly defined or there are
too many programs or some programs overlap.
(b) Program management and implementation may be difficult if it is not
supported by proper infrastructure.
“Which program did we mean in program budgeting? 18” This was the question
raised in 1954 by David Novick, the most influential proponent of program
budgeting during the post-World War II period. More than half a century
later, the same question can still be asked, because there is neither clear-cut
definition of a program budget nor general consensus on what it does. Novick
was perplexed by various applications of the program concept. He cautioned
that: “The word program can be used by different people to mean different
things such as an administrative organization, the performance of a specific
function, a combination of activities, a combination of functions, or any
endless number of combinations of activities, organizations and functions”
(David Novick 1954). In other words, a program is whatever is labeled a
program, and a program budget is any budget that is so designated.
Structure of
Levels An Example
Program Budget
Ministry Of Education, Culture and
Level-1 Ministry
Science (MOECS)
Level-2 Function Education
(a) Financial budget (in terms of staff
(a) Cost estimates;
cost, goods and services, capital cost,
Level-6 (b) Performance
subsidies and transfers);
parameters
(b) Number of children to be covered.
Function Mission
Performance
Program Indicators
Objective
AccountFund Resource
Allocation
Activity Strategic
Priority
Object
In this report, we present a modified version of the PART system of the USA
Federal Government, which can be applied to evaluate the programs of the
government of Mongolia. In the USA the system was introduced in July 2002,
when the Director of the Office of Management and Budget announced
development of a rating tool, called PART, for formally evaluating the
effectiveness of federal programs.
The PART sets a very high standard for compliance for each question. The
burden of proof for a Yes answer lies on the Agency to show that the
program has fully met the evidentiary requirements in order to award a Yes.
Points are awarded to a program based on the answer to each question, and
an overall rating of effectiveness is then estimated by using the following
weights.
weight: 20%
I. Program Purpose & Design
weight: 10%
II. Strategic Planning
weight: 20%
III. Program Management
weight: 50%
IV. Program Results/Accountability
Rating Range
(a) Effective 85 – 100
(b) Moderately Effective 70 – 84
(c) Adequate 50 – 69
(d) Ineffective 0 – 49
PERT chart is basically a detailed action and business plan to turn budgeted
program into actual results. Business action plans are an essential part for an
effective program implementation and ensures that the budgeted outputs are
actually produced. It involves two stages:
In addition to the suggestion given by IMF, priority action on the part of the
government of Mongolia is required on the following implementation issues
for successful implementation of program budgeting in Mongolia:
(a) Line ministry staff, not consultants, must undertake the work
Programs must be owned by the ministries. This implies that the line
ministry management and staff, and not consultants, must take the lead for
classification and development of programs, although the advice and
guidance of the consultants will be valuable.
This implies that a country should not simply import a program classification
from another country and try to adopt it.
Program budgeting will lead to demands for new data and information,
improved IT and skilled manpower for tracking performance results. Agencies
and MOF must be prepared to spend more money for strengthening their IT
system and recruiting more technical manpower.
One failure in the past had been that centrally developed program structures
are imposed upon many ministries and local governments. As a result, no
one agency is responsible for achieving program objectives and no one
manager is accountable for results. This undermines managerial
accountability and effective linkages among objectives, activities and funds.
This does not mean that one must adopt output budgeting or full accrual
accounting or activity-based-costing. It simply means that a program budget
must reflect at least all direct costs such as staff, materials, utilities and
other services.
(c) A program should integrate recurrent and capital budgets.
Selected References
Eden, Holger van; Regis Chapman; Dick Emery and Justin Tyson
(2008) Mongolia-Budget Preparation: A Roadmap for Reform and
Institutional Strengthening, IMF Technical Assistance Mission Team, Fiscal
Affairs Department, IMF, Washington D.C., February 2008
Annex-1
1. Background
1.1 Tasks envisaged under PSMFA (June 2002)
It is well known that the Government of Mongolia enacted the Public Sector
Management and Finance Act (PSMFA) on the 27 June 2002 in order to
modernize budget planning and budgeting systems as per international best
practices. The complete implementation of the provisions of the Act requires the
following activities on the part of the government:
19
International Strategic Planning Expert.
20
National Strategic Planning Expert.
21
Articles 26.1, 26.2 and 26.3 of the Public Sector Management and Finance Act (27
June 2002).
22
Article 23 of the PSMFA.
23
Article 9 of the PSMFA.
24
Article 37 of the PSMFA.
MOF, Govt. of Mongolia 275 Glocoms Inc. (USA)
ADB Project Terminal Report- Part-4 by Tarun Das
(7) The Act also specifies systems for the Assessment of Performance
Agreement27 .
Despite these efforts and good results during the last five years, progress
towards full implementation of the PSMFA remains slow due to some structural
problems. Assessments made by the IMF and ADB experts have indicated the
following constraints:
25
Article 25 of the PSFMA.
26
Article 18 of the PSMFA.
27
Article 47 of the PSFMA.
MOF, Govt. of Mongolia 276 Glocoms Inc. (USA)
ADB Project Terminal Report- Part-4 by Tarun Das
(b) The issues and activities involved in budget modernization are complex,
but the international experiences for transition from the classical budget
techniques to the modern framework were not studied carefully and in a
timely manner.
(e) In a way, the Act was passed in a hurry without assessing the capacities
and skill within the government for implementation of the Act and without
establishing the adequate institutional set up to support the process of
implementation. In fact, the Act has not provided an implementation plan.
(f) The Act is also over-ambitious for a developing country like Mongolia.
The Act contains all the components of Budget Modernization, which in
fact at present are being implemented by only the most advanced
countries like Australia, Canada, New Zealand, UK, USA 28 and selected
OECD countries. Even these countries (having much higher per capita
income, advanced information technology and skilled manpower) have
taken more than two decades to reach to this stage. Such a leap-frogging
may not be feasible for a developing country like Mongolia.
28
In the USA, there is an elaborate system and well established infrastructure to prepare strategic
plans, budgets and to evaluate budget performance. The Office of Performance Budge ting and
Strategic Planning is the focal point of Treasury's budget and performance integration efforts. The
Office oversees the USA President's Management Agenda and provides guidance to the Bureaus (i.e.
Agencies) on policy issues. There is also a separate Department on Strategic Plan in the Treasury
which prepares and implements medium term Strategic Plan for the Fiscal Years 2007 – 2012. It
indicates goals, objectives and strategies for the diverse activities under the strategic plan. There is also
an Office of Management and Budget (OMB) in the USA Congress to assist the USA President in
overseeing the preparation of the federal budget and to supervise its administration in Executive
Branch agencies. As compared to this, the institutional set up in Mongolia is constrained due to lack of
resources and technical manpower. At present, most of the substantial works are being carried out by
the international and national consultants under the capacity building projects being funded by the
Asian Development Bank and the World Bank. There is need to establish permanent internal units in
each ministry to deal with all these aspects of budget modernization.
On the basis of the above observations and conclusions, an eight year Action
Program for the period of 2008-2015 has been prepared by the government.
This is described in the Flow Chart-1 and Table-1 indicating desired actions by
all budgetary bodies in a phased manner during 2008-2015. This Action
Program will enable the budgetary bodies to complete implementation of the
Public Sector Management and Finance Law and, particularly, in endorsements
of the main law provisions such as formulation of strategic business plan,
determination of outputs and outcomes in public entities, and budgeting on the
basis of output costing, benchmarks and accrual accounting.
While framing this action program the following issues have been considered:
All the budgetary bodies including agencies and Aimags are directed to study the
flow chart carefully and to take note of the following tasks:
2. During the first phase the line ministries and other budgetary bodies
will prepare strategic business plans consistent with national plan,
sectoral master plan, millennium development goals as per advice
and directives by the MOF. They also prepare output budgets on the
basis modified accrual accounting and provide advice and guidance
to the agencies under their jurisdiction for preparation of strategic
business plans and output budgets.
29
Modified Accrual Accounting also called cash-plus-accrual accounting means
preparing budgets basically on cash accounting but using accrual accounting wherever
possible such as for government’s contributions to employees’ insurance, social security,
reserve fund, natural calamity and contingent liability funds. Depreciation costs for
assets may not be considered until all assets (both financial and non-financial) have been
fully listed and assessed at market prices.
30
Under performance based budgeting, outputs, outcomes, costs, planning and execution
of projects, physical and financial performances of the line ministries/ agencies of the
previous year are tracked and evaluated by the MOF as per prescribed performance
parameters, and budget for the next year is determined on the basis of this performance.
MOF also provides suggestions for improvement of performance parameters.
MOF, Govt. of Mongolia 279 Glocoms Inc. (USA)
ADB Project Terminal Report- Part-4 by Tarun Das
Upgrade IT and
technical manpower Capacity building in line ministries/ agencies to
to support output provide support for the preparation of SBPs and
Donors budgeting output budgets on the basis of performance
management and modified accrual accounting.
public service delivery functions in As per the World Bank Quarterly Report
education and health portfolios. on Mongolia dated the 28th February 2008,
“The recent passage of the Anti-
Corruption legislation, the implementation
of the Asset and Income Declaration
requirements for senior Government
officials and Parliamentarians, and the
adoption of the Extractive Industries
Transparency Initiative (EITI) is a
commendable step by the Government in
the right direction. Much remains to be
done, and the current Government has
also stated its intention to continue to
strengthen its public sector governance
capacity and implement the anticorruption
law effectively, and promote transparency
in Government-business interactions.”
In addition to the above mentioned reports, the following Non-TOR reports have been
prepared by the International Consultant.
57. A Balance Sheet for the Mongolia Development Fund for 2007-2008 (pp.1-5).
58. A Report on the National Workshop on Bond Market, organised jointly by UN-
ESCAP, ADB and Bank of Mongolia (BOM) at the Corporate Hotel, Ulaanbaatar
during 21-22 June 2007 (pp.1-4).
64. Comments on the report of the IMF Mission on Government Finance Statistics
(GFS) and Migration to GFSM 2001, pp.1-5.
67. Mongolia Seven-Year Capacity Building Action Plan for 2008-2014, pp.1-6,
January 2008.
68. Providing substantial help to the IT Expert Group for model description and
methodology, test, calibration, evaluation and selection of appropriate software
for output costing (December 2007-January 2008). Following report has been
prepared as a business guideline for choice of software.
69. Output Costing Methodology for Software Selection- Basic Concepts and Some
Advices for Selection, pp.1-9, December 2007.
70. Comparative Evaluation of the Australian ABC-FOCUS Software and the local
Mongolian ALOCOUS Software for Output Costing, pp.1-17, January 2008.
72. ADB Project Policy Matrix Compliance Report, pp.1-7, March 2008.07.04
73. Comments on the IMF Technical Assistance Mission Report on the Mongolian
Budget, pp.1-20, June 2008.
75. International Consultant Tarun Das prepared two lecture notes for UN-SIAP,
Chiba, Japan, as indicated below. Lecture notes were partly based on reports
of the ADB project (such as those on Government Finance Statistics, Cash
Accounting and Accrual Accounting).
77. Lecture Notes on Official Economic Statistics- Part-2 on Monetary and Financial
statistics (MFS) and Multi–Factor Productivity Measures (MFP), and Workout
Sessions, pp.1-62.
Reports 79 and 80 were circulated to Mr. Batjargal, Ms. Enkhtuul and E. Sandagdorj of
the MOF; Mr. Maurence and Mr. Tulga of Glocoms Inc. (USA); Ms. Pratibha Mehta,
Regional UNDP Director, Mongolia, Dr. Dilli Bhattarai, Chief Technical Adviser, and Ms.
Tsedev Erdenchimeg, National Project Manager, UNDP and Ministry of Finance,
Poverty, MDGs Monitoring and Assessment Systems Support, Ulaanbaatar.
Prepared by
Annex-3
Ministry of Finance
Government of Mongolia
ADB Capacity Building Project on Governance Reforms
Subject: Responses by Tarun Das, Strategic Planning Expert to the IMF Fiscal
Affairs Department Report on “ Mongolia-Budget Preparation: A Roadmap for
Reform and Institutional Strengthening” prepared by the Technical Assistance
Mission Team composed of Messrs. Holger van Eden (Head of the Team), Regis
Chapman, Dick Emery and Justin Tyson in February 2008.
A. General Response
First of all, I would like to congratulate the IMF Mission Team for producing an
excellent, comprehensive and well researched report on a Roadmap for Reform and
Institutional Strengthening for modernizing Budget preparation in Mongolia. It carries
the distinct quality stamp of IMF. I wonder how they do it, but they improve quality in
each of their reports. I think it reflects the intellectual versatility, natural talents and
incredible skills of the team members for research and report writing.
B. Specific Responses
1. I fully agree with the following recommendations of the IMF Mission Team:
(a) Reforming fiscal, planning and budgetary process will not be possible if Mongolia
does not choose to invest in new and strengthened institutions, and in well-trained
and remunerated staff in the financial management area.
(b) The mission would suggest that the MOF retains the core national and
international consultants of the World Bank ECTAC project to continue with
Program budgeting in other ministries. On the other hand, the ADB products on
output budgeting and accrual accounting represent far reaching reforms that
capture best practices, but are beyond Mongolia’s current capacity.
2. In fact, in our reports prepared during the project period, and also in the
terminal reports, we have made similar observations and recommendations.
4. It should also be recognized that the ultimate goal should be to introduce the
performance and accrual based output budgeting as per the requirements of
the Public Sector Management and Finance Act (PSMFA) passed on the 27
June 2002. For this we need gradual improvement in ICT and manpower skill and
progressive movement towards the goal. For this we have recommended Eight
Year Action Plan (2008-2015) for the government of Mongolia (Please see
Annex-1 for detailed plan).
6. It may be mentioned here that the starting point for most forms of
performance budgeting, including Accrual Output Budgeting (AOB), is
program budgeting, which was the standard public budgeting practice
throughout Australia in the 1980s prior to the adoption of AOB. AOB
incorporates most of the former program budgeting framework. The annual
government budget documents under AOB report the breakdown of funds
allocated to broad output groups within each Department, very much like the
former ‘programs’31. These output groups are groups of related outputs designed
to deliver the same outcome 32. Each broad output group comprise a number of
sub-output groups, like the former ‘sub-programs’.
31
Output groups under Accrual Output Budgeting in Australia are defined in such a way that they
more truly reflect the concept of an output than that under the program budgeting practice. For
example, departments are not permitted to use ‘corporate services’ as an output group, although
corporate services programs were common under program budgeting.
32
The Commonwealth refers to ‘Outcomes’ rather than output groups, meaning the same thing.
7. Budgetary allocations for the separate output groups are not binding. Instead,
parliamentary appropriations for departmental outputs are ‘global’, just as they
were under the former program budgeting regime 33. In other words, parliament
approves for each department one aggregate sum to cover all the outputs for
which the department is responsible, but has the flexibility to reallocate funds
between outputs during the year in response to unanticipated events and as per
legal requirements for accounting and auditing.
8. Although AOB has its roots in program budgeting, it differs from the program
budgeting in many respects. First of all, it incorporates private business and
competitive market environment in government activities to ensure efficiency.
Essentially, it builds a market-type superstructure upon program budgeting
foundations (WAT 199834). In this respect, it differs considerably from the forms
of performance budgeting which operate in other countries and do not generally
regard agency profit results as a key performance measure. To take an example, in
the USA under the system of ‘performance based program budgeting’ the annual
budget for each agency passed by the legislature includes only output and
outcome targets, but no prices. The United Kingdom has developed since 1998 a
system of Public Service Agreements and Service Delivery Agreements between
the Government and agencies linked to the budget. In Australia, New South
Wales is the only state not to have adopted accrual output budgeting.
33
The Commonwealth submits appropriations to Parliament in a form grouped into ‘outcomes’.
However, this allocation is not binding, and is purely for information (see Commonwealth Accrual
Budgeting Guidelines, 1999 and Accrual Appropriation Framework, 1999, Department of Finance
and Administration, Canberra).
34
WAT (Treasury, Western Australia) (1998) Output Based Management Output Measures -
Guidelines to Assist Agencies, The Treasury (Perth).
35
The Commonwealth differs from the states in that it provides loans to the departments as well
as equity injections (DOFA 1999).
36
Robinson, Marc (2007) edited. Performance Budgeting- Linking Funding and Results, Palgrave
McMillan.
10. So-called ‘capital charging’ has also been introduced by most of the states in the
Australian AOB system. Capital charging is a private-sector idea to include it as a
part of the output cost to reflect return on capital. Its first application to the public
sector appears to have been by the British National Health Service (NHS). New
Zealand subsequently extended capital charging to the whole budget sector. The
idea is that, in addition to depreciation, a type of ‘interest’ charge is levied upon
departments for the use of the capital, particularly in physical assets. The rate of
the capital charge is supposed to reflect the opportunity cost of capital provided to
Departments, and it is expected that that the Agencies to which the government
provides capital should earn at least a ‘normal’ rate of return. Proponents of
capital charging argue that it would reduce wasteful capital expenditure and
encourage the identification and sale of idle and surplus assets.
11. Clearly, in a budgeting system based upon output prices, it is logical to treat the
opportunity cost of capital as a component of cost in price-setting. Accordingly,
the State governments which impose capital charges treat it as an ‘above the line’
expense in operating statements. However, the Commonwealth Government takes
a different approach, treating the capital charge as a ‘below the line’ entry,
treating the capital charge equivalent of a profit dividend paid to shareholders.
12. The above analysis suggests that the ‘market’ principle of funding based on
output prices can only be selectively applied in the public sector. In addition to
the distinctive ‘market’ aspects of AOB, the system has led to a renewed effort to
improve and extend performance measures and indicators. Considerable work is
being undertaken in the Australia, Canada, New Zealand, UK and USA to
articulate the linkages between outputs and outcomes, and strategy. Moreover, it
has been associated with a major drive to shift public sector accounting in
Australia onto an accrual basis: a step which arguably has many benefits in other
areas, including fiscal policy (Robinson, 2000 and 200237).
37
Robinson, Marc (2000) ‘Contract Budgeting’, Public Administration, Vol. 78, No. 1, pp.75-90.
Robinson, Marc (2002) ‘Accrual Accounting and Australian Fiscal Policy’, Fiscal Studies.
ATTACHMENT-1
Recommendation-1: Page-6
38
Pages 16-17 in Das, Tarun and E. Sandagdorj (2007a) “Preparation of Strategic Business
Plans- General Guidelines, Suggestions for Improvement, and Summary of Recommendations”,
Final Report, pp.1-74, 30 Sept 2007.
Page-41: Analysis and recommendations I also agree with the observations of the
IMF Team on the methodologies and
“Our overall assessment of the ADB and guidelines on Output Costing and Output
World Bank projects is that while Budgeting, and Accrual Accounting and
conceptually sound they will need to be Accrual Budgeting developed by the ADB
phased in to meet the constraints of the Project Team comprising myself and E.
Mongolian budget establishment. The Sandagdorj. We had to prepare these
ADB products represent far reaching guidelines as per TOR approved by ADB
reforms that capture best practice, but are and also required under the sections 26.1,
beyond Mongolia’s current capacity. 26.2 and 26.3 of the Mongolia Public
39
Das, Tarun and E. Sandagdorj (2007b) Output Costing and Output Budgeting- Basic
Concepts and Methodology, pp.1-51, October 2007, and slide 1.2 of the Power Point
Presentation on Output Costing and Output Budgeting: Part-1: Current Status and Action
Plan, pp.1-39, at the Workshop held at the Corporate Hotel, Ulaanbaatar on 29-30 Nov 2007.
Indeed, only the most reform-minded Sector Management and Finance Act
countries, like New Zealand and Australia (PSMFA, 27 June 2002). However, while
come close to having systems with these formulating the Seven Year Action Plan 40
characteristics. Most OECD countries are for complete implementation of the
far from achieving these standards of PSMFA, we have observed that:
performance. The World Bank products in
contrast present a sound overall approach “The government of Mongolia has initiated
that needs to be simplified and phased in to measures to implement the PSMFA almost
fit current capacity constraints of immediately since its inception in June
Mongolia’s line ministries and the MOF.” 2002. Good progress has been made with
the introduction of Strategic Business Plans
in major line ministries; formulation of
Medium Term Fiscal and Budgetary
Framework, preparation of consolidated
financial statement for general government,
time bound execution of budget and
improved fiscal reporting on cash basis
with some steps towards accrual
accounting.”
40
Pages 1-2 in Das, Tarun and E. Sandagdorj (2007) “ Seven Year (2007-2013) Action
Plan to implement fully the provisions of the PSMFA (2002) as regards preparation of SBPs on
the basis of Performance Based Accrual Output Budgeting, pp.1-21, Nov 2007.
following reasons:
(1) The Act was passed in a hurry
without assessing the capacities and
skill within the government for
implementation of the Act and without
establishing the adequate institutional
set up to support the process of
implementation. In fact, the Act has
not provided an implementation plan.
42
Source: Adopted from Reinventing Government by David Osborne and Ted Gaebler, pp.1-427,
Addison-Wesley Publication Co., 1992.
Annex-4
(a) At the cognitive level, the course aims to impart, to the participants,
the current state-of-the-knowledge on program budgeting and budget
performance evaluation, so that it enhances their understanding and
ability to prepare program budgets and to monitor and evaluate
budget performance.
(b) At the attitudinal level, the course aims to increase sensitivity of the
participants about the impact of Millennium Development Goals,
governance reforms, poverty reduction and growth strategy on the
preparation of program budgets.
(c) At the skill level, the course aims to strengthen the participants’
leadership and capability for problem solving, team works and
communication skills and to make them aware of the principles and
values of modern planning, budgeting and systems management.
(d) Accordingly, the course encourages pro-active behavior and a
hands-on approach to both teaching and learning.
2 Learning Outcome
3 Pedagogy
Lunch 1245=1400
4
Module 4: An Example from the MOECS and Group
Discussions
4
Module 4: PART Questions and Instructions for Reply
and Time Schedules for PART Reply
Recommended Readings
2. Other References
Annex-5
Ministry of Finance
64. Mr. Jim Ramsey, International Consultant (IT development for budget
preparation)
65. Mr. David Lowey, International Consultant (IT development for
auditing and output costing)
66. Ms. Bolormaa, National Consultant
67. Mr. Oyunbaatar, National Consultant
68. Ms. Tsolmon, Functional Specialist, Citicom
69. Mr. Jugdernamjil, IT Expert, Citicom
70. Batdelger, Local consultant on software reviewing, MOF