Академический Документы
Профессиональный Документы
Культура Документы
December 2005
• Electronic copies of our audit reports can be viewed or downloaded from our website at
http://www.ola.state.md.us.
• Alternate formats may be requested through the Maryland Relay Service at 1-800-735-2258.
• The Department of Legislative Services – Office of the Executive Director, 90 State Circle,
Annapolis, Maryland 21401 can also assist you in obtaining copies of our reports and related
correspondence. The Department may be contacted by telephone at 410-946-5400 or 301-
970-5400.
December 29, 2005
We found that the caseworker and supervisor staffing levels included in the February
2005 DHR child welfare staffing report were unreliable. DHR did not consider all
pertinent factors affecting staffing, including the impact of all relevant industry staffing
standards. For example, by not considering leave usage in developing its staffing
standards, we estimated under one scenario that DHR understated its required
staffing level by 130 caseworkers and 26 supervisors statewide. Also, DHR did not
use the most current data available; however, because of certain data limitations, a
reliable determination of staffing levels was not possible.
During our review and testing of Child Protective Services (CPS) investigations, which
were limited to three specific local departments of social services (LDSS), we identified
a number of issues impacting the timeliness, adequacy and documentation of
investigations. For example, investigations of reported child abuse or neglect were not
always initiated or completed timely, and supervisors frequently did not document
their review and approval of decisions not to investigate allegations of abuse or
neglect. We also found inconsistencies between critical CPS data recorded in case
files and DHR’s automated records, casting doubts on the reliability of the record
keeping.
DHR’s automated system was not capable of tracking foster care case assignments to
help management ensure that cases were continually assigned to active employed
caseworkers. Although our testing of caseworker assignments to 111 foster care
cases active from January to June 2005 disclosed that during that period the cases
were assigned to valid DHR employees, case oversight was not consistent. We noted
at all three LDSS that documentation in the respective case file of required monthly
face-to-face meetings between the worker and the child was frequently lacking. Fifty-
four cases were noted where at least one month’s visit during the six month period
was not documented in the files. Some caseworkers acknowledged that monthly visits
did not always occur due to extended employee leave and unavailability of the child
during unscheduled visits. In some cases, telephone contact was made in lieu of face-
to-face meetings.
Our fourth objective dealt with testing the reliability of certain BCDSS foster care
performance results reported semi-annually by DHR in compliance with a consent
decree from a 1988 lawsuit. Our test of 20 of the 71 foster care results included in
the December 31, 2004 report disclosed that 8 results were reliable but 11 other
results were deemed to be unreliable and the remaining result was unauditable due to
a lack of documentation. Finally, we found that for a specific result we were requested
to review, dealing with the timely transfer of cases when caseworkers leave
employment or transfer, DHR did not track or report this information as required.
An executive summary of our results can be found on page 5 and our objectives, scope
and methodology of the audit are explained on page 7.
Respectfully submitted,
2
Table of Contents
Executive Summary 5
Background Information 11
Conclusion 17
Background 18
Finding 1 – February 18, 2005 Child Welfare Staffing Report 19
Was Not Reliable
Conclusion 23
Background 24
Finding 2 – Required Supervisory Review of Decisions to Not 26
Formally Investigate Allegations of Neglect and Abuse Was
Often Not Documented
Finding 3 – CPS Cases Were Sometimes Closed Without Making 28
Contact With the Alleged Victim
Finding 4 – Two Local Departments Did Not Comply With 28
Certain Processing and Documentation Requirements
Finding 5 – Investigations Were Often Not Initiated or 29
Completed Within the Legally Required Timeframes
Finding 6 – Evidence of CPS Investigation Results Being 31
Forwarded to State’s Attorney Offices Was Frequently Lacking
Finding 7 – CPS Data In the Client Information System Were Not 32
Always Accurate
Office of 3
Legislative
Audits
Finding 8 – Reasons for Decline in Continuing Services Cases 33
Were Not Adequately Assessed
Finding 9 - Reported Managing For Results Data On 34
Maltreatment Recurrence Might Be Overstated
Conclusion 37
Background 38
Finding 10 – The Automated System Did Not Have the 38
Capability to Identify the Historical Assignment of Caseworkers
Finding 11 – Case File Often Did Not Contain Documentation of 39
Required Monthly Contacts
Conclusion 43
Background 43
Finding 12 – Data Underlying Reported Measures Reviewed 46
Were Sometimes Found to Be Unreliable
Finding 13 – BCDSS Compliance With Timely Transfer of Foster 48
Care Cases Between Workers Was Not Reported
Exhibits
Exhibit A – Audit Request Letter From the President of the 51
Senate and the Speaker of the House of Delegates and
Follow-up Letter Granting Time Extension
Exhibit B – Child Welfare Staffing Report as of February 18, 55
2005
Exhibit C – OLA Recalculation of DHR’s February 2005 Staffing 57
Report
Exhibit D – Analysis of Questionable Allegations “Screened Out” 61
Exhibit E – Comparison of 31st, 32nd and 33rd 6-Month 63
Compliance Report Performance Measures (Baltimore City
Consent Decree)
Office of
4 Legislative
Audits
Executive Summary
At the request of the leadership of the Maryland General Assembly, the
Office of Legislative Audits has conducted a performance audit of various
child welfare issues. The audit had four stated objectives and the following
are summaries of the findings in those areas.
The results of our reviews and testing in this area disclosed a number of
problems impacting virtually every facet of Child Protective Services (CPS).
For example, we found that CPS investigations tested were often not
initiated or completed within the time frames required by State law, and
certain documents were not always completed during the investigation as
required. Problems were also found with the preliminary screening of the
allegation of neglect or abuse. Our tests disclosed numerous cases where
required supervisory review of decisions not to accept allegations of neglect
or abuse for formal investigation were not documented. For some cases, we
also found evidence that when efforts to contact the alleged victim were
impeded, the cases were closed without pursuing available legal means to
gain access. Finally, we found that critical CPS data recorded in the
automated DHR Client Information System (CIS) were not always complete
and accurate.
Office of
Legislative 5
Audits
Assignment of Foster Care Cases to Active Caseworkers
(see pages 37 through 41)
DHR’s automated system was not capable of tracking foster care case
assignments to help management ensure that cases were continually
assigned to active employed caseworkers. Therefore, we conducted
statistical samples at three local departments of social services (LDSS) to
determine, based on case file documentation and personnel records,
whether caseworkers for these particular cases were active DHR employees.
We found that all 111 cases tested (active during the period of January to
June 2005) were assigned to active caseworkers. However, caseworker
contact with the foster care children was inconsistent. In 54 cases there
was no documentation that required monthly visits occurred in each of the
six months tested. Missed or undocumented visits ranged from 26 cases
where one month was missed to 2 cases for which there was no
documented visit for the entire 6-month period. Although there is no way to
know if a visit actually occurred in these 54 cases, as compared to the
failure to document a visit, caseworkers did acknowledge to us that monthly
visits in fact do not always occur for a number of reasons. This situation has
now been commented upon in several of our previous audit reports starting
with the May 2002 Performance Audit Report on the Out-of-Home Care
Program.
Objectives
(1) the methodology used in preparing the February 18, 2005 DHR Child
Welfare Staffing table (as reported to the General Assembly) was
consistent with appropriate industry standards (for example, the Child
Welfare League of America or CWLA) and the reported staff-to-
caseload ratios were reliable.
(3) children in foster care were assigned to active case workers and that
case workers made monthly contact with children as required by
State law.
Office of
Legislative 7
Audits
Our audit objectives did not include other aspects of child welfare not
specifically requested (such as adoption services). In addition, since the
audit request specifically requested we evaluate Baltimore City, and Prince
George’s and Anne Arundel Counties, we did not include other local
departments of social services (LDSS) with respect to performing Objectives
2 and 3. Furthermore, our testing of compliance with the Consent Decree
(Objective 4) was necessarily limited to the Baltimore City Department of
Social Services (BCDSS).
Methodology
We used statistical sampling for certain tests to be able to project the results
to the entire population subject to testing. In each test, we tested the source
records (such as DHR’s automated Client Information System) to ensure that
the source was reliable for use in selecting test items. We found that we
could rely on the selected source(s) when selecting our test items. All
statistical sampling test results are projected based on a 95% level of
confidence.
Office of
8 Legislative
Audits
To test the accuracy of performance measures reported by DHR for
compliance with the Consent Decree, we selected certain measures
contained in the 33rd compliance report (distributed in February 2005, for
the 6-month period ending December 31, 2004) and obtained and tested
documentation supporting the reported performance. Specifically, we
interviewed DHR and BCDSS personnel, reviewed performance measure
calculations for reliability, and determined whether these calculations were
appropriate for the data being reported. We used sampling techniques or
other methods as deemed appropriate to test the related source documents.
We also analyzed BCDSS measurement data collection and reporting
activities to evaluate whether proper controls existed.
After our audit fieldwork started, we were requested by staff of the General
Assembly leadership to compile a summary of the results of the past three 6-
month compliance reports (the 31st, 32nd and 33rd). This information is
included in Exhibit E, and was not audited by us or subjected to any other
verification procedures, except as described in Objective 4 for the 33rd
request. Accordingly, the summary information is included for informational
purposes only, and we have drawn no conclusions on its accuracy or
reliability of the presented results.
Office of
Legislative 9
Audits
Office of
10 Legislative
Audits
Background Information
The Department of Human Resources’ Social Services Administration (SSA)
supervises child welfare social service programs provided through the 24
local departments of social services (LDSS). These programs include
services intended to prevent or remedy neglect, abuse or exploitation of
children, preserve, rehabilitate or reunite families and provide appropriate
placement and permanency services for children requiring out-of-home care
(such as foster care).
Over the past 20 years, the State and DHR have been parties to a lawsuit
regarding various aspects of the quality of care provided to foster children in
Baltimore City, which serves approximately 50% of the State’s foster care
caseload (L.J. v. Massinga). In 1988, the State entered into a Consent
Decree with a plaintiff to the lawsuit, which required DHR, in conjunction
with the Baltimore City Department of Social Services (BCDSS), to provide
certain services and functions. The Consent Decree has been modified over
time, but still maintains provisions related to care provided to foster children
in the City. To demonstrate compliance with the Decree, DHR files 6-month
compliance reports covering various aspects of services provided by BCDSS.
In addition, to the above noted lawsuit, there have been a number of reports
and studies concerning the quality of care provided to children requiring
services in the State. These include:
Office of
Legislative 11
Audits
• Department of Human Resources Social Services Administration Out-of-
Home Care Program performance audit report (May 2002) – issued by
the Office of Legislative Audits. This report included a number of
significant concerns about the delivery and monitoring of critical services
to the then 11,000 children in the State’s out-of-home care program,
administered by SSA and the local departments of social services.
Additional comments were included regarding the adequacy of DHR
resources devoted to the program.
• Citizen Review Board for Children Annual Report (2002 and 2003) –
indicated the need for stable funding and adequate human resources. It
also noted concerns regarding adequacy of investigations of child abuse
and neglect.
Caseload Standards
The General Assembly has statutorily mandated that DHR hire additional
child welfare caseworkers and supervisors in order to achieve the staff-to-
caseload ratios recommended by the CWLA. In fiscal year 2005, the
General Assembly restricted funds in the DHR budget unless certain position
targets were met. In February 2005, DHR reported that it was close to
achieving the recommended staffing levels, and subsequently $3.5 million in
restricted funds was released to DHR.
Office of
12 Legislative
Audits
Statistical Information
During the audit, DHR provided us with various statistical information. Table
1 provides fiscal year 2005 information for selected child welfare services
included in the scope of our audit.
Table 1
Selected Case Data for Fiscal Year 2005
Foster/Pre-
CPS Investigations Kinship Care
Adoptive Care
Local
June June June
Department FY 2005 FY 2005 FY 2005
2005 2005 2005
Average Average Average
Caseload Caseload Caseload
Other 21 Local
1,402 1,548.3 2,588 2,576.2 283 265
Department
Source: June 2005 DHR Monthly Management Report and CIS Data Extracts
Office of
Legislative 13
Audits
Chart 1
Average Monthly CPS Investigations Conducted
(Statewide)
Fiscal Year 2001 to 2005
2,800
2,726 2,741
2,700
2,629 2,625
2,600
2,520
2,500
2,400
2001 2002 2003 2004 2005
Fiscal Year
Chart 2
Average Number of Foster and Pre-Adoptive Care Cases
(Statewide)
Fiscal Year 2001 to 2005
10,500
10,177
9,999
10,000
9,682
9,500
9,132
9,000
8,795
8,500
8,000
2001 2002 2003 2004 2005
Fiscal Year
Office of
14 Legislative
Audits
Chart 3
Average Number of Kinship Care Cases
(Statewide)
Fiscal Year 2001 to 2005
2,500
2,221
1,910 1,803 1,823 1,900
2,000
1,500
1,000
500
0
2001 2002 2003 2004 2005
Fiscal Year
(Note: The average number of foster and pre-adoptive care cases reported
in Chart 2 for each year erroneously counts certain data. That is, CIS counts
certain cases twice when compiling the data for inclusion in the
Management Report. DHR personnel could not accurately restate the data
for those years. The number of cases in Table 1 accurately reflects the fiscal
year 2005 average case count. Chart 2 is included for trend comparative
purposes only.)
Office of
Legislative 15
Audits
Office of
16 Legislative
Audits
Findings and
Recommendations
Objective 1
Assessment of DHR Calculated Child Welfare
Staffing at February 18, 2005
Conclusion
Our first audit objective was to determine if the February 18, 2005 DHR
Child Welfare Staffing report was consistent with industry standards and if
the reported staff-to-caseload ratios were reliable. Our audit disclosed that
the February 18, 2005 DHR report on child welfare staffing was unreliable,
as it did not include a comprehensive consideration of all pertinent factors
affecting staffing, such as all relevant Child Welfare League of America
(CWLA) staffing standards and the most current data available. Although we
were unable to recalculate the actual staffing levels and ratios with any
confidence, due to missing or unavailable information, we believe the nature
and extent of questionable DHR assumptions and practices noted are
sufficient to conclude that the report is unreliable. For example, we noted:
Office of
Legislative 17
Audits
Background
To prepare the February 18, 2005 report of caseload staffing ratios
submitted to the General Assembly (see Exhibit B), DHR performed a two-
step process. First, DHR determined the number of caseworkers needed.
Second, DHR determined the number of existing staff. This information was
used to calculate the staffing ratios. The process worked as follows:
2. Divide the case averages by the CWLA standards for the type of
service provided. When no standard existed (such as for child
protective service intake screening), DHR developed an internal
standard based on their best estimates.
1 There are seven service categories: adoptive services, child protective services, family preservation
services, foster care, intensive family services, kinship care and services to families with children.
Office of
18 Legislative
Audits
standards to determine the adequacy of the number of staff employed by
DHR for child welfare services.
Finding
1. DHR Child Welfare Staffing report dated February 18, 2005 was
not prepared in accordance with recognized standards nor
based on reliable or current information – The Child Welfare Staffing
report (see Exhibit B) presented by DHR to the Maryland General Assembly in
February 2005 was not reliable. Certain assumptions were made by DHR
that were not verified, were inconsistent with the standards of the CWLA, or
were based on data of questionable accuracy. Additionally, we noted that
the most current data were not always used.
• Current CWLA caseload standards were not used when determining the
number of required caseworkers. For example, DHR used a standard of
6 cases per worker for both family preservation and intensive family
services, even though the CWLA recommended standards are 12 and 4,
respectively.
Office of
Legislative 19
Audits
• CWLA recommended practices include a consideration of employee leave
usage on staffing and caseload ratios (to arrive at annual workdays
available). DHR did not calculate the effect of leave, which could have
been significant. In fact, we estimated that if all employees included in
the February 2005 Staffing Report took 20 days off annually (from all
leave sources), DHR would need approximately 130 additional
caseworkers and 26 additional supervisors to meet existing staffing
standards. Because leave usage, especially among employees with
longevity, tends to be higher than 20 days per year, we believe these
estimates are conservative.
• DHR did not verify that staff included in the report actually functioned in
areas related to the delivery or supervision of foster care services.
During our field visits to three LDSS, it came to our attention that at least
7 supervisors included in the DHR calculation of available staff did not
directly supervise caseworkers (as assumed), but performed other
managerial duties. These three LDSS had a total of 192 supervisors.
2 Actually several different caseload averages were used, as the generic term “Child Welfare”
includes a number of different categories.
Office of
20 Legislative
Audits
cases included cases that were actually closed, and included cases
mistakenly opened for the sibling(s) of a child under CPS (that is, LDSS
personnel opened cases for multiple children in a family when only one
child was alleged to have been abused or neglected).
3 It should be remembered that the February 18, 2005 report is an amalgamation of all categories of
child welfare services.
Office of
Legislative 21
Audits
Recommendation
1. We recommend that DHR revise its methodology for calculating child
welfare staffing. CWLA standards should be utilized, the most current
information used, and the reliability and comprehensiveness of the
underlying data should be tested or otherwise verified.
Office of
22 Legislative
Audits
Objective 2
Child Protective Services Investigations
Conclusion
Our second audit objective related to determining the adequacy of several
aspects of Child Protective Services (CPS) at three LDSS. CPS is a
specialized social service for children who are believed to be neglected
and/or abused, and to their parents, other caregivers or to household or
family members to decrease the risk of continuing physical, sexual or mental
abuse or neglect. The results of our reviews and testing in this area
disclosed a number of issues impacting virtually every facet of CPS, including
the timeliness, adequacy and documentation of the investigative effort
related to child abuse and neglect allegations reported to the LDSS.
Although every issue may not have been found at each of the three LDSS
audited, we nevertheless believe that the frequency of occurrences was
sufficiently broad, and coupled with the sensitive nature of the CPS mission,
suggests that DHR should evaluate the CPS activity statewide.
Our tests found that CPS investigations at the 3 LDSS were often not
initiated or completed within the time frame required by State law, and
certain documents were not always completed during the investigation as
required. Problems were also found with the preliminary screening of the
allegation of neglect or abuse. Specifically, our tests disclosed that
frequently there was no documentation of the required supervisory review of
decisions to not accept allegations of neglect or abuse for formal
investigation. We also found evidence that when contact could not be made
with the alleged victim, cases were sometimes closed, without pursuing all
available means to get access. Preliminary findings and final dispositions of
neglect and abuse allegations were not routinely forwarded to the State’s
Attorney Office as required. Furthermore, we found problems with the
posting of critical CPS data to the automated DHR Client Information System
(CIS), including the posting of incomplete and inaccurate data, plus untimely
postings. We also found a lack of uniformity between the three LDSS in
determining actual case closure dates, and several instances of allegation
receipt dates (a key date that begins the timing of other actions) not
agreeing between CIS and the case file records.
Office of
Legislative 23
Audits
Additionally, our review of a recent downward trend in continuing service
case activity disclosed no predominant cause, although several plausible
explanations were noted based on discussions with LDSS personnel and our
review of the case files. These include the increased intervention of non-
government entities, removal of children into kinship care and
parents/caretakers declining offered services. We also found that reported
maltreatment recurrence rates might be slightly overstated, based on our
limited testing of some of the underlying data for the annual DHR reported
MFR performance measure of the percentage of children with recurrence of
maltreatment within six months of a first occurrence.
Background
Child abuse and neglect allegations are reported to the local departments of
social services (LDSS). Each LDSS provides staffing to accept these reports
24 hours a day, 365 days a year (either directly or in conjunction with other
local agencies such as local law enforcement officials). In some instances, a
person reporting alleged abuse or neglect may choose to contact DHR
headquarters directly where they will be referred to the appropriate LDSS.
Allegations can be oral (either in-person or over the phone), in writing or by e-
mail, and can be made anonymously.
Office of
24 Legislative
Audits
State law requires an on-site investigation to begin within 24 hours of
receiving a report of child abuse and within 5 days for neglect allegations.
These investigations may include work performed by the local law
enforcement agency and usually include interviews with the alleged victim
and any other children in the care of the suspected caregiver.
4 The Safety Assessment is a tool used to support the determination of the child’s level of safety
while receiving child welfare services. Children found to be in unsafe living arrangements may be
moved to safer environments.
5 The Risk Assessment is a formal consideration of factors that determine the risk that maltreatment
will recur. It includes child specific factors (such as the capability to protect oneself), caregiver
factors (such as substance abuse and level of functioning) and family factors (such as resources).
Office of
Legislative 25
Audits
Ruled-Out – the reported abuse or neglect did not occur.
Unsubstantiated – there was insufficient evidence to either prove or
disprove a finding of abuse or neglect.
Indicated – there was credible evidence, which has not been
satisfactorily refuted, that abuse or neglect occurred.
Records for “ruled-out” cases are maintained for 120 days after receipt of
the allegation then expunged, unless another allegation for the same
caregiver is received during that time frame. In these instances, record
retention is guided by the nature and outcome of the subsequent
investigation. Case files for unsubstantiated allegations are maintained for
five years unless another allegation concerning the same caregiver is
received. In these instances, the files are maintained for five years after
receiving the report for the original unsubstantiated finding or the expunged
date related to the subsequent investigation, whichever is later. It is DHR
policy to maintain case file records of indicated determinations for 25 years,
although State law is silent on this specific issue.
Findings
2. Documentation of the required supervisory review of initial
screening determinations was often missing and several
instances were noted where the decisions to screen out neglect
or abuse allegations appeared questionable – Our test of child
protective services investigations at the three LDSS disclosed that required
supervisory review and approval of initial screening determinations was
Office of
26 Legislative
Audits
frequently not documented. Additionally, the testing disclosed five cases at
two LDSS where the referral was not accepted for formal investigation (that
is, referral was screened out) although, in our opinion, the details from the
allegation appeared to meet the State definition of neglect or abuse. The
decisions to screen out these allegations appeared questionable.
Our test of 90 randomly selected CPS referrals from the period from April 1,
2005 to June 30, 2005 (30 selected from each LDSS) disclosed 58 referrals
lacking a documented supervisory review and approval of the screening
determinations, see Table 2. Additionally, out of the 90 cases tested, we
believe that the proper determinations were made for 85 cases. However,
we noted 5 that had been “screened out” by the LDSS, even though, in our
opinion, the assertions presented in the allegations appeared to meet the
legal definition of neglect or abuse established in the Annotated Code (for
the circumstances surrounding these five cases, see Exhibit D). Although
State law and the applicable State regulations describe the general
situations meeting the definitions of neglect and abuse, there can be an
inherent degree of subjectivity in interpreting a reported event (allegation),
which is often based on sketchy or less than complete information.
According to LDSS personnel, the five cases were “screened out” since in
their opinions, the information provided in the allegations did not include
enough information or other evidence that the abuse or neglect occurred. In
four of the five cases, we also found that there was no documented
supervisory review and approval of the decision not to formally investigate
the allegation. Since such decisions require sound judgment, the required
supervisory review is extremely important to help ensure that appropriate
decisions affecting a child’s welfare are made.
Table 2
Test Results – Child Protective Services Investigations
Cases With:
Local Cases No Documented
Questionable
Department Tested Supervisory
Determination
Approval
Anne Arundel 30 3 30
Baltimore City 30 0 6
Prince George’s 30 2 22
Totals 90 5 58
Office of
Legislative 27
Audits
3. CPS cases were sometimes closed without making contact with
the child or family – DHR had not developed formal guidance to aid CPS
workers on closing cases of reported neglect or abuse when access to the
child in question had been denied or the caseworker could not locate the
family. Although DHR policy provides specific guidance for CPS workers
when the victim and family relocate during the investigation, there was no
such guidance when the worker could not initially obtain access to the child.
In our testing of closed CPS investigation cases, we noted 7 of 192 closed
cases where the final disposition was noted as unsubstantiated (that is,
abuse or neglect may have occurred but there was a lack of evidence to
prove it) because the family or the caregiver refused the caseworker access
to the alleged victim or the caseworker could not locate the family. In
several of these cases, with at least one occurring at each of the three LDSS
tested, the caseworker made multiple unsuccessful attempts to contact the
victim or family.
Office of
28 Legislative
Audits
regulations provide that LDSS may accumulate and maintain statistical data
about “screened out” cases.6
Table 3
Results of Test of Timeliness of CPS Investigations
Number of Cases Where
Number
Local CPS Investigation Was:
of Cases
Department Initiated Completed
Tested
Untimely Untimely
Anne Arundel 64 17 8
Baltimore City 64 13 12
Prince George’s 64 18 22
Totals 192 48 42
6 The retention of this record does not appear to be contrary to the 120 day document destruction
requirement for “screened out” case documentation as it only contains non-identifying data, such
as a summary of the allegation, and is used for statistical and management purposes.
Office of
Legislative 29
Audits
we were able to readily determine the delay between the report of the
allegation and when the investigation was initiated, see Table 4.
Table 4
Number of Cases With Delays in Initiating CPS
Investigations
Number of Days Delayed
Local Department
1 to 5 6 to 10 Over 10
Anne Arundel 11 1 2
Baltimore City 8 1 2
Prince George’s 10 2 2
Totals 29 4 6
Table 5
Number of Cases With Delays Between Receipt of Allegation and
Completion of Investigation
Number of Days
Local Department 61 to 81 to 121 to Over Totals
80 120 240 240
Anne Arundel 5 2 1 0 8
Baltimore City 6 2 4 0 12
Prince George’s 6 6 6 4 22
Totals 17 10 11 4 42
Projection of Results
Our statistical sample consisted of tests of a random selection, from CIS, of
closed child protective investigation cases with closing dates between
February 1 and June 7, 2005. In Table 6, we projected our test results
Office of
30 Legislative
Audits
related to untimely CPS investigation initiation and completion based on a
confidence level of 95%. As an example of how to interpret the Table, we
are 95% confident that between 233 to 661 CPS investigations in the
BCDSS were not initiated timely (out of 2,201 total cases).
Table 6
Projection of Test Results for Untimely CPS Investigation Initiation and Completion
(based on 95% confidence)
Cases With Cases With
Population Untimely Initiation Untimely Completion
Local Percent (%) Quantity (#) Percent (%) Quantity (#)
subject to
Department Range Range Range Range
testing
Low High Low High Low High Low High
Anne Arundel 750 16.2 36.9 122 277 4.8 20.3 36 152
Baltimore City 2,201 10.6 30.0 233 661 9.3 28.2 205 620
Prince George’s 831 17.5 38.7 146 322 23.2 45.6 193 379
Since we only tested from these three local departments, the results of
these tests cannot be projected to other local departments or for other time
periods. Although we found CIS to be a reliable source for test selection
purposes, we found that we could not rely on CIS to accurately identify the
case closing date since each local department tested used different criteria
to record the closing date in CIS (see Finding 7). Consequently for the
purposes of our test, we obtained closing dates directly from the CPS case
files.
BCDSS did not any have process in place to review the completeness or
accuracy of CPS data entered into CIS by data entry personnel. AADSS had
a policy to review CPS data entered into CIS. However, at 2 of 3 AADSS field
locations reviewed, we found that no procedures were in place to ensure the
accuracy of any CPS data entered into CIS, while the third location claimed
that there was an undocumented independent supervisory review of data
input. Additionally, DHR had not provided any guidance to ensure the
consistency of CPS case closure dates in CIS or the accuracy of CPS data
posted to CIS. We found a lack of uniformity in the case closure date
process between the three LDSS reviewed. Specifically, we found three
Office of
32 Legislative
Audits
different dates were used. The CPS case closure date recorded in CIS was
either:
• the date the supervisor signed off on the case disposition form (the
proper date according to SSA personnel),
• the date the supervisor reviewed the entire investigation file for
completion or
• the date the caseworker signed the case disposition form (prior to
supervisory review and approval).
DHR did not have a formal process for assessing caseload trends. Our
interviews with administrative and LDSS employees, as well as our review of
cases filed, brought to light several potential causes for the past decline in
continuing services cases. For example, DHR central office staff indicated
that improved tools for risk and safety assessments may now lead
caseworkers to draw different conclusions on the level of services needed
(meaning they determined that families did not need continuing services,
while they may have decided otherwise in the past). Local department
personnel on the other hand, indicated that much of the decrease could be
attributed to reductions in staffing and placing more priority on higher risk
cases that take more time. This means spending more resources (such as
7 Continuing services includes cases where an LDSS provides assistance to the child/family to help
ensure the safety of the child and may include medical assistance (both physical and mental), in-
home aide services and transportation among the types of assistance provided.
8 DHR could not readily provide an explanation for the apparent increase in the average fiscal year
2005 caseload, which reverses the trend of the previous five years.
Office of
Legislative 33
Audits
staff time) on cases where a child was at the greatest risk of neglect and
abuse and the child/family needed more services and supervision.
Chart 4
Average Number of Cases for Child Protective Services
and Family Preservation Services
3500
2,913 2,800
3000
2,488
2500 2,332
2,156
1,971
2000
1500
1000
500
0
1999 2000 20001 2002 2003 2004
Fiscal Year
While the previously noted reasons could explain some of the decline, we
noted three further plausible causes which, depending on their frequency,
could also impact the number of cases. Our review of the case files noted
that community and other non-State providers of services were being used
instead of State services. In addition, we noted in many instances, children
were being removed from the home and being placed with relatives (that is,
kinship care), lessening the need for continuing services. Finally, we noted
that in some instances, when formally offered, parents refused DHR
services.
Since these three LDSS collectively account for a significant number of the
cases in the population from which the measurement is taken, the impact of
this test suggests that the statewide recurrence rate might be slightly lower
than the reported 8.4 percent.
Recommendations
2. We recommend that DHR ensure that all screening determinations of
neglect and abuse referrals be subject to a documented and timely
supervisory review and approval to confirm the propriety of the
determinations.
4. We recommend that DHR ensure that each LDSS complies with all legal
requirements regarding case documentation. In addition, DHR should
consider requiring each LDSS to maintain summary records of all
screened out cases for management oversight purposes.
Office of
Legislative 35
Audits
With regard to the above recommendations, DHR should ensure that its
CPS quality assurance review process includes steps, as appropriate, to
ensure LDSS compliance with the specific areas where we noted
weaknesses and errors during the audit.
9. We recommend that DHR review for accuracy, at least on a test basis, its
calculation of the performance measure of percentage of children with
recurrence of maltreatment within six months of a first occurrence to
ensure compliance with federal reporting standards.
Office of
36 Legislative
Audits
Objective 3
Assignment of Foster Care Cases to Active
Caseworkers
Conclusion
Our third audit objective was to assess if all children in foster care were
continually assigned to an active caseworker. We were ultimately unable to
design a comprehensive test for this attribute due to DHR and LDSS data
limitations. We had intended to conduct a match of automated case file and
personnel records to ensure that all foster care cases at a certain date were
assigned to active caseworkers, but were unable to for several reasons such
as CIS not retaining historical information on foster care caseworker
assignments. Instead, we conducted statistical samples of the critical
requirement of monthly caseworker contact with the children, while at the
same time ensuring the applicable caseworkers for these particular cases
were active DHR employees.
Using hard-copy case file data and DHR personnel files, we found that during
the 6-month period tested (January to June 2005), the 111 cases selected
for review of monthly face-to-face meetings were assigned to 92 different
individuals who were valid employees of DHR and the LDSS. That is, an
active employee was assigned to each case throughout the period tested.
We conducted this combined test since the intent of verifying that assigned
caseworkers are active DHR employees is to help ensure that caseworkers
are in a position to provide children with all required services. Since a key to
service delivery is the monthly face-to-face meeting with a child, one
objective of our test was to determine the documented existence of this
requirement. Our tests at all three local departments disclosed that out of a
total of 111 active cases tested during the period of January to June 2005,
in 54 cases there was no documentation that the visits had occurred for at
least one month during the 6-month period. Findings ranged from 26 cases
where one month was lacking to 2 cases for which there was no
documented visit for the entire 6-month period. Because the visits may not
have been documented, there is no way to know whether a visit actually
occurred in these 54 cases. However, caseworkers did acknowledge to us
that monthly visits in fact do not always occur due to extended employee
Office of
Legislative 37
Audits
leave or the child not being available during an unscheduled visit. In some
cases, caseworkers substituted phone contacts instead of the required face-
to-face visits.
Background
As previously noted, we were originally requested to determine if children in
foster care were under the supervision of active caseworkers. We
determined that due to a lack of available information, we could not design a
test to categorically provide this information. As the intent of the assignment
of active caseworkers is to ensure that children in foster care ultimately
receive required timely monitoring and services, we conducted a statistical
sample of cases to determine if children were receiving documented,
monthly visits from a caseworker. We sampled 37 cases active during the
period of January 2005 to June 2005, from each of the three LDSS for a
total of 111 cases. Since these tests were statistically valid, the results can
be projected to the LDSS in question, but not statewide or to other LDSS.
Findings
10. There was no system to identify caseworkers assigned to foster
care cases over the history of the case – Our review of CIS data files
and discussions with DHR and LDSS personnel revealed that CIS did not
include adequate information to ensure that foster care cases were
consistently assigned to active employed caseworkers. That is, CIS did not
maintain a historical record of past caseworker assignments which could be
used to ensure continuous active monitoring. We also determined that the
three LDSS did not maintain manual records documenting the same
information. Although we were advised that some supervisors kept a
manual record of caseworker assignments, upon review of these records we
Office of
38 Legislative
Audits
found these records included just the number of cases assigned. As a
result, DHR and the three LDSS lack critical information to use in monitoring
staff levels and caseworker assignments. However, our tests disclosed that
foster care cases were assigned to valid employees of DHR and the
respective LDSS. Specifically, we tested 111 foster care cases (37 from
each of the three LDSS) during the period from January to June 2005. These
111 cases were assigned to 92 different individuals. All employees tested
were valid employees of DHR and the LDSS for the entire period tested.
10. DHR could not document that foster care caseworkers met with
children monthly as required by regulations in almost 50
percent of the cases tested over a 6-month period - Our test of
foster care case files disclosed that frequently caseworkers either did not
visit children or there was no documentation that foster care children were
visited by caseworkers as required by State regulations. State regulations
generally require that caseworkers have a monthly, face-to-face meeting with
children, except under certain specified circumstances (such as placement
in a treatment facility or out-of-state). Our tests related to a statistical
sample of 111 foster care cases (37 selected from each local department
included in our audit), disclosed that there was no documentation that
children in 54 of the cases received all required visits for the period from
January through June 2005, see Table 7.
Table 7
Test Results – Caseworker Visits of Foster Children
Number of Months with Undocumented Caseworker Visits
Local Cases Between January and June 2005
Department Tested One Two Three Four Five Six
Total
Month Months Months Months Months Months
Anne Arundel 37 13 1 2 0 0 0 16
Baltimore City 37 6 1 0 2 1 0 10
Prince George’s 37 7 10 4 2 3 2 28
Totals 111 26 12 6 4 4 2 54
Office of
Legislative 39
Audits
As can be seen from Table 7, 28 of the foster children in our test either had
undocumented visits or did not receive visits from their caseworker for 2 or
more months during a 6-month period. Based on our review of the case files
and discussions with LDSS employees, the reasons given for not conducting
visits included extended employee leave (an issue raised in CWLA staffing
guidelines in Finding 1) and, the child not being available during an
unscheduled visit. Also, in some cases, phone contacts instead of in-person
contact were used and, there may have been instances in which the
caseworker had not yet documented a visit in the file when we conducted
our test in August 2005.
Projection of Results
As these three tests were conducted on a statistical basis, we can project
the results to the populations of the respective LDSS. Our statistical sample
consisted of tests of a random selection, from CIS, of children in foster care
as of April 30, 2005 (who were also in foster care during the entire period of
January to June 2005). While we found CIS to be a reliable source for our
test selection based on our preliminary testing of judgmentally selected
foster care cases, we did note that we could not rely on CIS to accurately
identify the current caseworker so we obtained this information directly from
the hard-copy case files. In Table 8, we projected our test results related to
documented monthly visits to foster care children based on a confidence
level of 95%. As an example of how to interpret the Table, we are 95%
confident that between 302 to 431 children at PGDSS did not receive at
least one documented monthly visit over the 6-month period tested (out of
484 total children).
Office of
40 Legislative
Audits
Table 8
Projection of Test Results for Monthly Visits to Foster Care Children
(based on 95% level of confidence)
Cases Where There was Either No Evidence
of Required Caseworker Contact
or No Contact for at Least One Month
Test
Local Department during January to June 2005
Population
Number of Cases in
% Range
the Range
Low High Low High
Anne Arundel 227 28.6% 57.9% 65 131
Baltimore City 5,117 12.8% 41.3% 653 2,113
Prince George’s 484 62.4% 89.0% 302 431
Since we only tested these three local departments for visits during the
previously mentioned six-month period, the results of these tests cannot be
projected to other local departments or for other time periods.
Recommendations
10. We recommend that DHR determine the feasibility of developing
system capabilities to monitor foster care caseworker assignments,
including historical caseworker assignment information.
11. We recommend that DHR ensure that all children in foster care receive
the required monthly face-to-face meeting with their assigned
caseworker, as required by State regulations. Additionally, DHR should
assess why visits have not occurred and take additional steps
necessary to ensure such visits are made as required (such as
reallocating caseworker resources or hiring additional staff as
necessary) and are documented.
Office of
Legislative 41
Audits
Office of
42 Legislative
Audits
Objective 4
Reliability of Selected Data Reported as
Required by the Consent Decree
Conclusion
Our fourth audit objective was to determine if 1) certain information
contained in the 6-month DHR compliance report applicable to Baltimore
City for the period ending December 31, 2004 was reliable, and 2) BCDSS
complied with requirements related to the timely transfer of foster care
cases when a worker leaves or transfers. The report was filed in accordance
with requirements established under the September 1988 L. J. v. Massigna
Consent Decree. The report included 72 performance measures (37 related
to foster care and 35 related to kinship care). For these measures, DHR
reported 146 separate results of which 71 related to foster care, 64 to
kinship care and 11 included combined results. Our test of 20 reported
results for foster care determined that 8 results were reliable but the
reliability of the supporting data underlying 11 other results were deemed
unreliable. We also noted that another result could not be tested due to a
lack of documentation to support how the related measure was calculated.
Background
In September 1988, DHR entered into a Consent Decree to settle a class
action lawsuit regarding the administration of foster care cases by the
BCDSS. The Court found overwhelming evidence of serious systematic
deficiencies in Baltimore City’s foster care program such that foster children
would suffer irreparable harm. The Consent Decree established a number of
Office of
Legislative 43
Audits
requirements for the improved provision of foster care services by BCDSS
including such areas as caseworker caseload, staff training, foster care
placement resources (that is, homes, shelters, etc.) and health care, among
others. To determine compliance with these requirements, the Decree
required that DHR file semi-annual reports with the Court containing specific
data such as assigned caseworkers and supervisors, caseload statistics,
complaints of abuse and neglect, number of homes approved and other
data. The Consent Decree was modified in December 1991 to remove
certain requirements as well as to add kinship care services to those
included in the Decree to be monitored and reported by DHR.
We reviewed and tested selected data from the 33rd report covering the
period from July to December 2004 (the most recent report filed at the time
of our audit).
BCDSS quality assurance unit tests foster and kinship care cases to
determine if BCDSS provides the services required by the Decree. The unit
uses a monthly random case selection process to measure compliance. For
each month included in a six-month reporting period, the unit samples 22
new entrant cases and 38 continuing care cases (for a total of 360 cases
per reporting period). New entrant cases represent those that entered foster
care in the three months prior to the test month and were in care for at least
60 days. Based on its internally developed Consent Decree Review Guide,
the unit evaluates each case for compliance based on documents in the
case file. The findings for each required element can be either “Yes” (the
required documentation exists and was completed timely if required), “No”
(the case files does not include the required documentation or the element
was not completed timely) or “n/a” (the element does not apply for the case
file under review). Case review results are documented and reviewed and
approved by supervisory personnel. The percentage of compliance equals
the number determined as compliant divided by the total of compliant and
non-compliant cases tested. Case elements noted as “n/a” are not included
in the calculations.
The unit compiles the results for each month into a spreadsheet. At the end
of the six-month reporting period, the monthly results are accumulated to
determine compliance for the entire period included in the compliance
report. Other data not contained in the case files, such as available foster
Office of
44 Legislative
Audits
care home placements, are based on various management reports
generated by supervisory staff and data systems as appropriate.
We evaluated the test results using the methodology developed for our
Office’s periodic audits of the State’s Managing for Results (MFR)
performance measures. In those audits, we test the data underlying
reported MFR measures and reach a conclusion regarding the reliability. For
purposes of this audit the corresponding conclusions would be reliable or
unreliable. The nature of audit testing of this type of reported information is
not to determine the true value or result of the information under
examination, but rather to assess the reliability of the underlying data.
Office of
Legislative 45
Audits
For the fifth category, we attempted to review the documentation used by
BCDSS to calculate new foster care homes approved and the number of
homes closed during the report period. BCDSS was not able to provide us
with documentation to support the figures reported. After obtaining other
documents, we were able to recreate the number of new homes approved
but could not develop the number of homes closed. As a result, we were
only able to test and report on new homes approved.
Findings
12. The reliability of the data underlying the reported measures
tested was questionable with several being judged unreliable –
Our testing of 51 new entrant cases and 51 continuing cases included in the
quality assurance unit’s sample for the period from July to December 2004
disclosed that the underlying data supporting selected measures were not
always reliable (that is, the reported compliance was either over or
understated). Tables 9 and 10 show the specific results of our testing and a
comparison to the equivalent BCDSS results.
Table 9
Test of Foster Care Cases for Consent Decree Compliance – New Entrants Cases
(Source: 33rd 6-Month Report)
Comparative Conclusions from OLA OLA
DHR
Test of Identical 51 Cases Assessment
Measure Reported
BCDSS Results OLA Results of DHR
Compliance
Yes No n/a Yes No n/a Results
Weekly Parental Visits 65% 28 19 4 7 41 3 Not Reliable
Monthly Caseworker Visits 56% 25 26 0 34 17 0 Not Reliable
Medi-Alert 94% 48 3 0 48 3 0 Reliable
Health Record
Office of
46 Legislative
Audits
Table 10
Test of Foster Care Cases for Consent Decree Compliance – Continuing Cases
(Source: 33rd 6-Month Report)
Comparative Conclusions from OLA OLA
DHR
Test of Identical 51 Cases Assessment
Measure Reported
BCDSS Results OLA Results of DHR
Compliance
Yes No n/a Yes No n/a Results
Weekly Parental Visits 74% 29 5 17 4 7 40 Not Reliable
Monthly Caseworker Visits 79% 40 11 0 43 8 0 Not Reliable
Medi-Alert 93% 48 3 0 47 4 0 Reliable
Health Record
Office of
48 Legislative
Audits
employment for a given time period or transferred to another non-foster care
unit. Although we subsequently were able to manually create at least a
partial record of caseworkers who left BCDSS from October 2004 through
February 2005 using Department of Budget and Management and DHR
personnel records, we could not obtain a listing of the foster care cases
handled by these caseworkers prior to leaving BCDSS. We were informed
that CIS, which records caseworker assignments, does not include a
historical record of caseworker assignments (see Finding 10). In addition,
CIS overwrites the previous caseworker of record in the system as soon as a
new caseworker is assigned to the case without retaining a history of prior
assignments. Finally, BCDSS did not maintain any internal documentation
regarding the historical assignment of specific cases for each caseworker.
Recommendations
12. We recommend that DHR periodically test the reliability of the
information reported to it by BCDSS for inclusion in the 6-month
compliance reports. In addition, we recommend that DHR ensure that
appropriate steps are taken by BCDSS to provide reliable results in the
future and that BCDSS retain adequate documentation to support all
data included in the report.
Office of
Legislative 49
Audits
Office of
50 Legislative
Audits
Exhibit A
Audit Request Letter From The President of the Senate
and the Speaker of the House of Delegates
Page 1 of 3
Office of 51
Legislative
Audits
Exhibit A
Audit Request Letter From The President of the Senate
and the Speaker of the House of Delegates
Page 2 of 3
Included as Exhibit B
52 Office of
Legislative
Audits
Exhibit A
Audit Request Letter From The President of the Senate
and the Speaker of the House of Delegates
Page 3 of 3
Office of 53
Legislative
Audits
54 Office of
Legislative
Audits
Exhibit B
Note: The above schedule does not include Montgomery County. The County receives a grant for operations
from DHR and all employees are county employees, not State employees.
Office of 55
Legislative
Audits
56 Office of
Legislative
Audits
Exhibit C
OLA Recalculation of DHR’s February 2005 Staffing Report
Page 1 of 3
As noted in Finding 1, we attempted to restate the February 18, 2005 caseload report by
substituting those variables where more reliable data were available. Specifically, we made
the following adjustments to DHR’s calculations:
1. We used 12-month case averages for the period from November 2003 to October
2004 which represented the most current data available at the time of the February
2005 report.
2. We adjusted staffing for both new hires and terminations.
3. We used current CWLA recommended caseload standards for determining the
number of workers needed.
The following partial restatement shows that, although statewide totals are close, staffing
among individual local departments often varies significantly from the original DHR report.
For example, according to the restatement, Anne Arundel County appears to have almost 20
caseworkers in excess of those needed based on current CWLA standards and Baltimore
City is short 49 staff to meet those same standards, while the original DHR report noted only
10.8 and (31.5), respectively (see Exhibit B).
Office of 57
Legislative
Audits
Exhibit C
OLA Recalculation of DHR’s February 2005 Staffing Report
Page 2 of 3
Recalculation of Estimated
Total Caseworkers and Supervisors Needed to Meet CWLA Standards
(the accompanying notes and comments are integral to interpreting this table)
Workers Supervisors
Local
Department CWLA Over / CWLA Over /
Standard Filled (Under) Standard Filled (Under)
58 Office of
Legislative
Audits
Exhibit C
OLA Recalculation of DHR’s February 2005 Staffing Report
Page 3 of 3
employee (annual earning rate of 10 days annual leave, 15 days sick leave and 6 personal
leave days) and take the equivalent of one month’s leave per year (or about 20 working
days), the number of staff required would increase. If each employee in the February 2005
report annually used 20 days of leave, DHR would have required approximately 130
additional caseworkers and 26 additional supervisors to help ensure an appropriate number
of staffing for the average caseloads during November 2003 to October 2004.
Office of 59
Legislative
Audits
60 Office of
Legislative
Audits
Exhibit D
Reporter claimed that mother is drug abuser who has Information given
been removed several times for crack overdose. does not meet
Reporter claimed neighbor advised that mother was child maltreatment
2 Neglect seen hitting the child (10 years old), but did not know if definition ®
injuries were sustained. Reporter said that his wife and
others had fed child in past because child claimed to
Anne
be hungry.
Arundel
Reporter, who was a CPS screener at another LDSS, Information of
claimed that mother had called the other LDSS to injuries not
report abuse of 8 year old child by father at a provided.
restaurant. Father allegedly hit child on side of head Accordingly,
and then hit the back of the head causing child’s information given
Physical forehead to hit the table. Mother reported that father does not meet
3
Abuse was in treatment for domestic abuse, was aggressive child maltreatment
toward children and had a temper. Reporter gave definition ®
mother Anne Arundel County DSS phone number and
mother suddenly began to make excuses for father.
Reporter made referral as reporter felt mother
ultimately would not.
Reporter (grandmother) claimed 7 year old girl has Per file notation –
been abused by older brother and mother refuses to Case
Sexual
4 take action. Reporter claimed child is scared and that recommended for
Abuse
she told reporter of the alleged abuse. A prior report of screen out by a
sexual abuse was found to be unsubstantiated. supervisor
Prince
George’s Reporter (Department of Juvenile Services worker) No explanation
claimed that 16 year old child’s mother died and child provided ®
has no known guardian (father does not want child).
5 Neglect
Since mother’s death the child has lived with a 70 year
old woman who it is claimed can no longer care for the
child.
Office of 61
Legislative
Audits
62 Office of
Legislative
Audits
Exhibit E
Comparison of 6-Month Compliance Report Performance Measures
(31st, 32nd, and 33rd Compliance Reports)
At the beginning of this audit, we were requested to summarize the reported results from
the last three 6-month compliance reports, which are required by the 1988 Consent
Decree. The decree required DHR to periodically report certain child welfare goals and
performance indicators of the Baltimore City Department of Social Services. The
information presented in Exhibit E was complied by us from the applicable reports
published by DHR and was not subject to audit verification by us (accept as indicated in
Finding 11).
Items shaded in gray represent ones selected for testing during the audit.
Page 1 of 13
31st Report
32nd Report 33rd Report
July 2003 to
Consent Decree Reference & Requirement January 2004 July 2004 to
December
to June 2004 December 2004
2003
Office of 63
Legislative
Audits
Exhibit E
Comparison of 6-Month Compliance Report Performance Measures
(31st, 32nd, and 33rd Compliance Reports)
Page 2 of 13
31st Report
32nd Report 33rd Report
July 2003 to
Consent Decree Reference & Requirement January 2004 July 2004 to
December
to June 2004 December 2004
2003
5E, M9 When worker leaves or transfers, supervisor will No Data No Data No Data
reassign the case within 5 working days of the transfer
and have a conference with the new worker within 10
working days of the reassignment.
64 Office of
Legislative
Audits
Exhibit E
Comparison of 6-Month Compliance Report Performance Measures
(31st, 32nd, and 33rd Compliance Reports)
Page 3 of 13
31st Report
32nd Report 33rd Report
July 2003 to
Consent Decree Reference & Requirement January 2004 July 2004 to
December
to June 2004 December 2004
2003
Office of 65
Legislative
Audits
Exhibit E
Comparison of 6-Month Compliance Report Performance Measures
(31st, 32nd, and 33rd Compliance Reports)
Page 4 of 13
31st Report
32nd Report 33rd Report
July 2003 to
Consent Decree Reference & Requirement January 2004 July 2004 to
December
to June 2004 December 2004
2003
Case Plan
M21 Each child placed with a relative shall have a written
case plan within 60 days.
Compliance Rate for Continuing Cases 92% 93% 88%
Compliance Rate for New Entrant Cases 94% 95% 84%
66 Office of
Legislative
Audits
Exhibit E
Comparison of 6-Month Compliance Report Performance Measures
(31st, 32nd, and 33rd Compliance Reports)
Page 5 of 13
31st Report
32nd Report 33rd Report
July 2003 to
Consent Decree Reference & Requirement January 2004 July 2004 to
December
to June 2004 December 2004
2003
18 A petition for the termination of parental rights of a All 99 cases All 218 cases All 149 cases
child placed in foster care shall be filed within 120 days
of establishing a goal of adoption.
M25 A petition for the termination of parental rights of a child All 9 cases All 12 cases All 12 cases
placed with relatives shall be filed within 120 days of
establishing a goal of adoption
Office of 67
Legislative
Audits
Exhibit E
Comparison of 6-Month Compliance Report Performance Measures
(31st, 32nd, and 33rd Compliance Reports)
Page 6 of 13
31st Report
32nd Report 33rd Report
July 2003 to
Consent Decree Reference & Requirement January 2004 July 2004 to
December
to June 2004 December 2004
2003
Compliance rate for Continuing Kinship Care cases 86% 78% 70%
Compliance rate for New Entrant Kinship Care cases 82% 79% 62%
M27 All educational screenings will be requested, in writing,
if there is reason to believe that the child placed with
relatives may be educationally handicapped.
Compliance rate for Continuing Kinship Care cases 89% 91% 80%
Compliance rate for New Entrant Kinship Care cases 77% 86% 75%
M28 The caseworker shall monitor the child's progress in
school and shall encourage the relative caretaker to
have contact with the child's school.
Compliance rate for Continuing Kinship Care cases 87% 77% 69%
Compliance rate for New Entrant Kinship Care cases 81% 73% 69%
68 Office of
Legislative
Audits
Exhibit E
Comparison of 6-Month Compliance Report Performance Measures
(31st, 32nd, and 33rd Compliance Reports)
Page 7 of 13
31st Report
32nd Report 33rd Report
July 2003 to
Consent Decree Reference & Requirement January 2004 July 2004 to
December
to June 2004 December 2004
2003
EPSDT Standards
21D, Provide medical care in accordance with EPSDT
M31 Standards.
Compliance Rate for Continuing Cases 99% 96% 83%
Compliance Rate for New Entrant Cases 98% 99.56% 90%
Compliance rate for Continuing Kinship Care cases 98% 99.56% 79%
Compliance rate for New Entrant Kinship Care cases 98% 98% 97%
Office of 69
Legislative
Audits
Exhibit E
Comparison of 6-Month Compliance Report Performance Measures
(31st, 32nd, and 33rd Compliance Reports)
Page 8 of 13
31st Report
32nd Report 33rd Report
July 2003 to
Consent Decree Reference & Requirement January 2004 July 2004 to
December
to June 2004 December 2004
2003
70 Office of
Legislative
Audits
Exhibit E
Comparison of 6-Month Compliance Report Performance Measures
(31st, 32nd, and 33rd Compliance Reports)
Page 9 of 13
31st Report
32nd Report 33rd Report
July 2003 to
Consent Decree Reference & Requirement January 2004 July 2004 to
December
to June 2004 December 2004
2003
Office of 71
Legislative
Audits
Exhibit E
Comparison of 6-Month Compliance Report Performance Measures
(31st, 32nd, and 33rd Compliance Reports)
Page 10 of 13
31st Report
32nd Report 33rd Report
July 2003 to
Consent Decree Reference & Requirement January 2004 July 2004 to
December
to June 2004 December 2004
2003
72 Office of
Legislative
Audits
Exhibit E
Comparison of 6-Month Compliance Report Performance Measures
(31st, 32nd, and 33rd Compliance Reports)
Page 11 of 13
31st Report
32nd Report 33rd Report
July 2003 to
Consent Decree Reference & Requirement January 2004 July 2004 to
December
to June 2004 December 2004
2003
Office of 73
Legislative
Audits
Exhibit E
Comparison of 6-Month Compliance Report Performance Measures
(31st, 32nd, and 33rd Compliance Reports)
Page 12 of 13
31st Report
32nd Report 33rd Report
July 2003 to
Consent Decree Reference & Requirement January 2004 July 2004 to
December
to June 2004 December 2004
2003
74 Office of
Legislative
Audits
Exhibit E
Comparison of 6-Month Compliance Report Performance Measures
(31st, 32nd, and 33rd Compliance Reports)
Page 13 of 13
31st Report
32nd Report 33rd Report
July 2003 to
Consent Decree Reference & Requirement January 2004 July 2004 to
December
to June 2004 December 2004
2003
Office of 75
Legislative
Audits
II. Child Protective Services
The narrative section of the report contains some misunderstandings of the Child
Protective Services investigation process. The process begins with receiving and
evaluating a community concern, generally in the form of a telephone call to a local
department of social services. The audit report indicates that a function of an intake
worker (screener) is to complete a safety assessment prior to the report being assigned to
a CPS worker for investigation (pages 24 – 25). That misrepresents the role of a
screener. The screener applies established criteria to determine if the referral alleging
child abuse or neglect contains sufficient information to allow a CPS worker to initiate an
investigation. It is the role of the CPS caseworker (investigator) to determine if a child is
safe as part of their responsibility during initial and subsequent contacts with a child and
his/her caretakers.*
The narrative also indicates that “records for “ruled out” cases, as with the earlier
“screened out” cases, are maintained for 120 days after the final determination is reached
then expunged (Page 26).” Family Law requires that expungement take place “within
120 days after the date of the referral if the report is ruled out, and no further reports of
child abuse or neglect are received.” If the Department takes 60 days to conclude it’s
finding, the audit report suggests that the Department has 120 days from that point to
expunge the record. This interruption extends the timeframe for expungement from 4 to
6 months for ruled out investigations. The statute is clear that the Department has 120
days from receipt of the allegation to expunge the record when the finding is ‘ruled out’.*
Response: Agree. The Department did not review each of the cases that the auditors felt
should have been investigated however, agrees with the general finding. It would have
been useful to see the actual screened-out reports to see if the Department concurred with
the auditor’s clinical assessment of what should be investigated. In the narrative of the
audit it was noted that Anne Arundel Co. DSS screened out cases because “the reporter
did not indicate if the child incurred physical injury”. Local departments are instructed
not to investigate allegations when it is clear that the child in question did not sustain an
injury. If the reporter reports that no injury occurred as a result of the incident, it is
correct to screen the report out from investigation. If, however, the LDSS was screening
out cases from investigation because the reporter did not know if the child sustained an
injury or if they suspected that there was an injury, the procedure is incorrect.
Planned Corrective Actions: The Department’s new automated case record contained
in MD CHESSIE requires supervisory review and approval of all screening decisions.
Auditor’s Comments:
*Changes were made to the Background Information to address the Department’s
concerns.
2
This feature is part of both early and major release of the new electronic case record. The
electronic system requires that all cases be approved (screened in or out for investigation)
prior to any action being taken.
Finding 3: The CPS cases were sometimes closed without making contact with the child
or family.
Response: Agree. The Department agrees with the recommendation but cautions that
law enforcement also has statutory limits as to how aggressive a report can be pursued.
For example, law enforcement can only forcibly enter a home if they believe a child to be
in imminent danger from child abuse or neglect.
Planned Corrective Actions: Current statute requires each local jurisdiction to establish
Memorandum of Agreements between local law enforcement and child protective
services as to how investigations will be conducted. This item will be incorporated into
the agreements where lacking.
Finding 4: Two local departments reviewed did not comply with certain requirements
related to processing or documenting CPS investigations.
Recommendations 4: We recommend that DHR ensure that each LDSS complies with
all legal requirement regarding case documentation. In addition, DHR should consider
requiring each LDSS to maintain summary reports of all screened out cases for
management oversight purposes.
Response: Agree. Local departments have built their own data files and each is
cautioned concerning maintaining identifying information on screened out reports beyond
120 days. CIS contains no information on screening activity; therefore there has been no
central office guidance on the subject.
Finding 5: Investigations were often not initiated or completed within the time frame
required by law.
3
Recommendation 5: We recommend that DHR ensure that all child protective services
investigations are initiated and completed in a timely manner as required by State law
Determining safety, risk of future maltreatment and service needs of the family are part
of the process but have not historically been considered the investigation as those items,
while part of the statute, have not been of interest to the other investigating entities (law
enforcement and State’s Attorney). When the Department conducts its own review of
child protection records, completion of the report to the State’s Attorney (form DHR/SSA
181 which is also used for neglect investigations) signified by the program supervisor’s
signature and date on the document, marks the completion of the investigation. This can
only be determined by a record review as the date on the DHR/SSA 181 is not captured
in the Department’s current data file (Client Information System). There is a business
rule in MD CHESSIE that will allow DHR to track the date of supervisory approval of
DHR/SSA 181. This interpretation of when an investigation is complete is in keeping
with the Department’s rules regarding notification of an individual of their opportunity to
appeal the dispositional finding of a Child Protective Services worker. Those determined
to be responsible for ‘indicated’ or ‘unsubstantiated’ child abuse or neglect are notified
once the determination is reached, not when all activities related to risk and service
determination are concluded.
Finally, local department directors are at times faced with determining how to best use
their staff resources to ensure safety of children. That has at times had a negative impact
on completion of paper reports associated with an investigation.
4
Finding 6: The case files routinely lacked evidence that preliminary finding and final
dispositions of abuse and neglect allegations were forwarded to the State’s Attorney
Offices.
Response: Agree. The requirement for producing a preliminary report has been in
Family Law for many years. Operationally, the practice of sending a preliminary report
to the local SAO has diminished as the information provided is often incomplete and of
little use. In one of the audit sites it was pointed out that the local SAO requested that the
local department of social services stop sending the preliminary reports because of the
limited information the reports provided and the time it takes to review each and
everyone of them. Law enforcement provides information to the SAO that is more useful
for determining when to prosecute an individual for crimes related to an alleged incident
of child abuse. The form DHR/SSA 181 is the tool designed for reporting the outcome of
the investigation to the SAO. It should be noted that Departmental case record reviews
(CAPS) have included checking for the presence of the DHR/SSA 181 (report of
disposition to the local SAO) and have found high compliance for the document in the
records. The Departmental review has not looked for documentation of mailing the
DHR/SSA 181 to the SAO and concluded that its presence in the record suggested that it
was shared with the local SAO.
Planned Corrective Actions: The Department plans to re-emphasis the need to forward
both the preliminary and final reports of the investigation to the SAO. MD CHESSIE
will allow the Department to monitor when reports are forwarded. Additionally, DHR
will consult with law enforcement and the SAO to evaluate the usefulness of the
preliminary report and consider proposing a change in statute if deemed appropriate.
Finding 7: CIS data entered in CIS were not always accurate or complete.
Response: Agree. Presently, caseworkers complete forms that are submitted to data
entry personnel who then enter data into CIS. Caseworkers will enter their own
information into MD CHESSIE and an electronic interface will post information to CIS.
The Department will be in a much better position to monitor casework activity once case
records are maintained electronically in MD CHESSIE.
Planned Corrective Actions: MD CHESSIE will eliminate the need to enter CPS
investigation information directly into CIS. Business rules for case opening, case
closure, case transfer, etc. are established for MD CHESSIE and supervisors will be in a
5
position to monitor the work of their caseworkers. Additionally, managers will be in a
better position to monitor casework activity, as they will have access to MD CHESSIE
and the management reports that it will generate.
Finding 8: Reasons for the decline in continuing services cases were not adequately
assessed.
Response: Agree. Local directors were faced with diminishing staff resources in the
recent past and made choices as to how to best provide ongoing and family preservation
services. Priority was given to the mandated services - child protective services and
foster care. Multiple variables, such as the economic conditions and the availability of
community services, impact the child welfare case loads.
Finding 9: DHR reported Managing for Results (MFR) performance measure on the
percentage of children with recurrence of maltreatment within six months of a first
occurrence might be overstated.
Response: Agree. The Department noted in its Program Improvement Plan to the
Federal Child and Family Service Review that the percentage of recurrence was not
accurate (actually an over count) and that better measures for that outcome needed to be
developed.
Planned Corrective Actions: MD CHESSIE allows the Department to identify the date
of a maltreatment incident that will allow for much more accurate counting of recurrence.
Incidents that occur prior to an initial contact with a family but are not reported until after
the investigation episode is complete will not be counted as recurrence. CIS does not
contain a data field for ‘date of incident’ which prevents an accurate count.
6
III. Assignment of Foster Care Cases to active Caseworker
Finding 10: There was no system to identify caseworkers assigned to foster care cases
over the history of the case.
Response: Agree. The audit report recommended that DHR consider using CIS to record
caseworkers and track visits. DHR has assessed CIS’s capability to record active
caseworkers and track visits. Unfortunately, CIS would not be able to appropriately
provide for such tracking.
Finding 11: DHR could not document that foster care caseworkers met with children
monthly as required by regulations in most 50 percent of cases tested over a 6 month
period.
Recommendation 11: We recommend that DHR ensure that all children in foster care
receive the required monthly face-to-face meeting with their assigned caseworker, as
required by State regulations. Additionally, DHR should assess why visits have not
occurred and take additional steps necessary to ensure such visits are made as require
(such as reallocating caseworker resources or hiring additional staff as necessary) and are
documented.
Response: Agree. Regulations and policy currently dictate that all children in foster care
receive a monthly face-to-face meeting with their assigned caseworkers. There must be
documentation in the record of the meetings. In this audit review there was some
disagreement about the format the documentation of visits and whether documentation
other than contact sheets was valid. The documentation by the local department can
include contact sheets, visitation logs or other narratives. The documentation of the visit
with the child must be maintained in the child’s records. Although DHR agrees that there
were instances where the visitation requirement was not met, it also notes that some visits
were not included as completed due to the discrepancy in the format of visit
documentation. There were also instances where, as noted in the audit report, a visitation
waiver was utilized. As long as there is a valid waiver in the record and regular reports
from the placement facility indicating visits with the child according to policy, the local
department should be considered in compliance with visitation requirements.
As this was an issue in the previous audit and there is still a need for improvement
despite training and policy efforts implemented by DHR, another solution has to be
pursued.
7
Planned Corrective Actions: For the jurisdictions reviewed in this audit, a corrective
action plan regarding visitation will be required and monitored for compliance. DHR
will monitor monthly visits in the form of written report submissions from all
jurisdictions. The reports will include the name of the child, visits made and explanations
of why the visitation requirement was not met. A corrective action plan will be required
to address the issue of non-compliance with the visitation requirement. After four
quarters of reports, the Social Services Administration will assess whether there has been
any significant change in compliance with the visitation requirement. The assessment
will include any barriers to meeting the visitation requirement statewide and
recommendations to DHR Executive administration for removing said barriers. DHR
will also issue policy publications emphasizing face-to-face visitation as opposed to other
types of contacts, what is expected from visitations, and the importance of prompt and
complete documentation.
DHR continues to actively recruit staff to meet the caseworker resource needs of the local
jurisdictions. Caseworker resources are currently allocated as judiciously as possible
according to children population and caseload.
Finding 12: The reliability of the data underlying the reported measures tested was
questionable with several being judged unreliable.
Recommendation 12: We recommend that DHR periodically test the reliability of the
information reported to it by BCDSS for inclusion in the 6-month compliance reports. In
addition, we recommend that DHR ensure that appropriate steps are taken by BCDSS to
provide reliable results in the future and that BCDSS retain adequate documentation to
support all data included in the report.
Response: Disagree. Consistent with the philosophy of managing for Results (MFR)
BCDSS/DHR periodically reviews all data in order to inform management decisions.
Universally accepted sound management practices encourage periodic review and
validations of data capture and methodologies used to analyze the data.
Planned Actions: Spring 2005 the Department authorized the hire of a nationally
recognized data consultant to: Validate LJ performance indicators/elements; Determine
whether the LJ data capture instruments ask the right and best questions to measure both
quantitative and qualitative compliance with each paragraph of the decree; Validate
methodologies used to measure and report LJ compliance and progress; and Validate
statistical soundness of LJ reporting format. The data consultant is expected to submit a
written report Spring 2006.
Finding 13: DHR did not report the BCDSS level of compliance regarding the timely
transfer of foster care cases between caseworkers and the method of calculating this
measure may not be appropriate.
8
AUDIT TEAM
Keonna M. Carter
David R. Fahnestock
Roger E. Jaynes, III
David S. Propper
Staff Auditors
Office of
Legislative
Audits