INVITATION TO NEGOTIATE. For. Statewide Contract Monitoring Services

Transcription

1 INVITATION TO NEGOTIATE For Statewide Contract Monitoring Services Issued By Florida Network of Youth and Family Services 2850 Pablo Avenue Tallahassee, Florida

2 Table of Contents 1. Introduction 2. Definition of Common Terms 3. Scope of Work 4. Expected Outcomes 5. Respondent Criteria 6. Selection 7. Calendar of Events 8. General Information 9. Preparation Instructions 2

3 1. Introduction The Florida Network of Youth and Family Services, Inc.(FNYFS) established in 1976, is a not-for-profit statewide association comprised of agencies which serve homeless, runaway and troubled youth ages ten to seventeen and their families. Services include advocacy for youth, public policy development, public education, data collection and research, contract management, quality improvement, training and technical assistance. The FNYFS is committed to promoting policies and practices that hold member agencies accountable for preventing delinquency and child abuse through the strengthening of youth and families. The Florida Department of Juvenile Justice provides primary funding, however, most agencies operating shelters seek additional grants from the federal government, the Department of Children and Families (DCF) and raise private funds each year. The shelters and non-residential services for these youth serve about 15,000 families annually. They offer a variety of services designed to promote the stability and strength of families. Intake services include assessment of the youth and family. Intervention services include parent training, youth development, case management, individual, group and family counseling, and referrals to other agencies, when needed. Temporary shelter services are also provided to self-referred youth and to those ordered into shelter by the court. This Invitation to Negotiate is to purchase statewide Quality Assurance (QA)/contract monitoring services of local provider agencies, as described in this Invitation to Negotiation. Services are expected to commence on July 1, Definition of Common Terms Definitions The following terms shall have the meanings as defined below when used throughout this Invitation to Negotiate. Assessment The gathering of information for the evaluation of a youth s physical, psychological, educational, vocational, social condition and family environment as they relate to the youth s need for services. Case Management Service coordination on behalf of clients which includes support, coordination and monitoring of services, information gathering; supportive linking; advocating, case review and termination, with appropriate referral. Case management services are conducted by both non-residential staff and shelter staff. CINS Children In Need of Services This is an adjudication status (court petition must be filed for a child for whom there is no pending investigation into an allegation of abuse, neglect, or abandonment; no pending referral alleging the child is delinquent; or no current supervision by the Department of Juvenile Justice or the Department of Children and Family Services for an adjudication of dependency or delinquency. The child must also have been found by the court to have persistently run away, to be habitually truant from school or to have persistently disobeyed the reasonable and lawful demands of the child s parent or legal custodian. Department Unless otherwise specified, the Florida Department of Juvenile Justice, also referred to as DJJ, is the executive branch agency responsible for the management of the juvenile justice and children and families in need of services (CINS/FINS) continuum of programs and services. 3

4 FINS Families in Need of Services A family that has a child who is running away; who is persistently disobeying reasonable and lawful demands of the parent or legal custodian and is beyond the control of the parent or legal custodian; or who is habitually truant from school or engaging in other serious behaviors that place the child at risk of future abuse, neglect, or abandonment or at risk of entering the juvenile justice system. A family is not eligible to receive services if, at the time of referral there is a pending investigation of abuse, neglect, or abandonment or no court ordered supervision by the Department of Juvenile Justice or the Department of Children and Families Services for an adjudication of dependency or delinquency. Florida Network of Youth and Family Services (FNYFS) - is a not-for-profit statewide association comprised of agencies which serve ungovernable, homeless, runaway and troubled youth ages ten and older and their families. The FNYFS is an advocate for prevention services and also provides statewide training and research, data collection, contract management and technical assistance. Non-Residential Services Intervention services to keep families intact and minimize outof-home placements (i.e., shelter, detention), based on the service needs of the youth and family as determined by the Centralized Intake Process. These services shall include but not be limited to; Homemaker or parent aide services Intensive crisis counseling Parent education Skills building In-home counseling services Youth development services Individual, group or family counseling Case management and referral Facilitation of CINS/FINS court process Case staffing committees Non-Residential services are meant to be short term. The standard for the average length of service per family will be twelve weeks, with the range varying from 2 weeks to 24 weeks depending upon the circumstances and progress of the youth. Additionally, follow-up and referral services will be provided. Performance-Based Budget Outcomes - The status of a juvenile in relation to delinquent behavior after completion of a program or services. Legislatively mandated outcomes for CINS/FINS services are as follows; 85% of youth completing services will remain crime free for 6 months 90% of youth shall remain crime free while receiving services Quality Assurance (QA) - a program whereby each state-operated or contractor-operated program must be evaluated annually based on standard criteria by Florida Network of Youth and Family Services. Referral Directing the child and family to the appropriate service based upon the service plan. As often as possible, CINS/FINS agencies have interagency agreements in place with other community-based service providers to ensure referred clients have access to longer term or more specialized services when such services are needed 4

5 Risk Factors Chosen indicators by the DJJ, the presence or absence of which may make an undesirable outcome more or less likely. Research suggests that the presence of risk factors will increase the likelihood that a youth will enter state care or custody or break the law. Screening The action of gathering information from a referral source (i.e., parent, child, law enforcement, etc.) to determine eligibility for CINS/FINS services under Chapter 984, F.S and to assess presenting problems and needs in order to facilitate further services. Status Offender - Status offenders are defined as juveniles, who have been accused of, or charged with, conduct that would not, under law, be an offense if committed by an adult such as truancy or running away. Temporary Shelter-Temporary shelter is available 24/7 and is designed to provide a safe place for youth in crisis to stay while family reunification is attempted. 3. Scope of Work The successful bidder will develop an annual schedule of a minimum of one on-site contract monitoring/qa visits for all CINS/FINS local provider agencies (31) and shelter sites (28) providing shelter and/or nonresidential services. Additional visits will be scheduled based on local agency need and performance. The successful bidder will develop a risk assessment tool to assist in the decision-making process identifying which CINS/FINS local providers will receive more than one on-site contract monitoring visit per year and for the prioritization of scheduling local providers for on-site visits throughout the year. On-site visits will be conducted using a contract-monitoring tool developed by the respondent and approved by the Florida Network and Quality Improvement (QI) Standards developed by the Florida Network. Written reports will be submitted regarding contract and QI compliance to the Florida Network and the Department within 15 working days of the monitoring visit. Quality Improvement Plans required of local providers resulting from on-site monitoring/qi visits will be coordinated and monitored for completion. Local provider consultation will be provided as needed via telephone, , on-site and at statewide meetings. Analysis of monthly, quarterly and annual data reports generated by the Florida Network and the DJJ is required. All cooperative agreements and subcontracts for the purposes of carrying out the required services must be approved by the FNYFS. Contractor shall administer and conduct all activities in compliance with all applicable federal and state laws and regulations. The total annual dollar amount available through this ITN covering the period of July 1, 2014 thru June 30, 2019 is $1,300, This includes travel expenses and all costs associated with conducting business. 4. Expected Outcomes An annual schedule of on-site contract monitoring/qa visits will be developed by October 15, A risk assessment tool will be developed to assist in the prioritization of scheduled visits. A contract monitoring tool will be developed and approved by the Florida Network by October 15,

6 100% of local providers will receive a minimum of one on-site contract monitoring/qa visit. 100% of written reports following each on-site contract monitoring visit will be submitted to the Florida Network, DJJ and the local provider within 15 working days of the on-site visit completion. A system for tracking the successful implementation of local providers that have Quality Improvement Plans will be developed and approved 5. Respondent Criteria Fatal Criteria Failure to provide all required documentation listed below will automatically disqualify the applicant from further consideration 5.1 The respondent must submit a cover letter indicating interest addressed to the Florida Network of Youth and Family Services, Inc. signed by the applicants Owner, Chief Executive Officer or Executive Director and include respondent s physical address, telephone number and address. 5.2 The respondent must submit an executive summary giving brief description of the applicant s qualifications and experience (length of time) in providing services to youth and families 5.3 The respondent must include a statement that describes or denies any pending or existing litigation or judgments. 5.4 The respondent must submit one original and five copies of response to this ITN to: Florida Network of Youth and Family Services Attention: Terry DeCerchio 2850 Pablo Avenue, Tallahassee, FL by 4:30 P.M. EDT, May 23, The FNYFS will not accept telegraphic, facsimile or electronically transmitted responses. Preferred Criteria FNYFS seeks Respondents meeting the following criteria, however, failure to meet these criteria will not disqualify the respondent. 5.5 The FNYFS is seeking respondents who have knowledge of and demonstrated experience in working with at-risk youth and families, non-profit regulations, Department of Children and Families licensing standards, Quality Improvement/Assurance processes and residential youth care facilities, preferably shelters, or respondents that can ensure such expertise through staffing. The respondent must provide evidence of its ability and capacity to carry out the required activities directly or can ensure such expertise through staffing. 5.6 The respondent must have an existing computer technology capacity including hardware and software that will access the internet for secure data transmissions. 6

7 5.7 Payment for services will be processed at the end of each month, after the services have been provided. Recipients must demonstrate the financial capacity to sustain service for approximately thirty days without payment. 6. Selection Potential respondents are reminded that this is not a bid or a Request for Proposal. This Invitation to Negotiate (ITN) merely seeks to identify providers that are interested in establishing a contract with the FNYFS for statewide QA/contract monitoring of local CINS/FINS services and assessing the capabilities of such potential local providers. The FNYFS will identify a review team made up of representatives familiar with the services to be provided and the area to be served that will review and rank the responses. The FNYFS retains the sole authority for developing and applying the criteria it will use to establish these rankings as described in Appendix I as approved by the DJJ. When a selection has been made all respondents will be notified. If negotiations with the selected agency are unsuccessful, negotiations will occur with the next ranked agency and continue that process until a contract is successfully negotiated. 7. Calendar of Events Scheduled Activity Date Method/Contact ITN Release April 16, 2014 VBS/Web Site/Mail/Telephone Written Questions to FNYFS Responses to written questions posted on FNYFS web site Sealed Responses Due Please allow enough time if mailing or hand delivering your response April 23, 2014 by 4:30PM EDT April 25, 2014 by 5:00P.M. EDT May 23, 2014 Sealed responses must be received no later than 4:30P.M. EDT Mail/ Terry DeCerchio 2850 Pablo Avenue Tallahassee, FL Terry@floridanetwork.org Submit by mail or hand deliver (no submissions) to: FNYFS Attn: Terry DeCerchio 2850 Pablo Avenue Tallahassee, FL Response Opening May 27, 2014 FNYFS, Tallahassee, FL Respondent ITN responses reviewed by the review team(s) selected by FNYFS Anticipated Award Announcement Anticipated Contract Negotiations May 29, June 12, 2014 June 20, 2014 June 23-27, 2014 Anticipate Start Date July 1, 2014 Announcement will be posted on the FNYFS web site FNYFS 7

8 Questions about services requested or the selection process must be addressed in writing by fax, , or postal deliver to the FNYFS Office. If the FNYFS finds it necessary to supplement, modify or interpret any portion of the ITN documents prior to the closing time and date, such procedure will be accomplished by the issuance of written addenda. No other methodology will be considered binding or authorized in giving information concerning, or to explain or interpret the ITN document. Any addenda will be posted at Note: acknowledgement of any addenda must accompany ITN Response. Questions concerning conditions and specifications of this ITN, must be received in writing by the FNYFS not later than April 23, 2014 by 4:30pm EDT. Telephone inquiries regarding the above will not be responded to. Note; Submit questions in writing to Florida Network Youth and Family Services Attn: Terry DeCerchio 2850 Pablo Avenue Tallahassee, Florida Facsimile: General Information A. Restrictions Respondents to this solicitation or persons acting on their behalf may not contact, between the release of this solicitation and the end of the 72-hour period following the FNYFS posting the notice of intended award, excluding Saturdays, Sundays, and state holidays, any employee or officer of the FNYFS, executive or legislative branch concerning any aspect of this solicitation, except in writing to the FNYFS as provided in the procurement documents. Violation of this provision may be grounds for rejecting a response. B. Certified Minority Business Enterprise The FNYFS supports the fostering of continued economic growth and development of Florida Minority Businesses Enterprises (MBEs) and Certified Minority Business Enterprises (CMBEs) (for-profit). The FNYFS welcomes certified MBE s interest as a respondent to this ITN. All respondents, whether an MBE or not, must describe participation in the procurement of goods and services and contracts that demonstrate a commitment to supporting CMBEs and MBEs. C. Preparation Costs ITN responses shall contain all information solicited, plus any additional data prints, or literature that the respondent deems pertinent to the Reviewer s understanding and evaluation of their response. The FNYFS is not liable for any costs or expenses incurred by an applicant related to or arising out to the ITN process D. Withdrawal A submitted ITN may be modified or withdrawn at any time prior to response opening upon written request by the Respondent. E. Response Duration All submitted responses are binding for one hundred twenty (120) days following the response opening date. 8

9 F. Special Accommodation Any person requiring a special accommodation because of a disability should call the FNYFS office at (850) at least seven (7) workdays prior to the responses due date. If a person is hearing or speech impaired, please contact the Division by using the Florida Relay Service, which can be reached at 1 (800) (TDD). G. Contract The contract resulting form this ITN will be a fixed price contract. The contract term will be July 1, 2014 through June 30, 2019 based on satisfactory performance and legislative appropriation. H. Response Posting Recommended Respondents will be posted on the FNYFS web page at for review by interested parties at the location where bids were opened on or about June 20, 2014 and will remain posted for a period of 72 hours. 10. Preparation Instructions Overview Proposals should be prepared simply, providing a straightforward, concise description of capabilities to satisfy the requirements of this ITN. Emphasis should be placed on completeness and clarity. The proposal should be organized in the order in which the requirements are presented as noted in this section. The proposal must contain a table of contents that cross-references the ITN requirements. Information that the respondent desires to present that does not fall within any of the requirements of the ITN should be inserted at an appropriate place or be attached at the end of the proposal and designated as additional material. The objective of the submitted response is to demonstrate that the respondent qualifies for further consideration by the FNYFS by meeting the mandatory criteria (Volume 1); and second to explain the respondent s ability to successfully deliver the services requested (Volume 2). In order to assist the FNYFS in reviewing responses, the following format shall be utilized: Volume 1 A. Cover letter - Provide a letter that specifies that respondent is responding to FNYFS ITN for Statewide Contract Monitoring Services. Include the respondent s name(s), address(es), telephone number(s), the name, title and signature of the authorized representative(s) submitting the proposal. The letter must clearly indicate that the person or persons signing the response is authorized to bind the respondent. B. Executive Summary Provide a brief summary of the respondent s understanding of the services requested, previous experience and description of your organization capability to provide said services to the FNYFS. C. References/Letters of Support Provide at least three (3) references that demonstrate efforts comparable to the one described in this ITN. Information must include the name and telephone number of a contact person. 9

10 D. A statement describing any pending or existing litigation or judgments that might affect the ability to carry out the contract or a statement that no pending or existing litigation or judgment exists. E. Proof of Minority Business Enterprise certification (if applicable) Volume 2 Proposal Responses to the following shall be prepared and submitted which address the specific eligibility requirements, scope of work and outcomes outlined in Sections 3, 4 and 5. Each response must be completed in the same order as it appears and section heading should be used to identify each response. The reply to all questions in the Proposal (Volume 2) should be NO MORE THAN thirty (30) PAGES but sufficient in detail to adequately address query. A RESPONDENT S QUALIFICATIONS Describe in detail, as the respondent, the plan to meet the requirements listed in Sections 5.5, 5.6 and 5.7 Respondent Criteria (page 7 of this ITN). Provide the number of positions that would be assigned to the project and explain technical expertise and responsibilities of positions. The respondent must provide evidence of ability and capacity to carry out the required activities or ensure such expertise through staffing. Describe how respondent proposes to maintain a reasonable level of staff stability and experience. Describe existing computer technology and fiscal capacity. B OVERALL PROJECT CONCEPT AND DESIGN Describe in detail (examples of content are given) the following: Concept- Respondent will describe understanding of the overall statutory intent, and mission of the DJJ and the FNYFS in serving Children and Families in Need of Services (CINS/FINS). Respondent will describe an understanding of the CINS/FINS service delivery system. Respondent will describe their understanding of Quality Improvement processes and how this process can be successfully incorporated into the contract monitoring process. Design-.Respondent will describe in detail the process whereby a systematic, organized review of a local provider operations and service provision is conducted in order to give reasonable assurance that the local provider is complying with contract requirements, Quality Improvement Standards and Indicators, rules, regulations and laws applicable to the local provider s contract performance, and how this process will serve to meet the specifications listed in Section 3, Scope of Work. Review of elements by which performance accountability, quality of services and youth safety are ensured shall be listed in order of priority. Include a proposed monitoring tool. Detail supports and activities the respondent will offer to ensure local agency program integrity, quality and the safety of all youth. Describe how respondent will ensure the timeliness and integrity of required reports submission. Describe how requests for technical assistance from local providers will be addressed and provided. C.GOAL AND PROJECTED OUTCOMES 10

11 Describe in detail the strategies the respondent will use to reach the required goals and projected outcomes in Section 4: Expected Outcomes (page 6 of this ITN) or reference previous reports that demonstrate achievement with similar outcomes. Describe how the program design will facilitate the reaching of these desired goals and outcomes. Discuss in detail what respondent views as the critical issues inherent in meeting these outcomes. SUBMIT One original and five copies to: Florida Network of Youth and Family Services Attn: Terry DeCerchio 2850 Pablo Avenue Tallahassee, Florida Note: The FNYFS WILL NOT ACCEPT TELEGRAPHIC, FACISIMLE OR ELECTRONICALLY TRANSMITTED RESPONSE. NO EXCEPTIONS Responses received after 4:30 P.M. EDT May 23, 2014, will not be considered. NO EXCEPTIONS. The FNYFS reserves the right to reject any and all responses and negotiations efforts. The FNYFS also reserves the right to waive any minor irregularities in an otherwise valid offer to negotiate. Materials submitted will become the property of the Florida Network of Youth and Family Service. 11

12 STATEWIDE CONTRACT MONITORING APPENDIX I Rating for Respondent Section I: FATAL CRITERIA (If any are not met, the application cannot be considered further.) Please circle the appropriate response. 1. Was application received in the manner and by the time and date, and at the location specified in the Invitation to Negotiate? 2. Were there one original and 5 copies of the application? 3. Statement describing or denying any pending or existing litigation or judgements in Volume 1? 4. Was a cover letter submitted signed by Owner, CEO or ED with address, telephone number and ? 5. Was an executive summary submitted with brief description of applicant s qualifications and experience? Yes Yes Yes Yes Yes No No No No No The FNYFS reserves the right to reject any and all applications or to waive minor irregularities when to do so would be in the best interest of the State of Florida. If all responses are Yes, continue to next section. If one or more is No, the application is rejected and the applicant disqualified.

13 VOLUME 1 SECTION II: EVALUATION CRITERIA Mandatory Requirements- Overview The following documents were submitted as required in Volume 1: Maximum = 5.5 Cover letter Executive Summary References/Letters of Support (3) Proof of MBE certification Section II. SCORE: Rating.5 point.5 point 3 point 1.5 point Notes 1

14 VOLUME 2 A. Respondent s Qualifications: Describe in detail, as the respondent, the plan to meet the requirements listed in Sections 5.5, 5.6 and 5.7 Respondent Criteria (page 7 of this ITN). Provide the number of positions that would be assigned to the project and explain technical expertise and responsibilities of positions. The respondent must provide evidence of ability and capacity to carry out the required activities or ensure such expertise through staffing. Describe how respondent proposes to maintain a reasonable level of staff stability and experience. Describe existing computer technology and fiscal capacity. All items in 5.5, 5.6 and 5.7 are clearly addressed and described with supporting documentation. Respondent has demonstrated experience and knowledge in working with at-risk youth and families, non-profits, Quality Improvement/Assurance processes, DCF and DJJ and shelters. Respondent clearly describes how staff stability and experience will be maintained. Respondent has existing computer technology and is fiscally sound. All items in 5.5, 5.6 and 5.7 are addressed and described with supporting documentation. Respondent has some experience and knowledge in working with at-risk youth and families, non-profits, Quality Improvement/Assurance processes, DCF and DJJ and shelters. Respondent can describe how staff stability and experience will be maintained. Respondent has existing computer technology and is fiscally sound. Most items in 5.5, 5.6 and 5.7 are addressed and described with some supporting documentation. Respondent has some experience and knowledge in working with at-risk youth and families, non-profits, Quality Improvement/Assurance processes, DCF and DJJ and shelters. Respondent can describe how staff stability and experience will be maintained. Respondent has existing computer technology and is fiscally sound. Rating Maximum = 25 Notes 2

15 Few items in 5.5, 5.6 and 5.7 are addressed and described with little supporting documentation. Respondent has very little experience and knowledge in working with at-risk youth and families, non-profits, Quality Improvement/Assurance processes, DCF and DJJ and shelters Responses to Sections 5.5, 5.6 and 5.7 were missing points A. SCORE: 5.5 The FNYFS is seeking respondents who have knowledge of and demonstrated experience in working with at-risk youth and families, non-profit regulations, Department of Children and Families licensing standards, Quality Improvement/Assurance processes and residential youth care facilities, preferably shelters, or respondents that can ensure such expertise through staffing. The respondent must provide evidence of its ability and capacity to carry out the required activities directly or can ensure such expertise through staffing. 5.6 The respondent must have an existing computer technology capacity including hardware and software that will access the internet for secure data transmissions. 5.7 Payment for services will be processed at the end of each month, after the services have been provided. Recipients must demonstrate the financial capacity to sustain service for approximately thirty days without payment. 3

16 B.1. Project Concept Concept- Concept- Respondent will describe understanding of the overall statutory intent, and mission of the DJJ and the FNYFS in serving Children and Families in Need of Services (CINS/FINS). Respondent will describe an understanding of the CINS/FINS service delivery system. Respondent will describe their understanding of Quality Improvement processes and how this process can be successfully incorporated into the contract monitoring process. Rating Maximum = 15 Notes The respondent describes an active understanding of the overall statutory intent, mission and CINS/FINS service delivery system. Respondent successfully describes their thorough understanding of Quality Improvement processes and how this process can be successfully incorporated into the contract monitoring process. The respondent describes an adequate understanding of the overall statutory intent, mission and CINS/FINS service delivery system as well as Quality Improvement processes and how it can be incorporated into the contract monitoring process. The respondent shows only a minimal understanding of the overall statutory intent, mission and CINS/FINS service delivery system as well as Quality Improvement processes and how it can be incorporated into the contract monitoring process. The respondent shows no understanding of the overall statutory intent, mission and CINS/FINS service delivery system, Quality Improvement processes or contract monitoring B.1. SCORE: 4

17 B.3. Design: Respondent will describe in detail the process whereby a systematic, organized review of a local provider operations and service provision is conducted in order to give reasonable assurance that the local provider is complying with contract requirements, Quality Improvement Standards and Indicators, rules, regulations and laws applicable to the local provider s contract performance and how this process will serve to meet the specifications listed in Section 3, Scope of Work. Review of elements by which performance accountability, quality of services and youth safety are ensured shall be listed in order of priority. Include a proposed monitoring tool. Detail supports and activities the respondent will offer to ensure local agency program integrity, quality and the safety of all youth. Describe how respondent will ensure the timeliness and integrity of required reports submission. Describe how requests for technical assistance from local providers will be addressed and provided. Maximum = 35 All of the following requirements are addressed, clearly described and reflect effective practice: Process of systematic, organized review of local provider operations Prioritization of review elements Proposed monitoring tool included Section 3, Scope of Work Ensuring the timeliness and integrity of required report submission Addressing requests for technical assistance At least four (4) of the following requirements are addressed, clearly described and reflect effective practice: Process of systematic, organized review of local provider operations Prioritization of review elements Proposed monitoring tool included Section 3, Scope of Work Ensuring the timeliness and integrity of required report submission Addressing requests for technical assistance At least three (3) of the following requirements are addressed, clearly described and reflect effective practice: Process of systematic, organized review of local provider operations Prioritization of review elements Proposed monitoring tool included Section 3, Scope of Work Ensuring the timeliness and integrity of required report submission Addressing requests for technical assistance Rating Notes 5

18 At least two (2) of the following requirements are addressed, clearly described and reflect effective practice: Process of systematic, organized review of local provider operations Prioritization of review elements Proposed monitoring tool included Section 3, Scope of Work Ensuring the timeliness and integrity of required report submission Addressing requests for technical assistance At least one (1) of the following requirements are addressed, clearly described and reflect effective practice: Process of systematic, organized review of local provider operations Prioritization of review elements Proposed monitoring tool included Section 3, Scope of Work Ensuring the timeliness and integrity of required report submission Addressing requests for technical assistance None of the requirements were met 0 B.3. SCORE: 3. Scope of Work The successful bidder will develop an annual schedule of a minimum of one on-site contract monitoring/qa visits for all CINS/FINS local provider agencies (31) and shelter sites (28) providing shelter and/or nonresidential services. Additional visits will be scheduled based on local agency need and performance. The successful bidder will develop a risk assessment tool to assist in the decision-making process identifying which CINS/FINS local providers will receive more than one on-site contract monitoring visit per year and for the prioritization of scheduling local providers for on-site visits throughout the year. On-site visits will be conducted using a contract-monitoring tool developed by the respondent and approved by the Florida Network and Quality Improvement (QI) Standards developed by the Florida Network. Written reports will be submitted regarding contract and QI compliance to the Florida Network and the Department within 15 working days of the monitoring visit. Quality Improvement Plans required of local providers resulting from on-site monitoring/qi visits will be coordinated and monitored for completion. Local provider consultation will be provided as needed via telephone, , on-site and at statewide meetings. Analysis of monthly, quarterly and annual data reports generated by the Florida Network and the DJJ is required. All cooperative agreements and subcontracts for the purposes of carrying out the required services must be approved by the FNYFS. Contractor shall administer and conduct all activities in compliance with all applicable federal and state laws and regulations. 6

19 D. Goals and Outcomes- Describe in detail the strategies the respondent will use to reach the required goals and projected outcomes in Section 4: Expected Outcomes or reference previous reports that demonstrate achievement with similar outcomes. Discuss in detail what respondent views as the critical issues inherent in meeting these outcomes. Maximum = 20 Respondent has clearly and thoroughly described strategies to meet all of the outcomes listed in Section 4 of the ITN and/or included previous reports that demonstrate achievement with similar outcomes. Respondent has adequately described strategies to meet all of the outcomes listed in Section 4 of the ITN and/or included previous reports that demonstrate achievement with similar outcomes. Respondent has somewhat described strategies to meet some or most of the outcomes listed in Section 4 of the ITN and/or included previous reports that demonstrate achievement with similar outcomes. Respondent has not described strategies to meet outcomes listed in Section 4 of the ITN and/or included previous reports that demonstrate achievement with similar outcomes. D. SCORE: Rating Notes 4. Expected Outcomes An annual schedule of on-site contract monitoring/qa visits will be developed by October 15, A risk assessment tool will be developed to assist in the prioritization of scheduled visits. A contract monitoring tool will be developed and approved by the Florida Network by October 15, % of local providers will receive a minimum of one on-site contract monitoring/qa visit. 100% of written reports following each on-site contract monitoring visit will be submitted to the Florida Network, DJJ and the local provider within 15 working days of the on-site visit completion. A system for tracking the successful implementation of local providers that have Quality Improvement Plans will be developed and approved 7

20 Evaluation Criteria Summary Volume 1 Section II: Evaluation Criteria Mandatory Requirements- Overview (5.5) SCORE: Volume 2 Section III: Proposal Respondent Qualifications (25) SCORE: Project Concept (15) SCORE: Project Design (35) SCORE: Goals and Outcomes (20) SCORE: TOTAL: TOTAL POSSIBLE: Reviewer Signature Date 8