ATTORNEY WORK PRODUCT — PRIVILEGED AND CONFIDENTIAL PREPARED IN ANTICIPATION OF LITIGATION
This memorandum constitutes attorney work product prepared in anticipation of litigation and is protected from disclosure by the attorney work-product doctrine. This document contains confidential attorney-client communications, mental impressions, conclusions, opinions, and legal theories of counsel. This memorandum is not to be disclosed to any person or entity outside of Calderwood & Harkness LLP or authorized client representatives of Metropolitan Transit Development Corp. without the prior written approval of Ian Blackwood, Responsible Partner. Any unauthorized disclosure, copying, distribution, or use of this memorandum or its contents is strictly prohibited and may result in waiver of applicable privileges.
PRIVILEGED MEMORANDUM
Summary of Linden Analytics Group Expert Findings
TO: Ian Blackwood, Partner; Christopher Aiken, Associate
FROM: Sara Hendricks, Lead Associate
DATE: October 5, 2022
RE: Summary of Expert Findings — Dr. Alicia Fernwood, Linden Analytics Group, LLC — Procurement Evaluation Analysis, RFP No. IDOT-TS-2022-014 (Illinois Integrated Transit Modernization Program)
CLIENT: Metropolitan Transit Development Corp. ("MTDC")
MATTER NO.: 1031-00003
PROTEST NO.: IDOT-BPC-2022-0047
I. Purpose and Scope of Memorandum
This memorandum summarizes the expert findings and opinions of Dr. Alicia Fernwood, Principal Consultant at Linden Analytics Group, LLC ("Linden Analytics" or "LAG"), an independent procurement analytics and cost-estimation consultancy organized under the laws of the Commonwealth of Virginia, with its principal offices located at 1925 Ballenger Avenue, Suite 310, Alexandria, Virginia 22314. Dr. Fernwood was retained by Calderwood & Harkness LLP on behalf of our client, Metropolitan Transit Development Corp. ("MTDC"), pursuant to an expert engagement letter dated July 22, 2022, to evaluate the procurement evaluation methodology employed by the Illinois Department of Transportation ("IDOT") in connection with RFP No. IDOT-TS-2022-014 for the Illinois Integrated Transit Modernization Program ("IITMP").
Dr. Fernwood's analysis addresses two primary areas of concern arising from the procurement record. First, Dr. Fernwood examines IDOT's failure to conduct an adequate cost-realism analysis on the cost-reimbursable line items proposed by Pinnacle Transit Solutions, Inc. ("Pinnacle"), the awardee. Second, Dr. Fernwood identifies and evaluates irregularities in the scoring methodology and best-value tradeoff determination that resulted in the contract award to Pinnacle — a higher-priced, lower-scored offeror — over MTDC's proposal. These two areas of analysis are closely interrelated, as the cost-realism failure directly affected the price evaluation, which in turn influenced the integrity of the tradeoff decision.
Dr. Fernwood is a former federal contracting officer with over two decades of professional experience in procurement oversight, cost estimation, and source selection support. Her qualifications, which are summarized in Section III of this memorandum and detailed in her curriculum vitae (maintained in the engagement file), establish her as a highly credible and experienced expert in the field of government procurement analysis.
Dr. Fernwood's findings are intended to support MTDC's agency-level bid protest (Protest No. IDOT-BPC-2022-0047), which was filed by this firm on August 8, 2022, on behalf of MTDC. The findings are also intended to inform the engagement team's assessment of potential litigation escalation to the Illinois Court of Claims in the event the agency-level protest does not result in a favorable outcome for MTDC.
This memorandum is prepared in anticipation of litigation and is protected by the attorney work-product doctrine. It reflects the mental impressions, conclusions, and legal theories of counsel and should be treated with the highest degree of confidentiality.
II. Background
A. The Solicitation
On January 18, 2022, the Illinois Department of Transportation issued Request for Proposals No. IDOT-TS-2022-014 (the "RFP" or the "Solicitation") for the Illinois Integrated Transit Modernization Program. The IITMP is a comprehensive, multi-year initiative designed to modernize and integrate transit systems across a significant portion of northeastern Illinois, encompassing bus rapid transit, light rail, and paratransit services. The RFP was issued through IDOT's Bureau of Transit Operations and was posted on the Illinois Procurement Bulletin in accordance with applicable Illinois Procurement Code requirements.
Proposals in response to the RFP were due on April 29, 2022. The Solicitation established a contract type consisting of Firm-Fixed-Price ("FFP") line items for the majority of contract deliverables, coupled with Cost-Reimbursable ("CR") line items for Technology Development work. This hybrid contract structure is significant to the expert analysis discussed herein, as the cost-reimbursable elements impose distinct evaluation obligations on the procuring agency — obligations that Dr. Fernwood concludes IDOT failed to meet.
The base performance period for the IITMP contract spans seven years, with an anticipated period of performance commencing October 1, 2022, and extending through September 30, 2029. In addition, the RFP contemplated two three-year option periods: Option Period I, running from October 1, 2029, through September 30, 2032, and Option Period II, running from October 1, 2032, through September 30, 2035. If both options are exercised, the total period of performance would extend to thirteen years.
The total maximum contract value, inclusive of the base period and both option periods, was established at up to $310 million. This substantial contract value reflects the scope and complexity of the IITMP and underscores the significance of the procurement decisions at issue in this protest.
Funding for the IITMP contract derives from three primary sources:
• Federal Transit Administration ("FTA") Capital Investment Grant: $148.5 million, representing approximately 60% of the anticipated base-period contract value. These federal funds carry their own compliance and oversight requirements, which are relevant to the cost-realism analysis discussed below.
• State of Illinois General Revenue Fund: $74.3 million, representing approximately 30% of the anticipated base-period contract value.
• IDOT Transit Modernization Fund: $24.8 million, representing approximately 10% of the anticipated base-period contract value, funded through state bond proceeds.
The blended federal-state funding structure amplifies the importance of rigorous cost evaluation, as both federal and state taxpayer funds are at risk of being committed to a contract based on unrealistic cost projections.
B. The Evaluation Criteria (RFP Section M)
Section M of the RFP established the evaluation criteria and their relative weights for the source selection process. The RFP specified a best-value tradeoff methodology, under which the award would be made to the offeror whose proposal represents the best overall value to the State of Illinois, considering technical merit and cost/price factors. The evaluation criteria, sub-factors, and point allocations were set forth as follows:
• Factor 1: Technical Approach — 40% weight, with a maximum of 400 points. This was the most heavily weighted evaluation factor and encompassed the offeror's proposed approach to accomplishing the IITMP's technical requirements, including system design, integration, implementation planning, and technology development.
• Factor 2: Management & Staffing Plan — 25% weight, with a maximum of 250 points. This factor evaluated the offeror's proposed management structure, key personnel qualifications, organizational approach, and workforce planning.
• Factor 3: Past Performance — 20% weight, with a maximum of 200 points. This factor assessed the offeror's demonstrated record of performance on contracts of similar size, scope, and complexity, including adherence to schedule, budget, and quality standards.
• Factor 4: Cost/Price — 15% weight, with a maximum of 150 points. This factor evaluated the reasonableness, realism, and completeness of the offeror's proposed pricing, including both the FFP and CR line items.
The total maximum score across all four factors was 1,000 points. The RFP's weighting structure clearly prioritized technical merit over cost/price, with the three technical/management/past performance factors collectively accounting for 85% of the total score (850 out of 1,000 points) and the Cost/Price factor accounting for the remaining 15% (150 points). However, even within a best-value framework that emphasizes non-price factors, cost/price evaluation remains a critical component — particularly where cost-reimbursable elements are involved — and the SSA's tradeoff determination must rationally account for price differentials between offerors.
C. The Competing Proposals
Two offerors submitted proposals in response to the RFP that are relevant to this protest:
MTDC's Proposal. MTDC submitted its proposal on or before the April 29, 2022, deadline. MTDC's total proposed price for the seven-year base performance period was $234.9 million. MTDC's proposal reflected its extensive experience as the incumbent operator and modernizer of transit services in the northeastern Illinois region, its deep familiarity with the existing transit infrastructure, and its established relationships with regulatory authorities including the FTA. MTDC's proposal team invested significant resources in preparing a comprehensive, technically detailed response to all RFP requirements.
Pinnacle's Proposal. Pinnacle Transit Solutions, Inc. ("Pinnacle"), a corporation organized under the laws of the State of Delaware and headquartered in Indianapolis, Indiana, submitted a competing proposal with a total proposed price of $247.6 million for the seven-year base performance period. Pinnacle's proposal was managed by Denise Whitfield, Pinnacle's Chief Operating Officer. Pinnacle's proposal included a subcontractor teaming arrangement with Northlake Harborline Technologies Systems, Inc. ("Northlake"), which IDOT's Source Selection Authority later cited as a distinguishing feature of Pinnacle's proposal.
The price differential between the two proposals was $12.7 million, with Pinnacle's proposal priced 5.4% higher than MTDC's. This differential is significant in the context of a best-value tradeoff analysis, as the SSA was required to articulate a rational basis for paying a $12.7 million premium for Pinnacle's proposal over MTDC's.
D. The Source Selection Decision
The Source Selection Decision Document ("SSDD") was issued on July 14, 2022. The SSDD was signed by Angela Moreau, Deputy Secretary for Multimodal Transportation, in her capacity as the Source Selection Authority ("SSA"). The Contracting Officer for the procurement was Gerald Fassett, P.E., who serves as Chief of the Bureau of Transit Operations within IDOT.
Notwithstanding MTDC's lower price and higher aggregate evaluation score (as detailed in Section V below), the contract was awarded to Pinnacle under the best-value tradeoff methodology. In the SSDD, the SSA cited Pinnacle's purported "superior workforce integration methodology" and its subcontractor teaming arrangement with Northlake Harborline Technologies Systems, Inc. as the primary justifications for selecting Pinnacle's higher-priced proposal over MTDC's. As discussed extensively in Section V of this memorandum, Dr. Fernwood identifies significant deficiencies in this rationale.
E. The Protest
On August 8, 2022, MTDC, acting through Calderwood & Harkness LLP, filed an agency-level bid protest with IDOT, designated as Protest No. IDOT-BPC-2022-0047. The protest challenges the award to Pinnacle on five grounds:
Ground 1: Scoring error and unreasonable best-value tradeoff determination. MTDC asserts that the SSA's decision to award to Pinnacle, despite MTDC's 30-point aggregate scoring advantage and $12.7 million lower price, lacks a rational basis and is not supported by the evaluation record.
Ground 2: Reliance on unstated evaluation criteria. MTDC asserts that the SSA's citation of "workforce integration methodology" as the primary basis for the award constitutes reliance on an evaluation criterion that was not disclosed to offerors in RFP Section M.
Ground 3: Organizational conflict of interest. MTDC asserts that Pinnacle's subcontractor, Northlake Harborline Technologies Systems, Inc., had an unmitigated organizational conflict of interest arising from its prior work with IDOT in developing the IITMP's preliminary specifications.
Ground 4: Cost-realism failure. MTDC asserts that IDOT failed to perform an adequate cost-realism analysis on Pinnacle's cost-reimbursable line items, resulting in an artificially favorable Cost/Price evaluation for Pinnacle.
Ground 5: Procedural irregularity. MTDC asserts that IDOT failed to follow its own evaluation procedures in several respects, including the failure to document the basis for the tradeoff decision in sufficient detail.
The protest is currently pending before the IDOT Administrative Review Board, which is chaired by Administrative Law Judge Terrence Odum. A hearing has not yet been scheduled as of the date of this memorandum.
III. Dr. Fernwood's Qualifications
Dr. Alicia Fernwood serves as Principal Consultant at Linden Analytics Group, LLC, where she leads the firm's procurement analysis and cost-estimation practice. Dr. Fernwood is a former federal contracting officer whose professional experience spans over two decades in procurement oversight, source selection support, cost analysis, and contract administration. During her career in government service, Dr. Fernwood held progressively responsible contracting positions with the General Services Administration ("GSA") and the U.S. Department of Transportation, where she served as a warranted contracting officer with authority over procurements valued in excess of $100 million.
Dr. Fernwood's areas of expertise include, but are not limited to, best-value tradeoff evaluation methodologies, cost-realism analysis, development and review of Independent Government Cost Estimates ("IGCEs"), source selection procedures, and competitive range determinations. She holds a Ph.D. in Public Policy from George Mason University and is a Certified Professional Contracts Manager ("CPCM") through the National Contract Management Association.
Since founding Linden Analytics Group in 2014, Dr. Fernwood has served as an expert consultant and testifying expert in numerous bid protest and procurement litigation matters at both the federal and state level. She has been retained as an expert in proceedings before the U.S. Government Accountability Office ("GAO"), the U.S. Court of Federal Claims, various state procurement review boards, and state courts of claims. Her expert testimony and written reports have been cited favorably in published decisions, and she is widely regarded as a leading authority in procurement evaluation analysis.
For this engagement, Dr. Fernwood was retained at a flat fee of $145,000 for the protest-phase engagement, which encompasses her review of the procurement record, analysis of the evaluation methodology, preparation of expert findings and opinions, and consultation with the engagement team. An additional $85,000 has been authorized for litigation-phase support in the event the matter escalates to the Illinois Court of Claims. The litigation-phase fee would cover preparation of a formal expert report, deposition testimony, and trial testimony. Dr. Fernwood's compensation is not contingent on the outcome of the protest or any subsequent litigation.
A copy of Dr. Fernwood's full curriculum vitae and engagement letter are maintained in the Calderwood & Harkness engagement file.
IV. Expert Findings: Cost-Realism Analysis Failure
A. Overview of Cost-Realism Requirements
The RFP established a hybrid contract structure that included both Firm-Fixed-Price line items and Cost-Reimbursable line items for Technology Development work. The inclusion of cost-reimbursable elements in the contract structure is a critical feature of this procurement because it triggers specific evaluation obligations that do not apply to fixed-price contracts. Specifically, where a solicitation includes cost-reimbursable elements, the procuring agency is required to perform a cost-realism analysis as part of its evaluation of proposals.
The purpose of a cost-realism analysis is to evaluate whether an offeror's proposed costs are realistic for the work to be performed, reflect a clear understanding of the contract requirements, and are consistent with the unique methods of performance and materials described in the offeror's technical approach. A cost-realism analysis is fundamentally different from a price-reasonableness analysis; while price reasonableness asks whether a price is too high, cost realism asks whether proposed costs are too low — and therefore likely to result in cost growth during contract performance.
Dr. Fernwood emphasizes that cost-realism analysis is mandatory — not discretionary — where a solicitation includes cost-reimbursable elements. The reason is straightforward: under a cost-reimbursable contract structure, cost risk rests with the government, not the contractor. The agency, rather than the contractor, bears the financial risk of cost underestimation. If a contractor proposes unrealistically low costs on cost-reimbursable line items, the government will ultimately be responsible for paying the actual costs incurred during performance, which may far exceed the proposed amounts. Accordingly, the agency has both the obligation and the incentive to scrutinize proposed costs for realism before making a source selection decision.
Dr. Fernwood identifies the applicable standards governing cost-realism analysis in this procurement. As a matter of Illinois state law, the procurement is subject to the Illinois Procurement Code (30 ILCS 500) and its implementing regulations, including 44 Ill. Admin. Code § 1.5530, which governs the evaluation of proposals in competitive negotiated procurements. While the Illinois regulatory framework does not prescribe cost-realism procedures with the same level of specificity as the Federal Acquisition Regulation, Dr. Fernwood draws on analogous federal standards — particularly FAR Part 15 (Contracting by Negotiation) and its Subpart 15.4 (Contract Pricing) — as commonly applied benchmarks in state procurement contexts. Dr. Fernwood notes that state procurement agencies routinely reference and apply FAR-derived cost-realism principles when evaluating proposals that include cost-reimbursable elements, and that IDOT's own procurement guidance documents reference federal procurement standards as supplementary authority.
B. Pinnacle's Cost-Reimbursable Line Items vs. the IGCE
Dr. Fernwood's analysis compares the cost-reimbursable line item pricing submitted by Pinnacle against the Independent Government Cost Estimate ("IGCE") that IDOT developed for the IITMP procurement. The IGCE serves as the agency's own benchmark estimate of the expected costs for the work to be performed and is a foundational reference point for any cost-realism evaluation.
The comparison reveals a significant discrepancy:
• Pinnacle's proposed cost for cost-reimbursable line items: $38.4 million
• IDOT's IGCE for the same cost-reimbursable line items: $49.2 million
• Shortfall: $10.8 million, representing a 21.95% understatement relative to the IGCE ($10.8 million ÷ $49.2 million = 21.95%)
Dr. Fernwood opines that a 21.95% deviation from the IGCE on cost-reimbursable line items constitutes a significant red flag that should have triggered heightened scrutiny by the evaluation team. In Dr. Fernwood's professional experience, deviations of this magnitude are not attributable to reasonable differences in estimating methodology or minor variations in assumptions about labor rates or material costs. Rather, a shortfall of nearly 22% suggests one or more of the following:
(a) Pinnacle did not fully understand the scope and complexity of the technology development requirements set forth in the RFP, and therefore underestimated the labor, materials, and other resources necessary to accomplish the work;
(b) Pinnacle intentionally underbid the cost-reimbursable line items in order to enhance its competitive position on the Cost/Price evaluation factor, knowing that any cost growth during performance would be borne by the government rather than by Pinnacle; or
(c) Pinnacle intended to rely on cost growth, contract modifications, or change orders during contract performance to make up for the shortfall between its proposed costs and the actual costs of the technology development work.
Any of these explanations, if substantiated, would represent a serious concern for the procuring agency and would warrant, at a minimum, detailed clarification questions to Pinnacle, a thorough analysis of Pinnacle's cost basis and assumptions, and a probable upward adjustment to Pinnacle's proposed costs for purposes of the evaluation.
C. Evidence of IDOT's Failure to Conduct Adequate Cost-Realism Evaluation
Dr. Fernwood conducted a detailed review of the procurement documentation available to the engagement team, including the Source Selection Decision Document dated July 14, 2022, and the supporting evaluation documentation generated by the Technical Evaluation Panel ("TEP"). Based on this review, Dr. Fernwood identifies the following evidentiary deficiencies, each of which supports her conclusion that IDOT failed to perform an adequate cost-realism analysis:
First, the Source Selection Decision Document contains no discussion whatsoever of Pinnacle's cost-reimbursable line items relative to the IGCE. The SSDD's narrative regarding the Cost/Price factor evaluation is limited to a general recitation of each offeror's total proposed price and the scoring results. There is no mention of the $10.8 million shortfall, no discussion of its significance, and no indication that the SSA considered whether Pinnacle's cost-reimbursable pricing was realistic.
Second, the Technical Evaluation Panel report — which serves as the primary record of the evaluators' analysis — does not reference any cost-realism evaluation methodology. The TEP report does not identify the specific steps taken by the evaluators to assess the realism of Pinnacle's cost-reimbursable line items, nor does it document any comparison between Pinnacle's proposed costs and the IGCE. The $10.8 million shortfall is not identified or discussed anywhere in the TEP report.
Third, the procurement record contains no evidence that IDOT issued evaluation notices, clarification requests, or discussion questions to Pinnacle regarding the cost-reimbursable line item pricing. In a properly conducted cost-realism evaluation, an agency that identifies a significant deviation from the IGCE would typically request a detailed explanation from the offeror, including supporting cost data, assumptions, labor rate calculations, and basis of estimate information. No such requests are reflected in the record.
Fourth, there is no evidence that IDOT adjusted Pinnacle's proposed costs upward for purposes of the best-value tradeoff analysis. When a cost-realism analysis reveals that an offeror's proposed costs are unrealistically low, standard procurement practice requires the agency to adjust the proposed costs upward to a more realistic level for evaluation purposes. This adjustment does not change the terms of the resulting contract; rather, it ensures that the tradeoff analysis is conducted on the basis of realistic cost projections. No such adjustment was made here.
Based on these evidentiary findings, Dr. Fernwood concludes that IDOT either failed to perform any cost-realism analysis on Pinnacle's cost-reimbursable line items, or conducted a cost-realism analysis so superficial and inadequately documented as to be functionally non-existent. Either conclusion constitutes a material procurement deficiency that undermines the integrity of the source selection decision.
D. Impact on the Cost/Price Scoring
The cost-realism failure had a direct and quantifiable impact on the Cost/Price factor scoring. Under the evaluation as conducted by IDOT, the scoring results on the Cost/Price factor were as follows:
• MTDC received 142 out of 150 points on Cost/Price.
• Pinnacle received 128 out of 150 points on Cost/Price.
• MTDC held a 14-point advantage on this factor.
While MTDC's 14-point advantage on Cost/Price is itself significant, Dr. Fernwood opines that the gap should have been substantially wider had IDOT conducted a proper cost-realism analysis and applied an appropriate upward adjustment to Pinnacle's cost-reimbursable line items.
Specifically, if Pinnacle's cost-reimbursable line items had been adjusted upward by the $10.8 million shortfall — bringing them into alignment with the IGCE's benchmark figure of $49.2 million — Pinnacle's total proposed price for evaluation purposes would have effectively been $258.4 million ($247.6 million + $10.8 million). Under this adjusted scenario, the price differential between MTDC's proposal ($234.9 million) and Pinnacle's adjusted proposal ($258.4 million) would have been approximately $23.5 million, or roughly 10.0% above MTDC's proposal. This represents a near-doubling of the price differential, from 5.4% to 10.0%.
Dr. Fernwood opines that an adjusted price differential of $23.5 million (10.0%) would have materially affected both the Cost/Price factor scoring and the SSA's best-value tradeoff analysis. Under any reasonable cost-realism methodology, Pinnacle's Cost/Price score should have been lower than the 128 points it received, further widening MTDC's aggregate scoring advantage beyond the already-significant 30-point gap that existed under the unadjusted evaluation. The precise magnitude of the scoring adjustment would depend on the specific cost-scoring formula applied by IDOT, but Dr. Fernwood is confident that the impact would have been substantial and potentially determinative.
E. Risk to the Government
Beyond its impact on the evaluation scoring, the cost-realism failure creates significant risk for the government — that is, for IDOT and its funding sources, including the federal and state entities that have committed over $247 million to the IITMP.
Given that cost-reimbursable line items shift cost risk to the government, an unrealistically low cost proposal creates a high probability of cost growth during contract performance. When actual costs exceed proposed costs on cost-reimbursable work, the government is contractually obligated to reimburse the contractor for the additional costs incurred. The result is that the government pays more than the amount reflected in the source selection analysis — an outcome that is both financially harmful and inconsistent with the competitive procurement process.
Dr. Fernwood notes that the IITMP involves complex technology development work — precisely the type of effort where cost-realism analysis is most critical. Technology development work is inherently uncertain and subject to cost escalation due to unforeseen technical challenges, evolving requirements, and the need for iterative design and testing. In such contexts, the risk of cost growth on unrealistically low proposals is especially acute.
The financial exposure is substantial. The failure to conduct an adequate cost-realism analysis exposes the State of Illinois and the Federal Transit Administration to a projected $10.8 million in unanticipated cost overruns on the cost-reimbursable elements alone. This figure represents the minimum expected cost growth based on the deviation from the IGCE; actual cost growth could exceed this amount if Pinnacle's cost underestimation reflects a more fundamental misunderstanding of the technology development requirements. Moreover, because $148.5 million of the IITMP's funding derives from FTA Capital Investment Grant funds, the cost-realism failure may implicate federal grant compliance requirements and could trigger audit findings or grant clawback provisions.
V. Expert Findings: Scoring Irregularities and Best-Value Tradeoff Analysis
A. Aggregate Scoring Comparison
Dr. Fernwood conducted a detailed review of the evaluation scoring as documented in the Source Selection Decision Document and the Technical Evaluation Panel report. The following table summarizes the scores assigned to MTDC and Pinnacle on each of the four evaluation factors:
Several observations emerge from this scoring comparison that are central to Dr. Fernwood's analysis:
MTDC outscored Pinnacle by 30 points overall, representing a 3.0% differential on the total 1,000-point scale. While a 3.0% differential might appear modest in the abstract, Dr. Fernwood emphasizes that in a two-offeror competitive procurement evaluated on a 1,000-point scale, a 30-point advantage is significant and reflects a consistent pattern of superiority across multiple evaluation dimensions.
MTDC outscored Pinnacle on three of the four evaluation factors: Technical Approach (+27), Past Performance (+6), and Cost/Price (+14). Pinnacle led on only one factor — Management & Staffing Plan — by 17 points. This distribution of scores is critically important to the tradeoff analysis, because it demonstrates that MTDC's advantage was broad-based and not confined to a single evaluation dimension.
Most significantly, MTDC held the highest score on the most heavily weighted factor — Technical Approach, which carried a 40% weight (400 points maximum) — with a commanding 27-point advantage. Under the RFP's own weighting scheme, Technical Approach was nearly twice as important as Management & Staffing (40% vs. 25%), which was the only factor on which Pinnacle outscored MTDC.
B. The SSA's Best-Value Tradeoff Rationale
Despite MTDC's aggregate 30-point scoring advantage and its lower proposed price ($234.9 million compared to Pinnacle's $247.6 million — a $12.7 million differential), the SSA, Angela Moreau, selected Pinnacle for the contract award. The SSA's narrative rationale, as set forth in the Source Selection Decision Document, cited two principal justifications for the tradeoff decision:
(1) Pinnacle's purported "superior workforce integration methodology," which the SSA characterized as a distinguishing strength of Pinnacle's proposal; and
(2) Pinnacle's subcontractor teaming arrangement with Northlake Harborline Technologies Systems, Inc., which the SSA described as providing enhanced capability in signal and communications systems integration.
Dr. Fernwood identifies three significant deficiencies in the SSA's best-value tradeoff rationale, each of which is discussed in detail below.
C. Deficiency 1: Reliance on Unstated Evaluation Criteria
The first and most fundamental deficiency in the SSA's rationale is the SSA's reliance on "workforce integration methodology" as the primary discriminator favoring Pinnacle over MTDC. Dr. Fernwood's review of RFP Section M — the evaluation criteria section of the Solicitation — confirms that "workforce integration methodology" is not identified as a sub-factor, evaluation criterion, rated element, or defined term anywhere in the RFP.
The RFP's evaluation factors are exhaustively listed and weighted in Section M. Those factors consist solely of: Technical Approach (40%), Management & Staffing Plan (25%), Past Performance (20%), and Cost/Price (15%). While the RFP provides narrative descriptions of the types of information to be evaluated within each factor, none of those descriptions references "workforce integration methodology" or any equivalent concept by name or by description.
Dr. Fernwood opines that the SSA's reliance on "workforce integration methodology" as the primary discriminator in the tradeoff decision constitutes reliance on an unstated evaluation criterion. This violates fundamental procurement principles — rooted in both the Illinois Procurement Code and universally recognized standards of competitive procurement — that require all significant evaluation factors to be disclosed to offerors in the solicitation. The purpose of this requirement is to ensure that offerors can tailor their proposals to address the factors that will actually be used to evaluate them, thereby promoting fair competition and enabling meaningful proposal preparation.
If IDOT intended for "workforce integration methodology" to be a component of Factor 2 (Management & Staffing Plan), this intent was not communicated to offerors, and MTDC was never put on notice that it needed to tailor its proposal to address this specific methodology in order to compete effectively. Yet even without such notice, MTDC still outscored Pinnacle in aggregate by 30 points — a fact that underscores the strength of MTDC's proposal and the irrationality of the SSA's reliance on a single undisclosed criterion to override the established evaluation framework.
D. Deficiency 2: Inadequate Price-Technical Tradeoff Documentation
The second deficiency concerns the adequacy of the SSA's documentation of the price-technical tradeoff decision. In a best-value tradeoff procurement, the SSA bears an affirmative obligation to provide a rational, documented explanation for why a technically superior, lower-priced offeror's proposal is being passed over in favor of a higher-priced, lower-scored proposal. This documentation requirement is not a mere formality; it is the mechanism by which the integrity and accountability of the source selection process are ensured.
The burden on the SSA to document a thorough and persuasive rationale increases commensurately with the significance of the price differential. Here, the price differential was $12.7 million, with Pinnacle's proposal priced 5.4% above MTDC's. A $12.7 million premium in a $234.9–$247.6 million procurement is not a trivial amount; it represents a meaningful additional expenditure of public funds that requires rigorous justification.
Dr. Fernwood notes that the Source Selection Decision Document contains only approximately two paragraphs of narrative justifying the tradeoff decision. This narrative is conclusory in nature and fails to meet the standard for adequate documentation in several critical respects.
The SSA did not quantify or specifically articulate what incremental benefit Pinnacle's proposal provides to justify the $12.7 million price premium. Nowhere in the SSDD does the SSA explain, in concrete or measurable terms, what the government would receive from Pinnacle's proposal that it would not receive from MTDC's proposal — and why that additional value is worth $12.7 million.
Moreover, the SSA did not explain why Pinnacle's 17-point advantage on the Management & Staffing Plan factor (a factor weighted at 25% of the total evaluation) was sufficient to justify overlooking MTDC's advantages on the remaining three factors. Specifically, the SSA failed to explain why the 17-point Management & Staffing advantage outweighed:
• MTDC's 27-point advantage on Technical Approach, the most heavily weighted factor at 40%;
• MTDC's 6-point advantage on Past Performance, weighted at 20%; and
• MTDC's 14-point advantage on Cost/Price, weighted at 15%.
The SSA's narrative makes no mention of the relative weights assigned to the evaluation factors, does not engage in any comparative analysis of the strengths and weaknesses of the two proposals across all four factors, and does not explain how the tradeoff is consistent with the evaluation framework established in the RFP. Dr. Fernwood concludes that this documentation falls far short of the rational basis required for a compliant best-value tradeoff decision and would not withstand scrutiny under applicable procurement law standards.
E. Deficiency 3: Failure to Account for the Scoring Methodology's Own Weightings
The third deficiency, which is related to but distinct from the second, concerns the SSA's effective disregard of the weighting scheme established in the RFP. By selecting Pinnacle based primarily on a single element within the Management & Staffing Plan factor — itself weighted at only 25% of the total evaluation — the SSA effectively overrode the weighting scheme by elevating a single sub-element within a 25%-weighted factor above the combined weight and results of the other three factors, which collectively accounted for 75% of the total evaluation.
Dr. Fernwood observes that when an agency establishes a weighted scoring methodology — particularly one that has been published to offerors in the solicitation and upon which offerors have relied in preparing their proposals — and then disregards the results of that methodology in the tradeoff decision without providing adequate justification, the integrity of the entire evaluation is compromised. Offerors participate in the competitive process in reliance on the evaluation framework as stated in the RFP. If the SSA is free to disregard that framework in favor of undisclosed preferences, the competition is rendered fundamentally unfair.
Dr. Fernwood further observes that the 30-point aggregate differential between MTDC and Pinnacle — distributed across three of four evaluation factors — represents a consistent, broad-based superiority in MTDC's proposal. This is not a case where the two offerors were separated by a narrow margin that could be legitimately overcome by a qualitative tradeoff judgment. Rather, MTDC demonstrated superiority in technical capability, past performance, and cost/price, while Pinnacle's sole area of advantage — Management & Staffing — was a lower-weighted factor on which its margin of advantage (17 points) was less than MTDC's advantage on any single one of the three factors where MTDC prevailed.
The cumulative effect of these three deficiencies, in Dr. Fernwood's opinion, is that the SSA's best-value tradeoff decision lacks a rational basis, is inconsistent with the evaluation framework established in the RFP, and was influenced by an unstated evaluation criterion that was not disclosed to offerors.
VI. Expert Findings: Damages Assessment
A. Proposal Preparation Costs
MTDC incurred approximately $3.2 million in proposal development costs in connection with its response to RFP No. IDOT-TS-2022-014. These costs include internal labor costs for MTDC personnel who were assigned to the proposal effort, consultant fees for outside advisors and subject matter experts who supported the proposal development process, and proposal production costs including document preparation, printing, and submission logistics.
Among the consultant costs included in the $3.2 million figure are fees paid to Strickland & Associates CPAs for their work in preparing cost-realism certifications and pricing backup documentation. Strickland & Associates, under the direction of Howard Strickland, CPA, provided certified cost and pricing data, historical cost comparisons, and financial analyses that were submitted as part of MTDC's proposal in support of the realism and reasonableness of MTDC's pricing.
These proposal preparation costs are potentially recoverable as bid preparation costs if the protest or subsequent litigation results in a determination that IDOT's award to Pinnacle was arbitrary, capricious, or otherwise contrary to applicable procurement law. Under Illinois law, an unsuccessful offeror may recover its reasonable bid or proposal preparation costs where the agency's award decision is found to be unlawful, provided that the offeror can demonstrate that it would have received the award but for the agency's error.
B. Estimated Lost Profits
Dr. Fernwood conducted an analysis of MTDC's estimated lost profits over the seven-year base performance period of the IITMP contract. This analysis is intended to provide a reasonable and supportable estimate of the profits that MTDC would have earned had it received the contract award, for purposes of the damages component of the protest and any subsequent litigation.
Dr. Fernwood's methodology applies an 8% profit margin to MTDC's proposed contract value of $234.9 million. The resulting calculation is:
$234.9 million × 8.0% = $18.792 million, rounded to $18.7 million
The 8% profit margin applied in this calculation is supported by two independent sources. First, the margin is consistent with MTDC's historical operating margins on comparable transit system modernization contracts, as reflected in MTDC's audited financial statements and contract performance records for the preceding five fiscal years. Second, the margin has been validated against industry benchmarks for transit system integration and modernization contracts, as compiled and provided by Strickland & Associates CPAs.
Dr. Fernwood considers the $18.7 million estimated lost profit figure to be conservative in several respects. Most significantly, this estimate does not account for profits that MTDC would have earned during the two three-year option periods (Option Period I: October 1, 2029 – September 30, 2032; Option Period II: October 1, 2032 – September 30, 2035). If both option periods were exercised, the total contract value could reach up to $310 million, and the associated lost profits would increase proportionally. The $18.7 million figure applies only to the base period and therefore represents a floor, rather than a ceiling, on MTDC's potential lost profit damages.
C. Broader Financial Impact
While the quantifiable damages described above represent the most directly measurable financial harm to MTDC, Dr. Fernwood also notes the broader financial and operational impact of the loss of the IITMP contract.
MTDC, with an annual operating budget of approximately $1.82 billion, is one of the largest transit development and operating entities in the Midwest. MTDC provides and manages transit services across a six-county service area encompassing Cook, DuPage, Kane, Lake, McHenry, and Will Counties in northeastern Illinois. The organization relies on modernization contracts such as the IITMP to sustain, upgrade, and expand transit services across its extensive service territory.
The IITMP contract represents a critical modernization initiative for MTDC's bus rapid transit, light rail, and paratransit services. The loss of this contract has operational and strategic consequences that extend beyond the direct financial damages quantified in this section. Without the IITMP contract, MTDC faces the prospect of deferred modernization of aging transit infrastructure, reduced capacity to implement planned service expansions, potential loss of organizational expertise and workforce continuity, and diminished competitive positioning for future transit modernization procurements in the region. While these broader impacts are more difficult to quantify than direct financial losses, they are real and significant, and they underscore the importance of the protest and any subsequent litigation in seeking to remedy the procurement deficiencies identified by Dr. Fernwood.
VII. Expert Opinions — Summary
Based on her comprehensive review of the procurement record and her analysis of the evaluation methodology, scoring results, and source selection decision, Dr. Alicia Fernwood provides the following summary expert opinions:
Opinion 1 — Cost-Realism Failure. IDOT failed to conduct an adequate cost-realism analysis on Pinnacle Transit Solutions, Inc.'s cost-reimbursable line items for Technology Development work. The $10.8 million shortfall (21.95%) between Pinnacle's proposed costs ($38.4 million) and IDOT's own Independent Government Cost Estimate ($49.2 million) should have triggered detailed scrutiny of Pinnacle's cost basis and assumptions, including clarification requests and evaluation notices directed to Pinnacle, and should have resulted in a probable upward adjustment to Pinnacle's proposed costs for evaluation purposes. The procurement record contains no evidence that any such scrutiny was undertaken. The absence of any documented cost-realism evaluation constitutes a material procurement deficiency that undermines the integrity of the Cost/Price evaluation and the best-value tradeoff analysis.
Opinion 2 — Scoring Irregularity and Best-Value Tradeoff. The SSA's decision to award the IITMP contract to Pinnacle, despite MTDC's 30-point aggregate scoring advantage (923 vs. 893 on a 1,000-point scale) and $12.7 million (5.4%) lower proposed price, lacks a rational, documented basis. The SSA's approximately two-paragraph narrative justification is insufficient to support the tradeoff and does not explain why Pinnacle's 17-point advantage on a single 25%-weighted factor (Management & Staffing Plan) justified overlooking MTDC's advantages on the remaining three factors, which collectively account for 75% of the evaluation weight. Moreover, the SSA's primary discriminator — "workforce integration methodology" — constitutes an unstated evaluation criterion that was not disclosed to offerors in RFP Section M, in violation of fundamental procurement principles.
Opinion 3 — Impact of Combined Deficiencies. The cost-realism failure and the scoring irregularities identified above are interrelated and mutually reinforcing. Had IDOT conducted a proper cost-realism analysis and adjusted Pinnacle's cost-reimbursable line items upward by the $10.8 million shortfall, the effective total proposed price for Pinnacle would have been $258.4 million, increasing the price differential between MTDC and Pinnacle from $12.7 million (5.4%) to approximately $23.5 million (10.0%). This widened price differential would have further undermined the reasonableness of the SSA's best-value tradeoff decision by increasing the cost premium that the SSA would have been required to justify. Under any reasonable evaluation framework, the combination of MTDC's higher aggregate technical score and significantly lower adjusted price would have compelled an award to MTDC.
Opinion 4 — Damages. MTDC's estimated lost profits of $18.7 million over the seven-year base performance period — calculated by applying an 8% profit margin to MTDC's proposed contract value of $234.9 million — are reasonable and conservative. The estimate is supported by MTDC's historical operating margins on comparable contracts and validated against industry benchmarks. Additionally, MTDC's proposal preparation costs of approximately $3.2 million represent additional compensable damages. The total estimated damages for the base period are therefore approximately $21.9 million ($18.7 million in lost profits plus $3.2 million in proposal preparation costs), exclusive of option-period profits.
VIII. Recommendations for the Protest Record
Based on her analysis and findings, Dr. Fernwood recommends the following actions to strengthen MTDC's position in the pending agency-level protest and to lay the groundwork for potential litigation escalation:
1. Request Production of Cost-Realism Documentation. Through the protest process before the IDOT Administrative Review Board, MTDC should request that IDOT produce all documentation relating to any cost-realism analysis performed on Pinnacle Transit Solutions, Inc.'s cost-reimbursable line items. This request should specifically encompass any internal worksheets, analytical memoranda, evaluation team notes, scoring sheets, and mathematical models used in assessing the realism of Pinnacle's proposed costs. The request should also seek any evaluation notices, clarification requests, or communications between IDOT (including the TEP, the Contracting Officer, or the SSA) and Pinnacle regarding Pinnacle's cost-reimbursable pricing. The absence of responsive documents would strongly corroborate Dr. Fernwood's conclusion that no meaningful cost-realism analysis was conducted.
2. Request Production of the IGCE and Supporting Documentation. MTDC should request production of the full IGCE for the IITMP procurement, including all supporting documentation, assumptions, labor rate analyses, and basis-of-estimate materials. This production is necessary to confirm the $49.2 million benchmark figure referenced in the evaluation documentation and to enable Dr. Fernwood to conduct a more granular analysis of the specific cost-reimbursable line items on which Pinnacle's pricing deviated from the government estimate.
3. Challenge Reliance on Unstated Evaluation Criteria. MTDC should affirmatively challenge the SSA's reliance on "workforce integration methodology" as a discriminator by demonstrating, through a comprehensive comparison of RFP Section M's evaluation criteria against the SSA's narrative rationale, that this concept was not listed as a sub-factor, evaluation criterion, rated element, or defined term in the Solicitation. This argument should be supported by Dr. Fernwood's analysis and by citation to applicable Illinois procurement law and analogous federal precedent prohibiting reliance on unstated evaluation criteria.
4. Prepare for Litigation Escalation. If the protest before the IDOT Administrative Review Board does not result in a favorable outcome for MTDC, the matter should be escalated to the Illinois Court of Claims. Dr. Fernwood is prepared to serve as a testifying expert in that forum and to prepare a formal, written expert report suitable for submission to the Court. The $85,000 litigation-phase fee has been authorized by the client for this purpose, and Dr. Fernwood has confirmed her availability for deposition and trial testimony.
5. Coordinate with Strickland & Associates CPAs. The engagement team should coordinate with Strickland & Associates CPAs, under the direction of Howard Strickland, CPA, to compile and organize the supporting financial data necessary for the damages analysis. This coordination should include verification of the $3.2 million proposal preparation cost figure, assembly of historical contract performance and profitability data supporting the 8% profit margin applied in the lost profits calculation, and preparation of any additional financial analyses that may be required for the protest record or for litigation.
IX. Conclusion
Dr. Fernwood's analysis demonstrates significant deficiencies in IDOT's evaluation of proposals submitted in response to RFP No. IDOT-TS-2022-014 for the Illinois Integrated Transit Modernization Program. The two principal categories of deficiency — the cost-realism failure and the inadequately documented best-value tradeoff decision — are each independently significant and, when considered in combination, present a compelling basis for overturning the award to Pinnacle Transit Solutions, Inc.
The cost-realism failure allowed Pinnacle to benefit from an artificially favorable Cost/Price evaluation based on unrealistically low cost-reimbursable pricing that deviated from IDOT's own IGCE by $10.8 million (21.95%). The inadequately documented best-value tradeoff decision compounded this error by permitting the SSA to override the RFP's established evaluation framework and select a higher-priced, lower-scored offeror based on an unstated evaluation criterion and a conclusory narrative that failed to articulate a rational basis for the tradeoff.
These findings directly support the following grounds asserted in MTDC's bid protest (Protest No. IDOT-BPC-2022-0047):
• Ground 1 (Scoring Error / Unreasonable Tradeoff): Dr. Fernwood's analysis of the scoring comparison and tradeoff rationale demonstrates that the SSA's decision to select Pinnacle over MTDC — notwithstanding MTDC's 30-point aggregate advantage and $12.7 million lower price — was unreasonable and unsupported by the procurement record.
• Ground 4 (Cost-Realism Failure): Dr. Fernwood's identification and quantification of the $10.8 million shortfall between Pinnacle's proposed costs and the IGCE, combined with the absence of any documented cost-realism analysis in the procurement record, establishes a material failure by IDOT to comply with its evaluation obligations.
• Ground 2 (Unstated Evaluation Criteria): Dr. Fernwood's analysis of the SSA's reliance on "workforce integration methodology" — a concept not identified anywhere in RFP Section M — reinforces MTDC's argument that the source selection decision was based on criteria not disclosed to offerors.
Dr. Fernwood's complete work papers, analytical models, supporting documentation, and underlying data are maintained in the Linden Analytics Group engagement file (LAG Project No. 2022-089) and are available for review by authorized engagement team members upon request. All materials generated by or provided to Dr. Fernwood in connection with this engagement are protected under the attorney work-product doctrine, as they were prepared at the direction of counsel in anticipation of litigation. These materials should be handled accordingly and should not be disclosed to any person or entity outside of the engagement team without the express authorization of the responsible partner.
DISTRIBUTION AND PRIVILEGE NOTICE
Distributed to:
• Ian Blackwood, Partner (Responsible Partner)
• Christopher Aiken, Associate (Working Associate)
File Copy: Copy retained in Calderwood & Harkness Matter No. 1031-00003 file.
Privilege Notice: This memorandum constitutes attorney work product prepared in anticipation of litigation by Sara Hendricks, Lead Associate, Calderwood & Harkness LLP, at the direction of Ian Blackwood, Partner. This memorandum contains the mental impressions, conclusions, opinions, and legal theories of counsel and is protected from disclosure by the attorney work-product doctrine. This memorandum is further protected by the attorney-client privilege to the extent it reflects confidential communications between counsel and the client, Metropolitan Transit Development Corp.
Do not forward, copy, distribute, or disclose this memorandum or any of its contents without the express written authorization of Ian Blackwood, Partner.
Calderwood & Harkness LLP 311 South Wacker Drive, Suite 4800 Chicago, IL 60606 Telephone: (312) 555-4200
| Factor | Maximum Points | MTDC Score | Pinnacle Score | MTDC Advantage/(Disadvantage) |
| Technical Approach | 400 | 378 | 351 | +27 |
| Management & Staffing Plan | 250 | 221 | 238 | (17) |
| Past Performance | 200 | 182 | 176 | +6 |
| Cost/Price | 150 | 142 | 128 | +14 |
| Total | 1,000 | 923 | 893 | +30 |