Phase 1: Concept Paper
The Concept Paper is evaluated based on the following criteria:
Criterion 1: Technical Approach (45%)
This criterion involves consideration of the following factors:
- Technical Outcome – Extent to which the proposed approach will result in improvement of currently available technology and will potentially result in a technical outcome which enables considerable progress toward the challenge goals.
- Maturity of the Proposed Solution – A measure of how detailed the solution is with evidence that the participant(s) has put significant thought into their planned prototype. This can be shown either through detailed planned implementation, or by displaying how their planned prototype has been implemented before in other areas.
Criterion 2: Feasibility (45%)
This criterion involves consideration of the following factors:
- Cost of Implementation – The projected rough order of magnitude cost of developing the network architecture and implementing it within the scope of FAA’s intended use.
- Availability of Resources – Resources used within the development of the architecture prototype are readily available and accessible.
- Technical Feasibility – The network architecture meets the technical requirements outlined in the evaluation criteria.
Criterion 3: Team Experience (10%)
This criterion involves consideration of the following factors:
- Team – The extent to which the capability of the participant(s) can address all aspects of the proposed project with a high chance of success, including, but not limited to, qualifications, relevant expertise, and time commitment of the participant. Reviewers will evaluate: (a) The relevance of the qualifications and experience of the key staff, leadership, and technical experts. (b) The extent of the key staff’s prior experience and the quality of the results achieved in leading programs similar in nature to the purpose, scope, and goals of the Challenge which may include the ability to manage the limited schedule, resources, and project risks while maintaining high quality project outcomes.
The concept papers and recorded presentations will be evaluated based on the criteria above. Each concept paper will be reviewed by at least two subject matter expert reviewers and the Judging panel members and be assigned a score for each criterion, 0-10 for each criterion. Scores will not be provided to the participants. In the case of a tie, the Judging panel will make a determination on the winners invited to compete in Phase 2.
Scoring for Concept Papers
10: Applicant has strong potential to aid in the achievement of the goals of the challenge
1-9: Varying degrees of certainty that the participant may have the potential to aid in the achievement of the goals of the challenge
0: Applicant does not have the potential to aid in the achievement of the goals of the challenge
Weighting of Criteria for Concept Papers
Criterion 1: Technical Approach 45%
Criterion 2: Feasibility 45%
Criterion 3: Team Experience 10%