Request for Proposals: Dynabench Data Collection and Benchmarking Platform

Areas of Interest

Meta AI encourages creative submissions along the theme of “rethinking benchmarking” that leverage the Dynabench platform, with areas of interest that include, but are not limited to, the following:

• New tasks or benchmarks that would benefit from having a dynamic (adversarial) component.

• Experiments that examine concrete questions about the human-and-model-in-the-loop paradigm for data collection or evaluation.

• Proposals for moving Dynabench beyond natural language processing and/or beyond the English language.

Requirements

Prior to submitting a proposal, please confirm that your institution will agree to a contract for sponsored research from Meta. The agreement will operate under “Open Science” terms meaning that all research will be available for publication in the public sphere. Application materials include:

• A summary of the project (1-2 pages), in English, explaining the area of focus, a description of techniques, any relevant prior work, and a timeline with milestones and expected outcomes;

• A draft budget description (1 page) including an approximate cost of the award and explanation of how funds would be spent; .

• Curriculum Vitae for all project participants; and

• Organization details; this will include tax information and administrative contact details.

Eligibility

• Proposals must comply with applicable U.S. and international laws, regulations, and policies;

• Applicants must be current full-time faculty at an accredited academic institution that awards research degrees to PhD students;

• Applicants must be the Principal Investigator on any resulting award;

• Meta cannot consider proposals submitted, prepared or to be carried out by individuals residing in, or affiliated with an academic institution located in, a country or territory subject to comprehensive U.S. trade sanctions; and

• Government officials (excluding faculty and staff of public universities, to the extent they may be considered government officials), political figures, and politically affiliated businesses (all as determined by Meta in its sole discretion) are not eligible.

Terms and Conditions

Please read these terms carefully before proceeding.

Meta’s decisions will be final in all matters relating to Meta RFP solicitations, including whether or not to grant an award and the interpretation of Meta RFP Terms and Conditions. By submitting a proposal, applicants affirm that they have read and agree to these Terms and Conditions.

• Meta is authorized to evaluate proposals submitted under its RFPs, to consult with outside experts, as needed, in evaluating proposals, and to grant or deny awards using criteria determined by Meta to be appropriate and at Meta’s sole discretion. Meta’s decisions will be final in all matters relating to its RFPs, and applicants agree not to challenge any such decisions.

• Meta will not be required to treat any part of a proposal as confidential or protected by copyright, and may use, edit, modify, copy, reproduce and distribute all or a portion of the proposal in any manner for the sole purposes of administering the Meta RFP website and evaluating the contents of the proposal.

• Personal data submitted with a proposal, including name, mailing address, phone number, and email address of the applicant and other named researchers in the proposal may be collected, processed, stored and otherwise used by Meta for the purposes of administering Meta’s RFP website, evaluating the contents of the proposal, and as otherwise provided under Meta’s Privacy Policy.

• Neither Meta nor the applicant is obligated to enter into a business transaction as a result of the proposal submission. Meta is under no obligation to review or consider any proposal.

• Feedback provided in a proposal regarding Meta products or services will not be treated as confidential or protected by copyright, and Meta is free to use such feedback on an unrestricted basis with no compensation to the applicant. The submission of a proposal will not result in the transfer of ownership of any IP rights.

• Applicants represent and warrant that they have authority to submit a proposal in connection with a Meta RFP and to grant the rights set forth herein on behalf of their organization. All awards provided by Meta in connection with this RFP shall be used only in accordance with applicable laws and shall not be used in any way, directly or indirectly, to facilitate any act that would constitute bribery or an illegal kickback, an illegal campaign contribution, or would otherwise violate any applicable anti-corruption or political activities law.

• Funding for winning RFP proposals will be provided to the academic institution with which the applicant is affiliated pursuant to a sponsored research agreement (“SRA”) between Meta and such academic institution. Applicants understand and acknowledge that their affiliated academic institution will need to agree to the non-negotiable terms and conditions of the SRA to receive funding.

• Applicants must disclose any current or past collaborations with Meta researchers that are related to their RFP project proposal.

To apply

Please submit proposal materials here.

Important Dates:

• Launch date: February 16th

• Deadline: March 23rd, 11:59pm PT

• Est. notification date: June 1st

Please reach out to dynabench-aiproposals@fb.com if you have any questions.