Data Impact Challenge II Rules

November 18, 2015

1     Challenge Context and Statement
2     Objective
3     Challenge Description
4     Key Dates
5     Call for Challenge Questions
6     Requirements for Submitted Questions
7     Rules for Question Submission
8     Voting
9     Challenge Questions
10   Judging
11   Team Eligibility
12   Team Roles
13   Awards
14   Additional Qualification Requirements
15   Obligations of all Participants
16   Obligations applicable to Award Recipients
17   Verification
18   License of Rights to Submission
19   Liability/Indemnification/Interference with the Challenge or Website
20   Use of Personal Information
21   Submitter Information
22   General
23   Linked Sites
24   Interpretation of Definitions
25   Award Decisions and Appeals
26   Supremacy of the Rules

SECTION I – The Data Impact Challenge

1   Challenge Context and Statement

Health care leaders, policy makers, clinicians and other stakeholders increasingly depend on data to make the best decisions about the management of the health care system and patient care. In recent decades, Canada has made great strides in increasing evidence-informed decision making at all levels of the health care system. This Challenge builds on the success of the first Data Impact Challenge to answer specific questions put forward by stakeholder organizations and the public in order that decisions are informed by evidence. The Challenge achieves this by incenting authorized users of health care data to conduct analyses on existing data.

2   Objective

The objective of this Challenge is to source relevant evidence relating to a set of questions, submitted by both stakeholder organizations and interested Canadians, regarding health and health care. This Challenge will provide actionable evidence for decision-making, while also demonstrating the potential for using existing data to support evidence-based policy in Canada.

3   Challenge Description

Canada Health Infoway and supporting organizations are challenging authorized users of Canadian health data sets to answer important questions about our health and health system. These questions, the “Data Impact Challenge Question Set”, are sourced both from Challenge stakeholder organizations as well as from an open call to interested Canadians to submit and vote for the questions they most want answered.

Canadians are asked to submit questions regarding health and health care that can be answered using data. Public voting will determine which of these questions will be included in the Challenge Question Set alongside the questions submitted by Challenge stakeholder organizations.

After the question set has been finalized, teams or individuals with access to health data sets may work on one or more of the listed questions.. As soon as work on any question is complete, teams must complete the Answer Submission Template and submit it through the Challenge website. Each Answer Submission Template will provide an answer to a single question and must include information on the data sources, analysis approach, findings, as well as the team’s attestation that these rules have been followed. After the submission deadline, the submissions will be scored by our judges to determine the award recipients.

Teams providing a qualifying answer to any one of the questions can earn their share of the available awards. Best Answer awards of $10,000 each will be provided to the submissions with the highest scores for each question. An additional Judges’ Choice award of $10,000 will be awarded to the submission with the highest score in the Challenge overall, and a $5,000 Speed Bonus will be awarded to the Best Answer Award recipient with the earliest submission time. A team may receive more than one award.

All teams that submit a qualifying answer but that do not receive a Best Answer award will have their submission placed in a draw for a chance to receive one of up to five $2500 Qualifying Answer incentives. No team may receive more than one incentive.

In order to answer a question, teams may access data from as many distinct authorized data sources or data custodian organizations as they have permission to use.

4   Key Dates

Public call for Challenge Questions November 18, 2015
Question submission period November 18, 2015 – November 30, 2015
Question voting period December 3, 2015 – December 8, 2015
Challenge begins; questions revealed December 15, 2015
Answer submission period December 15, 2015 – February 29, 2016
Answer submission deadline 3 p.m. ET, February 29, 2016
Judging March 2016
Award Announcement Spring 2016

SECTION II – Question Submission

5   Call for Challenge Questions

Questions can be submitted by anyone in the Canadian public, including employees of supporting organizations. Question submitters are asked to submit questions they wish to be included in the Challenge Question Set. The qualifying submitted question that earns the most votes will be included and the submitter will receive a $100 award.

6   Requirements for Submitted Questions

Proposed questions must be submitted using the entry form on the Challenge website (
Questions must be submitted in the required format, namely containing the following parts:

  • Issue – the issue of concern
  • Rationale – The reason the question should be answered. The rationale describes how answering the question will enable an improvement in health or health care in Canada. The rationale should also indicate who would make use of the question’s answer.
  • Metrics – the proposed metrics that would inform the answer to the question.
  • Guidelines – Suggested guidelines for the analysis, such as the minimum sample size needed, the minimum timeframe for the data, etc.

7   Rules for Question Submission

The submitter of the question included in the Challenge Question Set may not submit, or contribute, to an answer to that question during the answer submission phase of the Challenge, but may submit an answer to any of the other questions in the Challenge Question Set. The submitter of the question included in the Challenge Question Set will be recognized publicly.

Questions will be accepted from November 18, 2015 at 3 p.m. ET to November 30, 2015 at 3 p.m. ET.

Canada Health Infoway reserves the right to clarify, edit, or otherwise change any question submitted.  Similar submitted questions may be combined.

SECTION III – Question Voting

8   Voting

From December 3, 2015 to December 8, 2015, eligible questions will be displayed on the Challenge website for public voting. Each verified voter may vote for as many questions as the voter wishes, but only once per question. The qualifying question that has the greatest number of votes at the end of the voting period will be included in the Challenge Question Set and receive $100.

In the event of a tie, the question submitted first will receive the $100 award.

Any attempt to circumvent the one vote limit per submission, to use an automated process, or to provide any type of consideration in exchange for a vote will disqualify all votes emanating from the voter or person. Vote totals shown on the Challenge website during the voting period are not official and may change as a result of the verification process.

SECTION IV – Answer Submission

9   Challenge Questions

The Challenge Question Set will be available on December 15, 2015 on the Challenge website.

Additional questions or clarifications may be added during the course of the Challenge.

10   Judging

Answer submissions will judged by a panel of judges recruited by Infoway. The submissions will be scored against the criteria below, and the specifications for the question being answered described in the Challenge Question Set. Judges will review and score independently, and each of the scores for a submission will be combined to determine its total score.

Scoring for Best Answer Awards and Judges’ Choice Bonus

·         Data quality – 40%

To what extent do the data sources and analysis provide a credible and meaningful answer to the question as stated?

·         Representativeness – 40%

To what extend does the submission provide an answer which could be relevant in a population-wide, pan- Canadian context?

·         Innovation – 20%

To what extent is the analysis described in the submission innovative (e.g. leveraging underutilized data sources, streamlining processes, combining data sets, more deeply informing the underlying policy/practice issue)?

Assignment of Extra Draw Ballots for “Special Added Value” in Qualifying Answer Draw

Separate from the Best Answer Awards scoring, judges may designate a submission as having special added value. This classification will be given to entries that, in the judge’s estimation, provide value that goes beyond the question asked (e.g. incudes more detailed or more sophisticated analysis that would inform use of the results). Entries receiving this designation from at least two judges will receive an extra ballot in the Qualifying Answer Draw.

11   Team Eligibility

To qualify for the Challenge, teams must meet the following criteria:

  • Each team member must be authorized to access and analyze the data sets used in the submission. Team members are responsible to ensure that their right of access and analysis complies with applicable privacy and other pertinent legislation, rules and processes.
  • Each team member must comply with all applicable guidelines and processes related to the data sets being used to respond to the questions (e.g. privacy rules, ethics approval), and have the appropriate authorization to use the data for the purposes of this Challenge.
  • Teams must register and complete an Answer Submission Template for each question they choose to answer.
  • Teams must agree to the public sharing of their submission(s) and its/their content, and must be legally authorized to give this consent.

12   Team Roles

Each team must have a team leader who is the primary point of contact for the team.

A team leader:

  • Is the primary point of contact for team members throughout the Challenge.
  • Is the primary point of contact for Infoway throughout the Challenge.
  • Acts as coordinator for the team’s activities, including submitting the team’s answer(s).
  • Shall cooperate in any verification process and award distribution.
  • Is responsible for the team’s registration.

Team members must be invited to register by the team leader. All team members must complete their registration and agree to the Challenge rules.

The email address provided by the team leader will serve as the primary mechanism for Infoway to communicate with the team leader.

A team may use data from multiple data custodian organizations if it has obtained all appropriate authorizations, and the rights of access and analysis comply with applicable privacy and other applicable legislation, rules and processes.

13   Awards

Criteria for judging each submission are outlined in “Judging” section 6 above. Additional awards may be added during the course of the Challenge.

Award Description Amount
Best Answer Awards Provided to highest scoring qualifying submissions for each of the Challenge questions. $10,000 for each Challenge question
Judges’ Choice Award Provided to the submission with the highest score overall. One award of $10,000
Speed Bonus Provided to the Best Answer Award submission that was submitted earliest. One bonus of $5,000
Qualifying Answer Incentive Draw All teams with a qualifying submission that have not received an award will have their submission placed in a draw for a chance to receive one of up to five $2,500 incentives. Entries that judges classify as having special added value will receive an additional ballot. No team may receive more than one incentive. Teams whose ballots are drawn will be required to answer a skill-testing question to receive their incentive. Infoway will hold the draw after the judges’ results are finalized, in its offices at 150 King Street West, Suite 1300, Toronto, Ontario. Up to 5 incentives of $2,500

Other Benefits

Non-Monetary Benefits

Other benefits may include educational sessions and networking opportunities. Participation in these opportunities is optional. These opportunities will be announced on the Challenge website.

14   Additional Qualification Requirements

  1. In order to be eligible for an award, the team leader and team members must meet all of the terms and conditions described in these rules.
  2. Infoway reserves the right to refuse a submission from a person or a team whose eligibility is in question or who has been disqualified or is otherwise ineligible to enter.
  3. When an individual enters the Challenge as an employee, contractor or agent of another party, he/she warrants that such party has consented to the individual’s participation on its behalf. The individual also warrants that his/her actions do not violate any of the employer’s or contractor’s policies or procedures. Any submission made on behalf of another party without that other party’s consent is void.
  4. Infoway reserves the right to disqualify teams from the Challenge if Infoway, in its sole discretion, reasonably believes that any team member has attempted to undermine the legitimate operation of the Challenge by cheating, deception, or other unfair playing practices, or has tampered with any of Infoway’s websites, the submission process, the judging process, violates these rules, or acts in an unsportsmanlike or disruptive manner, or annoys, abuses, threatens, or harasses Infoway, its Supporting Organizations, its assigns or any other Challenge participant.

Parties Ineligible to Submit Answers

  1. All team members must reside in Canada, and all data used must have been collected in Canada.
  2. Directors, officers, employees and agents of Canada Health Infoway and their immediate family members as well as all persons with whom they reside, are not eligible to act as team leaders or team members in the Challenge.
  3. Directors, officers, employees and agents of Idea Crossing, their immediate family members and respective partners, affiliates, divisions and subsidiaries, and all persons with whom they reside, are not eligible to participate in the Challenge.
  4. Challenge judges, their immediate family members, and all persons with whom they reside, are not eligible to participate in the Challenge.
  5. Directors, officers, employees and agents of Supporting Organizations of the Challenge are not eligible to act as team leaders, but may participate as team members.
  6. Directors, officers, employees and agents of the Federal Government or any or its departments, agencies or crown organisations are not eligible to act as team leaders or team members in the Challenge.
  7. For the purposes of the Challenge: “immediate family member” is defined as a spouse, a common law partner, his or her dependent children as well as the dependent children of his or her spouse or common-law partner.

SECTION IV – General Challenge Rules

15   Obligations of all Participants

Each voter, question submitter, or answer submitter (“participant”) agrees that for all purposes the identifier established for him/her in the context of the registration or similar process will be attributed to and legally bind such participant and may be relied upon by Infoway and its agents, affiliates, and other third parties with whom Infoway works with respect to the Challenge and this even if another person used the participant‘s identifier. Completion of the registration process will create an account with a username and password which the participant agrees to guard as confidential information.

The participant agrees to provide accurate, current and complete information at all times. Participants also agree that they will review, maintain, correct, and update such information in a timely manner to maintain its accuracy and completeness by using the means allowed for the relevant information or, when appropriate, by contacting Infoway. If a participant provides (or Infoway has reasonable grounds to believe that a participant provided) any information that is inaccurate, not current, or incomplete, Infoway may suspend or terminate access, and/or participation in the Challenge, in addition to exercising all rights and remedies allowed by law.

No participant is to submit personal or confidential personal health information to Infoway, and must at all times during the Challenge adhere to the appropriate legislation and regulatory guidelines regarding patient information.

Team members must follow all applicable rules and guidelines as required by the data custodian organizations and law. This must include obtaining the legal right to publicly share the contents of the Answer Submission Template. Team members agree that data custodian organizations may be contacted independently to verify adherence to the Challenge rules.

Each team member must agree to reasonable participation, without any fee, in Infoway’s efforts to promote the Challenge.

16   Obligations applicable to Award Recipients

If an award recipient is found to be ineligible or otherwise not in compliance with these rules, the award recipient will be disqualified from that award, and all rights of the recipient to the award will be forfeited. If this occurs, Infoway may, at its sole discretion, select another award recipient from the remaining eligible teams.

Award recipients may be invited to participate in additional activities to communicate and share their submission and experience, for example through a webinar.

All monetary Challenge awards will be forwarded to the organization named by the team leader during qualification, which is then responsible for any distribution to others. It is the responsibility of the team to determine how the award money will be distributed. Once it has disbursed awards to the organization designated by the Team Leader, Infoway will not be involved in further distribution of award monies. Any change to the receiving organization must be made by the Team Leader and the previously identified organization in writing to Infoway.

17   Verification

Infoway may verify, or request that a third party verify, the information provided in a submission to ensure compliance with Challenge rules at any time for any reason. Any participant found to be in violation of the rules will be informed of the violation and will have three business days to address the violation to the satisfaction of Infoway and/or the Challenge auditors. Infoway, in its sole discretion, will determine the appropriate course of action, which may include disqualifying the participant in question from the Challenge, in addition to exercising all rights and remedies allowed by law.

18   License of Rights to Submission

By entering the Challenge, all team members (i) represent and warrant that they have all necessary rights, title, interest, including licenses, in and to all information, intellectual property and other material posted to the Challenge website “the Website” or otherwise submitted as part of registration to or in the course of the Challenge, or by reason of having received any award, including data, team member’s identification, profile and contact information, submitted protocols, analysis, and other materials, by any team member or by anyone else through the use of any team member’s username and password (the “Material”) or by other means, and may grant all licenses, waivers and other rights set out herein, and (ii) grant the following nonexclusive, unrestricted, worldwide, royalty-free, fully paid up and irrevocable licenses:

  1. To Infoway, its Supporting Organizations, its affiliates, its sublicensees , and their successors and assigns to access, reproduce, distribute, import, export, display, communicate or make available to the public, or otherwise use any Material, including any part thereof, whether as submitted or with any adaptation or other modification, in any format, on any medium and by any means, whether now known or existing or that may become known or existing in the future (each, a “Use”), for the purpose of promoting and/or sharing the team’s submission and the experience of the Challenge; and
  2. To any person accessing the Website (“Visitors”) to use any Material, but solely for non-commercial purposes, as submitted (without any adaptation or other modification), provided that, where reasonable in the circumstances, the name of the team or team member, as disclosed as part of the registration process, is associated with any such Use.

The preceding license extends to all rights, including any intellectual property rights as may protect any Material or team or team member, whether now enacted, conferred or recognized or that may be enacted, conferred or recognized in the future, that any team or team member (or successor and assigns) may own, control or obtain, including pursuant to applications or registrations made with the appropriate governmental authorities either before or after the date of the team or team member’s submission.

Subject to the limitations set forth above, all team members hereby irrevocably waive any moral rights that (s)he may have in the Material to the full extent allowed under any applicable laws, for the benefit of Infoway and any other person who benefits from the above licenses.

The rights granted herein shall be granted without any compensation other than that specifically provided in these rules.

19   Liability/Indemnification/Interference with the Challenge or Website

No responsibility is assumed by Infoway, its advertising and promotional agencies, their respective directors, officers, employees and representatives, its Supporting Organizations for any disruption to telephone network or lines, computer on-line systems, servers or providers, computer equipment, software or the failure of any submission to be received because of technical problems or traffic congestion on the Internet or at any website, or any combination thereof, as well as for any lost, incomplete, destroyed, misdirected, illegible or late submission which was not received, for any reason whatsoever.

Infoway and its Supporting Organizations are not responsible for printing, distribution or production errors and may terminate, modify, extend any portion of, or withdraw, this Challenge, at any time and for any reasonable cause whatsoever, without requirement of individual notice and without liability. Any changes to these Rules will be posted on the Challenge website.

Infoway and its Supporting Organizations are not responsible for any access or analysis of data that is unauthorized or non-compliant with applicable privacy and other legislation and requirements.

Infoway reserves the right to modify the Challenge (including, but not limited to, extending any portion of the Challenge), these rules, or to cancel this Challenge for any reasonable cause whatsoever including, but not limited to, in the event of technical corruption, virus, bugs, non-authorized human intervention or other technical problems which may arise from time-to-time which in Infoway’s opinion undermine or destroy the integrity of this Challenge. No liability or responsibility is assumed by Infoway or Supporting Organizations resulting from user attempts to participate in this Challenge or, if required, download any information necessary to participate in this Challenge. In the event of a dispute regarding an online submission, the submission will be deemed submitted by the Participant at the time logged on the Challenge website.

If for any reason the Challenge is not capable of being conducted as intended by Infoway, including due to computer viruses, bugs, tampering, unauthorized intervention, fraud, technical failures, or any other cause that corrupts or interferes with the administration, security, fairness, integrity or proper conduct of the Challenge, Infoway may, at its sole discretion, disqualify any team or participant responsible for such misconduct and may then cancel, terminate, modify, or suspend the Challenge.

Any attempt to deliberately damage any website or interfere with the legitimate operation of the Challenge may be a violation of criminal and civil laws, and Infoway reserves the right to seek damages and/or other relief from all responsible persons to the fullest extent permitted by law.

By entering this Challenge, a participant agrees to hold Infoway, its Supporting Organizations, their respective directors, officers, employees and representatives, harmless from and against any and all claims and liability arising directly or indirectly out of or in any way connected with this Challenge and/or the award(s) provided.

By entering the Challenge, each participant releases Infoway and its Supporting Organizations, directors, officers, employees, and representatives from any liability whatsoever for any claims, costs, losses, or damages of any kind (including, without limitation, those related to personal injury, death, damage to property, infringement of proprietary rights, rights of publicity or privacy or defamation) arising out of or in connection with:

  1. entering and participating in the Challenge;
  2. the information submitted;
  3. accessing and analyzing the data;
  4. the outcome of the Challenge and/or
  5. accepting any award.

By participating in this Challenge, participants agree to be bound by the rules and the decisions of the judges and Infoway.

20   Use of Personal Information

Participants consent to the collection, use and publication on the website of the participant’s name, location, organization, and submitted materials, which information is mandatory in order to participate in the Challenge, and which information may be posted on the Challenge website.

Participants recognize and agree that the information he/she provides may be stored on servers located in the United States. In such circumstances it may be subject to the jurisdiction where such information is stored and may be subject to the laws in such jurisdiction as well as its tribunals.

21   Submitter Information

By entering a submission in the Challenge, submitters consent to the collection and use by Infoway of his/her personal information in order to process the submission and administer the Challenge, including the granting of any awards. All participants agree that their personal information will be managed according to the terms of Infoway’s Privacy Policy, available at

The submitter agrees that by entering the Challenge this constitutes permission for, and submitter’s consent to, Infoway, its agencies and representatives to use his/her submission and the names and/or likenesses of the submitter for advertising, and promotional, publicity and educational purposes, in any media now known or hereafter devised, without further notice, compensation, consideration, review, or consent, and without regard to moral rights, unless prohibited by law.

22   General

In the case of any issues with the Challenge website that delays submission, a resolution decided at the sole discretion of Infoway will be communicated to the team leader.

The section headings contained herein are included solely for convenience and are not intended to be full or accurate descriptions of the content thereof and will not affect the interpretation of these rules.

This Challenge and the terms and conditions contained in these rules, shall be exclusively governed by and construed in accordance with the laws of the Province of Ontario, Canada and the federal laws of Canada applicable therein. The parties hereby attorn to the exclusive jurisdiction of the courts of Ontario.

Any litigation respecting the awarding of an award or this Challenge must be initiated before the courts in the City of Toronto in the Province of Ontario, Canada.

This Challenge is void where prohibited or otherwise restricted by law.

23   Linked Sites

The Challenge website may contain links to Web sites of third parties. Infoway provides these links simply as a convenience, but does not endorse the linked website or its contents. While the information, products, services and information may be helpful to those accessing these sites, they are independent entities of Infoway and are not controlled by Infoway, the contents are not endorsed by Infoway, and any visits to linked sites are at the sole risk of the persons accessing same. These sites are governed by privacy policies (if any) of the organization providing the linked website(s).

24   Interpretation of Definitions

Infoway may, from time to time, make clarifications with regard to the rules. These will be available at

25   Award Decisions and Appeals

All decisions regarding this Challenge and the selection of the award recipients are final and without any right of appeal.

26   Supremacy of the Rules

Where any discrepancy exists between these rules and other documents issued or provided in the context of the Challenge, these rules shall prevail.