Evaluating sources and justifying actions
What Excellence actually asks for
- Excellence requires you to justify your position and actions by analysing and evaluating the biological knowledge. The standard names three ways this may be shown:
- Comparing the significance of different implications.
- Considering the likely effectiveness of your proposed actions.
- Commenting on sources — their validity and their bias.
- You do not need all three, but each is a distinct skill and doing two or three well makes a response much stronger.
Evaluating sources: validity
-
The standard specifies three aspects of validity:
- Currency — how recent is it? A source on a fast-moving topic such as a spreading disease or a new technology can be outdated within a few years. On slower-moving biology, age matters less. Say why currency does or does not matter for your issue, rather than noting a date.
- Peer review status — has it been examined by other scientists before publication? Peer review is not a guarantee of correctness, but it means specialists have checked the methods and reasoning, which filters out much weak work.
- Scientific acceptance — is the claim consistent with the wider body of evidence, or is it an outlier? A single study contradicting a large body of established work is more likely to be wrong than to have overturned it, so a claim gains credibility from replication and convergence with independent lines of evidence.
-
A useful hierarchy, from stronger to weaker for scientific claims:
- Peer-reviewed research, especially where findings have been replicated.
- Reviews and syntheses by scientific bodies, which weigh many studies together.
- Government and Crown research institute publications, which are generally reliable though they may reflect policy priorities.
- Reputable science journalism, which is secondhand and may simplify or overstate.
- Advocacy organisation material, which may be accurate but selects evidence to support a position.
- Unattributed websites and social media, where there is no accountability for accuracy.
-
This is a guide, not a rule. A well-sourced advocacy document can be more useful than a poor journal article, and the reason you trust a source matters more than its category.
Evaluating sources: bias
-
The standard names attitudes, values and beliefs as sources of bias. Bias is not necessarily dishonesty — it is more often selection: which evidence gets included, which gets omitted, and how it is framed.
-
Questions to ask:
- Who produced it, and what is their interest? An industry body, an advocacy group, a regulator and a university researcher may all be accurate while emphasising different things.
- Who funded it? Funding does not invalidate research, but it is relevant information and should be disclosed.
- What is omitted? The most effective bias is usually omission rather than falsehood.
- How is it framed? Emotive language, selected images and one-sided case studies signal persuasion rather than description.
- Is uncertainty acknowledged? A source presenting a contested issue as entirely settled is misrepresenting the state of knowledge, whichever side it takes.
-
Important: a biased source is not automatically useless. An advocacy organisation may present accurate evidence and raise legitimate points. The right response is to use it with the bias identified, and to check its factual claims against an independent source — not to discard it, and not to accept it uncritically.
-
Apply the same scrutiny to sources you agree with. Examining only the other side's sources is itself a bias, and a marker will notice it.
Comparing the significance of implications
-
Not all implications matter equally, and saying which matter more — with reasons — is analysis.
-
Useful criteria for weighing them:
- Reversibility. Can the outcome be undone? Extinction cannot. An irreversible harm generally weighs more heavily than a reversible one of similar size.
- Scale. How many organisms, how large an area, how many people?
- Timeframe. Short-term and temporary, or permanent and compounding?
- Certainty. How confident is the evidence that the outcome would occur?
- Distribution. Who bears the cost, and who receives the benefit?
-
Comparing on stated criteria is far stronger than asserting that one thing matters more. It also makes your reasoning checkable, which is what allows a marker to judge it.
Considering the likely effectiveness of actions
-
This is where most responses could be strengthened most, and the standard names it explicitly.
-
Desirability and effectiveness are different questions. An action can be clearly desirable and still not work.
-
For each action you propose, ask:
- Would it address the actual cause? An action treating a symptom while the cause continues will not solve the problem. If a pest population recovers from surrounding land, a one-off local cull cannot succeed however well executed.
- Is it achievable? Consider cost, who would have to act, and whether they have the authority and capacity.
- Does it depend on compliance? Actions relying on voluntary behaviour are only as effective as uptake. Hygiene stations work only if used, and only if maintained.
- What is the scale mismatch? A personal action may be right but negligible in effect. Say so honestly — it is more convincing than overstating it, and pairing a personal action with a societal one addresses the gap.
- Are there side effects? An effective action may create new problems, and acknowledging them strengthens the proposal.
-
An honest assessment of your own proposal is strong evidence for Excellence. Proposing an action, identifying its main limitation, and explaining why you still think it worthwhile shows judgement. Proposing an action and claiming it would simply solve the problem does not.
Selective advantage
- Not applicable — this is a skills standard, assessing the integration and evaluation of biological knowledge rather than biological content.
Worked Example
Worked Example
A student researching an introduced predator control issue has three sources.
- Source A: a 2024 paper in a peer-reviewed ecology journal reporting bird nesting success in treated and untreated forest blocks over six years. Funded by a government conservation agency.
- Source B: a 2011 report by an advocacy group opposing the control method, citing non-target deaths and quoting affected residents.
- Source C: a 2025 blog post, no author named, stating that the method is completely safe and that all opposition is misinformed.
Evaluate these sources and explain how each should be used.
Answer:
Source A — strongest, and usable directly.
- Currency: 2024, and reporting six years of data. Recent enough for a question about current practice.
- Peer review: yes, in an ecology journal, so the methods and analysis have been examined by specialists before publication.
- Scientific acceptance: it reports a controlled comparison of treated and untreated blocks, which is the design capable of attributing the difference in nesting success to the treatment rather than to other factors. This is the strongest design available for the question.
- Bias: funded by a government conservation agency, which has an institutional interest in the method being effective. This does not invalidate it — peer review provides an independent check, and the funding is disclosed — but it is relevant. It would be worth checking whether independently funded studies report similar results, since agreement across differently funded work is much harder to explain by funding effects.
Use: as the primary evidence on effectiveness, with the funding noted.
Source B — biased but genuinely useful, and should not be discarded.
- Currency: 2011, which is a real weakness. Practice, application rates and monitoring may have changed substantially since, so its description of the method may no longer be accurate. This is the criticism that matters most.
- Peer review: no. It is an advocacy report, so its claims have not been independently checked.
- Bias: produced by a group opposing the method, so evidence supporting it is unlikely to be given equal weight. The quotations from affected residents are chosen for effect rather than sampled.
- But it should still be used. It raises non-target deaths, which is a genuine biological implication that any complete response must address, and it represents a viewpoint the standard requires engagement with. Discarding it because it is biased would omit a real cost and a real position.
Use: to identify the non-target issue and to represent the opposing viewpoint, with its factual claims checked against peer-reviewed sources and its age noted.
Source C — should not be used as evidence.
- No named author, so nobody is accountable for accuracy and expertise cannot be assessed.
- Not peer reviewed.
- The claim itself signals unreliability. Describing the method as completely safe and all opposition as misinformed presents a genuinely contested issue as settled. Non-target deaths are documented in peer-reviewed work, so the claim is inconsistent with the evidence, and dismissing all opposition ignores that much of the disagreement is about values rather than facts.
- Its recency does not help it. 2025 is current, but currency only matters if the source is otherwise credible — a recent unreliable source is not better than an old reliable one.
Use: none as evidence. It could be mentioned as an example of the poor information circulating on the issue, which is itself a relevant observation.
The general principle.
Note that the source agreeing with pro-control conclusions (C) is rejected while the source opposing them (B) is retained. That is the correct outcome, and it demonstrates the reasoning: sources are judged on validity and transparency, not on whether they support the position you favour.
Applying scrutiny only to sources you disagree with is itself a bias, and it is easy for a marker to spot. The defensible approach is to identify each source's limitations, use each for what it can legitimately support, and check contested factual claims against independent evidence.