Building an AI scientist
Example Research Team · 2025 · System report
Found via: Broad evaluation search
Read the developers’ own evaluation to establish what they claim and how they measured it.
Collection: System reports
Try the reference manager
Follow what changes as the agent organises the references. Select a collection or a paper to inspect it.
Illustrative simulation · All papers, passages, and decisions are invented. This page does not connect to your Zotero library.
Before organising the references, the agent loads the Zotero Wrangler skill and reads its instructions. The researcher supplies the task; the skill tells the agent how to do the library work.
Five records have arrived from the example searches. Keep where each came from, so we can return to the search that found it. Two records refer to the same paper; we will inspect that next.
Example Research Team · 2025 · System report
Found via: Broad evaluation search
Read the developers’ own evaluation to establish what they claim and how they measured it.
Collection: System reports
Example Research Team · 2025 · Same paper found again
Found via: Targeted follow-up search
The example provides the same paper identity for both records. Bring their search sources together in the next step.
Example Methods Group · 2025 · Evaluation methods
Found via: References in a known paper
Use this paper to ask what a test measures, and what evidence would answer our question.
Collection: Evaluation methods
Example Laboratory Team · 2026 · Evaluation study
Found via: Search for tests by other teams
Read the methods and the relationship to the developers before deciding whether this is an independent check.
Collection: Possible independent tests
“Our laboratory, which did not develop the system, repeated two of its proposed experiments.”
Location: Methods section · invented passage
Interpretation: A separate team checked selected experiments. Read the results before drawing a conclusion.
Example Announcement Team · 2026 · Announcement
Found via: Web search
This announcement may lead us to a paper, but gives no evaluation detail for the comparison.
Collection: Set aside / revisit
Decision: Set aside from the evaluation comparison. Keep the lead and return to it if it helps us find the underlying paper.
Five records have arrived from the example searches. Keep where each came from, so we can return to the search that found it. Two records refer to the same paper; we will inspect that next.
The example identifies two records as the same paper. Keep one reference with both search sources. We now have four references, and can still see how each was found.
Group the references by what we need to learn: the developers’ claims, evaluation methods, and possible independent checks. Select a collection to see its references. The announcement is still waiting for a decision.
The announcement gives no evaluation detail. Keep it in Set aside / revisit with that reason. It remains in the project collection, so setting it aside does not lose the reference.
The selected paper now has a note explaining who checked the work, with the passage and section behind that interpretation. Select a collection and paper to compare the notes.
Loaded the Zotero Wrangler skill and read its instructions, then saved the search questions, the five returned records, and their search sources.
Consolidated the example’s known duplicate into one reference; retained both search sources. Four references remain.
Added collections for system reports, evaluation methods, and possible independent tests. Recorded why each paper might help answer the question.
Kept the announcement in Set aside / revisit with the reason “no evaluation detail”. The full project collection still contains four references.
Attached an illustrative reading note to the evaluation paper, including the supporting passage, its section, and the interpretation to check.
Step {step} of {total}1 reference{count} referencesNo references in this collection at this step.