Course material
AI_Assisted_Literature_Review_Student_Guide_V12.docx
Details
Filename
AI_Assisted_Literature_Review_Student_Guide_V12.docx.pdf
Size
235.3 KB
Type
application/pdf
Published
Extracted text
Scientific Inquiry with AI • AI-Assisted Literature Review • Student Guide Page 1 Literature Research with AI From Survey to Synthesis Scientific Inquiry with AI Student Guide Detailed Instructions & Course Material Why This Lesson Every research project begins inside a conversation that other researchers started before you. A literature review helps you learn what the field already knows, what it still argues about, and where a new question might fit. AI can help with the slow parts: finding papers, comparing them, mapping citations, and drafting first-pass syntheses. But AI can also sound confident while being wrong. It can misremember a finding, overstate a claim, or cite something that does not support the sentence Learning Goals Upon completion of this investigation, you should be able to: Phenomena: ● Distinguish manual retrieval tools from generative AI, and understand why the two warrant different kinds of trust. ● Read a field rather than a paper: identify what a research community treats as settled, what it treats as contested, and the signals that distinguish the two. Experimental Practices: ● Formulate a focused, researchable question by hand, then use AI as a critic to refine it — and understand why question quality determines search quality. ● Execute the five-step AI-assisted research workflow — claim survey, citation mapping, corpus reasoning, grounded synthesis, and orchestrated deep research — using structured, reusable prompts. ● Design the dimensions of a synthesis matrix appropriate to your own research question, and use it to evaluate and compare sources. ● Use a validated corpus (your verified papers plus your deep research report) in a grounded-Q&A tool such as NotebookLM to deepen your own understanding. Habits of Mind: ● Verify AI-generated claims against primary sources, and articulate why this is the same discipline scientists have always applied to any intermediary source. ● Identify a gap, contested point, or possible extension that no source you found has directly addressed — the first step of original inquiry. ● Recognize when a fully automated “deep research” tool is the right way to get oriented in an unfamiliar topic, and when its output still needs further investigation before you can rely on it. What You Will Need ● A general-purpose AI model with web search, file upload, and a deep research mode — Claude, ChatGPT, Gemini, or Perplexity. Check your deep research usage limits before class; you start one run during the session. Companion documents: Lesson Plan • Instructor Guide • Prelab Tutor Document V1 Scientific Inquiry with AI • AI-Assisted Literature Review • Student Guide Page 2 ● Google Scholar — free. The only search tool you use for the manual baseline in Part 1. ● ResearchRabbit — free. Used for citation mapping in Stage 4. ● NotebookLM — free with a Google account. Used in Stage 9. ● Your institutional library proxy login — the route to full-text papers behind paywalls. ● Full-text PDFs of the two or three papers most central to your question, obtained in Part 1. ● Your two written pause notes from the demonstration video, on paper. Class opens by revisiting them. ● Optional: Semantic Scholar — free. Its open-access PDF links are often the fastest route to a full text. The Core Idea ● AI output sits on a spectrum of trust. A search tool gives you real papers you can open. A language model gives you a written summary that may or may not be accurate. Do not automatically trust or distrust either one. Instead, ask: What kind of output is this, and how should I check it? ● The five steps are ordered by how much work you hand to the AI. As the AI does more searching, organizing, and synthesizing, your job shifts to directing and checking its work. The most important decisions still stay with you: what question to ask, what claims to trust, and what gap to pursue. ● A matrix cell is the natural unit of verification: Each cell should contain one small claim from one source, so you can verify it quickly. Blank cells are also useful. If no paper in your set measured something, that blank may point to a research gap. ● The driving question the demonstration runs on: “Our example asks: When does AI help undergraduate STEM students learn, and when does it just help them get answers without learning? You will run the same process on your own research question. Part 1 — Pre-Class Preparation ~2 hours A. Manual Literature Work and the Demonstration Video (~85 minutes) Do this half of the prelab in the order given. The manual work comes first on purpose: you cannot judge what an AI-assisted search is worth if you have never felt what the search costs by hand. Everything you build here — your question, your friction notes, your PDFs — gets used in class. 1. Define your research question (10 minutes) Pick a topic you genuinely care about, or adopt and adapt one from the starter list below. Then write a focused, researchable question by hand — no AI yet. A strong question names a system or population, a mechanism or variable, and a comparison. Weak: “How does caffeine affect the body?” Stronger: “Does caffeine improve reaction time on a simple visual stimulus task in habitual coffee drinkers compared with non-drinkers, and if so, is the effect dose-dependent?” Starter topics (build a question around one of these if you are stuck — adopting one is not a lesser path): ● Does spacing your studying out over time actually help you remember? ● Does listening to music while you study help you learn? ● Does caffeine boost performance? ● Does using fast chargers shorten a rechargeable battery's life? ● Does the color of an object influence human response? ● Is genetic modification of food, animals, or humans beneficial or harmful? Why it matters: Question quality determines search quality. A vague question returns a vague literature — and a long automated run on a weak question is the most expensive mistake available in this lesson. Companion documents: Lesson Plan • Instructor Guide • Prelab Tutor Document V1 Scientific Inquiry with AI • AI-Assisted Literature Review • Student Guide Page 3 2. Manual search — Google Scholar only (20 minutes) Keyword search, no AI. Find the five papers that seem most relevant. Read titles and abstracts. What to look for: The friction. Take notes as you go: what was hard to find, what turned out to be wasted effort, whether you could realistically have reviewed every plausible source, and whether you suspect relevant work exists under search terms you could not guess. Why it matters: The friction is the point. These notes are the reference experience against which every AI-assisted result in this lesson gets judged, and class opens with them. 3. Deep manual read (15 minutes) Pick one paper and read it without AI. Write a three-sentence summary in your own words, plus one question the paper alone cannot answer. 4. Obtain the PDFs (10 minutes) Get the full text of the two or three papers most central to your question. These seed the synthesis matrix you build in class; you will add to them with whatever the AI-assisted search surfaces. Routes to a paywalled paper, in rough order of preference: your institutional library proxy; the publisher page reached through the library's link resolver; preprint servers (arXiv, bioRxiv, medRxiv, PsyArXiv, ChemRxiv); Google Scholar's “All versions” link, which often surfaces an author-hosted PDF; Semantic Scholar's open-access links; the author's own webpage; and, as a last resort, a polite email to the corresponding author — which works more often than you would expect, and is itself a small lesson in scholarship as conversation. Judgment call: If a paper resists access after a genuine attempt, document what you tried and move on. An abstract is an acceptable fallback — marked as such in your matrix. 5. Watch the demonstration video (~30 minutes, including pauses) The video runs the complete five-step workflow on a shared demonstration question about AI in education. It contains two writing pauses, and both are mandatory: ● Pause 1 (before Step 1 is revealed): “If you had a human research assistant surveying this literature, what exact instructions would you give them? Include what kinds of papers to find, what details to extract, and how they should handle uncertainty.” Write it before you resume. ● Pause 2 (before Step 4 is run). “Write one claim you would bet is settled and one claim you would bet is contested. What signal would tell you the difference?” Write both before you resume. Bring both written notes to class. The tutor session asks about them, and class opens by revisiting them. Watching the video without doing the pauses defeats its purpose — the gap between what you wrote and what the video reveals is where the learning happens. B. Socratic AI Tutoring Session (~15 minutes) Watch the video and complete both pause prompts first — this session will ask about them. Then upload the Prelab Tutor Document to your AI model and follow its lead. The tutor will ask questions instead of giving a lecture. It will help you think through four key ideas: how much to trust search results versus AI summaries, what each step hands over to AI, why verification matters, and what decisions still stay with you. Companion documents: Lesson Plan • Instructor Guide • Prelab Tutor Document V1 Scientific Inquiry with AI • AI-Assisted Literature Review • Student Guide Page 4 Answer honestly. There are no wrong answers here. Saying “I’m not sure, but here’s my thinking” is better than guessing. At the end, you will get an engagement score as a personal target, not a grade, plus a short roadmap for what to focus on next. Share the chat log with your instructor when you finish. Only completion is recorded for the course. Note: The tutor session is also an example of the lesson’s main question: when does AI help students learn instead of just giving them answers? C. Additional Pre-Class Preparation (~15 minutes) Written summary (~10 minutes). After the video and the tutor session, write a brief summary of the key terms and core concepts in your own words: the five steps and what each one delegates, and the difference between a search result and a generated summary. Consolidating this before class is what makes the in-class work fast. Tool access verification (~5 minutes). Confirm all of the following before you walk in: ● Your AI platform works and its deep research mode is available to you. ● ResearchRabbit opens (you use it in Stage 4). ● Your Google account opens NotebookLM (you use it in Stage 9). ● Your library proxy login works — you already used it to get your PDFs. D. Review of In-Class Investigation (~10 minutes) Skim the stages below. Do not try to memorize them — get the shape of the block, and note two things as you read: where you expect to make a decision, and where you expect to want AI help. Class moves quickly, and the stages you have previewed are the ones you will actually run rather than read. Part 2 — In-Class Investigation ~2 hours The Investigation, Stage by Stage You will run the full workflow on your own research question while the instructor guides the class through each stage. This guide gives you the prompts, steps, and decisions you need to make. Remember two things: start your deep research run early so it can work in the background, and expect to leave with a possible research gap, not a final conclusion. Stage 1 — Refine your question with AI (~5 minutes) Run the refinement prompt on the question you wrote by hand in the prelab. Read the critique and the sharpened versions it proposes. Prompt 0 — Question refinement (run before everything else) Here is my research question: [question]. Critique it as a literature-review question: does it name a specific system or population, a mechanism or variable, and a comparison? Is it answerable from existing literature, or is it really several questions bundled together? Propose 2–3 sharpened versions with different scopes, and for each, say what kind of literature it would point toward. Do not choose one for me — give me the trade-offs and I'll decide. Decide: Choose the version of the question you want to use: your original, one AI suggested, or a mix of both. The AI gives feedback, but it does not choose for you. Your research question should still reflect what you care about and what you can realistically investigate. Companion documents: Lesson Plan • Instructor Guide • Prelab Tutor Document V1 Scientific Inquiry with AI • AI-Assisted Literature Review • Student Guide Page 5 Why it matters: You wrote your question by hand first. Now use AI to review it. The AI checks whether your question has a clear population or system, variable or mechanism, and comparison. It can suggest improvements, but you still decide what the final question becomes. Stage 2 — Launch deep research (~2 minutes) Open your AI's deep research mode, paste your refined question, and start the run. It works in the background for the rest of the block. You come back to it in Stage 8. Why it matters: This is the one step you cannot make up later. If you forget it, you will have nothing to compare at the end of class. Judgment call: Launch it after the refinement pass, not before. A long autonomous run on a weak question is the most expensive mistake available in this block. Stage 3 — Step 1: Claim survey (~10 minutes) Fill in the claim-survey prompt with your own details in the brackets, then run it with web search on. Skim the results, choose the two or three most relevant papers, and check which ones you can access as full-text PDFs. These are possible sources for your matrix. Prompt 1 — Claim survey I'm researching [question]. Search the literature and return 8–10 relevant papers. For each, give me: full citation with DOI or stable link, population or scope, methodology in one sentence, key finding in one sentence, and whether the finding supports, contradicts, or qualifies [hypothesis]. Include at least two papers from fields adjacent to [primary field] that study the same phenomenon under different terminology, and tell me what terms those fields use for it. If you cannot verify a detail from the paper or abstract, mark it as 'not confirmed' rather than inferring it. Why it matters: This step shows the difference between manual search and AI-assisted search. AI can return a useful paper list quickly, but its summaries still need to be checked against the original sources. Checkpoint: If more than half the results seem off-target, your question's key terms are ambiguous. Revise the question and rerun — refinement is iterative, not one-and-done. Do now: Jot one line toward the comparison table in Stage 8: what did each approach surface, and what would you trust each one for? Stage 4 — Step 2: Citation mapping (~5 minutes) Open ResearchRabbit and paste one starred paper from Stage 3. Explore the visualization for a few minutes: the cluster around your paper, the earlier work it builds on, and the later work that builds on it. What to look for: You are not just collecting more papers. You are looking at how the field is connected. Older, highly connected papers may be foundational. Clusters may show different methods or schools of thought. Newer papers near the edges may show where the field is still developing. Why it matters: This is a map of a research conversation, not a search. The goal in this stage is awareness, not mastery: know that this deeper mode of exploring a literature exists, and know what kind of question it answers. Do now: Note one or two papers the map surfaces that Stage 3 did not. If the tool is unavailable, a general model can approximate this step — but be honest with yourself about the difference: the specialized tool reads a structured citation graph that the general model does not have direct access to. Prompt 2 — Citation mapping (general-model approximation) Companion documents: Lesson Plan • Instructor Guide • Prelab Tutor Document V1 Scientific Inquiry with AI • AI-Assisted Literature Review • Student Guide Page 6 Take this paper [citation]. Identify the foundational papers it builds on (the work it's responding to) and the recent papers that have built on it. For each, give me the citation, its relationship to the seed paper, and a one-sentence summary. If you are inferring the relationship rather than confirming it directly, say so. Stage 5 — Step 3: The synthesis matrix (~15 minutes) Build your source set from your prelab PDFs plus the best papers from Stages 3 and 4. Use three to five sources for your first matrix. Use full-text PDFs when possible, and mark any abstract-only sources clearly. Before running the AI prompt, decide which columns your matrix should include. Decide — this is the stage's real work: The columns of a comparison table are an analytical decision, and they depend on your question. A core set applies almost everywhere: method or study design, system or population, independent variables, dependent variables, key finding, stated limitations. Then you add the one or two your particular question demands (ex. dose levels for a caffeine question, type of exercise for a mental-health question). The columns are the thinking. The AI populates the cells. Prompt 3 — Corpus reasoning (synthesis matrix) I've uploaded [N] papers on [topic]. Build a comparison table with one row per paper and these columns: method/study design, [system or population], independent variables, dependent variables, key finding, and stated limitations, plus these question-specific columns: [your additions]. Add any further columns you think my question requires and tell me why. Then, below the table: where do the papers agree, where do they disagree, and what different predictions would their findings make in a new experiment? Ground every cell in the uploaded papers, and leave a cell blank rather than inferring a value the paper doesn't state. Where a source is an abstract only, mark its row as abstract-based. What to look for: Blank cells. The prompt tells the model to leave a cell empty rather than infer, and empty cells are where gaps live: “nobody in my set measured X” is a proto-gap statement. Pause before you read the AI's synthesis: Take two minutes and write your own read of the matrix first — where the papers agree, where they disagree, which blank cells look like gaps — in your own words, before the AI offers any synthesis at all. You compare the two in the next stage. Stage 6 — Step 4: Grounded synthesis and gap analysis (~8 minutes) Run the orientation prompt with web search on. Include the papers you reviewed in Stages 3–5 so the AI can compare its synthesis with your source set. Read the response carefully: look for what seems well-supported, what seems uncertain, and what you may need to check next. Deep Research does a larger version of this same process in the background. Prompt 4 — Grounded synthesis (directed, with confrontation) Give me a 200-word orientation to the current state of research on [question]. Separate what is well-established, what is contested, and what appears to be emerging. I have already reviewed these papers: [citations]. Note whether your synthesis is consistent with them, and flag any claim in your synthesis that those papers would dispute. Cite primary sources rather than secondary summaries, and flag any places where the evidence base is thin. What to look for: Two things. First: does the settled/contested split match the bets you wrote at the video's second pause? Score yourself honestly. Second: what kinds of sources did it cite — primary research, review articles, popular press? A synthesis is only as good as the sources it drew from. Why the confrontation clause matters: An open synthesis built from sources the AI chose is being checked against a closed corpus built from sources you chose. The two modes triangulate. If they agree, Companion documents: Lesson Plan • Instructor Guide • Prelab Tutor Document V1 Scientific Inquiry with AI • AI-Assisted Literature Review • Student Guide Page 7 you have independent corroboration. If they disagree, either your curation missed something or the model's search pulled weak sources — and working out which is exactly the judgment this lesson exists to build. Compare: Set the AI's synthesis beside the read you wrote at the end of Stage 5. Where did you agree? What did it see that you did not — and what did you see that it did not? Stage 7 — The spot-check (~8 minutes) Pick one specific, checkable claim the AI made about one paper — a number, a method, a population, a finding — and go to the primary source. Read the relevant section. Record three lines: the claim as the AI stated it; what the source actually says; and your verdict (confirmed / overstated / wrong / couldn't access). Why it matters: This is not framed as defense against AI failure. It is the standard discipline of working with primary sources — the same one scientists have always applied to a review article, a textbook, or a colleague's summary. Any summary is a pointer toward the primary source, not a substitute for it. If the AI turns out to be right every time you check, good: the habit is the point, and the checking is what makes the claim genuinely yours to build on. Judgment call: “Couldn't access” is an acceptable verdict, provided you document what you tried. The access struggle is data too. Worth knowing: Finding an AI error and documenting it earns credit. It never costs it. Stage 8 — Step 5: Deep research and the comparison table (~7 minutes) Your deep research run has finished by now, or will shortly. Take a first look at the report with two questions in hand: can you see the steps inside it — where is it surveying, where is it synthesizing? And would you put it in a paper without verifying the sources yourself? Then open the comparison table and start filling it in. You complete it at home; reading the report closely is homework too. What it helped me find/do What I verified What I would trust it for Manual search (prelab) Claim survey (Stage 3) Citation map (Stage 4) Synthesis matrix (Stage 5) Grounded synthesis (Stage 6) Spot-check (Stage 7) Deep research report Judgment call: Stage 6 and deep research are not competing versions of the same move. Stage 6 costs seconds and is the everyday probe; deep research costs many minutes and a limited budget of runs, and is the commissioned survey for a serious project. Stage 9 — Learning from a validated corpus (~20 minutes) This stage sits outside the five-step workflow. The five steps help you find what the field knows; NotebookLM helps you learn from the sources you collected. After a short instructor demo, build a notebook using your verified papers and your Deep Research report if it is finished. Explore the notebook, and click at least one inline citation to check the exact source passage. Companion documents: Lesson Plan • Instructor Guide • Prelab Tutor Document V1 Scientific Inquiry with AI • AI-Assisted Literature Review • Student Guide Page 8 Why it matters: NotebookLM is only as trustworthy as the sources you upload. Since you spent class building and checking your source set, this is one of the safest ways to use AI for learning. You can also use this approach in your other classes. What to watch: NotebookLM only knows the sources you upload. That makes it more grounded, but not perfect. It may still miss context or combine ideas incorrectly, so always click citations to check the original source. Share: If you find a feature worth showing, show it. The class shares discoveries at the end of the stage. Reflect: Where Does It Break Down? Close the block by writing one-line answers to three prompts. Some will be shared aloud. ● What is the consensus claim in your area — what does the field treat as basically settled? ● What is contested or unresolved — where are researchers still arguing? And how could you tell? ● What is a question you could investigate that no paper you have found has directly answered? You are leaving with a possible research gap, not a final answer. In the postlab, you will test that gap against your matrix. If you do not have one yet, that is okay. Before you leave, ask: when would I use Deep Research, and when would I do the steps myself? Part 3 — After Class [~2 hours] A. Finish the In-Class Work and Generate Your Report Complete anything the class did not finish; your instructor will say what at the end of the session. Two things carry over by design: read the deep research report closely and complete the step-comparison table. Then have your AI produce a draft report of your analysis. Write the prompt yourself: specify what you want in it, what evidence it should draw on, and what it should not invent. Then review it for accuracy. You are the one who signs it, and any claim you cannot trace to a source you have actually read does not go in. B. Literature Map and Gap Statement (~90 minutes) This is the main deliverable: a one-page Literature Map and Gap Statement, built on the synthesis matrix you began in class and supported by your NotebookLM notebook. Five parts. ● The question and its evolution. Three stages — the prelab version you wrote by hand, the AI-critiqued version after Stage 1, and the final version after seeing the literature — with one line on what changed at each stage and why. ● Synthesis matrix: Expand your matrix to 5–10 papers. Use full-text PDFs when possible, and update any abstract-only rows. Verify the cells you rely on, leave unknown cells blank, and attach the matrix to your Literature Map. ● A small map of the field. 5–10 papers with one-sentence characterizations you have personally verified against the primary source (not against an AI summary). ● Gap statement: Use your matrix to test your possible research gap. Look for blank cells, disagreements between papers, or missing populations/conditions. A real gap should matter and should point to evidence that would help resolve it. If your first gap does not hold up, revise it and explain what changed. ● A reflection, written after you have built and used the notebook. Which steps were most useful for which sub-tasks? What did the notebook add that reading alone did not — including any features your classmates showed you? Did the deep research report find the gap you ended up identifying, miss it, or suggest something you had not considered? What surprised you? And how did going to primary sources change your understanding compared with relying on AI summaries? Companion documents: Lesson Plan • Instructor Guide • Prelab Tutor Document V1 Scientific Inquiry with AI • AI-Assisted Literature Review • Student Guide Page 9 Stretch goal, if you finish early — the Swanson move. Pick a field adjacent to yours, ask what that field knows about your phenomenon, and look for a connection neither field has drawn. Prompt 5 — Cross-field connection (stretch) I'm studying [phenomenon] within [field A]. What does [field B] know about this phenomenon or its underlying mechanisms? What terminology does that field use, what are 2–3 key papers, and is there a finding in field B that researchers in field A appear not to have engaged with? Distinguish clearly between connections you can support with specific sources and analogies you are speculating about. C. Retrieval Practice / Course Review (~30 minutes) Spend about thirty minutes on integrated course review using the course's AI-enhanced retrieval tool. This is the standard routine in every lesson: it spaces your practice out over time and interleaves this lesson with earlier ones, which is what makes the material stick rather than fade. Everything You Turn In ● Your hand-written research question, and your manual search notes — including the friction. ● Your three-sentence deep-read summary, and the one question that paper alone could not answer. ● The full-text PDFs of your two or three central papers (or documented access attempts). ● Your tutor session chat log, shared with your instructor. ● Your two written pause answers from the demonstration video. ● The step-comparison table, completed. ● The spot-check record: claim, source, verdict. ● The Literature Map and Gap Statement — all five parts, with the extended synthesis matrix attached. ● Your NotebookLM notebook of validated sources (or a link to it). Companion documents: Lesson Plan • Instructor Guide • Prelab Tutor Document V1