There was recently a claim:

I think it’s mostly correct, but to get started you have to develop high Personal Agency first, which is difficult and not that straightforward. While I’m working on lowering the barrier even more with Paper To Project, a tool that aims to create a ranked list of novel, plausible and testable projects in AI safety and interpretability, here’s a comparison of existing tools that can help you to get started. We want to help to answer these question:

  • Which problems are most critical right now?
  • Which ones are tractable for someone with my specific background and available time?
  • How do I move from reading abstract papers or high-level problem descriptions to a concrete project I can actually do?

AI scientist approach

These have an idea generation step in their pipeline, which should be possible to use on it’s own to get started

Company/ProjectWhat it doesHow to use
NoviSciGenerates thousands of ideas, deduplicates via comparing their embeddings using cosine similarities, and ranks via a swiss tournament based on what paper gets a higher reviewer score from an LLMThis is potentially the most useful, though the ranking they created is not good enough compared to Human ranking. It should first be grounded on a topic or a list of papers, for example this recent post with a list of problems
SakanaAIFully automatic scientific discovery, from idea generation to a paper.It’s first step is an idea generation from a template with seed ideas. It should be possible to use only this part with a stronger guidance towards AI safety research. Ranking ideas relies on a chain of thought and self-reflection in LLMs
Ai2’s CodeScientistCodeScientist creates novel ideas to explore essentially by using genetic mutations (using an LLM-as-a-mutator paradigm) to mutate combinations of scientific articles and code examplesGenerates a batch of ideas and relies on human to rank and comment on them, but then plans and runs experiments.
Future House’s AviaryAgents to generate a scientific answer to problems like engineering proteins, summarizing literature, molecular cloningA scientist helper that can be a next step after identifying what problem to solve. You can try Openreview For PaperQA to ask questions from the most recent papers
GoogleAI scientist where you define your goal and it explores literature, generates and expands ideasClosed source, not applied to AI research, not available to public
CurieEnd-to-end experimentation automation, where you ask a question and it runs an experimentDesigned to test and validate simple ideas, not focused on figuring out what ideas are important
There’s also
  • research town that reads and writes papers by creating a graph, but it’s not clear how to get ideas from there
  • a paper that generates seed ideas first, fetches related papers and iterates on them before fixating on a final idea and decomposing it into smaller parts. Couldn’t find any code though

Useful tools that help with research

Main users here are academics, researchers, applied scientists

Startup/CompanyWhat it does (briefly)What’s missingAudience Size
Elicit, SciSpace, Semantic Scholar, SciteAI research assistants for brainstorming, writing, searchFocuses on literature Q&A, summarization, brainstorming; doesn’t systematically generate skill-level-specific project proposals from papers.>2M users
Research Rabbit, Connected Papers and LitmapsCitation-based literature discovery & organization, visual mapping. Claims to be a Spotify for PapersExploring paper networks & finding related work; no project idea extraction or skill tailoring.>400k users
ScholarcyAI tools for summarizing and organizing research papersFocuses on digesting individual papers; not generating new projects based on them.>600k users
PaperpalAI academic writing & editing assistantFocuses on improving manuscript quality; not project ideation from existing research.>20k users
SciteAssesses research reliability via citation analysisEvaluates paper impact/reception; not project generation.>350k users
R Discovery, NotebookLMAI tool for finding relevant papers, summaries, audio summaries and translationsFocuses on discovery & summarization; no generation of skill-specific project ideas. Mobile app exists.>3M users

Another good review on literature review tools

These existing tools help you find what to read, but not necessarily what to do next in a way that’s tailored to your capabilities. This is the gap that future tools or initiatives could potentially fill, making it easier for more people to transition from interested observers to active contributors

  • Research is difficult, it’s usually easier with a good Graduate Advisor. Solo research is even more difficult, but not impossible, as you can see in these examples
  • Take a look at How to do a Good Research by Eamonn Keogh
  • Check out comments here and here
  • Try things out and see what happens!