-
Notifications
You must be signed in to change notification settings - Fork 1.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Is it possible to provide suggested "subquestions" as well as a main question? #380
Comments
Hey @SeanJAmmirati can you please share more about the motivation for this feature? What are you trying to achieve with it and what output are you expecting? |
Thanks for getting back to me @assafelovic! The motivation for this feature is to generate a "larger report" that contains multiple defined sub-themes but all fit together into one unified report under the one main top-level query. Based on my experience using GPTResearcher so far it does a great job automatically generate a set of sub questions and flush out a report based on a primary top-level query. What I'd like to do is say: here is a primary top-level query, here are some sub-questions to that query and have it use that outline to build a unified report that answers the primary question by answering the subquestions (and where necessary adds for lack of a better term "sub sub questions".) Today Output: Requested Output: I realize you could use GPTResearcher to just build reports for each Sub Question as standalone and then merge them into one document, but then you don't have the advantage of a unified answer. Let me know if this makes sense? |
@SeanJAmmirati It absolutely makes sense! In fact I was considering using this approach myself for generating a detailed report. This would overcome the limitation of having the report restricted to two pages. But there are some challenges:
If this seems ok to implement then I have some ideas which I can try to implement @assafelovic . |
@proy9714 this is a long awaited feature with huge impact so happy to see what you bring! I'd take a look at here as well for inspiration: https://github.com/langchain-ai/langgraph/blob/main/examples/storm/storm.ipynb It uses the STORM methodology. Generally you'd generate subsections and then for each generate content leading to much longer and more detailed research reports. Looking forward to see your further impact on this project! As regards to costs, maybe we can consider adding a flag in config file for each one report generation or using the "advanced in depth" for longer but costlier reports. Also feel free to ping me on the Discord community channel to further discuss! 🚀 |
Ok sure...on it 🫡 |
I strongly recommend the Storm methodology. I'm glad that you brought it up. |
Hi @proy9714 how is this going? I'm not an engineer so can't help with development, but let me know if there is any way I can support you on this work. |
Hey, sorry for the late response. I'm on vacation right now....will be available early next month. |
Hi @assafelovic @proy9714 @SeanJAmmirati , I'm very new to this project and just going through the code for the first time. (Very cool stuff!) The STORM methodology seems interesting. But as I was reading the comments, I thought a simple, intermediate solution might be to update the current prompt that generates subtopics. You could inject the user-provided subtopics into the current prompt that requests the LLM to build additional topics. The prompt should be engineered such that I have no expertise in prompt engineering, so I am not sure how well an LLM would do on this task. Thanks, |
Hey @dphiggs01 I have in fact thought about this same approach. Combining user provided subtopics with ones generated by the AI. Absolutely possible. Will definitely get to it when I have time. |
It looks like the package only provides the ability to input one main question and it automatically generates the subquestions. This is very cool, but is it possible to also suggest subquestions to be included with the main question?
Thanks in advance for your advice / feedback.
The text was updated successfully, but these errors were encountered: