-
Notifications
You must be signed in to change notification settings - Fork 3.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Create a Share-OpenDevin for people to share their interaction trajectories #1802
Comments
This is really a terrific idea! I think we should collect more data for fine-tuning to make things work better. |
happy to take care of the logging stuff (state, action, agent input/output, meta data, ...), will try to finish this in a few days. |
Awesome idea! I wonder if it would be nice if we can let the users interact with the environment as well, e.g. terminal, editor, etc. so that we can not only record user chat history and agent actions, but also user correction actions that may sometime happen when dealing with dumb agents. Might be a bit far fetched for now, but I think recording user demonstrations when the agent is not acting correctly are super useful as well. |
My goal for EventStream is that it's a serializable representation of an entire session/workflow. I'd suggest leaning on that. I'm currently working through persistent sessions, which is pretty similar technologically here |
OK! I figured out how to set up a place on AWS where we can dump trajectories to share. Here's an example script of how it can be done. We can use this to add a button that allows users to share trajectories. import requests
url = "https://kttkfkoju5.execute-api.us-east-2.amazonaws.com/od-share-trajectory"
data = {
"email": "test@example.com",
"token": "exampletoken",
"trajectory": [{"x": 1, "y": 2, "z": 3}, {"x": 4, "y": 5, "z": 6}],
"feedback": "positive"
}
response = requests.post(url, json=data)
print(response.status_code)
print(response.json()) We can refine this more later as we know more about our requirements. |
What problem or use case are you trying to solve?
Similar to ShareGPT where people can share their interaction with ChatGPT, we can create "ShareOpenDevin", where users can contribute their interaction trajectories with OpenDevin.
Describe the UX of the solution you'd like
We need:
controller
can send over the currentState
(which already contains all the history interactions) to the remoteShareOpenDevin
API (we probably need a better way to figure out how to manage each session - maybe withuuid
- so that same session at different steps won't get submitted multiple times)/share
receiving people's share requests.Do you have thoughts on the technical implementation?
Describe alternatives you've considered
Additional context
The text was updated successfully, but these errors were encountered: