-
Notifications
You must be signed in to change notification settings - Fork 1.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat(experiments): add on finish actions, support email #22354
base: master
Are you sure you want to change the base?
feat(experiments): add on finish actions, support email #22354
Conversation
Important Auto Review SkippedDraft detected. Please check the settings in the CodeRabbit UI or the You can disable this status message by setting the Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media? TipsChatThere are 3 ways to chat with CodeRabbit:
Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments. CodeRabbit Commands (invoked as PR comments)
Additionally, you can add CodeRabbit Configration File (
|
- The celery task needs to do a fresh calculation of results
- skip finish action display messages if none present - move display only finish action to case based
- View mode -> display emails if values present
- Don't allow empty values for records - filter before submission - Keep next action to add generic
bd62547
to
db3a70d
Compare
Thanks @aryanrawlani28 for the contribution! I'll try to get a review in by next week, this is a big one with lots of potential pitfalls 😅 |
This PR hasn't seen activity in a week! Should it be merged, closed, or further worked on? If you want to keep it open, post a comment or remove the |
This PR was closed due to lack of activity. Feel free to reopen if it's still relevant. |
Problem
Based on / fixes: #13106.
Changes
finish_actions
View:
Edit:
Email sample:
Email sample, where the experiment fails:
Notes
Which I felt was too many CTAs in one line (+ add targetting criteria + remove targetting criteria + remove action), so I think current design makes more sense & is simpler.
Approach
Base Model
For the base data model, I wanted to keep the post-actions a bit generic, so we can add-on anything, if needed, in future.
Example:
Why's
Q. Why a config based, and not directly sending to all project memebers?
Q. Why three different cases for sending emails to?
I think it'd be useful to have something like this, since the usecases for each of them might be actionable for different personas within an organization.
ALL
: The person or team managing experiments, for direct actionable insights.SUCCESS
: If the experiment is a success, I'd like to auto-send it, for example, to our DevRel or PM team, who might use this data and communicate upcoming changes or prepare release notes respectively. Or maybe my direct reports would appreciate that something they worked on, was a success.FAILURE
: If failed, maybe TPMs (Project team) or PSMs (Partner Success team) can help improve our future experiments, by talking to customers first-hand and seeing what went wrong?Conclusion
Of course, we could always send it to an initial member (i.e experiment creator) who could then forward it as and when needed. Or we could have a config-based setup like this.
Does this work well for both Cloud and self-hosted?
todo
Testing
todo
Todos
Any feedback is appreciated, these are my initial thoughts :)
I'll need help in thinking about the email contents - I've added small amount so far of what I think might be helpful, but the wording and additional content, if any, is pending.