Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

AI 代理 Wasm 插件对接 Google Gemini/Gemini Flash #947

Open
Tracked by #940
CH3CHO opened this issue May 15, 2024 · 9 comments
Open
Tracked by #940

AI 代理 Wasm 插件对接 Google Gemini/Gemini Flash #947

CH3CHO opened this issue May 15, 2024 · 9 comments
Assignees
@UniDra001
Labels
area/plugin good first issue Good for newcomers level/normal sig/wasm type/enhancement New feature or request

Comments

@CH3CHO
Copy link
Collaborator

CH3CHO commented May 15, 2024 •
edited

https://developers.generativeai.google/
@CH3CHO CH3CHO mentioned this issue May 15, 2024
Open
22 tasks
@CH3CHO CH3CHO changed the title Google PaLM2/Gemini（链接） AI 代理 Wasm 插件对接 Google PaLM2/Gemini May 15, 2024
@CH3CHO CH3CHO added type/enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed level/normal area/plugin sig/wasm labels May 15, 2024
@johnlanni johnlanni changed the title AI 代理 Wasm 插件对接 Google PaLM2/Gemini AI 代理 Wasm 插件对接 Google Gemini/Gemini flash May 16, 2024
@johnlanni johnlanni changed the title AI 代理 Wasm 插件对接 Google Gemini/Gemini flash AI 代理 Wasm 插件对接 Google Gemini/Gemini Flash May 16, 2024
@UniDra001
Copy link

我想尝试下这个issue~

@CH3CHO CH3CHO removed the help wanted Extra attention is needed label May 27, 2024
@UniDra001
Copy link

您好，我在开发的时候遇到一个问题，gemini的模型选择和api_key都是放在请求url中的，但是在wasm代理的时候只能在ProcessRequestBody获取body绑定的model类型，这样的话就没法修改请求url，请问有解决方法吗？ gemini API

@CH3CHO
Copy link
Collaborator Author

CH3CHO commented May 29, 2024

您好，我在开发的时候遇到一个问题，gemini的模型选择和api_key都是放在请求url中的，但是在wasm代理的时候只能在ProcessRequestBody获取body绑定的model类型，这样的话就没法修改请求url，请问有解决方法吗？ gemini API

1.4.0 里是可以在 ProcessRequestBody 里修改 header 的。可以参考一下 qwen 的实现和这个 PR #1005 。

@UniDra001
Copy link

好的，另外还想问下，开发wsam插件有本地调试的方案吗？

@CH3CHO
Copy link
Collaborator Author

CH3CHO commented May 29, 2024

好的，另外还想问下，开发wsam插件有本地调试的方案吗？

看这个：https://higress.io/zh-cn/docs/user/wasm-go

@UniDra001
Copy link

嗯嗯这个我看过了，我想问的是支持单步调试吗？

@CH3CHO
Copy link
Collaborator Author

CH3CHO commented May 29, 2024

嗯嗯这个我看过了，我想问的是支持单步调试吗？

这个应该还不支持的。

@UniDra001
Copy link

请问有什么办法能看到网关发送给LLM服务商的请求吗？我这边显示请求格式错误，但是不好调试排错

@CH3CHO
Copy link
Collaborator Author

CH3CHO commented May 30, 2024

请问有什么办法能看到网关发送给LLM服务商的请求吗？我这边显示请求格式错误，但是不好调试排错

打日志就行了，在gateway容器里看

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@UniDra001 UniDra001

Labels
area/plugin good first issue Good for newcomers level/normal sig/wasm type/enhancement New feature or request
Projects
Higress
Status: Todo
Milestone
No milestone
Development

No branches or pull requests
2 participants
@CH3CHO @UniDra001