Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

longtext llama3-gradient bug #4293

Open
bambooqj opened this issue May 9, 2024 · 0 comments
Open

longtext llama3-gradient bug #4293

bambooqj opened this issue May 9, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@bambooqj
Copy link

bambooqj commented May 9, 2024

What is the issue?

If I use 'ollama' for long text processing, then the 'system' statements will no longer be effective. Instead, it will produce random outputs. The model is 'llama3-gradient'.

systemmsg="""
Please analyze the type of website based on the 'body' content I provide, and return to me in JSON format with the structure {type:..., why:...}.
"""
def get_webpage_content(url):
    try:
        if response.status_code == 200:
            return response.text
        else:
            print(f'Failed to retrieve the webpage. Status code: {response.status_code}')
            return None
    except requests.exceptions.RequestException as e:
        print(f'An error occurred: {e}')
        return None

body = get_webpage_content('http://www.sohu.com')
response = ollama.generate(model='llama3-gradient', prompt=body,format='json',options={
    "seed": 123,
    "num_ctx": 32000
  },
  system=systemmsg)
print(response['response'])

OS

Windows

GPU

Nvidia

CPU

Intel

Ollama version

0.1.34

@bambooqj bambooqj added the bug Something isn't working label May 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant