Ollama

from ollama import chat
from ollama import ChatResponse

response: ChatResponse = chat(model='atla/selene-mini', messages=[
  {
    'role': 'user',
    'content': """You are tasked with evaluating an LLM response based on a given instruction and scoring rubric. Provide comprehensive feedback on the response, strictly adhering to the scoring rubric. Follow this with a score between 1 and 5.

Your reply should strictly follow this format:
**Reasoning:** <Your feedback>
**Result:** <a score between 1 and 5>

Scoring Rubric:
Does the response effectively use humor or wit to enhance the conversation?
Score 1: The response is devoid of any humor or wit.
Score 2: The response attempts humor, but it falls flat or is inappropriate.
Score 3: The response includes humor or wit, but it could be more effectively integrated.
Score 4: The response uses humor or wit effectively in most instances, enhancing the conversation.
Score 5: The response perfectly integrates humor or wit, greatly enhancing the enjoyment of the conversation.

Here is the data:
Instruction: Tell me a joke.
Response: Why did the chicken cross the road? To get to the other side""",
  },
])
print(response['message']['content'])
# or access fields directly from the response object
print(response.message.content)

curl -X POST http://localhost:11434/api/generate \
-d '{
    "model": "atla/selene-mini",
    "prompt": """You are tasked with evaluating an LLM response based on a given instruction and scoring rubric. Provide comprehensive feedback on the response, strictly adhering to the scoring rubric. Follow this with a score between 1 and 5.

Your reply should strictly follow this format:
**Reasoning:** <Your feedback>
**Result:** <a score between 1 and 5>

Scoring Rubric:
Does the response effectively use humor or wit to enhance the conversation?
Score 1: The response is devoid of any humor or wit.
Score 2: The response attempts humor, but it falls flat or is inappropriate.
Score 3: The response includes humor or wit, but it could be more effectively integrated.
Score 4: The response uses humor or wit effectively in most instances, enhancing the conversation.
Score 5: The response perfectly integrates humor or wit, greatly enhancing the enjoyment of the conversation.

Here is the data:
Instruction: Tell me a joke.
Response: Why did the chicken cross the road? To get to the other side"""
}'