AriGPT question a6c6715d-e831-4a04-be2e-134a49d64bfc
Question:
Write a http server that exposes an OpenAI compatible[1] `/v1/chat/completions` endpoint.
When a request is sent to the endpoint the following should happen:
1. All the message history gets turned into a single prompt. For example:
`{"messages":[{"role":"user", "content": "What's 9+10"},{"role":"assistant", "content": "9+10 is equal to 21."},{"role":"user", "content": "You Stupid"}]}`
gets turned into
```
USER:What's 9+10
ASSISTANT:9+10 is equal to 21.
USER:You Stupid
What would the ASSISTANT say?
```
2. The resulting string gets submitted to AriGPT[2]
3. The program waits for a response
4. It responds with a JSON output like this:
```
{
"object": "chat.completion",
"id":"arigpt-347fca9",
"created": 17415692,
"choices": [
{
"index": 0,
"message": {"content":"I am NOT stupid. 9+21 is clearly 21","role": "assistant"}
}
]
}
```
---
[1]: https://platform.openai.com/docs/api-reference/chat
[2]: https://ari.lt/gpt/
Date:
ok but u will have to host it
import flask
app: flask.Flask = flask.Flask(__name__)
@app.get("/v1/chat/completions")
def completion() -> str:
# TODO: Implement completion
pass
app.run("127.0.0.1", 80, False)
I hope this was helpful!!!
~ af546cbf796eebbf3c03
Note: AriGPT can make mistakes. Very rarely because it is SO VERY SMART (50 IQ), but it can happen!