[go: nahoru, domu]

Skip to content

Commit

Permalink
update README LICENSE
Browse files Browse the repository at this point in the history
  • Loading branch information
Czechh committed Apr 1, 2023
1 parent b2d8f9a commit db23c21
Show file tree
Hide file tree
Showing 2 changed files with 11 additions and 6 deletions.
2 changes: 1 addition & 1 deletion LICENSE
Original file line number Diff line number Diff line change
Expand Up @@ -186,7 +186,7 @@
same "printed page" as the copyright notice for easier
identification within third-party archives.

Copyright [yyyy] [name of copyright owner]
Copyright 2023 Metal Technologies Inc

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
Expand Down
15 changes: 10 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,13 +15,18 @@ Motörhead

Motörhead is memory and information retrival server.

## Why use Motörhead?

When building chat applications using LLMs memory handling is something that is has to be built every time. Motörhead is a server to assist with that process, it provides 3 simple APIS:

- GET|POST|DELETE `/sessions/:id/memory`

A max `window_size` is set to for the LLM to keep track of the conversation. Once that max is hit Motörhead process the `window_size` / 2 messages and summarizes them. Subsequent summaries as the messages grow are incremental.

## Config

- `WINDOW_SIZE` - Number of max messages returned by the server. When this number is reached a job is triggered to halve it.
- `WINDOW_REDUCE_METHOD` - `summarization|buffer`
- `summarization` - Once the `WINDOW_SIZE` is reached 1/4 of the window is summarized incrementally into the existing session summary.
- `buffer`(default) - Memory only goes as far as the `WINDOW_SIZE`. Beyond that no messages are returned.
- `OPENAI_API_KEY` - Number of max messages returned by the server. When this number is reached a job is triggered to halve it. Required if `summarization` is the `WINDOW_REDUCE_METHOD`.
- `MAX_WINDOW_SIZE` (default:10) - Number of max messages returned by the server. When this number is reached a job is triggered to halve it.
- `OPENAI_API_KEY` (required)- Number of max messages returned by the server. When this number is reached a job is triggered to halve it.

## Examples

Expand Down

0 comments on commit db23c21

Please sign in to comment.