Skip to content

Context Management #1682

@StefanoBraghetto

Description

@StefanoBraghetto

Describe the feature or problem you'd like to solve

Context manager

Proposed solution

Be able to manage the context of an smart LLM is huge advantage to get the best out of them. It is well known that the model capabilities decreases as the context grows. The web version of chat gpt allows you to edit any previous message in the conversation chain, allowing you to rewrite any previous message in a way that given the conversation you can just rewrite the a previous question instead of add extra context.

This should make more efficients as well (less cross attention)

Example prompts or workflows

No response

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions