Skip to content

Allow for local models to stay loaded into vram/ system ram for repeated generations #18

@thedudeliest

Description

@thedudeliest

looking at task manager, models leave vram, they are loaded repeatedly from disc every time you want to make a generation. going to take some time to make sure I can disable that, but I forsee those not aware of this killing their ssd's by not being aware of this trait/property

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions