KoboldAI Tutorial: Crafting Quirky Stories with Open Source AI Models

Introduction

KoboldAI is an open-source project that enables users to run AI models locally on their own hardware. This client-server setup allows a web interface (client) to communicate with an AI model running on a server, making it user-friendly for those who may not be tech-savvy. In contrast, Google Colab is a free cloud service that facilitates machine learning education and research, providing access to powerful GPUs and TPUs.

Getting Started with KoboldAI on Google Colab

KoboldAI's Google Colab version allows users to harness the power of AI models on Google's robust hardware, which can often outperform local setups. Whether you're looking to write creatively or develop text-based games, KoboldAI offers an exciting platform to explore.

Understanding KoboldAI's Models

KoboldAI supports multiple AI models like GPT-2, GPT-3, and GPT-Neo, which can generate human-like text tailored to various applications from writing assistance to creative storytelling and interactive gaming. The Nerys model is particularly notable for its versatility in narrative creation.

Primary Use Cases of KoboldAI:

Interactive Storytelling: Engage with the AI as it responds to prompts to form an evolving narrative.
Writing Assistance: Collaborate with the AI to overcome writer’s block and enrich your writing projects.
Text Adventure Mode: Create unpredictable and exciting text-based games.

Prerequisites

Basic knowledge of operating Google Colab
Creativity and a willingness to explore the potential of open-source AI

Powering Up Google Colab

Starting KoboldAI can be done locally or through Google Colab for a quick and resource-efficient option. To begin with Google Colab:

Click the provided link to initiate a GPU-powered KoboldAI instance.
Ensure you are logged into your Google account to access the service.

Upon successful setup, you will have direct access to KoboldAI through your web interface.

Choosing the Right Model

Before using the AI, it's vital to select the appropriate model tailored to your writing needs. KoboldAI provides a selection screen featuring distinct models:

Nerys: A hybrid model perfect for novel writing and adventure mode.
Janeway: Trained for SFW content across various genres, mainly focusing on novel writing.
Picard: Ideal for serious SFW novel writing.
AID: Engaging for text adventure pursuits.
OPT: A generic model designed for broad application.
Fairseq Dense: Effective for pop culture tasks.
Neo: The foundational model best suited for blogging or programming content.

Using the Nerys Model

For our demonstration, we will use the Nerys model:

Select "Nerys V2 6B" from the model list.
Run the model by clicking the play button at the top interface.

Follow the prompts to start your storytelling experience; we can submit an initial setup scene to provide context for the AI-generated narrative.

Creating With Nerys: Writing Assistant Example

Start your psychological horror story with a couple of sentences and let KoboldAI proceed. For example:

This is a great way to start off our psychological horror novel, isn't it?

After submission, KoboldAI will provide a continuation, demonstrating how effectively it can enhance your narrative.

Transforming Into a Text-Based Adventure Game

Activate Adventure Mode by navigating to the settings and enabling it. You can now give commands to guide your protagonist, like:

You take a step back.

This interaction further builds your story, adding layers and dynamics to your adventure.

Conclusion

This tutorial provided insights into setting up and using KoboldAI through Google Colab. By exploring different models, specifically the versatile Nerys, you're now prepared to enhance your creative writing and gaming experiences. Embrace this open-source AI tool to explore endless storytelling possibilities!

For further learning, check out other tutorials and share your thoughts on using KoboldAI!