How to download and run local LLMs.

One big question that always comes up on the topic of AI is are large language models able to run if they;re not connceted to the internet? The answer is yes and in this tutorial we'll show you how you can do it using LM Studio.

Step 1: Visit LM Studio

- Go to LM Studio on your web browser.

- Choose your platform (Mac, Windows, or Linux) and perform a standard install.

Step 2: Open LM Studio Application

- Once installed, open LM Studio.

- This will bring you to the main page of the application.

Step 3: Explore and Select Models

- Search for models using keywords or paste a Hugging Face repository URL.

- Browse "New and Noteworthy" for popular models voted by the community, like Open Hermes, Mistral, and Code Llama 2.

Step 4: Download a Model

- Choose a model to download, for example, "Code Llama."

- Click "Download." The model will appear in your downloads section.

Step 5: Using the Downloaded Model

- After downloading, navigate to the left-hand side and click on the "New Chat" speech bubble icon.

- For first-time users, a blank screen appears.

- Select the model you wish to use, such as OpenAI's GPT-3.5.

Step 6: Starting a Conversation

- Enter a prompt in the provided text box. For example: "Tell me about Earth."

- The model will generate a response based on your prompt.

Step 7: Understanding the Local Setup

- Note that these models run locally on your laptop or PC.

- Local versions may be slower compared to hosted versions like GPT-3.5 Turbo.

- No internet connection is required for local models.

Step 8: Additional Features

- Explore further settings and details on the left panel.

- Manage and set defaults for your downloaded models.

- Search and sort models by popularity, recent updates, or downloads.

Step 9: Interacting with the Response

- Once a response is generated, you can regenerate it, continue the chat, or tweak the prompts.

- Adjust model initialization, hardware settings, or save presets.

Step 1: Visit LM Studio

- Go to LM Studio on your web browser.

- Choose your platform (Mac, Windows, or Linux) and perform a standard install.

Step 2: Open LM Studio Application

- Once installed, open LM Studio.

- This will bring you to the main page of the application.

Step 3: Explore and Select Models

- Search for models using keywords or paste a Hugging Face repository URL.

- Browse "New and Noteworthy" for popular models voted by the community, like Open Hermes, Mistral, and Code Llama 2.

Step 4: Download a Model

- Choose a model to download, for example, "Code Llama."

- Click "Download." The model will appear in your downloads section.

Step 5: Using the Downloaded Model

- After downloading, navigate to the left-hand side and click on the "New Chat" speech bubble icon.

- For first-time users, a blank screen appears.

- Select the model you wish to use, such as OpenAI's GPT-3.5.

Step 6: Starting a Conversation

- Enter a prompt in the provided text box. For example: "Tell me about Earth."

- The model will generate a response based on your prompt.

Step 7: Understanding the Local Setup

- Note that these models run locally on your laptop or PC.

- Local versions may be slower compared to hosted versions like GPT-3.5 Turbo.

- No internet connection is required for local models.

Step 8: Additional Features

- Explore further settings and details on the left panel.

- Manage and set defaults for your downloaded models.

- Search and sort models by popularity, recent updates, or downloads.

Step 9: Interacting with the Response

- Once a response is generated, you can regenerate it, continue the chat, or tweak the prompts.

- Adjust model initialization, hardware settings, or save presets.

Step 1: Visit LM Studio

- Go to LM Studio on your web browser.

- Choose your platform (Mac, Windows, or Linux) and perform a standard install.

Step 2: Open LM Studio Application

- Once installed, open LM Studio.

- This will bring you to the main page of the application.

Step 3: Explore and Select Models

- Search for models using keywords or paste a Hugging Face repository URL.

- Browse "New and Noteworthy" for popular models voted by the community, like Open Hermes, Mistral, and Code Llama 2.

Step 4: Download a Model

- Choose a model to download, for example, "Code Llama."

- Click "Download." The model will appear in your downloads section.

Step 5: Using the Downloaded Model

- After downloading, navigate to the left-hand side and click on the "New Chat" speech bubble icon.

- For first-time users, a blank screen appears.

- Select the model you wish to use, such as OpenAI's GPT-3.5.

Step 6: Starting a Conversation

- Enter a prompt in the provided text box. For example: "Tell me about Earth."

- The model will generate a response based on your prompt.

Step 7: Understanding the Local Setup

- Note that these models run locally on your laptop or PC.

- Local versions may be slower compared to hosted versions like GPT-3.5 Turbo.

- No internet connection is required for local models.

Step 8: Additional Features

- Explore further settings and details on the left panel.

- Manage and set defaults for your downloaded models.

- Search and sort models by popularity, recent updates, or downloads.

Step 9: Interacting with the Response

- Once a response is generated, you can regenerate it, continue the chat, or tweak the prompts.

- Adjust model initialization, hardware settings, or save presets.

Tutoriales Relacionados