<titledata-rh="true">Running an AI application | Podman Desktop</title><metadata-rh="true"name="viewport"content="width=device-width,initial-scale=1"><metadata-rh="true"name="twitter:card"content="summary_large_image"><metadata-rh="true"property="og:image"content="https://podman-desktop.io/img/banner_podman-desktop.png"><metadata-rh="true"name="twitter:image"content="https://podman-desktop.io/img/banner_podman-desktop.png"><metadata-rh="true"property="og:url"content="https://podman-desktop.io/tutorial/running-an-ai-application"><metadata-rh="true"property="og:locale"content="en"><metadata-rh="true"name="docusaurus_locale"content="en"><metadata-rh="true"name="docsearch:language"content="en"><metadata-rh="true"name="docusaurus_version"content="current"><metadata-rh="true"name="docusaurus_tag"content="docs-tutorial-current"><metadata-rh="true"name="docsearch:version"content="current"><metadata-rh="true"name="docsearch:docusaurus_tag"content="docs-tutorial-current"><metadata-rh="true"property="og:title"content="Running an AI application | Podman Desktop"><metadata-rh="true"name="description"content="Running an AI application using the UI."><metadata-rh="true"property="og:description"content="Running an AI application using the UI."><metadata-rh="true"name="keywords"content="podman desktop,podman,AI application"><linkdata-rh="true"rel="icon"href="/img/favicon.ico"><linkdata-rh="true"rel="canonical"href="https://podman-desktop.io/tutorial/running-an-ai-application"><linkdata-rh="true"rel="alternate"href="https://podman-desktop.io/tutorial/running-an-ai-application"hreflang="en"><linkdata-rh="true"rel="alternate"href="https://podman-desktop.io/tutorial/running-an-ai-application"hreflang="x-default"><linkdata-rh="true"rel="preconnect"href="https://MR01ANKQ9S-dsn.algolia.net"crossorigin="anonymous"><scriptdata-rh="true"type="application/ld+json">{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Running an AI application","item":"https://podman-desktop.io/tutorial/running-an-ai-application"}]}</script><linkrel="alternate"type="application/rss+xml"href="/blog/rss.xml"title="Podman Desktop RSS Feed">
<p>This tutorial covers the following end-to-end tasks required to run and verify an Artificial Intelligence (AI) application on your local machine:</p>
<liclass=""><strong>Catalog</strong>: Helps in downloading or importing a model.</li>
<liclass=""><strong>Services</strong>: Helps in creating an inference server that runs in a container to serve a large language model (LLM) using an OpenAI-compatible API. After creating a service, you can access its details and generate its client code in any programming languages to integrate your application.</li>
<liclass=""><strong>Playgrounds</strong>: Helps in experimenting with model parameters and accuracy to identify the best model and parameters for your use case. Each playground denotes a customized environment to experiment with a model.</li>
<liclass=""><strong>Recipes Catalog</strong>: Helps in accessing a catalog of recipes, such as ChatBot, audio-to-text, code generation, and summarizer. Each recipe denotes an AI application catering to a specific use case. You can use a recipe to start an AI application. You can also clone a recipe to your local machine for editing purposes.</li>
<liclass=""><strong>Running</strong>: Helps in accessing all running AI applications.</li>
<h2class="anchor anchorTargetStickyNavbar_tleR"id="before-you-begin">Before you begin<ahref="#before-you-begin"class="hash-link"aria-label="Direct link to Before you begin"title="Direct link to Before you begin"translate="no"></a></h2>
<liclass=""><aclass=""href="/docs/podman/creating-a-podman-machine">A running Podman machine</a> with at least 6 GB memory. If the Podman machine does not have enough memory, you get a notification to update its memory configuration while downloading a model or running a recipe:
<h2class="anchor anchorTargetStickyNavbar_tleR"id="installing-the-extension">Installing the extension<ahref="#installing-the-extension"class="hash-link"aria-label="Direct link to Installing the extension"title="Direct link to Installing the extension"translate="no"></a></h2>
<imgdecoding="async"loading="lazy"alt="install the extension"src="/assets/images/downloading-ai-lab-ext-299b7c850bce2fd8bbbc2ab6b3270e7a.png"width="1962"height="634"class="img_SS3x"></li>
<liclass="">Select the <strong>Installed</strong> tab to check the extension is active, and check that a new AI Lab component is added in the left navigation pane.
<h2class="anchor anchorTargetStickyNavbar_tleR"id="downloading-a-model">Downloading a model<ahref="#downloading-a-model"class="hash-link"aria-label="Direct link to Downloading a model"title="Direct link to Downloading a model"translate="no"></a></h2>
<h2class="anchor anchorTargetStickyNavbar_tleR"id="creating-a-service">Creating a service<ahref="#creating-a-service"class="hash-link"aria-label="Direct link to Creating a service"title="Direct link to Creating a service"translate="no"></a></h2>
<p>In the Services section, click <strong>New Model Service</strong>.
<imgdecoding="async"loading="lazy"alt="create a new model service"src="/assets/images/create-new-model-service-ea8c2365c8c0bd53be04353d4bbbadbe.png"width="1086"height="750"class="img_SS3x"></p>
<imgdecoding="async"loading="lazy"alt="create a new model service"src="/assets/images/create-a-service-fe22540049e76cdd058004bc3abaa195.png"width="1536"height="630"class="img_SS3x"></p>
<imgdecoding="async"loading="lazy"alt="create a new model service"src="/assets/images/open-service-details-74e703c418efbc20f7ec65e9a14acb8e.png"width="1536"height="1024"class="img_SS3x"></p>
<p>View the newly created service on the same page.
<imgdecoding="async"loading="lazy"alt="new service on the page"src="/assets/images/newly-created-service-226100da3e06b054b4355ff0c1ee9be1.png"width="1536"height="266"class="img_SS3x"></p>
<p>Optional: View the service container by opening the <strong>Containers</strong> page from the left navigation pane.
<imgdecoding="async"loading="lazy"alt="new service container"src="/assets/images/running-service-in-a-container-59d98e3e8c667f91e4e54c97fea80616.png"width="1982"height="506"class="img_SS3x"></p>
<h2class="anchor anchorTargetStickyNavbar_tleR"id="optional-creating-a-playground">Optional: Creating a playground<ahref="#optional-creating-a-playground"class="hash-link"aria-label="Direct link to Optional: Creating a playground"title="Direct link to Optional: Creating a playground"translate="no"></a></h2>
<p>In the Playgrounds section, click <strong>New Playground</strong>.
<imgdecoding="async"loading="lazy"alt="create a new playground"src="/assets/images/new-playground-f7f1112477f363057fb96e4f6a9b81b8.png"width="1086"height="728"class="img_SS3x"></p>
<p>View the newly created playground on the same page.
<imgdecoding="async"loading="lazy"alt="newly created playground"src="/assets/images/newly-created-playground-4f6f926a0c0ab6e09417233df7902d25.png"width="1268"height="276"class="img_SS3x"></p>
<imgdecoding="async"loading="lazy"alt="editing model parameters"src="/assets/images/editing-model-parameters-4e74800edfc96ddc871e30d5043a820c.png"width="1572"height="792"class="img_SS3x"></p>
<p>Click the <strong>Edit system prompt</strong> icon to add a system prompt and save it.
<imgdecoding="async"loading="lazy"alt="edit system prompt icon"src="/assets/images/edit-system-prompt-icon-4fd921890f57cb4f68f4d69e9e3d92d0.png"width="1304"height="379"class="img_SS3x"></p>
<p>Enter your question in the prompt box and analyze the accuracy of the answer.
<imgdecoding="async"loading="lazy"alt="defining a system prompt"src="/assets/images/defining-a-system-prompt-8671ce78a8b33a2a3a8eb03a750a2c7a.png"width="1572"height="1292"class="img_SS3x"></p>
<h2class="anchor anchorTargetStickyNavbar_tleR"id="running-a-recipe-chatbot-ai-application">Running a recipe: ChatBot AI application<ahref="#running-a-recipe-chatbot-ai-application"class="hash-link"aria-label="Direct link to Running a recipe: ChatBot AI application"title="Direct link to Running a recipe: ChatBot AI application"translate="no"></a></h2>
<imgdecoding="async"loading="lazy"alt="more details of a recipe"src="/assets/images/more-details-of-recipe-87e213378a5d5bd15ac31eabe446f883.png"width="2248"height="1178"class="img_SS3x"></p>
<imgdecoding="async"loading="lazy"alt="starting a recipe"src="/assets/images/starting-a-recipe-56960ceaed7f915626207923de65b4a9.png"width="1724"height="650"class="img_SS3x"></p>
<p>Click <strong>Start ChatBot recipe</strong>. This step might take some time to pull the recipe, copy the model to your Podman machine, start the inference server, load configurations, and create the application.
<imgdecoding="async"loading="lazy"alt="starting a chatbot recipe"src="/assets/images/starting-a-chatbot-recipe-2563c94d79b9668908ce96141fbbe54d.png"width="1268"height="652"class="img_SS3x"></p>
<p>Optional: View the running AI application pod by opening the <strong>Pods</strong> page from the left navigation pane.
<imgdecoding="async"loading="lazy"alt="pod running AI app"src="/assets/images/pod-running-ai-app-a9d36d4bd79935ea6ba153d5d80efebb.png"width="1732"height="424"class="img_SS3x"></p>
<h2class="anchor anchorTargetStickyNavbar_tleR"id="verifying-the-ai-application">Verifying the AI application<ahref="#verifying-the-ai-application"class="hash-link"aria-label="Direct link to Verifying the AI application"title="Direct link to Verifying the AI application"translate="no"></a></h2>
<p>Click the <strong>Open AI App</strong> icon to open the ChatBot application locally in a browser.
<imgdecoding="async"loading="lazy"alt="opening the AI application"src="/assets/images/open-ai-application-bc696ad523aa59a78734fee241d23b64.png"width="1542"height="306"class="img_SS3x"></p>
<p>Enter your question in the chat box and analyze the accuracy of the answer.
<imgdecoding="async"loading="lazy"alt="interacted with chatbot application"src="/assets/images/interacted-with-chatbot-application-e44958a60f1560c05f4b993289e36c58.png"width="1368"height="936"class="img_SS3x"></p>
</ol></div><footerclass="theme-doc-footer docusaurus-mt-lg"><divclass="row margin-top--sm theme-doc-footer-tags-row"><divclass="col"><b>Tags:</b><ulclass="tags_Ow0B padding--none margin-left--sm"><liclass="tag_DFxh"><arel="tag"class="tag_otG2 tagRegular_s0E1"href="/tutorial/tags/podman-desktop">podman-desktop</a></li><liclass="tag_DFxh"><arel="tag"class="tag_otG2 tagRegular_s0E1"href="/tutorial/tags/running-an-ai-application">running-an-ai-application</a></li></ul></div></div></footer></article><navclass="docusaurus-mt-lg pagination-nav"aria-label="Docs pages"><aclass="pagination-nav__link pagination-nav__link--prev"href="/tutorial/managing-your-application-resources"><divclass="pagination-nav__sublabel">Previous</div><divclass="pagination-nav__label">Managing your application resources</div></a><aclass="pagination-nav__link pagination-nav__link--next"href="/tutorial/creating-an-extension"><divclass="pagination-nav__sublabel">Next</div><divclass="pagination-nav__label">Creating an extension</div></a></nav></div></div><divclass="col col--3"><divclass="tableOfContents_XG6w thin-scrollbar theme-doc-toc-desktop"><ulclass="table-of-contents table-of-contents__left-border"><li><ahref="#before-you-begin"class="table-of-contents__link toc-highlight">Before you begin</a></li><li><ahref="#installing-the-extension"class="table-of-contents__link toc-highlight">Installing the extension</a></li><li><ahref="#downloading-a-model"class="table-of-contents__link toc-highlight">Downloading a model</a></li><li><ahref="#creating-a-service"class="table-of-contents__link toc-highlight">Creating a service</a></li><li><ahref="#optional-creating-a-playground"class="table-of-contents__link toc-highlight">Optional: Creating a playground</a></li><li><ahref="#running-a-recipe-chatbot-ai-application"class="table-of-contents__link toc-highlight">Running a recipe: ChatBot AI application</a></li><li><ahref="#verifying-the-ai-application"class="table-of-contents__link toc-highlight">Verifying the AI application</a></li></ul></div></div></div></div></main></div></div></div><footerclass="theme-layout-footer footer"><divclass="container container-fluid"><divclass="row footer__links"><divclass="theme-layout-footer-column col footer__col"><divclass="footer__title">Documentation</div><ulclass="footer__items clean-list"><liclass="footer__item"><aclass="footer__link-item"href="/docs/installation">Installing Podman Desktop</a></li><liclass="footer__item"><aclass="footer__link-item"href="/docs/migrating-from-docker">Migrating from Docker</a></li><liclass="footer__item"><aclass="footer__link-item"href="/docs/kubernetes">Working with Kubernetes</a></li><liclass="footer__item"><aclass="footer__link-item"href="/docs/troubleshooting">Troubleshooting</a></li></ul></div><divclass="theme-layout-footer-column col footer__col"><divclass="footer__title">Links</div><ulclass="footer__items clean-list"><liclass="footer__item"><ahref="https://github.com/podman-desktop/podman-desktop"target="_blank"rel="noopener noreferrer"class="footer__link-item">GitHub<svgwidth="13.5"height="13.5"aria-label="(opens in new tab)"class="iconExternalLink_nPrP"><usehref="#theme-svg-external-link"></use></svg></a></li><liclass="footer__item"><ahref="https://discord.com/invite/x5GzFF6QH4"target="_blank"rel="noopener noreferrer"class="footer__link-item">Chat (bridged): #podman-desktop on Discord<svgwidth="13.5"height="13.5"aria-label="(opens in new tab)"class="iconExternalLink_nPrP"><usehref="#theme-svg-external-link"></use></svg></a></li><liclass="footer__item"><ahref="https://github.com/podman-desktop/podman-desktop#communication"target="_blank"rel="noopener noreferrer"class="footer__link-item">Other ways to Communicate<svgwidth="13.5"height="13.5"aria-label="(opens in new tab)"class="iconExternalLink_nPrP"><usehref="#theme-svg-external-link"></use></svg></a></li><liclass="footer__item"><ahref="https://github.com/orgs/podman-desktop/projects/4/views/3"target="_blank"rel="noopener noreferrer"class="footer__l
