Build a storefront chatbot with OpenAI 

Topics covered: Shopify connections, AI + vector embeddings, HTTP routes
Time to build: ~30 minutes

Large Language Model (LLM) APIs allow developers to build apps that can understand and generate text. We can use OpenAI's APIs to build a chatbot that can understand a shopper's question and respond with product recommendations.

In this tutorial, you will learn how to:

• set up a Shopify and OpenAI connection in Gadget
• add custom data models and fields
• use OpenAI's text embedding API to generate vector embeddings for product descriptions
• use OpenAI's chat API to generate and stream a response to a shopper's question
• use a Shopify theme app extension to embed the chatbot into a storefront

Prerequisites 

To get the most out of this tutorial, you will need:

• A Shopify Partners account
• A development store
• The Shopify CLI installed on your local machine
• Gadget's CLI: ggt, installed locally

You can fork this Gadget project and try it out yourself.

You will still need to set up the Shopify Connection and theme app extension after forking. Read on to learn how to connect Gadget to a Shopify store!

Step 1: Create a Gadget app and connect to Shopify 

Your first step will be to set up a Gadget project and connect to a Shopify store via the Shopify connection. Create a new Gadget application at gadget.new and select the Shopify app template.

Now we will set up a custom Shopify application in the Partners dashboard.

1. Go to the Shopify Partner dashboard
2. Click on the link to the Apps page

3. Click the Create App button

4. Click the Create app manually button and enter a name for your Shopify app

5. Click on Settings in the side nav bar
6. Click on Plugins in the modal that opens
7. Select Shopify from the list of plugins and connections

8. Copy the Client ID and Client secret from your newly created Shopify app and paste the values into the Gadget Connections page

9. Click Connect on the Gadget Connections page to move to scope and model selection

Now we get to select what Shopify scopes we give our application access to, while also picking what Shopify data models we want to import into our Gadget app.

10. Select the scopes and models listed below and click Confirm to connect to the custom Shopify app

• Enable the Products Read API scope, and select the underlying Product and Product media models that we want to import into Gadget

Now we want to connect our Gadget app to our custom app in the Partner dashboard.

11. In your Shopify app in the Partner dashboard, click on Configuration in the side nav bar so you can edit the App URL and Allowed redirection URL(s) fields
12. Copy the App URL and Allowed redirection URL from the Gadget Connections page and paste them into your custom Shopify App

Now we need to install our Shopify app on a store.

13. Go back to the Shopify Partner dashboard
14. Click on Apps to go to the Apps page again
15. Click on your custom app
16. Click on Select store

17. Click on the store we want to use to develop our app
18. You may be prompted about Store transfer being disabled. This is okay, click Install anyway
19. Click Install app to install your Gadget app on your Shopify store

You will be redirected to an embedded admin app that has been generated for you. The code for this app template can be found in web/routes/index.jsx.

Now you can install your app on a store from the Partners dashboard. Do not sync data yet! You're going to add some code to generate vector embeddings for your products before the sync is run.

Step 2: Set up OpenAI connection 

Now that you are connected to Shopify, you can also set up the OpenAI connection that will be used to fetch embeddings for product descriptions. Gadget provides OpenAI credits for testing while building your app, so you don't need a personal OpenAI API key to get started.

1. Click on Settings in the nav bar
2. Click on Plugins
3. Click on the OpenAI connection
4. Select the Use Gadget's API keys option in the modal that appears OR enter your own OpenAI API key
5. Click Add connection at the bottom of the page

Your OpenAI connection is now ready to be used!

Step 3: Add data models for chat responses 

Now we need a new data model to capture the chat responses from OpenAI, and the products recommended to shoppers. We need to use a has many through relationship to relate the chat response to the recommended products.

1. Click + next to the api/models folder to add a new model
2. Name the model chatLog
3. On api/models/chatLog/schema, click + next to FIELDS to add a new field
4. Name the field response and leave it as a string field

This string field will record the response coming back from OpenAI. We also want to keep track of the products that were recommended, so we need to add a has many through relationship to the shopifyProduct model.

5. Add another field to chatLog called recommendedProducts
6. Set the field type to a has many through relationship
7. Set the sibling to shopifyProduct and the joinModel to recommendedProduct, this will create a new recommendedProduct model
8. Name the field in recommendedProduct that relates to the chatLog model, chatLog
9. Name the field in recommendedProduct that relates to the shopifyProduct model, product
10. Name the field in the shopifyProduct model that relates to the recommendedProduct model, chatRecommendations

Step 4: Add vector field to shopifyProduct model 

Before you add code to create the embeddings from product descriptions, you need a place to store the generated embeddings. You can add a vector field to the shopifyProduct model to store the embeddings.

The vector field types store a vector, or array, of floats. It is useful for storing embeddings and will allow you to perform vector operations like cosine similarity, which helps you find the most similar products to a given chat message.

To add a vector field to the shopifyProduct model:

1. Go to api/models/shopifyProduct/schema
2. Click on + in the FIELDS section to add a new field
3. Name the field descriptionEmbedding
4. Set the field type to vector

Now you are set up to store embeddings for products! The next step is adding code to generate these embeddings.

Step 5: Write code effect to create vector embedding 

Now you can add some code to create vector embeddings for all products in your store. You will want to run this code when Shopify fires a products/create or products/update webhook. To do this, you will create a code effect that runs when a Shopify Product is created or updated.

1. Go to the api/models/shopifyProduct folder and click on + to create a new file
2. Name the file createEmbedding.js
3. Paste the following code into api/models/shopifyProduct/createEmbedding.js:

api/models/shopifyProduct/createEmbedding.js
JavaScript
Copy
1export const createProductEmbedding = async ({ record, api, logger, connections }) => {
2  // only run if the product does not have an embedding, or if the title or body have changed
3  if (!record.descriptionEmbedding || record.changed("title") || record.changed("body")) {
4    try {
5      // get an embedding for the product title + description using the OpenAI connection
6      const response = await connections.openai.embeddings.create({
7        input: `${record.title}: ${record.body}`,
8        model: "text-embedding-ada-002",
9      });
10      const embedding = response.data[0].embedding;
11
12      // write to the Gadget Logs
13      logger.info({ id: record.id }, "got product embedding");
14
15      // use the internal API to store vector embedding in Gadget database, on shopifyProduct model
16      await api.internal.shopifyProduct.update(record.id, { shopifyProduct: { descriptionEmbedding: embedding } });
17    } catch (error) {
18      logger.error({ error }, "error creating embedding");
19    }
20  }
21};

In this snippet:

• the OpenAI connection is accessed through connections.openai and the embeddings.create() API is called
• the internal API is used in the onSuccess function to update the shopifyProduct model and set the descriptionEmbedding field

The internal API needs to be used because the shopifyProduct model does not have a Gadget API trigger on this action by default. You can read more about the internal API in the Gadget docs.

Now call this function from your api/models/shopifyProduct/actions/create.js and api/models/shopifyProduct/actions/update.js actions:

4. Open api/models/shopifyProduct/actions/create.js and paste the following code:

api/models/shopifyProduct/actions/create.js
JavaScript
Copy
1import { applyParams, preventCrossShopDataAccess, save, ActionOptions, CreateShopifyProductActionContext } from "gadget-server";
2import { createProductEmbedding } from "../createEmbedding";
3
4/**
5 * @param { CreateShopifyProductActionContext } context
6 */
7export async function run({ params, record, logger, api, connections }) {
8  applyParams(params, record);
9  await preventCrossShopDataAccess(params, record);
10  await save(record);
11}
12
13/**
14 * @param { CreateShopifyProductActionContext } context
15 */
16export async function onSuccess({ params, record, logger, api, connections }) {
17  await createProductEmbedding({ record, api, logger, connections });
18}
19
20/** @type { ActionOptions } */
21export const options = {
22  actionType: "create",
23};

5. Open api/models/shopifyProduct/actions/update.js and paste the following code:

api/models/shopifyProduct/actions/update.js
JavaScript
Copy
1import { applyParams, preventCrossShopDataAccess, save, ActionOptions, UpdateShopifyProductActionContext } from "gadget-server";
2import { createProductEmbedding } from "../createEmbedding";
3
4/**
5 * @param { UpdateShopifyProductActionContext } context
6 */
7export async function run({ params, record, logger, api, connections }) {
8  applyParams(params, record);
9  await preventCrossShopDataAccess(params, record);
10  await save(record);
11}
12
13/**
14 * @param { UpdateShopifyProductActionContext } context
15 */
16export async function onSuccess({ params, record, logger, api, connections }) {
17  await createProductEmbedding({ record, api, logger, connections });
18}
19
20/** @type { ActionOptions } */
21export const options = {
22  actionType: "update",
23};

Now vector embeddings will be generated when a new product is created, or an existing product is updated.

Generate embeddings for existing products 

Now that the code is in place to generate vector embeddings for products, you can sync existing Shopify products into your Gadget app's database. To do this:

1. Click on Settings in the nav bar
2. Click on the Plugins page
3. Select the Shopify connection
4. Click on Installs for the connected Development app

5. Click on the Sync button for the store you want to sync products from

Product and product media data will be synced from Shopify to your Gadget app's database. The code effect you added will run for each product and generate a vector embedding for the product. You can see these vector embeddings by going to the Data page for the shopifyProduct model. The vector embeddings will be stored in the descriptionEmbedding field.

Step 6: Add /chat HTTP route 

We will use an HTTP route to handle incoming chat messages from the storefront. The route will take a message from the shopper, use cosine similarity to determine what products to recommend, and stream a response from OpenAI back to the client.

1. Hover over the api folder and right-click on it to create a folder named routes
2. Click + next to api/routes create a new file
3. Name the file POST-chat.js

Your app now has a new HTTP route that will be triggered when a POST request is made to /chat. You can add code to this file to handle incoming chat messages.

3. Paste the following code in api/routes/POST-chat.js:

api/routes/POST-chat.js
JavaScript
Copy
1import { RouteContext } from "gadget-server";
2import { openAIResponseStream } from "gadget-server/ai";
3
4/**
5 * Route handler for POST chat
6 *
7 * @param { RouteContext } route context - see: https://docs.gadget.dev/guides/http-routes/route-configuration#route-context
8 *
9 */
10export default async function route({ request, reply, api, logger, connections }) {
11  // get input from shopper
12  const { message } = request.body;
13
14  // embed the incoming message from the user
15  const embeddingResponse = await connections.openai.embeddings.create({ input: message, model: "text-embedding-ada-002" });
16
17  // find similar product descriptions
18  const products = await api.shopifyProduct.findMany({
19    sort: {
20      descriptionEmbedding: {
21        cosineSimilarityTo: embeddingResponse.data[0].embedding,
22      },
23    },
24    first: 2,
25    filter: {
26      status: {
27        equals: "active",
28      },
29    },
30    select: {
31      id: true,
32      title: true,
33      body: true,
34      handle: true,
35      shop: {
36        domain: true,
37      },
38      featuredMedia: {
39        file: {
40          image: true,
41        },
42      },
43    },
44  });
45
46  // capture products in Gadget's Logs
47  logger.info({ products, message: request.body.message }, "found products most similar to user input");
48
49  const prompt = `You are a helpful shopping assistant trying to match customers with the right product. You will be given a question from a customer and some JSON objects with the id, title, handle, and description (body) of products available for sale that roughly match the customer's question, as well as the store domain. Respond in HTML markup, with an anchor tag at the end with images that link to the product pages and <br /> tags between your text response and product recommendations. The anchor should be of the format: <a href={"https://" + {domain} + "/products/" + {handle}} target="_blank">{title}<img style={border: "1px black solid"} width="200px" src={product.featuredMedia.file.image.url} /></a> but with the domain, handle, and title replaced with passed-in variables. If you have recommended products, end your response with "Click on a product to learn more!" If you are unsure or if the question seems unrelated to shopping, say "Sorry, I don't know how to help with that", and include some suggestions for better questions to ask. Here are the json products you can use to generate a response: ${JSON.stringify(
50    products
51  )}`;
52
53  // send prompt and similar products to OpenAI to generate a response
54  // using GPT-4 Turbo model
55  const chatResponse = await connections.openai.chat.completions.create({
56    model: "gpt-4-1106-preview",
57    messages: [
58      {
59        role: "system",
60        content: prompt,
61      },
62      { role: "user", content: message },
63    ],
64    stream: true,
65  });
66
67  // function fired after the steam is finished
68  const onComplete = (content) => {
69    // store the response from OpenAI, and the products that were recommended
70    const recommendedProducts = products.map((product) => ({
71      create: {
72        product: {
73          _link: product.id,
74        },
75      },
76    }));
77    void api.chatLog.create({
78      response: content,
79      recommendedProducts,
80    });
81  };
82
83  await reply.send(openAIResponseStream(chatResponse, { onComplete }));
84}

This code will:

• create a vector embedding from the shopper's message using the OpenAI connection using connections.openai.embeddings.create()
• use cosine similarity to find the 2 most similar products to the shopper's message using the Gadget API:

cosine similarity in api/routes/POST-chat.js
JavaScript
Copy
1const products = await api.shopifyProduct.findMany({
2  sort: {
3    descriptionEmbedding: {
4      // cosine similarity to the embedding of the shopper's message
5      cosineSimilarityTo: embeddingResponse.data[0].embedding,
6    },
7  },
8  first: 2,
9  select: {...}
10});

• use the OpenAI chat API to generate a response using the gpt-4-1106-preview model

stream chat completion in api/routes/POST-chat.js
JavaScript
Copy
1const chatResponse = await connections.openai.chat.completions.create({
2  model: "gpt-4-1106-preview",
3  messages: [
4    {
5      role: "system",
6      content: prompt,
7    },
8    { role: "user", content: message },
9  ],
10  stream: true,
11});

• stream the response back to the client and save the records to the database using reply.send(openAIResponseStream(chatResponse, { onComplete }))
  • onComplete is a callback function that is called after the stream is finished

Set up CORS handling 

Before we can call our /chat route from a theme extension, we need to enable CORS handling. To do this we will use the @fastify/cors plugin.

1. Open the Gadget command palette using P or Ctrl P
2. Enter > in the palette to change to command-mode
3. Run the following command to install the @fastify/cors plugin:

Run in the Gadget command palette
Copy
yarn add @fastify/cors

Once the plugin is installed, you can add it to your app's configuration:

4. Add a new file in the api/routes folder called +scope.js
5. Paste the following code into api/routes/+scope.js:

api/routes/+scope.js
JavaScript
Copy
1import { Server } from "gadget-server";
2import cors from "@fastify/cors";
3
4/**
5 * Route plugin for *
6 *
7 * @param { Server } server - server instance to customize, with customizations scoped to descendant paths
8 *
9 * @see {@link https://www.fastify.dev/docs/latest/Reference/Server}
10 */
11export default async function (server) {
12  await server.register(cors, {
13    origin: true, // allow requests from any domain
14  });
15}

This will allow requests from ANY domain! For your actual, production app, you probably want to set the origin option to a specific domain - the domain of your store. Read more about CORS in Gadget in our documentation.

Your route is now complete! Now all that is needed is a frontend app that allows shoppers to ask a question and displays the response along with product recommendations.

Step 7: Use Shopify theme app extension to embed chatbot 

We make use of an app embed block for our storefront chatbot theme extension. This means that our extension works with any Shopify theme, both vintage and Online Store 2.0 themes.

1. Use git to clone the Shopify CLI app

2. cd to the cloned directory
3. Update the direct script tag in extensions/theme-extension/blocks/chatbot.liquid to include your app's script tag URL

<script src="https://example-app--development.gadget.appapi/client/web.min.js" defer="defer"></script>

4. Run shopify app dev to start your app and connect to your existing Partners app and development store

You should now be set up and ready to add the chatbot theme app extension to the storefront theme.

5. Navigate to your storefront theme editor and click on App embeds in the left sidebar
6. Enable your app - the chatbot should appear in your storefront preview
7. Click Save in the top right corner of the page

Your chatbot should now be available in your storefront - try it out!

Next steps 

You now have a chatbot that can respond to shopper questions with product recommendations! You can continue to build on this app by:

• customizing the embedded React frontend, found in the frontend folder, to give merchants installation instructions
• editing the prompt in routes/POST-chat.js to customize the chatbot's response
• change the look, feel, and merchant customization options for the chatbot by editing the theme extension files
• maintain full chat context by passing messages back and forth between the client and server
  • also maintain chat context between browser sessions and/or windows by storing the full chat context in the database

Have questions about the tutorial? Join Gadget's developer Discord to ask Gadget employees and join the Gadget developer community!

Want to learn more about building AI apps in Gadget? Check out our building AI apps documentation.