How to scrape Amazon product data from Black Box into a Google Sheet

Black Box, a tool from Helium10, is a product research tool designed for Amazon sellers. It helps users find profitable products by filtering through millions of listings based on criteria like demand, competition, and sales volume.

Atuomate data entry into the Black box search field.

In this guide, you'll learn how to use a bot to load the Black Box homepage, automate the input of search criteria, and click "Search." The bot will then scrape the results and extract them into a Google Sheet.

For this guide, we'll focus on Simple Search Mode, but the same principles apply to automating an Advanced Search. Check out our other Helium 10 guides if you're interested in automating Cerebro or Helium10.

# Getting Started

To begin, create a Google Sheet and add two tabs for search criteria and another to store the extracted data.

  1. Create a new Google Sheet: If you're logged into Google, type sheet.new in your browser to quickly create a new sheet.
  2. Set up tab one: Enter your criteria into the first tab.
  3. Set up tab two: Name the second tab "Products" and leave it blank.

# How to automate extracting product data from Black Box

To start building your bot, open Axiom.ai and click "New automation" to use the no-code bot builder. Then, click "Add first step" and follow the guide.

Download the template we created for this scraper. Click to learn how to upload it.

  1. Add a 'Read data from a Google Sheet' step and configure.
    1. Spreadsheet: Search for and add the Google Sheet you created.
    2. Sheet name: Choose the tab containing the search criteria.
  2. Add a 'Loop through data' step.
    1. Loop through data: Click 'Insert Data' and select 'google-sheet-data'. The loop step will now iterate through the search criteria in the Google Sheet.
  3. Add a 'Go to page' sub-step to load the Black Box landing page with the search field.
    1. Enter URL: The URL will look something like this: https://members.helium10.com/black-box/products?accountId=xxxxxxx
  4. Add a ‘Select list’ sub-step.
    1. Select: Click ‘Select’, then select the "Market place" dropdown.
    2. Text: In the text field, click "Insert Data" and choose the Google Sheet data. In the data preview, select column "A" with the marketplace value.
      Axiom.ai select data to insert into select list in Black Box
  5. Add a ‘Select list’ sub-step.
    1. Select: Click ‘Select’, then select the "Category" dropdown.
    2. Text: In the text field, click "Insert Data" and choose the Google Sheet data. In the data preview, select column "A" with the category value.
  6. Add a ‘Select list’ sub-step.
    1. Select: Click ‘Select’, then select the "Improvement range" dropdown.
    2. Text: In the text field, click "Insert Data" and choose the Google Sheet data. In the data preview, select column "A" with the Improvement range value.
  7. Add a ‘Select list’ sub-step.
    1. Select: Click ‘Select’, then select the "Price range" dropdown.
    2. Text: In the text field, click "Insert Data" and choose the Google Sheet data. In the data preview, select column "A" with the price range value.
  8. Add a 'Click element' sub-step to click search.
    1. Select: Click 'Select', then click on "Custom" and tick "Use element text." Finally, click "Complete."
  9. Add a ‘Get data from bot's current page’ sub-step. With search results displayed on the Black Box page, select the data you wish to extract.
    1. Select: Click ‘Select’ to open the multi-selector tool.
    2. In column "A", click on the arrow, then click "Select link." On the Black Box page, click the image in the "Product" column, then repeat in the row below.
      Axiom.ai selecting data to scrape from Black Box
    3. Press "Shift + N" to add a new column. On the page, select the Product title in one row, then repeat in the next.
    4. Add another column. On the page, select the BSR, selecting the number in one row, then repeat in the next.
    5. To extract the price, press "Shift + N" to add a new column. Then, in the new column, click the arrow and select "Custom Selector", insert [data-testid="table-cell-price"], then press Complete.
      Axiom.ai using a custom selector
    6. Add one more column. On the page, select the Brand in one row, then repeat in the next.
    7. Select the 'Next' button for pagination using the right arrow key.
    8. Set a maximum number of results you wish to scrape. I chose 100 when making this bot.
  10. Add a 'Write data to a Google Sheet' step.
    1. Spreadsheet: Select your Google Sheet.
    2. Sheet Name: Choose the tab where you want to write the Amazon product data.
    3. Data: Click 'Insert Data' and choose "scraped-data-"
    4. Write Options: Select 'Add to Existing Data' to append new data without deleting existing data.
  11. Add a 'Delete rows from a Google Sheet' step to remove the processed criteria numbers.
    1. Spreadsheet: Select your Google Sheet.
    2. Sheet Name: Choose the tab containing the search criteria.
    3. First Row to Delete: Leave this set to 1.
    4. Last Row to Delete: Set to 10.

The Black Box automation, when completed, should resemble the diagram below.

Axiom.ai design pattern for building a bot to automate data extraction from helium10 tool black box

# Testing your Black Box automation

Once you have saved your Helium 10 Black Box automation, click "Run" within the Axiom.ai extension to start extracting Amazon product data.

Axiom.ai data scraped into a Google Sheet

# Issues you may encounter:

  1. Elements not found: If elements are not being clicked, you may need to reselect them. Changing marketplaces can affect selectors.
  2. Keyword data not loading in time: Cerebro can sometimes be slow to load data. You may need to adjust the wait time in Step 8.

# Try out the template

While creating this guide and testing Axiom.ai on Helium 10, we also built a template. If you choose to use the template, you will need to do the following:

  1. Step 1: Add your own Google Sheet.
  2. Step 2.1: Add the URL to the Black Box page while logged in.
  3. Step 2.7: Select the data you wish to scrape.
  4. Steps 2.8 and 2.9: Add your Google Sheet.

Please note that this template is a starting point, and you may need to customize it.

Click to download the Black Box template.

# Wrapping up

Extracting product data from Black Box is straightforward. You can simply point and select the data you want to extract. Some fields, like Price, may require a custom selector, but it’s easy to set up.

You can fully customize this automation by adding the search criteria you want and selecting the data you wish to scrape.

The same methods also apply to Advanced Search Mode. If you need help automating Helium 10, reach out to support@axiom.ai.

Testing was completed on January 29, 2025. Features in Helium 10 or Axiom.ai may change over time, and updates may be needed.

Prev: No previous page
Next: No next page