Skip to content
Report a bug

List Scraping

Learn how to scrape lists of items from web pages

List scraping allows you to extract multiple items from a web page, such as:

  • Product listings from e-commerce sites
  • Search results
  • Article listings from blogs
  • Directory entries
  • Social media posts
  • And much more

Easy Scraper automatically detects lists on the page and extracts data from each item.

  1. Navigate to the page

    Go to the webpage containing the list you want to scrape. Make sure the list is fully loaded before opening the extension.

  2. Open Easy Scraper

    Click the Easy Scraper icon in your browser toolbar. It finds the list on the page, outlines it, and shows its items in the table on the right ("24 items, 5 columns · outlined on the page").

    If it finds no list, or the wrong one, click Pick items on the page (or Pick a different list) and click one of the things you want, like a product name or a price. Easy Scraper finds the others like it.

  3. Review the columns

    Each column's menu (the ⋮ in its header) can Rename it, Show on page where its data comes from, or Remove it.

  4. Choose how to get more pages

    Under More pages, choose This page, Scroll, Next page or Load more (see Pagination Options below).

  5. Run it

    With This page, there's nothing to run. Otherwise click the button in the bottom-right corner: Scrape all pages, Load all items or Scroll to the end. The footer shows the progress, and Stop ends the run early.

  6. Export your data

    Click Download spreadsheet for a CSV that opens in Excel, Google Sheets and Numbers. Its arrow offers the other formats (an Excel workbook, a new Google Sheet, or JSON for developers), and the button then downloads the format you chose last. The copy button above the table copies the rows to paste into a spreadsheet.

Easy Scraper has four ways to get the rest of a list, under More pages.

Scrapes the items the page shows now. Use it when the whole list is already on the page.

Scrolls down the page until no more items load. Use it for infinite scroll, like social media feeds.

Clicks the page's "Next" link or button, then scrapes the page it loads, until there's no next page.

  1. Click Pick and click the site's Next button on the page.
  2. Easy Scraper checks the button: "Found on the page" means it's ready. Show on page outlines it.
  3. Click Scrape all pages.

If the run stops before the last page, the notice above the table says why, with the fix: pick the button again, or wait longer between pages.

Clicks a "Load more" or "Show more" button that adds items to the same page, until it's gone. Pick it the same way as the Next button, then click Load all items.

For Scroll, Next page and Load more, Wait and stop settings sets:

  • Wait time: the least and most seconds to wait for new items after each page or load
  • Auto-scroll and Scroll delay: scrolling each page, for sites that load items as you scroll
  • Max items: stop once this many items are scraped

Once you change one, its value shows under the link.

Easy Scraper can extract three types of data from each field:

Text Content

Extracts the visible text content of an element.

Examples:

  • Product names
  • Prices
  • Descriptions
  • Headings

How it works: The extension reads the text content from the selected HTML element.

Link URLs (href)

Extracts the URL from a link element.

Examples:

  • Product page URLs
  • Article links
  • External references

How it works: Extracts the href attribute from <a> (link) elements. Automatically converts relative URLs to absolute URLs.

Image URLs (src)

Extracts image URLs from image elements.

Examples:

  • Product images
  • Thumbnails
  • Profile pictures
  • Icons

How it works: Extracts the src attribute from <img> elements or background images from elements with CSS background-image properties.

Let the page fully load

Before opening Easy Scraper, wait for the page to fully load. If content is still loading, the extension may not detect all items.

Start with a small test

When scraping large lists, start by setting a low "Max items" limit (e.g., 10-20 items) to test your configuration before running a full scrape.

Use appropriate wait times
  • For fast websites: Use shorter wait times (1-2 seconds) - For slow websites: Increase wait times (3-5 seconds) - Add a scroll delay if items aren't loading properly
Watch for dynamic content

Some websites load content dynamically. If you're not getting all the data, try: - Increasing wait times - Adding a scroll delay - Manually scrolling before starting the scrape

Check your data quality

After scraping, review the data table to ensure:

  • All fields are populated correctly
  • URLs are complete (not broken)
  • No missing or duplicate items
No list detected

Problem: Easy Scraper says "No list detected" when you open it.

Solutions:

  • Make sure the page has fully loaded
  • Check that the page actually contains a list of repeating items
  • Try refreshing the page and waiting a few seconds before opening the extension
  • Some pages use complex layouts that may not be automatically detected
Missing items

Problem: Not all items are being scraped.

Solutions:

  • If using scroll mode, increase the max wait time
  • Add a scroll delay to give the page time to load
  • Try using "Click Next Page" instead of scroll if pagination buttons exist
  • Check if the website has rate limiting or anti-scraping measures
Duplicate items

Problem: The same items appear multiple times in the results.

Solutions:

  • Check if the page has multiple identical lists
  • Try removing and re-adding fields
  • Refresh the page and start over
Empty or incorrect field data

Problem: Some fields are empty or contain wrong data.

Solutions:

  • Use the column's Show on page to check where its data comes from
  • Remove the field and add it again by selecting the correct element
  • Make sure you're clicking the right element when adding fields
  • Some data may be loaded dynamically - try waiting longer before scraping
Scraping stops before all pages

Problem: Scraping stops before reaching the last page.

Solutions:

  • Increase the max wait time for page loads
  • Check if the "Next Page" button selector is still valid on later pages
  • Some websites may block scraping after a certain number of requests
  • Try reducing the scraping speed by increasing wait times

After scraping a list, you can:

  1. Export the data for analysis or use in other applications
  2. Scrape details from each URL using Page Details Scraping
  3. Save your configuration by creating a reusable scraper