List Scraping
Learn how to scrape lists of items from web pages
Overview
Section titled “Overview”List scraping allows you to extract multiple items from a web page, such as:
- Product listings from e-commerce sites
- Search results
- Article listings from blogs
- Directory entries
- Social media posts
- And much more
Easy Scraper automatically detects lists on the page and extracts data from each item.
How to Scrape a List
Section titled “How to Scrape a List”-
Navigate to the page
Go to the webpage containing the list you want to scrape. Make sure the list is fully loaded before opening the extension.
-
Open Easy Scraper
Click the Easy Scraper icon in your browser toolbar. It finds the list on the page, outlines it, and shows its items in the table on the right ("24 items, 5 columns · outlined on the page").
If it finds no list, or the wrong one, click Pick items on the page (or Pick a different list) and click one of the things you want, like a product name or a price. Easy Scraper finds the others like it.
-
Review the columns
Each column's menu (the ⋮ in its header) can Rename it, Show on page where its data comes from, or Remove it.
-
Choose how to get more pages
Under More pages, choose This page, Scroll, Next page or Load more (see Pagination Options below).
-
Run it
With This page, there's nothing to run. Otherwise click the button in the bottom-right corner: Scrape all pages, Load all items or Scroll to the end. The footer shows the progress, and Stop ends the run early.
-
Export your data
Click Download spreadsheet for a CSV that opens in Excel, Google Sheets and Numbers. Its arrow offers the other formats (an Excel workbook, a new Google Sheet, or JSON for developers), and the button then downloads the format you chose last. The copy button above the table copies the rows to paste into a spreadsheet.
Pagination Options
Section titled “Pagination Options”Easy Scraper has four ways to get the rest of a list, under More pages.
This page
Section titled “This page”Scrapes the items the page shows now. Use it when the whole list is already on the page.
Scroll
Section titled “Scroll”Scrolls down the page until no more items load. Use it for infinite scroll, like social media feeds.
Next page
Section titled “Next page”Clicks the page's "Next" link or button, then scrapes the page it loads, until there's no next page.
- Click Pick and click the site's Next button on the page.
- Easy Scraper checks the button: "Found on the page" means it's ready. Show on page outlines it.
- Click Scrape all pages.
If the run stops before the last page, the notice above the table says why, with the fix: pick the button again, or wait longer between pages.
Load more
Section titled “Load more”Clicks a "Load more" or "Show more" button that adds items to the same page, until it's gone. Pick it the same way as the Next button, then click Load all items.
Wait and stop settings
Section titled “Wait and stop settings”For Scroll, Next page and Load more, Wait and stop settings sets:
- Wait time: the least and most seconds to wait for new items after each page or load
- Auto-scroll and Scroll delay: scrolling each page, for sites that load items as you scroll
- Max items: stop once this many items are scraped
Once you change one, its value shows under the link.
Field Types
Section titled “Field Types”Easy Scraper can extract three types of data from each field:
Text Content
Extracts the visible text content of an element.
Examples:
- Product names
- Prices
- Descriptions
- Headings
How it works: The extension reads the text content from the selected HTML element.
Link URLs (href)
Extracts the URL from a link element.
Examples:
- Product page URLs
- Article links
- External references
How it works: Extracts the href attribute from <a> (link) elements. Automatically converts relative URLs to absolute URLs.
Image URLs (src)
Extracts image URLs from image elements.
Examples:
- Product images
- Thumbnails
- Profile pictures
- Icons
How it works: Extracts the src attribute from <img> elements or background images from elements with CSS background-image properties.
Tips for Successful List Scraping
Section titled “Tips for Successful List Scraping”Let the page fully load
Before opening Easy Scraper, wait for the page to fully load. If content is still loading, the extension may not detect all items.
Start with a small test
When scraping large lists, start by setting a low "Max items" limit (e.g., 10-20 items) to test your configuration before running a full scrape.
Use appropriate wait times
- For fast websites: Use shorter wait times (1-2 seconds) - For slow websites: Increase wait times (3-5 seconds) - Add a scroll delay if items aren't loading properly
Watch for dynamic content
Some websites load content dynamically. If you're not getting all the data, try: - Increasing wait times - Adding a scroll delay - Manually scrolling before starting the scrape
Check your data quality
After scraping, review the data table to ensure:
- All fields are populated correctly
- URLs are complete (not broken)
- No missing or duplicate items
Common Issues and Solutions
Section titled “Common Issues and Solutions”No list detected
Problem: Easy Scraper says "No list detected" when you open it.
Solutions:
- Make sure the page has fully loaded
- Check that the page actually contains a list of repeating items
- Try refreshing the page and waiting a few seconds before opening the extension
- Some pages use complex layouts that may not be automatically detected
Missing items
Problem: Not all items are being scraped.
Solutions:
- If using scroll mode, increase the max wait time
- Add a scroll delay to give the page time to load
- Try using "Click Next Page" instead of scroll if pagination buttons exist
- Check if the website has rate limiting or anti-scraping measures
Duplicate items
Problem: The same items appear multiple times in the results.
Solutions:
- Check if the page has multiple identical lists
- Try removing and re-adding fields
- Refresh the page and start over
Empty or incorrect field data
Problem: Some fields are empty or contain wrong data.
Solutions:
- Use the column's Show on page to check where its data comes from
- Remove the field and add it again by selecting the correct element
- Make sure you're clicking the right element when adding fields
- Some data may be loaded dynamically - try waiting longer before scraping
Scraping stops before all pages
Problem: Scraping stops before reaching the last page.
Solutions:
- Increase the max wait time for page loads
- Check if the "Next Page" button selector is still valid on later pages
- Some websites may block scraping after a certain number of requests
- Try reducing the scraping speed by increasing wait times
Next Steps
Section titled “Next Steps”After scraping a list, you can:
- Export the data for analysis or use in other applications
- Scrape details from each URL using Page Details Scraping
- Save your configuration by creating a reusable scraper