'%3e%3crect%20x='131'%20y='166'%20width='250'%20height='250'%20fill='white'/%3e%3cpath%20fill-rule='evenodd'%20clip-rule='evenodd'%20d='M115.2%2051.2C93.9923%2051.2%2076.8%2068.3923%2076.8%2089.6V422.4C76.8%20443.608%2093.9923%20460.8%20115.2%20460.8H396.8C418.008%20460.8%20435.2%20443.608%20435.2%20422.4V195.106C435.2%20184.921%20431.154%20175.154%20423.953%20167.953L318.447%2062.4471C311.246%2055.2457%20301.479%2051.2%20291.294%2051.2H115.2ZM236.8%20224C236.8%20213.396%20245.396%20204.8%20256%20204.8C266.604%20204.8%20275.2%20213.396%20275.2%20224V289.166L299.329%20262.356C306.422%20254.474%20318.562%20253.835%20326.444%20260.929C334.326%20268.022%20334.965%20280.162%20327.871%20288.044L270.271%20352.044C266.63%20356.09%20261.443%20358.4%20256%20358.4C250.557%20358.4%20245.37%20356.09%20241.729%20352.044L184.129%20288.044C177.035%20280.162%20177.674%20268.022%20185.556%20260.929C193.438%20253.835%20205.578%20254.474%20212.671%20262.356L236.8%20289.166V224Z'%20fill='%23059669'/%3e%3c/g%3e%3cdefs%3e%3cclipPath%20id='clip0_3_8'%3e%3crect%20width='512'%20height='512'%20fill='white'/%3e%3c/clipPath%3e%3c/defs%3e%3c/svg%3e){kind=small}
List Scraping
Learn how to scrape lists of items from web pages
Overview
List scraping allows you to extract multiple items from a web page, such as:
- Product listings from e-commerce sites
- Search results
- Article listings from blogs
- Directory entries
- Social media posts
- And much more
Easy Scraper automatically detects lists on the page and extracts data from each item.
How to Scrape a List
Navigate to the page
Go to the webpage containing the list you want to scrape. Make sure the list is fully loaded before opening the extension.
Open Easy Scraper
Click the Easy Scraper icon in your browser toolbar. The extension will automatically detect lists on the page.
Review detected items
Easy Scraper will show you a preview of the detected items and fields. Each field represents a piece of data extracted from each item (e.g., title, price, link).
Configure fields
You can customize fields:
- Rename fields: Click on the field name to edit it
- Highlight fields: Click the search icon to highlight where the field data comes from
- Remove fields: Click the delete icon next to any field you don't need
Configure pagination
If your list spans multiple pages or requires scrolling, configure the load more options (see Pagination Options below).
Start scraping
Click "Start Scraping". Easy Scraper will extract all the data and display it in a table.
Export your data
Once scraping is complete, export your data:
- Download CSV: Import into Excel or Google Sheets
- Download JSON: Use in applications or scripts
- Copy: Copy as tab-separated values to paste into spreadsheets
Pagination Options
Easy Scraper supports four methods for handling pagination and loading more items:
Option 1: None (No Additional Loading)
Use this when all items are already visible on the page. Easy Scraper will extract only the items currently displayed.
Best for:
- Single-page lists
- All items already loaded
Option 2: Scroll down to load more items
Automatically scrolls to the bottom of the page to trigger loading of additional items. This works with infinite scroll implementations.
Best for:
- Infinite scroll pages (e.g., social media feeds)
- Pages that load more items as you scroll
Configuration:
- Min wait time: Minimum seconds to wait for new items to load (default: 1s)
- Max wait time: Maximum seconds to wait for new items to load (default: 3s)
- Scroll delay: Delay in milliseconds between scroll actions (helps with slow-loading pages)
- Max items: Limit the total number of items to scrape
If items aren't loading, try increasing the max wait time or adding a scroll delay.
Option 3: Click link to navigate to next page
Clicks a "Next Page" button to navigate to a different page URL.
Best for:
- Traditional pagination with numbered pages that change the URL
- "Next" links that navigate to a new page
- Pagination that dynamically replaces the current page content without URL changes
Configuration:
- Next Page Button: Click "Select" to choose the button/link to click
- Min wait time: Minimum seconds to wait for new items to load
- Max wait time: Maximum seconds to wait for new items to load
- Auto-scroll: Automatically scroll the page during scraping
- Scroll delay: Delay in milliseconds between scroll actions
- Max items: Limit the total number of items to scrape
Select the button
Click "Select" next to "Next Page Button" and then click the pagination button on the page.
Verify selection
Click "Verify" to ensure you've selected the correct button (it will be highlighted).
Configure wait times
Set appropriate wait times based on how long the page takes to load.
Make sure the button you select actually navigates to a new page URL. If it loads more items on the same page, use Option 4 instead.
Option 4: Click button to load more items on same page
Clicks a "Load More" or "Show More" button that adds additional items to the current page without navigating away.
Best for:
- "Load More" buttons that append items to the page
- "Show More" links that expand the list in-place
Configuration:
- Load More Button: Click "Select" to choose the button to click
- Min wait time: Minimum seconds to wait for new items to load
- Max wait time: Maximum seconds to wait for new items to load
- Auto-scroll: Automatically scroll the page during scraping
- Scroll delay: Delay in milliseconds between scroll actions
- Max items: Limit the total number of items to scrape
Select the button
Click "Select" next to "Load More Button" and then click the button that loads more items on the page.
Verify selection
Click "Verify" to ensure you've selected the correct button (it will be highlighted).
Configure wait times
Set appropriate wait times based on how long new items take to load after clicking.
This option is ideal when clicking the button adds more items to the current page rather than navigating to a new URL. If the button navigates to a different page, use Option 3 instead.
Field Types
Easy Scraper can extract three types of data from each field:
Extracts the visible text content of an element.
Examples:
- Product names
- Prices
- Descriptions
- Headings
How it works: The extension reads the text content from the selected HTML element.
Extracts the URL from a link element.
Examples:
- Product page URLs
- Article links
- External references
How it works: Extracts the href attribute from <a> (link) elements. Automatically converts relative URLs to absolute URLs.
These URLs can be used later with Page Details Scraping to extract data from each linked page.
Extracts image URLs from image elements.
Examples:
- Product images
- Thumbnails
- Profile pictures
- Icons
How it works: Extracts the src attribute from <img> elements or background images from elements with CSS background-image properties.
Tips for Successful List Scraping
Before opening Easy Scraper, wait for the page to fully load. If content is still loading, the extension may not detect all items.
When scraping large lists, start by setting a low "Max items" limit (e.g., 10-20 items) to test your configuration before running a full scrape.
- For fast websites: Use shorter wait times (1-2 seconds) - For slow websites: Increase wait times (3-5 seconds) - Add a scroll delay if items aren't loading properly
Some websites load content dynamically. If you're not getting all the data, try: - Increasing wait times - Adding a scroll delay - Manually scrolling before starting the scrape
After scraping, review the data table to ensure:
- All fields are populated correctly
- URLs are complete (not broken)
- No missing or duplicate items
Common Issues and Solutions
Problem: Easy Scraper says "No list detected" when you open it.
Solutions:
- Make sure the page has fully loaded
- Check that the page actually contains a list of repeating items
- Try refreshing the page and waiting a few seconds before opening the extension
- Some pages use complex layouts that may not be automatically detected
Problem: Not all items are being scraped.
Solutions:
- If using scroll mode, increase the max wait time
- Add a scroll delay to give the page time to load
- Try using "Click Next Page" instead of scroll if pagination buttons exist
- Check if the website has rate limiting or anti-scraping measures
Problem: The same items appear multiple times in the results.
Solutions:
- Check if the page has multiple identical lists
- Try removing and re-adding fields
- Refresh the page and start over
Problem: Some fields are empty or contain wrong data.
Solutions:
- Use "Verify" to check that the field selector is correct
- Remove the field and add it again by selecting the correct element
- Make sure you're clicking the right element when adding fields
- Some data may be loaded dynamically - try waiting longer before scraping
Problem: Scraping stops before reaching the last page.
Solutions:
- Increase the max wait time for page loads
- Check if the "Next Page" button selector is still valid on later pages
- Some websites may block scraping after a certain number of requests
- Try reducing the scraping speed by increasing wait times
Next Steps
After scraping a list, you can:
- Export the data for analysis or use in other applications
- Scrape details from each URL using Page Details Scraping
- Save your configuration by creating a reusable scraper
Learn Page Details Scraping
Take your scraped URLs and extract detailed information from each page