BIG W Marketplace Scraper at a glance
BIG W Marketplace Scraper is a ready-to-run Apify actor from abotapi for collecting ecommerce data. Its documented output includes name, brand, seller type, seller and price, which you can export as JSON, CSV or Excel or read through the Apify API. It costs $1.80 per 1,000 results on the Apify Free plan and from $1.00 on paid plans, with smaller per-run or optional feature charges listed on Apify.
- Runs on
- Apify cloud: console, API, schedules and integrations
- Data type
- Ecommerce, Automation, Developer Tools
- Pricing
- $1.80 per 1,000 results (Free plan), from $1.00 on paid plans
- Output
- Documented below · JSON, CSV, Excel
- Inputs
- 34 options
Scrape BIG W Marketplace seller listings from bigw.com.au: name, brand, price, was-price, saving, condition, category, images, specs, GTIN/EAN/MPN, rating and customer reviews. Search by keyword with brand, category, price and rating filters, or paste product / search URLs.
What BIG W Marketplace Scraper can do
- Two ways to find products. Search by keyword with rich filters, or paste product and search URLs directly. No need to build search parameters by hand.
- Marketplace-seller focus. Defaults to third-party BIG W Marketplace sellers only, with an option to also include BIG W's own range for a full-catalogue view.
- Real specials detail. Was-price, discount amount and percent, the site's own offer label (such as "1/2 Price" or "35% OFF"), clearance flags and per-unit pricing, all left empty rather than invented when the site shows no offer.
- Full listing depth. Images, specifications, variant and colour/size matrices, GTIN/EAN/MPN identifiers, fulfilment and stock detail come back on every record.
- Reviews on demand. Attach customer reviews and an aggregate rating summary per product, capped to the number you need, and pay only when you turn it on.
- Unlimited catalogue walking by default. Pagination has no artificial cap: a search or URL walk stops only once the storefront's own result count is reached or a page repeats with nothing new.
Choose what to collect
These inputs let you configure BIG W Marketplace Scraper - Products, Sellers & Reviews. Open the actor on Apify to enter your values and review the current options.
| Input | What it controls |
|---|---|
modestring · required | Choose 'search' to use keywords and filters, or 'url' to scrape specific product or search URLs you paste below. |
queriesarray | One or more keywords to search, for example 'piano keyboard' or 'garage shelving'. Each keyword is searched separately. Leave empty to browse the whole marketplace. |
urlsarray | Product or search URLs to scrape, for example https://www.bigw.com.au/product/x/p/9900004603, https://www.bigw.com.au/search?text=piano (add &page=2 to start on page 2; the m. mobile host works too) or a category link such as https://www.bigw.com.au/toys/lego/c/6822101. Multiple URLs supported. Left untouched, URL mode scrapes these examples. |
marketplaceOnlyboolean | Keep only listings sold by third-party marketplace sellers (exclude items sold directly by BIG W). On by default. |
soldBystring | Optional. Who sells the products: all, BIG W only, or marketplace sellers only. When set it overrides 'Marketplace sellers only'; leave on 'Not set' to keep that toggle in charge. |
fulfilmentstring | Optional. 'Click and collect only' keeps products that can be collected in store. Marketplace products are never collectable, so combining it with marketplace sellers returns nothing. |
brandstring | Optional. Keep only products whose brand matches this value, for example 'Alpha' or 'Giantz'. |
Show 27 more inputs
| Input | What it controls |
|---|---|
categorystring | Optional. Restrict results to a BIG W category: either its name as shown on the site (e.g. LEGO), which is looked up on the store, or its id (the trailing number in a category URL, e.g. 6822101 in /toys/lego/c/6822101). A name that cannot be found stops the run with a clear error. |
specialsCategorystring | Optional. Show only products in one of BIG W's on-site specials views. 'On special / reduced' covers half-price and percentage-off deals; also clearance, flash deals, recent price drops and new arrivals. Leave as 'Any' for no specials filter. Combine with a keyword to find specials in a topic, or leave the keyword empty to browse all specials. |
dealstring | Optional, advanced. Filter by a raw BIG W deal label, for example 'Clearance', 'Flash Deal' or 'Special'. Most users should use the 'Specials / offers' selector above instead. Combined with it when both are set. |
sortBystring | Ordering applied to the collected results. |
minPriceinteger | Optional. Only keep products priced at or above this amount (AUD). |
maxPriceinteger | Optional. Only keep products priced at or below this amount (AUD). |
minRatinginteger | Optional. Only keep products with an average customer rating at or above this value (1 to 5). |
includeOutOfStockboolean | Include products that are currently out of stock. On by default; turn off to keep only in-stock products. |
fetchReviewsboolean | Also collect customer reviews for each product (review text, star rating, author, date, pros/cons, photos) plus an aggregate rating summary. Adds requests per product. |
maxReviewsPerProductinteger | Cap on reviews collected per product when 'Fetch customer reviews' is on. Use 0 for the hard limit of 1000 reviews per product (enforced in code). |
maxItemsinteger | Maximum number of products to return across the whole run. Use 0 for unlimited. |
maxPagesinteger | Optional safety cap on result pages walked per keyword / URL. 0 = unlimited (default); the walk still stops naturally once the storefront's own result total is reached, a page repeats with no new products, or Max products is hit. |
deliveryPostcodestring | Four-digit postcode, for example 4209. Requires 'Verify home delivery'. |
verifyHomeDeliveryboolean | Check delivery availability to the postcode above for every returned product. Off by default. |
resumeFromRunIdstring | Optional. ID of a previous run of this actor (or a dataset ID). Products already in that dataset are skipped, so this run returns only NEW products (a delta). Combine both runs' datasets for the full set. Max products then counts only the new products. For recurring daily monitoring of the same search, use Incremental mode below instead. |
incrementalModeboolean | Turn this on for daily or recurring monitoring. The first run returns all matching products as NEW. Later runs normally return only NEW, UPDATED, and REAPPEARED products. Turn on "Emit unchanged" or "Emit expired" only when you also want those products returned (and billed). State is kept separately for each distinct search/filter setup (or by State key below). Off by default. |
stateKeystring | Optional. Name this monitoring campaign to keep its state stable, or to deliberately share state across differently-configured runs. Leave empty to let the actor derive a key automatically from your search/filter settings - different searches then never mix state with each other. |
emitUnchangedboolean | Off by default. Turn on to also return products that have not changed since the last run, marked UNCHANGED. This returns - and bills - extra rows you already have, so leave it off unless you specifically want the full snapshot every run. |
emitExpiredboolean | Off by default. Turn on to also return products that were present in a previous run but are no longer found, marked EXPIRED. Only produced once a run has fully scanned the tracked search - not when Max products or Max pages capped it, or when Resume was used. This returns - and bills - extra synthetic rows. |
changeScopestring | All fields (default): any change to the product record, except reviews and the rating, returns an UPDATED row. Price and availability only: only price changes (price, was price, RRP, saving, special and clearance flags) and availability changes (in stock, listing status, deliverable, collectable, and each size or colour variant being added, removed or changing its listing status) return an UPDATED row; changes to descriptions, images, categories or other details never do. Selling price and availability only: like Price and availability only, but a price change counts only when the selling price (price) moves; was price, RRP, savings and promotion flags never return a row on their own. In every option, a home delivery availability change at your delivery postcode (for the product or one of its sizes or colours) returns an UPDATED row when Verify home delivery is on. Changing this option or Fetch reviews on a search with no State key continues from that search's saved state instead of starting over. |
compactUpdatesboolean | Off by default. When on, UPDATED rows (and EXPIRED rows) are short: article id, url, name, brand, seller type, current price and stock, previousPrice, plus priceChanges (old and new value of each moved price or availability field) and variantChanges (each size or colour variant added, removed or changed, with old and new values). With Verify home delivery on, the row also carries the delivery answer and deliveryChanges / variantDeliveryChanges. NEW rows always carry the complete product record. Review text is not fetched for compact rows and is not billed for them. |
expireAfterMissedScansinteger | Only used with Emit expired products. A product is marked EXPIRED only after it has been missing from this many complete scans in a row (default 1). Raise it (for example 3) so a product that briefly drops out of a search is not reported as gone. A product that comes back resets the count. A product URL whose lookup could not be read never counts as missing. |
baselineDatasetIdstring | Optional. Pick the dataset of an earlier run of this Actor to use as your starting point, so your first incremental run returns only products that changed since then instead of the whole set again. Pick the dataset unedited: it must be this Actor's own product output. Only used on the first run for a state key; ignored once that state key already tracks products. Cannot be combined with Resume from a previous run. If the dataset is old, everything that changed since is returned as UPDATED or NEW. |
ignoreFieldsForChangesarray | Optional. Field names that must not count as a change, so a product is not returned as UPDATED just because of them. Use a top-level name (for example rating) or a dotted path for a nested field (for example fulfilment.eta; inside lists the path applies to every element). The fields are still returned in the output - they are only left out of change detection and changedFields. Changing this list never re-reports products already tracked. Incremental mode only. |
mcpConnectorsarray | Optionally send results into the apps you already use, via Model Context Protocol (MCP) connectors. Authorize one under Apify, Settings, API & Integrations, then select it here. Notion gets a rich page-per-item export; other connectors get a best-effort write/digest. Leave empty to skip; never changes the dataset output. Supported: Notion (https://mcp.notion.com/mcp), Linear (https://mcp.linear.app/sse), Airtable (https://mcp.airtable.com/mcp), Apify (https://mcp.apify.com). |
notionParentPageUrlstring | URL or id of the Notion page under which item pages are created. Required to enable the Notion export; ignored by other connectors. |
maxNotifyListingsinteger | Cap on items written to each connector per run. Does not affect the dataset. |
Fields in the output
The documented dataset includes the fields below. Availability can depend on the source page and selected mode.
nameNamebrandBrandsellerTypeSeller typesellerNameSellerpricePricewasPriceWassavingsPercentSave %isOnSpecialOn specialpriceLabelOffercurrencyCurrencyconditionConditionratingRatingShow 31 more fields
categoryCategoryarticleIdArticle idimageUrlImage (image)urlURL (link)changeTypeChange typechangedFieldsChanged fieldsfirstSeenAtFirst seenlastSeenAtLast seendeliveryPostcodeDelivery postcodestandardDeliveryAvailableStandard deliverystandardDeliveryEtaFromStandard fromstandardDeliveryEtaToStandard tosameDayDeliveryAvailableSame dayminDeliveryFeeCentsMin fee (cents)deliveryCheckedDelivery checkedreviewsreviewstitleReview titleauthorAuthordateDatebodyReviewrecommendedRecommendedhelpfulVotesHelpful votesverifiedPurchaserVerified purchaserpreviousPricePrevious pricepriceChangesPrice changesvariantChangesVariant changesotherChangesOther changesinStockIn stocklistingStatusListing statusdeliveryChangesDelivery changesvariantDeliveryChangesVariant delivery changesExample output
An example from this actor’s documentation. Values are illustrative; this is not a fresh live result.
{
"articleId": "7700001111",
"gtin": "9312345678901",
"ean": "9312345678901",
"mpn": "SC-SHELF-01",
"barcodes": null,
"name": "Sample Garage Shelving Unit",
"title": "SampleCo Sample Garage Shelving Unit",
"brand": "SampleCo",
"sellerType": "Marketplace Seller",
"sellerName": "Sample Seller Co",
"productChannel": "MARKETPLACE",
"isMarketplace": true,
"condition": "NEW",
"listingStatus": "ACTIVE",
"url": "https://www.bigw.com.au/product/sample-item/p/7700001111",
"price": 45,
"wasPrice": 60,
"rrp": 65,
"saving": 15,
"savingsPercent": 25,
"isOnSpecial": true,
"unitPrice": {
"price": 2.25,
"unit": "100 G"
},
"currency": "AUD",
"priceLabel": "Special",
"priceLabelType": "PERCENT_OFF",
"clearance": false,
"onlineOnlyPromotion": false,
"promotions": [],
"paymentOptions": [
"Afterpay",
"Zip"
],
"rating": 4.5,
"description": "A sample product description.",
"imageUrl": "https://www.bigw.com.au/medias/sample-image.jpg",
"images": [
"https://www.bigw.com.au/medias/sample-image.jpg"
],
"category": "Home & Garden",
"categories": [
"Home & Garden",
"Storage"
],
"categoryPath": "Home & Garden > Storage > Shelving",
"variants": null,
"colours": [
"Black",
"White"
],
"sizes": null,
"specifications": {
"Material": "Steel",
"Assembly required": "Yes"
},
"maxQuantity": 5,
"deliverable": true,
"collectable": false,
"limitedFreeShipping": false,
"inStock": true,
"fulfilment": {
"logisticType": "DIRECT_SHIP",
"dsv": false,
"delivery": true,
"collection": false
},
"searchMode": "search",
"source": "bigw.com.au"
}Ways to use this data
- Price and deal tracking: monitor specials, clearance and price drops across BIG W Marketplace sellers for repricing or deal-alert tools.
- Marketplace seller research: compare third-party sellers against BIG W's own range by brand, category or price band.
- Catalogue and comparison feeds: pull structured product data (identifiers, images, specifications, variants) into your own catalogue, price-comparison site or feed.
- Review and reputation analysis: collect customer reviews and rating distributions to score sellers or products over time.
- Recurring monitoring: schedule the actor against a fixed search or product list and get only what changed since last time.
Before you run
Start with a small input and check the resulting records against your expected fields. Source content and actor options can change; the current Apify listing is the reference for availability and pricing.
Questions about this actor
What data does BIG W Marketplace Scraper return?
The documented output for BIG W Marketplace Scraper includes name, brand, seller type, seller, price, was, save % and on special. Availability of each field depends on the source page and the selected mode.
How much does BIG W Marketplace Scraper cost?
It costs $1.80 per 1,000 results on the Apify Free plan and from $1.00 on paid plans, with smaller per-run or optional feature charges listed on Apify. The Apify listing shows the current rate for every plan.
Why did marketplaceOnly change what I expected?
Marketplace sellers only is on by default, so a plain keyword search returns third-party seller listings only, not BIG W's own range. Turn it off to see both, or combine it with Specials / offers to browse deals across the whole catalogue.
Why did my run fail instead of returning an empty dataset?
If the site refuses every request, the run stops with a clear message so "no matches today" is never confused with "nothing could be read". Run it again in a few minutes. If only some keywords or URLs could be read, you still get what was found.
Can I use it with AI agents or MCP?
Yes. Call it from any Apify integration or MCP client, and use the connector field to push results into Notion, Linear or Airtable.
