SEO for a Marketplace With Thousands of Auto-Generated Pages
An online marketplace needed landing pages at scale, with thousands generated automatically, but that approach risked flooding search engines with thin or duplicate content. Meek Media built programmatic SEO templates, set quality thresholds that decide which pages go live, added structured data, designed internal linking and wrote indexation rules so only pages with real value are offered to Google.
- Client
- Online marketplace (name withheld)
- Privacy
- Client name withheld
How do you do programmatic SEO without creating thin or duplicate pages?
Generate pages only where the data supports a useful page, and control what gets indexed. For this marketplace, Meek Media built templates that draw on real listing data, set quality thresholds each page must meet, added structured data, linked pages in a logical hierarchy and defined indexation rules that keep weak pages out of search.
Why do automatically generated pages risk thin and duplicate content?
The marketplace needed scalable landing pages. With thousands of pages generated automatically, there was no practical way to write each one by hand, but scale brought its own danger. Pages built from a template can easily end up thin, with little unique content, or nearly identical to each other apart from a swapped keyword.
That risk is not only about wasted effort. Google's spam policies specifically address scaled content abuse: producing many pages mainly to manipulate rankings rather than to help users, however they are created. Even short of that, large numbers of low-value pages make it harder for Google to find and trust the good ones. They use up crawl attention, dilute a site's overall quality and often compete with each other for the same searches. A marketplace has a real advantage here because it holds data that can make each page genuinely useful. The challenge was to build a system that turns that data into distinct, helpful pages, and that knows when not to publish or index a page at all.
What we found
- A need for scalable landing pages across thousands of automatically generated URLs
- Risk of thin pages with too little unique content
- Risk of near-duplicate pages differing only by a keyword or location
- No quality threshold deciding which pages should exist
- Indexation rules needed to keep weak pages out of search
- Internal linking and structured data needed at scale
How did Meek Media build scalable pages that stay useful?
Instead of asking how many pages could be generated, we asked which pages deserved to exist. Templates, data rules and indexation logic were designed together, so the system scales up where it has something useful to show and holds back where it does not.
-
1
Define page types around real search needs
We identified the page patterns that match how people search the marketplace, for example category plus attribute or category plus location combinations. Each pattern was checked against real queries and the results Google shows, to confirm it matches a distinct intent. Combinations that simply repeated another page's intent were dropped at the planning stage, before any URLs existed.
-
2
Build programmatic SEO templates
Templates were designed so each page draws on live marketplace data such as listings, counts, attributes and filters, not just a swapped keyword in fixed copy. Titles, headings, descriptions and introductory text were generated from rules that vary with the underlying data. Each template gave the page a clear purpose, useful content above the fold and paths to related pages.
-
3
Set quality thresholds
Before a page could go live or be indexed, it had to meet minimum requirements, such as a sufficient number of relevant listings and enough unique content to differ meaningfully from similar pages. Pages below the threshold were not published, were set to noindex, or were merged into a broader parent page. Thresholds were rechecked as data changed, so pages could move in or out automatically.
-
4
Add structured data
Each template included JSON-LD structured data generated from the same data as the visible page, such as breadcrumb and item list markup where appropriate. Structured data helps search engines understand each page's place in the site and its contents. Because it is generated automatically, it was validated on samples from every template to catch errors that would repeat at scale.
-
5
Design internal linking at scale
Pages were placed in a clear hierarchy, from broad categories down to specific combinations, with breadcrumbs and links to parent, sibling and child pages. Links were generated only to pages that passed the quality threshold, so internal authority flows to indexable pages. This also ensures every valuable page is reachable through crawlable links, not only through sitemaps.
-
6
Write indexation rules
Clear rules decided which pages are indexable, which carry a noindex tag, which canonicalise to a parent and which are kept out of crawling entirely. XML sitemaps list only indexable pages. Pages that lose their listings are handled consistently, for example by noindexing or redirecting to a parent, so the index reflects what the marketplace can actually offer.
What We Delivered
- Page type and URL pattern plan based on search intent
- Programmatic SEO templates for each page type
- Quality threshold rules for publishing and indexing
- JSON-LD structured data built into every template
- Automated internal linking rules and page hierarchy
- Indexation rules covering noindex, canonical and sitemap inclusion
What Other Teams Can Learn From This
Scale follows data, not keywords
Programmatic pages work when each one shows something a searcher cannot get from a sibling page, such as different listings, prices or options. If the only difference between two pages is a keyword in the title, they should be one page. Start with the data you have, then build page types around it.
Quality thresholds are a feature, not a limitation
Deciding in advance what a page needs before it is indexed protects the whole site. It keeps empty or near-empty pages out of search, stops weak pages from diluting strong ones and lets the system respond automatically as inventory changes. Fewer indexed pages of higher quality usually outperform a huge index of thin ones.
Test templates on samples before rolling out
When one template produces thousands of pages, every mistake is multiplied. Review a sample of generated pages from each template, including the weakest cases, before publishing at scale. Check content, metadata, structured data and links. It is far easier to fix a template than to clean up thousands of indexed pages later.
Frequently Asked Questions
What is programmatic SEO?
Programmatic SEO is creating many landing pages from templates and structured data, rather than writing each page by hand. It suits sites with large datasets, such as marketplaces and directories. It works when each page offers distinct, useful information and fails when pages are thin or near-duplicates.
Does Google penalise automatically generated pages?
Google does not penalise pages simply for being generated at scale. Its spam policies target scaled content abuse, meaning many pages made mainly to manipulate rankings with little value for users, however they are produced. Pages that genuinely help searchers are acceptable, whether written by hand or generated from data.
How do you stop programmatic pages from becoming thin content?
Set quality thresholds that each page must meet before it is published or indexed, such as enough relevant listings and enough unique information. Pages below the threshold can stay unpublished, be noindexed or be folded into a broader page. Build templates around real data, not keyword variations.
Should every programmatically generated page be indexed?
No. Index only pages that meet your quality threshold and match a real search need. Weak pages can still exist for users but carry a noindex tag or canonicalise to a parent page. Keep XML sitemaps limited to indexable pages so search engines focus on the pages that matter.
Related Case Studies
Rebuilding a 10,000+ Page Website Without Losing SEO
A website with more than 10,000 pages needed a complete redesign, and thousands of those pages were indexed and ranking. Meek Media planned the rebuild so search value carried across: URL architecture, page templates, metadata migration, redirects, structured data, internal linking and a structured launch QA process that checked the new site before and after it went live.
Read the case study →
Recovering a Website After a Google Algorithm Traffic Collapse
After a major Google update, this site lost 60–80% of its organic traffic. Meek Media audited everything that shapes how Google judges a site: content quality, backlinks, site architecture, duplicate pages, search intent and technical SEO. We then rebuilt the organic strategy around the pages that deserved to rank, rather than chasing the update itself.
Read the case study →
Core Web Vitals Rescue for a High-Traffic Website
This website had strong traffic but failed Core Web Vitals. Heavy scripts, large images, layout shifts, slow server responses and third-party integrations were all dragging down the experience. Meek Media tackled the problem on two fronts, optimising the front-end architecture and the server infrastructure behind it, so pages loaded faster, responded quicker and stayed visually stable.
Read the case study →
Facing a similar problem?
Every engagement starts with a free audit. We find what is holding your site back, show you the fix, and scope the work to your goals before you commit.