Panel book size and why a small country runs dry

What “panel size” actually means

When people talk about a survey panel’s “size,” they usually mean the total number of registered members. That number is close to useless on its own. A panel with 2 million members worldwide might have a hundred thousand in your country, and within that hundred thousand, only a few thousand who match the specific quota a client is buying for this week.

The number that actually determines whether you get surveys, and how well those surveys pay per minute, is the depth of your specific slice of the book. Not the panel. The cell.

How books get sliced into quota cells

Market research buyers don’t ask for “1,000 people.” They ask for something like “500 women aged 35 to 44, working full time, household income above a certain threshold, living in a specific country.” The panel has to fill that exact cell, not a nearby one.

To do that, every panelist gets sorted by demographics, and often by past survey behavior, into a grid of small cells: age band by gender by income by region by employment status, sometimes crossed further by category-specific traits like car ownership or having young kids. A panel’s front-end sends out a broad invite, a short screener sorts people into cells, and the system keeps letting people into that specific study only until the cell’s quota is full. Everyone else gets the “thank you, this survey is not available” or “quota full” screen, usually after they’ve already answered several screener questions.

That screener time is the detail people miss. You don’t get screened out instantly. You get screened out after giving the panel two, three, sometimes six answers, because the system has to check whether you match before it can reject you.

Why small countries run dry so fast

Population size sets a hard ceiling on how many people can ever exist in a given cell, and panel membership is a further fraction of that. Take an illustrative example: a country with 5 million people might have 60,000 to 80,000 active panelists across every panel a person could join. Slice that by 10 age-and-gender bands, then by three income tiers, then by employment status, and a single target cell can shrink to a few hundred or low thousands of people nationally.

Compare that to a country of 300 million. The same slicing still leaves tens of thousands of people in a given cell, because the base pool was so much bigger to begin with. A study that closes in an hour in the small country might stay open for days in the large one.

This is why panelists in smaller countries so often see a pattern: a burst of survey invites in the morning, most of them showing “not available” by early afternoon, and then a dry stretch until the next batch of studies opens or the book gets a fresh recruitment push. It’s not bad luck and it’s not your account being throttled. It’s the arithmetic of a small denominator.

Niche B2B or high-income quotas make this worse. If a client wants small-business owners with over $500,000 in annual revenue in a country of a few million people, that cell might genuinely be in the low hundreds nationally, across every panel combined. Once it’s full, it stays full until someone new registers or an existing panelist’s profile data gets refreshed.

The payout math nobody shows you

Panels typically pay for completed surveys, calculated against an estimated length of interview (LOI). A 15-minute survey might carry a certain incentive tied to that 15-minute estimate. What that estimate does not include is the time you spend on studies you get screened out of.

If your country’s book is thin, you get routed into more screeners relative to completes, because the system is testing more people against a cell that fills fast. Each screen-out costs you two to five minutes of unpaid or barely-paid time (some panels toss a token amount for screen-outs, many pay nothing). String together a run of these and your actual time invested per dollar earned goes up, even though the advertised per-survey rate hasn’t changed at all.

This is the mechanism, not a guess about what you’ll personally earn. No panel discloses your effective rate after screen-outs, because their advertised rate is always completes-only. Nobody is going to tell you your real hourly return, because they only ever measure the number that flatters them.

What a thin book does to your effective hourly rate

The honest way to think about it: your effective rate is total dollars earned divided by total time spent, including every screen-out, every “survey not available” click, and every minute waiting for the next invite. In a country with a deep book, that denominator stays close to the advertised LOI because most attempts convert to completes. In a country with a thin book, the denominator balloons, because a much larger share of your time goes into attempts that end in rejection.

This is also why the same panel can feel completely different depending on where you live. Someone in a large market posting about steady survey income isn’t lying about their experience, they’re just describing a different book than the one available to someone in a small market. The panel is the same. The underlying pool is not.

How to measure your own country’s book depth

You don’t need special tools for this, just a log and a week of honest tracking. For every session on a given panel, record four things: the time you started, whether you were screened out or completed, how many questions you answered before a screen-out happened, and the time you finished. Do this for a full week, not a single day, because study volume varies by day and by which clients are buying fieldwork that week.

At the end of the week, look at two ratios: completes divided by total attempts, and total unpaid screener time divided by total paid time. Those two numbers tell you more about whether a panel is worth your time in your specific country than any review or forum post ever will, because they’re measured from your own book, not someone else’s.

If your screen-out ratio is high and holding steady over multiple weeks, that’s not something to fight by changing your answers to force your way past screeners. Doing that doesn’t get you into a genuinely thin cell, it just produces answers that don’t match your real profile, and panels cross-check screener answers against your stored profile data and past responses over time. A thin book is a supply problem on the panel’s side. It isn’t fixed by you answering differently.

What this means for account health

Because thin-book countries push people toward more screener attempts, it’s tempting to attempt every single invite that shows up, hoping some convert. That’s reasonable up to a point, but a pattern of very fast screen-outs across many attempts, especially if screener answers look inconsistent with earlier ones, is exactly the kind of signal panels use to flag accounts for review. The fix isn’t to attempt less carefully. It’s to expect a lower completion ratio as a fact of your market and answer every screener honestly and consistently, since consistency is what keeps your profile data useful to you long term.

Small-country panelists are working with a genuinely smaller pool of opportunity. That’s a real constraint, not a personal failing, and understanding the quota mechanism behind it is the difference between getting frustrated at a “broken” panel and correctly reading a book that was always going to run dry by early afternoon.

For more on how panels actually calculate pay, screen-outs, and account health, head back to the Survey Farm home page.