gradient blur

How to Start Testing When You Don't Know Where to Start

A practical framework to identify bottlenecks across your funnel, prioritize experiments, and focus on the tests that actually move onboarding, trials, and revenue.

Superwall: How to Start Testing When You Don't Know Where to Start

Natalia Burakova

Pearfect Growth, Fractional Growth Leader

Published

When your subscription app has enough data to analyze but performance is still below benchmarks, it's hard to know where to start. Should you fix the App Store page? Redesign onboarding? Test new pricing? In this article, we'll define a diagnostic framework that helps you identify your biggest opportunities and build a test plan to boost your app's performance.

To start the analysis, it’s important to deepen your understanding of the competitive landscape and niche benchmarks, and to ground it with real product data. My personal opinion? The best way to understand your competitors is to actually download and use their apps. I love automation tools, but they can't give you 100% of the actual user experience.

Industry experts such as Business of Apps publish comprehensive benchmark analytics on a yearly basis. Try to get the most actionable information out of them. They'll give you the baseline to measure your performance against.

Once you've gathered competitive insights and benchmarks, here's how to diagnose where your biggest opportunities lie. The framework is simple: start at the top of your funnel and work your way down. Each step will help you identify bottlenecks and prioritize what to test first. The goal is to find where you're losing users (or money) and fix it systematically.

Step 1: Look at Your Funnel

I mean, look at your funnel holistically, including App Store Connect statistics. How far are you from the App Store benchmarks? If your App Store conversion level isn't impressive, that's a good place to start. App Store optimization, icons test & screens test are very underrated and can make a huge impact.

💡 Pro tip: You can launch App Store and product tests at the same time, increasing your learning speed.

💡 Pro tip: Use App Store screens and Custom Product Pages (CPP) to test your messaging and align your winning value proposition with the rest of the flow. Consistent UA Creative → App Store → Onboarding → Paywall offering can significantly increase your performance.

Step 2: Look at Your Onboarding Performance

How many people complete the onboarding and reach the paywall? Where do they churn?

For shorter, value-focused onboardings of 3–5 screens (typical for Business & Productivity apps), around 80% of users should reach the onboarding paywall. If you have less, it's a signal to focus on onboarding optimization and value presentation.

For long, personalization-focused onboardings with quizzes and 30+ screens, the completion rate can be significantly lower. Around 60% onboarding paywall reach can be fine there, but only if your conversion meets the benchmark and lets you get ROAS-positive traffic. If not, iterate on it.

💡 Pro tip: Never try to sell the features. Even rational people don't make rational decisions. People are buying problem-solving, positive emotions, and freedom from boring tasks. If you don't know how to sell value, try the "Problem - Solution - Result" framework.

💡 Pro tip: To ensure that your onboarding has a chance to perform well from the beginning, find a few competitors with medium-level revenue (not too small and not top performers), review 5–10 apps, and adopt their onboarding approach to your app.

Step 3: Analyze Your Trial Conversion Performance

If you have a low conversion to trial (or to paid in case you don’t offer trial), there are three possible reasons:

Your pricing is off

This is the easiest opportunity to fix. If conversion doesn't happen due to high prices, check the competitive periods and prices, then adjust your offers to match the niche.

You didn’t explain what people get with the subscription

Same as with onboarding, it's extremely important to present the values and benefits correctly on the paywall. Your value offer should be:

  • Short

  • Clear

  • Easy to understand

It can be supported with a value stack to show the list of features or use cases to increase the perceived value.

💡 Pro tip: Messaging from top-performing UA creatives or App Store works really well here.

gradient blur
dashboard-header

Examples of mobile app paywalls with value stacks, showing different subscription plans, pricing options, and trial configurations.

Your paywall design underperforms

There are endless possible reasons why the paywall design underperforms — from visual bugs to approaches that don’t match the niche or audience expectations.

A good place to start:

  • Review competitor paywalls

  • Identify industry-standard design patterns

  • Compare your screen with top-performing apps

  • Build a test plan to close the gap

💡 Pro tip: Every time your paywall test reaches the limit and doesn’t show impact anymore, iterate on the onboarding. Testing paywalls is usually faster and cheaper than rebuilding onboarding flows, so ROI for paywall tests is often higher.

Step 4: Analyze Your Trial-to-Paid Conversion Performance

If your app converts well to trial but conversion from trial to paid is low, that indicates:

  • There's a mismatch between the value promise and the product itself

  • The product quality doesn't meet expectations

This mismatch can lead to App Store rating decreases as well as revenue loss. This is the trickiest one on the list. If this is what's happening with your app, I'd recommend reviewing the app performance, feature setup, and how much the app actually matches current industry standards and user expectations. It may require deeper research and a significant app update. But it's definitely possible to fix this gap within a reasonable amount of time.

Putting It All Together

When you analyze your app using this framework, you can identify a list of opportunities that can increase your app's performance and create a test plan focused on the areas with the highest growth potential.

The key is prioritization. Not all opportunities are created equal. Focus on the bottleneck that's costing you the most users or revenue first. If 50% of users drop off during onboarding, fix that before testing trial period lengths or paywall configuration.

Your test plan should be realistic and sequenced. Quick wins on paywalls can fund longer onboarding rebuilds. App Store tests can run parallel to product tests. The goal isn't perfection, it's progress. Each test teaches you something about your users, and each insight compounds into better performance over time.

If your main bottleneck turns out to be pricing or paywall conversion, you might find it useful to explore this article: three proven paywall and pricing experiments that indie app teams use to increase revenue.

Hope this framework was useful for you. Continue testing and iterating. Try new approaches, concepts, and messages. The more tests you run, the higher your chances of reaching peak performance.

If you’re looking for a way to apply this framework in practice, try Superwall for free and make it easier to run and iterate on onboarding, pricing, and paywall tests without slowing down your team.

Keep experimenting, stay curious, and remember, every test is a step toward better understanding what your users really need.

Stay up to date

Subscribe to our newsletter and be the first to know about new features, updates, and more.

gradient blur

Get a demo

We'd love to show you Superwall

Want to learn more?

  1. Fill out this tiny form →
  2. We'll prepare you a custom demo
  3. Walk you through Superwall
  4. Follow up and answer questions

Key features

  • Drag 'n Drop Paywalls
  • 200+ Custom Templates
  • Unlimited A/B tests
  • Surveys, Charts & More

Select one...

Select one...

By proceeding you consent to receiving emails and our terms.

gradient blur
shape-starshape-starshape-starshape-starshape-star

Customer Stories

Our customers refer to Superwall as their most impactful monetization tool. In their own words:

dashboard-header

Thanks to Superwall, we were able to 2x our iOS app profitability in just six months. It has greatly assisted our growth team in achieving exceptional results by facilitating high-frequency experimentation.

Mojo launch
Bernard Bontemps, Head of Growth
dashboard-header

Really excited about the progress we made recently on paywalls with Superwall. We got more than 50% increase in conversion for upsell screens. This is crazy.

Photoroom launch
Matthieu Rouif, CEO
dashboard-header

Superwall has completely changed the game for us. We’re able to run experiments 10x faster and unlock the ideal monetization model for our users.

RapChat launch
Seth Miller, CEO
dashboard-header

Superwall made testing paywalls so much faster. Instead of releasing a new version of the app each time, we were able to iterate on the winning paywalls much quicker. Thanks to that it increased our revenue per customer by 40%.

Teleprompter launch
Mate Kovacs, Indie Dev
dashboard-header

Superwall lets us move 10x faster on our monetization strategy. We can build and launch multiple paywall iterations without the need for client releases or complicated deploys. Our product iteration loop is days, rather than months because of Superwall.

Citizen launch
Jon Rhome, Head of Product
dashboard-header

Superwall enables Bickster’s marketing team to design and optimize app paywalls, freeing up engineering to concentrate on innovation. As a result, Superwall helped accelerate our install-to-subscription rates, lower engineering expenses, and cured our team’s frustration with the (once) time-consuming process of iterating on paywalls.

Bickster launch
Chris Bick, CEO
dashboard-header

Superwall has revolutionized our monetization strategy. It’s an essential tool that allows rapid paywall testing and optimization, leading to remarkable improvements in our subscription conversions and revenue generation. Can’t recommend Superwall enough for any app-based business.

Coinstats launch
Vahe Baghdasaryan, Sr. Growth
dashboard-header

Superwall has played an integral part of improving our subscription business. Compared to other providers, Superwall has proven superior in facilitating high-frequency experimentation allowing us to achieve an ideal monetization model, resulting in a significant increase in revenue.

Hornet launch
Nils Breitmar, Head of Growth
dashboard-header

Superwall is the single greatest tool we’ve used to help us increase our revenue. Our material wins from Superwall are greater than any tool we’ve worked with to date!

Pixite launch
Jordan Gaphni, Head of Growth
dashboard-header

Shout out to Superwall for helping us dial in our paywall — made a big impact on monetization, increasing revenue by more than 50% 💸

Polycam launch
Chris Heinrich, CEO
dashboard-header

Superwall increases revenue. Full stop. Being able to test paywalls on the fly and quickly analyze results has drastically increased our revenue and improved our monetization of users. Highly recommend this tool!

Hashtag Expert launch
Zach Shakked, Founder
Start for FREE

Simple win-win pricing

Interest aligned pricing. Contact us for a discount.

dashboard-header
Indie
Free
Up to 250 conversions per month
Access to every standard feature
Try it free

Standard Features

  • 250 Conversions a Month
  • Drag 'n Drop Paywall Editor
  • 200+ Paywall Templates
  • Unlimited A/B tests
  • Charts & Analytics
dashboard-header
Startup
$0.20/conversion
Pay as you go pricing that scales
Up to 5,000 conversions a month
Sign Up

Standard Features

  • 5,000 Conversions a Month
  • Drag 'n Drop Paywall Editor
  • 200+ Paywall Templates
  • Unlimited A/B tests
  • Charts & Analytics
dashboard-header
Growth
Flat-Rate
100% custom flat-rate pricing
Terms that make sense for you
Get Pricing

Premium Features

  • Unlimited Conversions
  • We Build Your Paywalls
  • 4 Weekly Growth Meetings
  • Dedicated Slack Channel
  • Custom Integrations