Singapore Growth Experiments: A/B Testing Framework
Issue: BUY-3321
Owner: Wave (Growth Specialist
Status: Active — Monitoring Phase
Overview
Framework for running hypothesis-driven A/B tests across Singapore content experiments to optimize organic traffic, signup conversion, and referral growth. Tests are independent and can run concurrently.
Active Experiments
Exp 1: Grocery SEO Content
Hypothesis: "best [X] Singapore" long-tail queries convert to API signups at 2%+ because grocery shopping is frequent, local, and high-intent.
| Variant | Description | Metric |
|---|---|---|
| A | Category hub links to individual guides | CTR to guide pages |
| B | Direct links + price comparison widget | API signup rate |
Cookie/Split: ab_grocery=A|B
Primary Metric: Signup conversion rate from grocery guide traffic
Secondary: Time on page, pages per session
Exp 1b: Electronics + Baby SEO
Hypothesis: Comparison-style buying guides ("iPhone vs Samsung") outperform list-style guides ("Best X in Singapore") for commercial-intent queries.
| Variant | Description | Metric |
|---|---|---|
| A | List-style ("Best Headphones Singapore 2026") | Organic traffic |
| B | Comparison-style ("AirPods Pro vs Sony WH-1000XM5 Singapore") | Signup conversion |
Cookie/Split: ab_content_style=A|B
Primary Metric: Signup conversion per 1000 visitors
Secondary: Bounce rate, avg session duration
Exp 2: Community Outreach
Hypothesis: Personalized outreach to Singapore dev communities drives more qualified signups than generic content distribution.
| Variant | Description | Metric |
|---|---|---|
| A | Generic MCP announcement template | Referral signups |
| B | Community-specific personalized pitch | Referral signup quality score |
Tracking: UTM campaign sg-dev-community-{A|B}
Primary Metric: Qualified signups (first API call within 24hrs)
Secondary: Reply rate, reposts/shares
Exp 3: MCP Directory Listings
Hypothesis: MCP directory listings with detailed use-case copy outperform basic listing submissions.
| Variant | Description | Metric |
|---|---|---|
| A | Basic submission (name, description, URL) | Referral traffic |
| B | Full submission (use cases, code examples, Singapore focus) | Referral + signup conversion |
Tracking: UTM mcp-directory-{A|B} on directory referral links
Primary Metric: API signups from directory traffic
Secondary: Time-to-first-call, return visit rate
Event Tracking
| Event | Trigger | Properties |
|---|---|---|
page_viewed | Blog page load | page_path, content_type, ab_variant |
guide_cta_clicked | BuyWhere API CTA click | ab_variant, page_path, cta_label |
api_signup | API key generated | source, ab_variant, utm_campaign |
community_cta_clicked | Community outreach link clicked | community, ab_variant |
Analysis Schedule
- Weekly: Check sample sizes, surface early signals
- Day 14: First formal readout — declare winner or extend
- Day 30: Final analysis — scale winning variants
Success Criteria
| Experiment | Target | Timeline |
|---|---|---|
| Exp 1 (Grocery) | 5K visits/mo, 2% signup conv | 30 days |
| Exp 1b (Content Style) | 10% lift in signup conv | 30 days |
| Exp 2 (Community) | 50 signups/mo | Ongoing |
| Exp 3 (MCP Directories) | 500 referral visits | 14 days |
Document History
- 2026-04-19: Initial framework created for Singapore growth experiments