LogoLogo
  • Overview
  • Key Features
  • Getting Started
    • Installation
    • Quick Start Guide
    • Configuration Options
    • Authentication
  • NPM Package
    • Installation
    • Core API Reference
    • Event Tracking
    • Experimentation
    • Performance Monitoring
    • Session Recording
    • Error Tracking
    • Advanced Configuration
  • A/B Testing & Experimentation
    • Creating Experiments
    • Targeting Users
    • Measuring Results
    • Statistics & Significance
    • Best Practices
  • Analytics Dashboard
    • Overview
    • User Journey Analysis
    • Conversion Funnels
    • Custom Reports
  • Session Recording
    • Privacy Considerations
    • Viewing Recordings
    • Filtering & Searching
    • Heatmaps
  • Performance Monitoring
    • Core Web Vitals
  • User Management
    • Roles & Permissions
    • Team Collaboration
    • Access Controls
    • Audit Logs
  • Troubleshooting
    • Common Issues
    • Debugging Tools
    • Error Reference
  • Appendix
    • Glossary
    • API Status Codes
    • Migration Guides
    • Release Notes
    • Roadmap
Powered by GitBook
On this page
  1. A/B Testing & Experimentation

Creating Experiments

PreviousAdvanced ConfigurationNextTargeting Users

Last updated 1 month ago

Setting up your first experiment in Mtrix is straightforward. Follow these steps to create, target, and measure experiments that drive meaningful improvements.

Experiment Creation Process

The experiment creation process in Mtrix follows a logical workflow:

Step 1: Define Your Experiment

  1. In the Mtrix dashboard, navigate to Experiments and click Create Experiment

  2. Fill in the 3-step form starting from Experiment Details:

    1. Name: A clear, descriptive name (e.g., "Homepage Hero Call-to-Action Test")

    2. Location: Page(s) you want to trigger the experiment

    3. Type: Select from A/B Testing, Multivariate Testing, Split URL, or Mask URL

    4. Variant Selection: Select the variants you want to test against each other

  3. Define your hypothesis using the structured format:

  4. Select the priority level of the experiment (generates PIE score)

  5. Configure Advanced Settings:

    1. Time to go live: Select a specific time to automatically start receiving traffic

    2. Multi-armed bandit: Toggle it on to let Mtrix favor the winning variant while still experimenting a small set of traffic on the rest

    3. Completion criteria: Select from Visitor Count, Date, Revenue Generated to stop receiving traffic when the criteria met

Step 2: Review and Launch

Voila! You created your first draft experiment. At this stage, you need can review your changes and take the experiment live!

  1. preview.mtrix.io will allow you to view variants, and see how your users will experience your page

  2. You can configure your audience targeting (which we'll cover on the next section) or traffic allocation pre-launch or at any time during the testing.

  3. Once you're ready to ship your test, you can change the Status to In-progress.