Natural Language Test Creation

Describe the Test.
Pie Runs It.

Create automated tests in plain English. No selectors to configure. No scripts to maintain. No code to debug. Just describe what you want tested and watch it execute.

Try it free See how it works
Results in minutes Zero code required
<60s
Prompt to running test
90%
Less effort vs scripting
0
Lines of code required
Live
Watch execution in real-time

Test scripts take hours.
Prompts take seconds.

Traditional test automation means learning frameworks, writing code, debugging selectors, and maintaining scripts that break with every UI change. Pie flips the model.

Traditional
With Pie
Create test
2-4 hours
< 1 minute
Skills needed
Selenium, Cypress...
Plain English
Maintenance
20-40 hrs/month
Self-healing

How It Works

Create. Validate. Automate.

Build tests in plain English, verify they work live, then let Pie run them on every release.

1

Write in Plain English

Describe the test like you'd explain it to a teammate. No special syntax required.

"Test checkout with an expired credit card"
"Verify admin can't access user-only pages"
2

Watch It Execute Live

Pie's AI agent navigates your app using computer vision. See every click, every assertion in real-time.

Navigating to checkout...
Entering expired card...
Verifying error message...
3

Get Clear Results

Pass or fail with screenshots, execution replay, and step-by-step reasoning.

Test Passed
Error message displayed correctly.

Real Examples

Just Tell Pie What to Test

Real prompts. Real tests. No syntax to memorize.

Authentication
"Sign up with a new email, log out, then log back in and confirm the dashboard loads."

Pie generates

  • Register a new account
  • Log out
  • Log back in with the same credentials
  • Verify the dashboard loads
E-commerce
"Add an item to the cart, set quantity to 2, and check out with a test card."

Pie generates

  • Add the first product to the cart
  • Increase quantity to 2
  • Verify the total updates
  • Check out with a test card
CMS
"Create a draft page, publish it, and confirm it appears in the published list."

Pie generates

  • Create a page and add body text
  • Save as Draft
  • Change status to Published
  • Verify it appears in the Published list
Edge Case
"Create a contact, delete it, then confirm it no longer shows up in search."

Pie generates

  • Create a contact with a unique name
  • Delete it and confirm
  • Search for it again
  • Verify no results are found

Pro tips for great prompts

  • Use > for navigation: Settings > Users > Roles
  • Say "unique email" or "unique name" for auto-generated data
  • End with "verify" for explicit assertions

Use Cases

Test What Automated Tools Can't

Discovery builds your baseline. Custom Tests handle the scenarios that require domain knowledge.

Edge Cases

Boundary values, special characters, Unicode input, maximum field lengths. The inputs that break apps in production.

"Enter 10,000 character description and submit"

Negative Testing

Invalid inputs, unauthorized access attempts, error handling. Verify your app fails gracefully.

"Try accessing /admin as a regular user"

Regression Tests

That bug you fixed last month? Create a test to make sure it stays fixed forever.

"Verify cart total includes tax for CA addresses"

Smoke Tests

Critical path validation after every deploy. Know within minutes if login, checkout, or core flows work.

"Complete full checkout with saved payment method"

Feature Flags & A/B Tests

Test both variants of an experiment. Verify feature flags enable/disable correctly.

"Test checkout flow with new_ui flag enabled"

Manual Test Migration

Upload your spreadsheet of manual test cases. Pie converts them into automated tests.

Import from CSV, Excel, or TestRail

Iterative Testing

Your First Prompt Doesn't Need to Be Perfect

Watch the test run live. See exactly what the agent does. If it takes a wrong turn, add clarification and rerun. The agent adapts to your feedback.

No debugging scripts. No hunting through logs. Just iterate until the test does exactly what you need.

Initial prompt
"Test the Safe Zone feature"
Agent feedback

Tapped circle button instead of square. Buttons are visually similar.

Your clarification
"The delete button is under the three-dot menu"
Test passes

Safe Zone feature tested successfully. Test saved to regression suite.

Complete Coverage

Discovery Builds the Foundation.
Custom Tests Fill the Gaps.

Autonomous Discovery

Point Pie at your app. We explore every feature, every flow, every edge of your UI. In hours, you have a regression suite that would take weeks to build manually.

  • 100+ tests generated automatically
  • Core user flows covered
  • Regression baseline established

Custom Tests

You know things about your app that no AI can discover on its own. Custom Tests let you encode that domain knowledge into your test suite.

  • Edge cases only your team knows
  • Specific bugs from customer reports
  • Complex business logic validation

Both run together in your regression suite. Import existing test cases. Add new ones anytime.

Start Testing in Minutes

No scripts to write. No selectors to maintain. Describe what needs testing and watch it happen.

Try it free Talk to sales
SOC 2 Type 2 certified No source code access required

FAQ

Did we miss a question?
Email us directly →

How do I create a custom test?
Describe the test in plain English. 'Log in as admin, navigate to settings, change notification preferences, verify changes persist after logout.' Pie interprets the intent and executes it. No code, no selectors, no scripting language to learn.
What if Pie misinterprets my test description?
You watch the test execute live. If the agent takes a wrong turn, add clarification and rerun. Most tests work correctly on the first or second attempt. The agent learns from your feedback.
How do Custom Tests work with Autonomous Discovery?
They're complementary. Discovery generates your baseline test suite automatically. Custom Tests let you add specific edge cases, regression scenarios, and tests for flows only your team knows about. Both run together in your regression suite.
Can I import my existing manual test cases?
Yes. Upload a CSV of your manual test bank and Pie converts them into executable automated tests. No rewriting required.
How long do custom tests take to run?
Most tests complete in 2-5 minutes. You can watch the entire execution live or let it run and review results later.
What platforms are supported?
Web apps, iOS, Android, React Native, Flutter. If a human can interact with it, Pie can test it.