Jetify Launches TestPilot: AI QA Engineer

Jetify Introduces Testpilot, its First AI Agent

Jetify, previously operating as Jetpack.io, is announcing the release of its inaugural AI agent product on Tuesday. This new offering, named Testpilot, is designed to significantly streamline the routine aspects of test creation.

The core functionality of Testpilot involves automating the creation of test plans, their execution, and the subsequent reporting of results.

Notably, the agent operates through direct interaction with the user interface, simplifying the testing workflow.

Initial Capabilities and Future Expansion

Currently, Testpilot is optimized for testing web-based applications. However, the development team has already outlined plans to extend its capabilities to include mobile testing in the near future.

While Jetify initially focused on providing cloud-based development environments, the launch of Testpilot signifies a strategic shift.

A Pivot Towards AI-Driven Development

According to Jetify CEO and co-founder Daniel Loreto, this launch represents a pivotal moment and the first in a series of AI agent releases.

These future agents will be centered around enhancing various stages of the software development life cycle.

“We believe, as many others do, that AI represents a transformative technology occurring roughly once every three decades,” Loreto stated.

“Similar to the advent of the internet or mobile technology, the opportunity to contribute to this wave was a compelling factor in our decision to pursue this direction.”

Addressing a Key Developer Pain Point

The team identified a significant challenge faced by developers – the often-tedious task of writing tests.

Specifically, UI testing can be problematic, as tools like Selenium can become unreliable with even minor changes to the user interface.

AI excels at handling such dynamic elements, maintaining functionality even with slight UI adjustments.

Leveraging Existing QA Practices

Loreto also highlighted that QA teams are already accustomed to utilizing third-party tools for application testing.

This familiarity makes the adoption of Testpilot a more natural progression.

“Companies readily acknowledge the need for comprehensive end-to-end testing and are often willing to engage external partners to facilitate this process,” he explained.

Simplified Integration and Access

Integrating Testpilot into the development process is straightforward, requiring only access to log in to the application being tested.

Because the agent analyzes the live application, it doesn't necessitate access to code repositories like GitHub.

Current Limitations and Future Development

While Testpilot can currently cover 60% to 70% of the tests a human tester would typically devise, a gap remains.

Jetify acknowledges this limitation but views the current capabilities as a substantial benefit.

Currently, onboarding requires direct engagement with Jetify, but a self-service option, including mobile support, is planned for release soon.

The company is still evaluating optimal pricing models, which is influencing the timing of the self-service launch.