Skip to content
FSQ-labPublic

Latest commit

 

History

619 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

FSQ — Fully Self Quality

Describe a goal. Test the real app.

Describe what to do and what should happen. Let AI operate the real app and verify the outcome. Inspect screenshots, actions, and results to see what happened.

An open-source project from FSQ Lab.

CI status Python 3.11 or newer MIT license Alpha status

Website · Quick start · 中文 · Guide · Contribute

See a complete test

FSQ_Android_Quick_Test_EdgeTTS_v2_GitHub.mp4

Watch on YouTube · English captions · Media sources and review status

The video shows one real Android Quick Test: find the FSQ repository, follow its About website link, and verify both homepage headlines. You can start with Web; platform setup and execution differ, and search results and outcomes can vary.

From goal to evidence

Describe the journey and the checks. Find FSQ-lab/FSQ, follow its About website link, and verify Describe a goal. and Test the real app.. The card adds editorial explanation around a recorded goal; the surrounding text is separate from the product UI.

Editorial task card with a real Quick Test goal: search for the repository, follow About to its website, and check both headlines

Watch AI operate the real app. The Android browser screen sits beside the FSQ action timeline, connecting execution with captured screenshots and interface state.

Real FSQ execution capture showing the action timeline beside the Android browser device view

Check the result against the evidence. The captured page shows both required headlines. The same Run reports execution success, verification success, and complete evidence separately. The card pairs real page and report captures with editorial explanation.

Editorial result card pairing the captured homepage headlines with the same Run report showing execution and verification success and complete evidence

Quick start

Choose Coding Agent or FSQ UI. Both lead to one Quick Test and evidence review. You need Python 3.11+, a supported configured Provider and explicitly selected model, and platform prerequisites. Enter Provider credentials privately in local FSQ Settings; never paste them into Coding Agent chat.

Quick Test prepares ~/.fsq/quick-test/ automatically. It requires no manual project Workspace setup, does not save a formal Case, and does not perform Strict Replay.

Coding Agent

Add the FSQ Skill, reload your Coding Agent, and ask it to run the complete goal below with FSQ Quick Test.

Expand: one-time setup and first run

Open your project in the Coding Agent and paste:

The official FSQ project is https://github.com/FSQ-lab/FSQ. Establish the exact opened project root. Batch and disclose read-only Python, fsq, and Skill-presence checks with their working directories, commands, purpose, and effects. Request one approval covering only installation or upgrade of fsq-agent and one fsq init --agent skill in this project; show exact commands and Python-environment and project-file effects first. Perform only approved operations, verify fsq, and report the installed Skill path. This setup does not initialize a Workspace, configure a Provider, or run a test. Ask me to reload or start a new Coding Agent session, then stop.

After reloading, select Web and an available browser, then send “Use FSQ Quick Test for the following goal” with the complete goal. Follow the installed Skill: it discovers readiness, asks for unresolved decisions, and reports actual progress and evidence. After a package upgrade, rerun fsq init --agent skill and reload to update the copied Skill.

Open Coding Agent setup guide

FSQ UI

Install FSQ, open the local UI, choose Quick Test, and paste the same goal.

Expand: install and start Quick Test
python -m pip install --upgrade fsq-agent
fsq ui
  1. Configure a supported Provider and explicitly select a model in Settings.
  2. Return to Quick Test, select Web and an available browser, and paste the goal below.
  3. Select Start Quick Test. FSQ interprets the app and validates the target and environment before testing. Unresolved intent, zero or multiple target matches, or preparation failure stop the request without follow-up dialogue.
  4. Use Open report to inspect the outcome and evidence. Target availability does not prove the model understood the intended app correctly.

Open FSQ UI setup guide

Try a complete user journey

Web is an accessible first-use option; the recording shows Android. After selecting a browser, copy this complete goal into either entry path:

Use the selected browser to search for the FSQ-lab/FSQ GitHub repository. Open that repository, follow the website link in its About section, and verify that the destination page displays both “Describe a goal.” and “Test the real app.” Report the outcome with the captured page evidence. Only browse public pages. Do not sign in, change repository content, or submit forms. Stop and report a blocker if the repository or About website link cannot be identified.

After the run, inspect the report and captured page evidence. Treat failed, inconclusive, or preparation-error outcomes as observed; they do not mean the checks passed.

Go further when you need to

  • Inspect the run: review screenshots, interface state, events, and reports to compare actual behavior with your expectations.
  • Manage reusable Cases: use FSQ Case Manager for registered Workspaces, explicit Case creation or saving an available candidate, and run history. A run may produce a Case; generation is conditional.
  • Choose deterministic replay: review any returned Case unchanged, then separately request Strict Replay. Replay operates the target again and requires prerequisite and side-effect checks; Quick Test never runs it automatically.

FSQ supports Web, Android, Windows, and macOS targets, subject to platform prerequisites.

Help shape FSQ

If FSQ is useful to you, visit the repository and Star FSQ to help others discover it. Tried it? Share your experience: what worked, where you got stuck, and what you want to test next.

Include the FSQ version, platform, sanitized goal, expected and actual outcome, and only reviewed diagnostic excerpts. Remove credentials, personal data, private URLs, paths, and device identifiers before sharing screenshots or logs. Report security issues through Security.

Important

FSQ is alpha software for evaluation and contribution. Evidence is stored locally and may contain private app data; review it before sharing, and do not commit evidence or credentials. AI operations send necessary provider-bound inputs to your configured Provider. Public interfaces may evolve before 1.0; see support and stability.

Documentation

Built by FSQ Lab and the community, with thanks to all contributors.

License

MIT — Copyright (c) Microsoft Corporation.

Releases

Packages

Used by

Contributors

Languages