| New web app: stack and developer handoff | Documented workflow New apps use TanStack Start; two-way Git sync enables external development. Constraint: Framework/database choice is constrained. Git sync creates a new repo; ZIP import is the existing-code route. Sources & assessment scopeNamed product: Hosted prompt-to-web-app workflow; new projects use the currently documented TanStack Start stack. Older React/Vite projects differ. Method: Documentation-based decision comparison, checked 24 October 2026. Choose a lane before comparing; N/A is not a low score. No repository was executed, no model benchmark or live app was tested, no paid credits were used, and no numeric quality stars are assigned. For a later matched trial, freeze repository, acceptance tests, tool/model/plan, permissions and revision budget; assess diff correctness, test validity, unexpected changes, recovery and human review effort. Do not compare a source editor’s hosting omissions with a hosted builder as if they were the same failure. | Documented workflow A project includes editable source and Git tools for external repository work. Constraint: Moving the code is not evidence that managed database, secrets and hosting migrate automatically. Sources & assessment scopeNamed product: Replit hosted Agent and web-app project workflow; native mobile and other artifact types are outside this scenario. Method: Documentation-based decision comparison, checked 24 October 2026. Choose a lane before comparing; N/A is not a low score. No repository was executed, no model benchmark or live app was tested, no paid credits were used, and no numeric quality stars are assigned. For a later matched trial, freeze repository, acceptance tests, tool/model/plan, permissions and revision budget; assess diff correctness, test validity, unexpected changes, recovery and human review effort. Do not compare a source editor’s hosting omissions with a hosted builder as if they were the same failure. |
|---|
| New web app: undo code versus data | Documented workflow Revert restores the code version and matching edge functions. Constraint: Database records and migrations are not undone by code history. Sources & assessment scopeNamed product: Hosted prompt-to-web-app workflow; new projects use the currently documented TanStack Start stack. Older React/Vite projects differ. Method: Documentation-based decision comparison, checked 24 October 2026. Choose a lane before comparing; N/A is not a low score. No repository was executed, no model benchmark or live app was tested, no paid credits were used, and no numeric quality stars are assigned. For a later matched trial, freeze repository, acceptance tests, tool/model/plan, permissions and revision budget; assess diff correctness, test validity, unexpected changes, recovery and human review effort. Do not compare a source editor’s hosting omissions with a hosted builder as if they were the same failure. | Documented workflow Checkpoint rollback restores development project state; development DB restore is optional. Constraint: Production database recovery is a separate operation, not automatic checkpoint rollback. Sources & assessment scopeNamed product: Replit hosted Agent and web-app project workflow; native mobile and other artifact types are outside this scenario. Method: Documentation-based decision comparison, checked 24 October 2026. Choose a lane before comparing; N/A is not a low score. No repository was executed, no model benchmark or live app was tested, no paid credits were used, and no numeric quality stars are assigned. For a later matched trial, freeze repository, acceptance tests, tool/model/plan, permissions and revision budget; assess diff correctness, test validity, unexpected changes, recovery and human review effort. Do not compare a source editor’s hosting omissions with a hosted builder as if they were the same failure. |
|---|
| New web app: private data and launch responsibility | Documented workflow Free/Pro contributors can opt their own data out of training; Business/Enterprise is excluded by default. Constraint: One member’s opt-out does not cover everyone. Validate generated access control before launch. Sources & assessment scopeNamed product: Hosted prompt-to-web-app workflow; new projects use the currently documented TanStack Start stack. Older React/Vite projects differ. Method: Documentation-based decision comparison, checked 24 October 2026. Choose a lane before comparing; N/A is not a low score. No repository was executed, no model benchmark or live app was tested, no paid credits were used, and no numeric quality stars are assigned. For a later matched trial, freeze repository, acceptance tests, tool/model/plan, permissions and revision budget; assess diff correctness, test validity, unexpected changes, recovery and human review effort. Do not compare a source editor’s hosting omissions with a hosted builder as if they were the same failure. | Documented workflow Owner configures app visibility, authorisation, secrets and end-user privacy. Constraint: Platform controls do not establish that generated business logic or data access is correct. Sources & assessment scopeNamed product: Replit hosted Agent and web-app project workflow; native mobile and other artifact types are outside this scenario. Method: Documentation-based decision comparison, checked 24 October 2026. Choose a lane before comparing; N/A is not a low score. No repository was executed, no model benchmark or live app was tested, no paid credits were used, and no numeric quality stars are assigned. For a later matched trial, freeze repository, acceptance tests, tool/model/plan, permissions and revision budget; assess diff correctness, test validity, unexpected changes, recovery and human review effort. Do not compare a source editor’s hosting omissions with a hosted builder as if they were the same failure. |
|---|
| Generated app security and maintainability | Output quality · not scored Not scored — matched app test not run. Constraint: No portal was built or independently checked for cross-user access, recovery or maintainability. Security scans are not a guarantee of a safe app. Sources & assessment scopeNamed product: Hosted prompt-to-web-app workflow; new projects use the currently documented TanStack Start stack. Older React/Vite projects differ. Method: Documentation-based decision comparison, checked 24 October 2026. Choose a lane before comparing; N/A is not a low score. No repository was executed, no model benchmark or live app was tested, no paid credits were used, and no numeric quality stars are assigned. For a later matched trial, freeze repository, acceptance tests, tool/model/plan, permissions and revision budget; assess diff correctness, test validity, unexpected changes, recovery and human review effort. Do not compare a source editor’s hosting omissions with a hosted builder as if they were the same failure. | Output quality · not scored Not scored — matched app test not run. Constraint: No equivalent app, access-control test or code-maintenance review was performed. Provider testing features and responsibility guidance are not trial results. Sources & assessment scopeNamed product: Replit hosted Agent and web-app project workflow; native mobile and other artifact types are outside this scenario. Method: Documentation-based decision comparison, checked 24 October 2026. Choose a lane before comparing; N/A is not a low score. No repository was executed, no model benchmark or live app was tested, no paid credits were used, and no numeric quality stars are assigned. For a later matched trial, freeze repository, acceptance tests, tool/model/plan, permissions and revision budget; assess diff correctness, test validity, unexpected changes, recovery and human review effort. Do not compare a source editor’s hosting omissions with a hosted builder as if they were the same failure. |
|---|