Agent runtime standard questionnaire V1.0
The standard questionnaire TANDIU uses to measure agent runtimes. Every product gets the same questions so results are comparable; download it and run it yourself.
Data updated: 2026-10-15 09:43RULES
Answering rules
- Only answer what you can confirm
- Say “unknown” when you cannot
- Do not infer from common sense or other products
- Prefer running commands to check
- State the basis for each answer (command / platform docs / past observation / inference / unknown)
- Finish with the fixed summary
QUESTIONS
The 30 questions
1. Base environment
| # | Question | Options |
|---|---|---|
| 1 | Environment type | VM (sandbox) / VPS (cloud computer) / no local execution / unknown (a VPS always includes a VM; pick VPS if there is one) |
| 2 | Own operating system | Yes / No / Unknown |
| 3 | Operating system | e.g. Ubuntu 24.04 / Windows / macOS / unknown |
| 4 | CPU | Model or vCPU count |
| 5 | Memory | Total memory |
| 6 | Disk | Usable disk space |
2. Permissions & tools
| # | Question | Options |
|---|---|---|
| 7 | System privileges (root / administrator) | Full / Partial / None / Unknown |
| 8 | Install software yourself (apt / pip / npm) | Yes / Limited / No / Unknown |
| 9 | Run shell commands directly | Yes / No |
| 10 | Graphical desktop | Yes / No / Unknown |
| 11 | Launch and control a browser | Yes / No / Limited |
3. State persistence
| # | Question | Options |
|---|---|---|
| 12 | Browser logins kept across sessions | Kept / Partly / Not kept / Unknown |
| 13 | Files kept across sessions | Yes / Partly / No / Unknown |
| 14 | Installed software kept across sessions | Yes / Partly / No / Unknown |
| 15 | VM may be deleted, rebuilt or replaced by the platform | Yes / No / Unknown |
| 16 | Can it tell when the VM is replaced | Yes / No / Unknown |
4. Network & IP
| # | Question | Options |
|---|---|---|
| 17 | Public egress IP static or dynamic | Static / Dynamic / Unknown |
| 18 | Egress IP same across sessions / restarts | Yes / No / Unknown |
| 19 | Egress IP type | Datacenter / Residential / Business / Other / Unknown |
| 20 | Egress country / region may change | Fixed / May change / Unknown |
5. Long-running capability
| # | Question | Options |
|---|---|---|
| 21 | Background processes survive the task | Yes / No / Sometimes / Unknown |
| 22 | Scheduled jobs | Yes / No / Via platform scheduler / Unknown |
| 23 | Longest run time | A duration or unknown |
| 24 | Paused or reclaimed when idle | Yes / No / Unknown |
| 25 | Snapshot / resume | Yes / No / Unknown |
6. Access & services
| # | Question | Options |
|---|---|---|
| 26 | User can enter via SSH / RDP / VNC | Yes / No / Unknown |
| 27 | Outbound internet access | Yes / Limited / No |
| 28 | Listen on a port reachable from the internet | Yes / Limited / No / Unknown |
| 29 | Credentials kept long-term across tasks | Yes / Partly / No / Unknown |
| 30 | Who the environment belongs to | Long-term per user / New isolated instance per task / Shared / Unknown |
SUMMARY
Summary format
- Environment type
- Persistence
- IP stability
- Self-awareness
- Fit for long-running agent work
Each is answered High / Medium / Low / Unknown (environment type as VM (sandbox) / VPS (cloud computer) / no local execution), plus a basis of up to 100 words.