FAQ

What is the username and password for the virtual machines?

The username and password for the virtual machines are as follows: - Ubuntu: user / password - Windows: TBD

How to setup the account and credentials for Google and Google Drive?

See Account Guideline.

How can I configure a proxy for the VM if I’m behind a GFW?

See Proxy Guideline.

What are the running times and costs under different settings?

Setting	Expected Time*	Budget Cost (Full Test Set/Small Test Set)
GPT-4V (screenshot)	10h	$100 ($10)
Gemini-ProV (screenshot)	15h	$0 ($0)
Claude-3 Opus (screenshot)	15h	$150 ($15)
GPT-4V (a11y tree, SoM, etc.)	30h	$500 ($50)

*No environment parallelism. Calculated in April 2024.