VisualWebArena benchmark for BrowserGym
Verified details
These details have been verified by PyPIProject links
GitHub Statistics
Maintainers
Project description
WebArena benchmark for BrowserGym
This package provides browsergym.visualwebarena, which is an unofficial port of the VisualWebArena benchmark for BrowserGym.
Note: the original VisualWebArena codebase has been slightly adapted to ensure compatibility.
Setup
- Install the package
pip install browsergym-visualwebarena
- Download tokenizer ressources
python -c "import nltk; nltk.download('punkt')"
-
Setup the web servers (follow the visualwebarena README).
-
Setup the URLs as environment variables (note the
VWA_prefix)
export VWA_CLASSIFIEDS="$BASE_URL:9001/"
export VWA_CLASSIFIEDS_RESET_TOKEN="4b61655535e7ed388f0d40a93600254c" # Default reset token for classifieds site, change if you edited its docker-compose.yml
export VWA_SHOPPING="$BASE_URL:7770/"
export VWA_REDDIT="$BASE_URL:9999"
export VWA_WIKIPEDIA="$BASE_URL:8888/wikipedia_en_all_maxi_2022-05/A/User:The_other_Kiwix_guy/Landing"
export VWA_HOMEPAGE="$BASE_URL:4399"
- Setup an OpenAI API key
export OPENAI_API_KEY=...
NOTE: be mindful of costs, as VisualWebArena will call GPT4 for certain evaluations (llm_fuzzy_match).
Project details
Verified details
These details have been verified by PyPIProject links
GitHub Statistics
Maintainers
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file browsergym_visualwebarena-0.13.0.tar.gz.
File metadata
- Download URL: browsergym_visualwebarena-0.13.0.tar.gz
- Upload date:
- Size: 8.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/5.1.1 CPython/3.12.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 3746ac5a9d88cf4f24eb5d8f1afa99f03993136ffa02be9c4df31d6810cc139b |
|
| MD5 | a22ef35a88aa0235fa83b47845665602 |
|
| BLAKE2b-256 | 318d072769fe1313c64de127f4964541694f6e03e146f22c0e332dfba3a7ffd9 |
Provenance
The following attestation bundles were made for browsergym_visualwebarena-0.13.0.tar.gz:
Publisher:
pypi.yml on ServiceNow/BrowserGym
-
Statement type:
https://in-toto.io/Statement/v1- Predicate type:
https://docs.pypi.org/attestations/publish/v1 - Subject name:
browsergym_visualwebarena-0.13.0.tar.gz - Subject digest:
3746ac5a9d88cf4f24eb5d8f1afa99f03993136ffa02be9c4df31d6810cc139b - Sigstore transparency entry: 147404092
- Sigstore integration time:
- Predicate type:
File details
Details for the file browsergym_visualwebarena-0.13.0-py3-none-any.whl.
File metadata
- Download URL: browsergym_visualwebarena-0.13.0-py3-none-any.whl
- Upload date:
- Size: 9.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/5.1.1 CPython/3.12.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 844b02d5385f7f83d8af8e515a892d86ed1d5cd6735ab63891dc7d1904cc052b |
|
| MD5 | 655017a9022c4e7e165010ccadf5ea44 |
|
| BLAKE2b-256 | d59b0ac779a96d9a195541ce7d0af4c92bee9bcbd5ebdfba002dc949614a2b3f |
Provenance
The following attestation bundles were made for browsergym_visualwebarena-0.13.0-py3-none-any.whl:
Publisher:
pypi.yml on ServiceNow/BrowserGym
-
Statement type:
https://in-toto.io/Statement/v1- Predicate type:
https://docs.pypi.org/attestations/publish/v1 - Subject name:
browsergym_visualwebarena-0.13.0-py3-none-any.whl - Subject digest:
844b02d5385f7f83d8af8e515a892d86ed1d5cd6735ab63891dc7d1904cc052b - Sigstore transparency entry: 147404104
- Sigstore integration time:
- Predicate type:
