WebArena benchmark for BrowserGym
Project description
WebArena benchmark for BrowserGym
This package provides browsergym.webarena, which is an unofficial port of the WebArena benchmark for BrowserGym.
Note: the original WebArena codebase has been slightly adapted to ensure compatibility.
Setup
- Install the package
pip install browsergym-webarena
- Download tokenizer ressources
python -c "import nltk; nltk.download('punkt')"
- Setup the web servers (follow the webarena README).
BASE_URL=<YOUR_SERVER_URL_HERE>
- Setup the URLs as environment variables
export SHOPPING="$BASE_URL:7770/"
export SHOPPING_ADMIN="$BASE_URL:7780/admin"
export REDDIT="$BASE_URL:9999"
export GITLAB="$BASE_URL:8023"
export WIKIPEDIA="$BASE_URL:8888/wikipedia_en_all_maxi_2022-05/A/User:The_other_Kiwix_guy/Landing"
export MAP="$BASE_URL:3000"
export HOMEPAGE="$BASE_URL:4399"
Usage
import gymnasium as gym
import browsergym.webarena # register gym environments
env = gym.make("browsergym/webarena.310")
List of all the available WebArena environments
env_ids = [id for id in gym.envs.registry.keys() if id.startswith("browsergym/webarena")]
print("\n".join(env_ids))
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file browsergym_webarena-0.0.1a8.tar.gz.
File metadata
- Download URL: browsergym_webarena-0.0.1a8.tar.gz
- Upload date:
- Size: 5.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/5.0.0 CPython/3.12.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | fc5491e626c1599de66e9c58190e251da25acdaceefa06936b794203b1bd205e |
|
| MD5 | 5bffe3df057ae1c10bb6a4505db34215 |
|
| BLAKE2b-256 | 77efd57f55ca83d18c0ab9eedc44ad96582afb817ed0322ed23bdf1319086b8f |
File details
Details for the file browsergym_webarena-0.0.1a8-py3-none-any.whl.
File metadata
- Download URL: browsergym_webarena-0.0.1a8-py3-none-any.whl
- Upload date:
- Size: 6.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/5.0.0 CPython/3.12.2
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | d349a174da327f8892a3dafa7f7e3b2a690c2215daae6b0b20aaf3c7eb2fff70 |
|
| MD5 | f97e260115f33f0c48c9c580970b7fcf |
|
| BLAKE2b-256 | a2dd5c94aa412d22b4f17dc02139383b90cabd3224b63008d24d62d3b2c286f5 |
