A high-level Web Crawling and Web Scraping framework

Navigation

Verified details

These details have been verified by PyPI
Maintainers
Avatar for dangra from gravatar.com dangra Avatar for kmike from gravatar.com kmike Avatar for pablohoffman from gravatar.com pablohoffman Avatar for scrapy from gravatar.com scrapy

Unverified details

These details have not been verified by PyPI
Project links
Meta
Classifiers

Project description

https://scrapy.org/img/scrapylogo.png

Scrapy

PyPI Version Supported Python Versions Ubuntu macOS Windows Wheel Status Coverage report Conda Version

Overview

Scrapy is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

Scrapy is maintained by Zyte (formerly Scrapinghub) and many other contributors.

Check the Scrapy homepage at https://scrapy.org for more information, including a list of features.

Requirements

  • Python 3.8+

  • Works on Linux, Windows, macOS, BSD

Install

The quick way:

pip install scrapy

See the install section in the documentation at https://docs.scrapy.org/en/latest/intro/install.html for more details.

Documentation

Documentation is available online at https://docs.scrapy.org/ and in the docs directory.

Releases

You can check https://docs.scrapy.org/en/latest/news.html for the release notes.

Community (blog, twitter, mail list, IRC)

See https://scrapy.org/community/ for details.

Contributing

See https://docs.scrapy.org/en/master/contributing.html for details.

Code of Conduct

Please note that this project is released with a Contributor Code of Conduct.

By participating in this project you agree to abide by its terms. Please report unacceptable behavior to opensource@zyte.com.

Companies using Scrapy

See https://scrapy.org/companies/ for a list.

Commercial Support

See https://scrapy.org/support/ for details.

Project details

Verified details

These details have been verified by PyPI
Maintainers
Avatar for dangra from gravatar.com dangra Avatar for kmike from gravatar.com kmike Avatar for pablohoffman from gravatar.com pablohoffman Avatar for scrapy from gravatar.com scrapy

Unverified details

These details have not been verified by PyPI
Project links
Meta
Classifiers

Release history Release notifications | RSS feed

2.11.2

2.11.1

This version

2.11.0

2.10.1

2.10.0

2.9.0

2.8.0

2.7.1

2.7.0

2.6.3

2.6.2

2.6.1

2.6.0

2.5.1

2.5.0

2.4.1

2.4.0

2.3.0

2.2.1

2.2.0

2.1.0

2.0.1

2.0.0

1.8.4

1.8.3

1.8.2

1.8.1

1.8.0

1.7.4

1.7.3

1.7.2

1.7.1

1.7.0

1.6.0

1.5.2

1.5.1

1.5.0

1.4.0

1.3.3

1.3.2

1.3.1

1.3.0

1.2.3

1.2.2

1.2.1

1.2.0

1.1.4

1.1.3

1.1.2

1.1.1

1.1.0

1.1.0rc4 pre-release

1.1.0rc3 pre-release

1.1.0rc2 pre-release

1.1.0rc1 pre-release

1.0.7

1.0.6

1.0.5

1.0.4

1.0.3

1.0.2

1.0.1

1.0.0

1.0.0rc3 pre-release

1.0.0rc2 pre-release

1.0.0rc1 pre-release

0.24.6

0.24.5

0.24.4

0.24.3

0.24.2

0.24.1

0.24.0

0.22.2

0.22.1

0.22.0

0.20.2

0.20.1

0.20.0

0.18.4

0.18.3

0.18.2

0.18.1

0.18.0

0.16.5

0.16.4

0.16.3

0.16.2

0.16.1

0.16.0

0.14.4

0.14.3

0.14.2

0.14.1

0.12.0.2550

0.10.4.2364

0.9

0.8

0.7

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Scrapy-2.11.0.tar.gz (1.2 MB view details)

Uploaded Source

Built Distribution

Scrapy-2.11.0-py2.py3-none-any.whl (286.4 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file Scrapy-2.11.0.tar.gz.

File metadata

  • Download URL: Scrapy-2.11.0.tar.gz
  • Upload date:
  • Size: 1.2 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.11.5

File hashes

Hashes for Scrapy-2.11.0.tar.gz
Algorithm Hash digest
SHA256 3cbdedce0c3f0e0482d61be2d7458683be7cd7cf14b0ee6adfbaddb80f5b36a5
MD5 acbbaf2f42cdd8cb503048e94e25e040
BLAKE2b-256 687ee76d9116a6260f7fbdc4cf98b7bc4c93926ced2bc2c5e124a852cb66dfea

See more details on using hashes here.

Provenance

File details

Details for the file Scrapy-2.11.0-py2.py3-none-any.whl.

File metadata

  • Download URL: Scrapy-2.11.0-py2.py3-none-any.whl
  • Upload date:
  • Size: 286.4 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.11.5

File hashes

Hashes for Scrapy-2.11.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 a7f36544d1f5ceb13cff9b7bc904bd7c0fc43a3af0fbe5aa2034fd937cf092d1
MD5 b395fda63ba459b48c4ff27ac69e0b26
BLAKE2b-256 086622ed9609df4b6d94a66512572a11b35943a6cb36dc268f88ebfbede60be1

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page