Scrapy

A high-level Web Crawling and Web Scraping framework

These details have been verified by PyPI

Maintainers

dangra kmike pablohoffman scrapy

These details have not been verified by PyPI

Project links

Project description

Scrapy

Overview

Scrapy is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

Scrapy is maintained by Zyte (formerly Scrapinghub) and many other contributors.

Check the Scrapy homepage at https://scrapy.org for more information, including a list of features.

Requirements

Python 3.6+
Works on Linux, Windows, macOS, BSD

Install

The quick way:

pip install scrapy

See the install section in the documentation at https://docs.scrapy.org/en/latest/intro/install.html for more details.

Documentation

Documentation is available online at https://docs.scrapy.org/ and in the docs directory.

Code of Conduct

Please note that this project is released with a Contributor Code of Conduct (see https://github.com/scrapy/scrapy/blob/master/CODE_OF_CONDUCT.md).

By participating in this project you agree to abide by its terms. Please report unacceptable behavior to opensource@zyte.com.

Companies using Scrapy

See https://scrapy.org/companies/ for a list.

Commercial Support

See https://scrapy.org/support/ for details.

Project details

These details have been verified by PyPI

Maintainers

dangra kmike pablohoffman scrapy

These details have not been verified by PyPI

Project links

Release history Release notifications | RSS feed

2.11.2

May 14, 2024

2.11.1

Feb 14, 2024

2.11.0

Sep 18, 2023

2.10.1

Aug 30, 2023

2.10.0

Aug 4, 2023

2.9.0

May 8, 2023

2.8.0

Feb 2, 2023

2.7.1

Nov 2, 2022

2.7.0

Oct 17, 2022

2.6.3

Sep 27, 2022

2.6.2

Jul 25, 2022

This version

2.6.1

Mar 1, 2022

2.6.0

Mar 1, 2022

2.5.1

Oct 5, 2021

2.5.0

Apr 6, 2021

2.4.1

Nov 17, 2020

2.4.0

Oct 11, 2020

2.3.0

Aug 4, 2020

2.2.1

Jul 17, 2020

2.2.0

Jun 24, 2020

2.1.0

Apr 24, 2020

2.0.1

Mar 18, 2020

2.0.0

Mar 3, 2020

1.8.4

Feb 14, 2024

1.8.3

Jul 25, 2022

1.8.2

Mar 1, 2022

1.8.1

Oct 5, 2021

1.8.0

Oct 29, 2019

1.7.4

Oct 21, 2019

1.7.3

Aug 1, 2019

1.7.2

Jul 23, 2019

1.7.1

Jul 18, 2019

1.7.0

Jul 18, 2019

1.6.0

Jan 30, 2019

1.5.2

Jan 22, 2019

1.5.1

Jul 11, 2018

1.5.0

Dec 29, 2017

1.4.0

May 18, 2017

1.3.3

Mar 10, 2017

1.3.2

Feb 13, 2017

1.3.1

Feb 8, 2017

1.3.0

Dec 21, 2016

1.2.3

Mar 3, 2017

1.2.2

Dec 6, 2016

1.2.1

Oct 21, 2016

1.2.0

Oct 3, 2016

1.1.4

Mar 3, 2017

1.1.3

Sep 22, 2016

1.1.2

Aug 18, 2016

1.1.1

Jul 13, 2016

1.1.0

May 11, 2016

1.1.0rc4 pre-release

Apr 28, 2016

1.1.0rc3 pre-release

Mar 1, 2016

1.1.0rc2 pre-release

Feb 29, 2016

1.1.0rc1 pre-release

Feb 4, 2016

1.0.7

Mar 3, 2017

1.0.6

May 4, 2016

1.0.5

Feb 3, 2016

1.0.4

Dec 30, 2015

1.0.3

Aug 11, 2015

1.0.2

Aug 6, 2015

1.0.1

Jul 1, 2015

1.0.0

Jun 19, 2015

1.0.0rc3 pre-release

Jun 12, 2015

1.0.0rc2 pre-release

Jun 5, 2015

1.0.0rc1 pre-release

May 22, 2015

0.24.6

Apr 20, 2015

0.24.5

Feb 25, 2015

0.24.4

Aug 9, 2014

0.24.3

Aug 9, 2014

0.24.2

Jul 8, 2014

0.24.1

Jun 27, 2014

0.24.0

Jun 26, 2014

0.22.2

Feb 14, 2014

0.22.1

Feb 8, 2014

0.22.0

Jan 17, 2014

0.20.2

Dec 9, 2013

0.20.1

Nov 28, 2013

0.20.0

Nov 8, 2013

0.18.4

Oct 10, 2013

0.18.3

Oct 3, 2013

0.18.2

Sep 4, 2013

0.18.1

Aug 27, 2013

0.18.0

Aug 10, 2013

0.16.5

May 30, 2013

0.16.4

Jan 23, 2013

0.16.3

Dec 7, 2012

0.16.2

Nov 9, 2012

0.16.1

Oct 26, 2012

0.16.0

Oct 18, 2012

0.14.4

May 15, 2012

0.14.3

Apr 20, 2012

0.14.2

Mar 11, 2012

0.14.1

Jan 2, 2012

0.12.0.2550

Oct 25, 2011

0.10.4.2364

Nov 16, 2010

0.9

Jun 28, 2010

0.8

Dec 12, 2009

0.7

Jan 20, 2010

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Scrapy-2.6.1.tar.gz (1.1 MB view details)

Uploaded Mar 1, 2022 Source

Built Distribution

Scrapy-2.6.1-py2.py3-none-any.whl (264.3 kB view details)

Uploaded Mar 1, 2022 Python 2 Python 3

File details

Details for the file Scrapy-2.6.1.tar.gz.

File metadata

Download URL: Scrapy-2.6.1.tar.gz
Upload date: Mar 1, 2022
Size: 1.1 MB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.63.0 importlib-metadata/4.11.2 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.10.2

File hashes

Hashes for Scrapy-2.6.1.tar.gz
Algorithm	Hash digest
SHA256	`56fd55a59d0f329ce752892358abee5a6b50b4fc55a40420ea317dc617553827`
MD5	`8c8a8bdbe6c5da59ba6bb05f1f314c0a`
BLAKE2b-256	`d9559f25801938d701fb99aae62a9e930aba26f2617211172251820b4d1921ec`

See more details on using hashes here.

Provenance

File details

Details for the file Scrapy-2.6.1-py2.py3-none-any.whl.

File metadata

Download URL: Scrapy-2.6.1-py2.py3-none-any.whl
Upload date: Mar 1, 2022
Size: 264.3 kB
Tags: Python 2, Python 3
Uploaded using Trusted Publishing? No
Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.63.0 importlib-metadata/4.11.2 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.10.2

File hashes

Hashes for Scrapy-2.6.1-py2.py3-none-any.whl
Algorithm	Hash digest
SHA256	`e977f57d4e828f25d2702e8c2212e8abcd7d6ce45be560f1830a39432a494c09`
MD5	`8c493153faf1f26d4497d21900045705`
BLAKE2b-256	`479e011e2ed50af67373067c518510eac1c07c5a1a9d54a1064dd08c6518d0c4`