Scrape Facebook public pages without an API key

These details have not been verified by PyPI

Project links

Project description

Facebook Scraper

Scrape Facebook public pages without an API key. Inspired by twitter-scraper.

Install

pip install facebook-scraper

Usage

Send the unique page name as the first parameter and you're good to go:

>>> from facebook_scraper import get_posts

>>> for post in get_posts('nintendo', pages=1):
...     print(post['text'][:50])
...
The final step on the road to the Super Smash Bros
We’re headed to PAX East 3/28-3/31 with new games

Optional parameters

(For the get_posts function).

group: group id, to scrape groups instead of pages. Default is None.
pages: how many pages of posts to request, the first 2 pages may have no results, so try with a number greater than 2. Default is 10.
timeout: how many seconds to wait before timing out. Default is 5.
credentials: tuple of user and password to login before requesting the posts. Default is None.
extra_info: bool, if true the function will try to do an extra request to get the post reactions. Default is False.
youtube_dl: bool, use Youtube-DL for (high-quality) video extraction. You need to have youtube-dl installed on your environment. Default is False.

CLI usage

$ facebook-scraper --filename nintendo_page_posts.csv --pages 10 nintendo

Run facebook-scraper --help for more details on CLI usage.

Note: If you get a UnicodeEncodeError try adding --encoding utf-8.

Post example

{'post_id': '2257188721032235',
 'text': 'Don’t let this diminutive version of the Hero of Time fool you, '
         'Young Link is just as heroic as his fully grown version! Young Link '
         'joins the Super Smash Bros. series of amiibo figures!',
 'time': datetime.datetime(2019, 4, 29, 12, 0, 1),
 'image': 'https://scontent.flim16-1.fna.fbcdn.net'
          '/v/t1.0-0/cp0/e15/q65/p320x320'
          '/58680860_2257182054366235_1985558733786185728_n.jpg'
          '?_nc_cat=1&_nc_ht=scontent.flim16-1.fna'
          '&oh=31b0ba32ec7886e95a5478c479ba1d38&oe=5D6CDEE4',
 'images': ['https://scontent.flim16-1.fna.fbcdn.net'
          '/v/t1.0-0/cp0/e15/q65/p320x320'
          '/58680860_2257182054366235_1985558733786185728_n.jpg'
          '?_nc_cat=1&_nc_ht=scontent.flim16-1.fna'
          '&oh=31b0ba32ec7886e95a5478c479ba1d38&oe=5D6CDEE4'],
 'likes': 2036,
 'comments': 214,
 'shares': 0,
 'reactions': {'like': 135, 'love': 64, 'haha': 10, 'wow': 4, 'anger': 1},  # if `extra_info` was set
 'post_url': 'https://m.facebook.com/story.php'
             '?story_fbid=2257188721032235&id=119240841493711',
 'link': 'https://bit.ly/something', 
 'is_live': False}

Notes

There is no guarantee that every field will be extracted (they might be None).
Shares doesn't seem to work at the moment.
Group posts may be missing some fields like time and post_url.
Group scraping may return only one page and not work on private groups.

To-Do

Async support
~~Image galleries~~ (images entry)
Profiles or post authors
~~Comments~~ (with options={'comments': True})

Alternatives and related projects

facebook-post-scraper. Has comments. Uses Selenium.
facebook-scraper-selenium. "Scrape posts from any group or user into a .csv file without needing to register for any API access".
Ultimate Facebook Scraper. "Scrapes almost everything about a Facebook user's profile". Uses Selenium.
Unofficial APIs. List of unofficial APIs for various services, none for Facebook for now, but might be worth to check in the future.
major-scrapy-spiders. Has a profile spider for Scrapy.
facebook-page-post-scraper. Seems abandoned.
- FBLYZE. Fork (?).
RSSHub. Generates an RSS feed from Facebook pages.
RSS-Bridge. Also generates RSS feeds from Facebook pages.

Project details

These details have not been verified by PyPI

Project links

Release history Release notifications | RSS feed

0.2.59

Aug 31, 2022

0.2.58

Jul 20, 2022

0.2.57

Jun 28, 2022

0.2.56

May 11, 2022

0.2.55

Mar 30, 2022

0.2.54

Feb 18, 2022

0.2.53

Feb 10, 2022

0.2.52

Jan 14, 2022

0.2.51

Dec 20, 2021

0.2.50

Nov 10, 2021

0.2.49

Nov 1, 2021

0.2.48

Oct 20, 2021

0.2.47

Sep 29, 2021

0.2.46

Sep 7, 2021

0.2.45

Jul 12, 2021

0.2.44

Jul 4, 2021

0.2.43

Jun 22, 2021

0.2.42

Jun 8, 2021

0.2.41

Jun 2, 2021

0.2.40

Jun 1, 2021

0.2.39

May 31, 2021

0.2.38

May 25, 2021

0.2.37

May 19, 2021

0.2.36

May 14, 2021

0.2.35

May 10, 2021

0.2.34

May 6, 2021

0.2.33

May 3, 2021

0.2.32

May 3, 2021

0.2.30

Apr 27, 2021

0.2.29

Apr 20, 2021

0.2.28

Apr 11, 2021

0.2.27

Apr 1, 2021

This version

0.2.26

Mar 28, 2021

0.2.25

Mar 20, 2021

0.2.24

Mar 15, 2021

0.2.23 yanked

Mar 15, 2021

Reason this release was yanked:

Don't use, throws exception

0.2.22

Mar 12, 2021

0.2.21

Mar 10, 2021

0.2.20

Mar 8, 2021

0.2.19

Feb 4, 2021

0.2.18

Jan 12, 2021

0.2.17

Nov 10, 2020

0.2.15

Nov 9, 2020

0.2.14

Nov 8, 2020

0.2.13

Oct 5, 2020

0.2.12

Sep 17, 2020

0.2.11

Sep 16, 2020

0.2.10

Aug 21, 2020

0.2.9

Aug 6, 2020

0.2.8

Aug 1, 2020

0.2.7

Jul 30, 2020

0.2.6

Jul 20, 2020

0.2.5

Jul 17, 2020

0.2.4

Jul 8, 2020

0.2.3

Jun 29, 2020

0.2.3a0 pre-release

Jun 24, 2020

0.2.2a3 pre-release

Jun 15, 2020

0.2.2a2 pre-release

May 28, 2020

0.2.2a1 pre-release

May 28, 2020

0.2.2a0 pre-release

May 25, 2020

0.2.1a0 pre-release

May 24, 2020

0.1.12

Apr 16, 2020

0.1.11

Apr 9, 2020

0.1.10

Mar 25, 2020

0.1.9

Mar 12, 2020

0.1.8

Jan 23, 2020

0.1.7

Jan 19, 2020

0.1.6

Dec 31, 2019

0.1.5

Oct 18, 2019

0.1.4

Sep 8, 2019

0.1.3

Jul 31, 2019

0.1.2

Apr 30, 2019

0.1.1

Mar 15, 2019

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

facebook-scraper-0.2.26.tar.gz (19.0 kB view details)

Uploaded Mar 28, 2021 Source

Built Distribution

facebook_scraper-0.2.26-py3-none-any.whl (19.5 kB view details)

Uploaded Mar 28, 2021 Python 3

File details

Details for the file facebook-scraper-0.2.26.tar.gz.

File metadata

Download URL: facebook-scraper-0.2.26.tar.gz
Upload date: Mar 28, 2021
Size: 19.0 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: poetry/1.1.5 CPython/3.9.2 Linux/5.10.23-1-MANJARO

File hashes

Hashes for facebook-scraper-0.2.26.tar.gz
Algorithm	Hash digest
SHA256	`67d38f89b3928b766b254d1810c7007dc69379c3f2a6bd61bb8e2768d74141e4`
MD5	`d5ce88b9a6e8468bec6699fcfdfa69ca`
BLAKE2b-256	`6702749a670e33d2dc1a24ec873eb813c3d631cd7fe002026fe73ceaee6a33f3`

See more details on using hashes here.

File details

Details for the file facebook_scraper-0.2.26-py3-none-any.whl.

File metadata

Download URL: facebook_scraper-0.2.26-py3-none-any.whl
Upload date: Mar 28, 2021
Size: 19.5 kB
Tags: Python 3
Uploaded using Trusted Publishing? No
Uploaded via: poetry/1.1.5 CPython/3.9.2 Linux/5.10.23-1-MANJARO

File hashes

Hashes for facebook_scraper-0.2.26-py3-none-any.whl
Algorithm	Hash digest
SHA256	`1ef26e78310a433a9135f6abda19bcc7b9d6c7206eaeb5f88b229aa3d9e48110`
MD5	`048c9e759aa176058148797df99bb852`
BLAKE2b-256	`7d3278df9afb0bf4741955ae6b5175cbf3217957eec599107886083409c2046c`