Skip to main content

Scrape Facebook public pages without an API key

Project description

Facebook Scraper

Scrape Facebook public pages without an API key. Inspired by twitter-scraper.

Install

pip install facebook-scraper

Usage

Send the unique page name as the first parameter and you're good to go:

>>> from facebook_scraper import get_posts

>>> for post in get_posts('nintendo', pages=1):
...     print(post['text'][:50])
...
The final step on the road to the Super Smash Bros
Were headed to PAX East 3/28-3/31 with new games

CLI usage

$ facebook-scraper --filename nintendo_page_posts.csv --pages 1 nintendo

Use

$ facebook-scraper --help

for more details on CLI usage

Optional parameters

  • group: group id, to scrape groups instead of pages. Default is None.
  • pages: how many pages of posts to request, usually the first page has 2 posts and the rest 4. Default is 10.
  • timeout: how many seconds to wait before timing out. Default is 5.
  • sleep: how many seconds to sleep between each request. Default is 0.
  • credentials: tuple of user and password to login before requesting the posts. Default is None.
  • extra_info: bool, if true the function will try to do an extra request to get the post reactions. Default is False.
  • youtube_dl: bool, use Youtube-DL for (high-quality) video extraction. You need to have youtube-dl installed on your environment. Default is False.

Post example

{'post_id': '2257188721032235',
 'text': 'Don’t let this diminutive version of the Hero of Time fool you, '
         'Young Link is just as heroic as his fully grown version! Young Link '
         'joins the Super Smash Bros. series of amiibo figures!',
 'time': datetime.datetime(2019, 4, 29, 12, 0, 1),
 'image': 'https://scontent.flim16-1.fna.fbcdn.net'
          '/v/t1.0-0/cp0/e15/q65/p320x320'
          '/58680860_2257182054366235_1985558733786185728_n.jpg'
          '?_nc_cat=1&_nc_ht=scontent.flim16-1.fna'
          '&oh=31b0ba32ec7886e95a5478c479ba1d38&oe=5D6CDEE4',
 'likes': 2036,
 'comments': 214,
 'shares': 0,
 'reactions': {'like': 135, 'love': 64, 'haha': 10, 'wow': 4, 'anger': 1},  # if `extra_info` was set
 'post_url': 'https://m.facebook.com/story.php'
             '?story_fbid=2257188721032235&id=119240841493711',
 'link': 'https://bit.ly/something'}

Notes

  • There is no guarantee that every field will be extracted (they might be None).
  • Shares doesn't seem to work at the moment.
  • Group posts may be missing some fields like time and post_url.
  • Group scraping may return only one page and not work on private groups.

To-Do

  • Async support
  • Image galleries
  • Videos
  • Profiles or post authors
  • Comments

Alternatives and related projects

Project details


Release history Release notifications | RSS feed

This version

0.2.4

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

facebook-scraper-0.2.4.tar.gz (14.5 kB view details)

Uploaded Source

Built Distribution

facebook_scraper-0.2.4-py3-none-any.whl (15.0 kB view details)

Uploaded Python 3

File details

Details for the file facebook-scraper-0.2.4.tar.gz.

File metadata

  • Download URL: facebook-scraper-0.2.4.tar.gz
  • Upload date:
  • Size: 14.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.0.5 CPython/3.8.2 Linux/5.4.0-7634-generic

File hashes

Hashes for facebook-scraper-0.2.4.tar.gz
Algorithm Hash digest
SHA256 fb5e15ded7f31b600b7049b17ba7c4934206886a038eb193276e9ede65d08f60
MD5 0faf84a277f764fc8d05e46f4fba0504
BLAKE2b-256 9f8018bbe90e889543f4380eb86d7d5e29d50182eb4eb9ded742b5e1a0e23050

See more details on using hashes here.

File details

Details for the file facebook_scraper-0.2.4-py3-none-any.whl.

File metadata

  • Download URL: facebook_scraper-0.2.4-py3-none-any.whl
  • Upload date:
  • Size: 15.0 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.0.5 CPython/3.8.2 Linux/5.4.0-7634-generic

File hashes

Hashes for facebook_scraper-0.2.4-py3-none-any.whl
Algorithm Hash digest
SHA256 60571dd944098d9eedf1ce7b506ee8a87755c2cb49fdb95040e191b1f1ff635e
MD5 fc59c10cc7bb9db6eb3de923c133827f
BLAKE2b-256 9fdf570a7c85718810d6ca9565b4701ad3aed8525f15363b0118dbba6c28f59d

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page